The aging population in Quebec and Canada has led to a large increase in the number of knee and hip surgeries. This partnership has two thrusts to solve two overarching problems of tracking and registration in total knee arthroplasty (TKA). Tracking and registration will determine the location and angle for cutting the femur bone, an action that cannot be undone. As such, both thrusts are of critical importance. Thrust 1 will focus on robust tracking of surgical tools, and automatically detecting if tracking is inaccurate. This thrust will be carried out in two specific aims, wherein the first aim focuses on classical image processing and Machine Learning (ML) techniques, and the second aim focuses on Deep Learning (DL). In addition to improving the tracking accuracy, our proposed method will automatically detect if one of the tools is not being accurately tracked, so that the surgeon can clean the affected tool. Thrust 2 will focus on robust point cloud registration, classification of the accuracy of the registration, and personalized point selection strategy. This thrust will also be carried out in two aims. In the first aim, we first develop novel registration techniques for the mathematically challenging problem of registration. We will then develop novel methods that can automatically assess the accuracy of the registration, so that the procedure can only proceed if registration is accurate. In the second aim, we will develop a novel sampling strategy that is personalized to each femur bone, so that optimal registration results can be achieved with the selection of few points. In both aims of this thrust, we will develop novel techniques that use both traditional ML and DL algorithms. This research partnership can lead to development of novel technologies that enable more accurate and reliable localization and registration in TKA, potentially improving the outcome of the surgery. It will also lead to training of six highly qualified personnel (HQP) working in close collaboration with a Canadian company.