The goal of this project is to design a tool for augmented reality (AR) assisted surgery that can accurately overlap three-dimensional human anatomy models onto the patient body and deliver a better understanding of the patient's anatomic relations beneath the surface.
I visualized reconstructed 3D human anatomy model in HoloLens 2 using Unity, aligned the models to the target based on physical markers and point cloud data by implementing Singular Value Decomposition (SVD) based Iterative Closest Point (ICP) algorithm using C#, designed and implemented an easy-to-use UI for surgeons and designed experiments to validate the accuracy of the system.
I also helped to transfer the project using Oculus Integration SDK to enable usage on Meta Quest devices.