3D magnetic seed localization for augmented reality in surgery

3D magnetic seed localization for augmented reality in surgery

Ambrosini, P. (TU Delft Computer Graphics and Visualisation; Erasmus MC)
Azizian Amiri, S. (TU Delft Medical Instruments & Bio-Inspired Technology)
Zeestraten, Eliane (Amphia Hospital)
van Ginhoven, Tessa (Erasmus MC)
Marroquim, Ricardo (TU Delft Computer Graphics and Visualisation)
van Walsum, T. (Erasmus MC)

2024

Purpose: For tumor resection, surgeons need to localize the tumor. For this purpose, a magnetic seed can be inserted into the tumor by a radiologist and, during surgery, a magnetic detection probe informs the distance to the seed for localization. In this case, the surgeon still needs to mentally reconstruct the position of the tumor from the probe’s information. The purpose of this study is to develop and assess a method for 3D localization and visualization of the seed, facilitating the localization of the tumor. Methods: We propose a method for 3D localization of the magnetic seed by extending the magnetic detection probe with a tracking-based localization. We attach a position sensor (QR-code or optical marker) to the probe in order to track its 3D pose (respectively, using a head-mounted display with a camera or optical tracker). Following an acquisition protocol, the 3D probe tip and seed position are subsequently obtained by solving a system of equations based on the distances and the 3D probe poses. Results: The method was evaluated with an optical tracking system. An experimental setup using QR-code tracking (resp. using an optical marker) achieves an average of 1.6 mm (resp. 0.8 mm) 3D distance between the localized seed and the ground truth. Using a breast phantom setup, the average 3D distance is 4.7 mm with a QR-code and 2.1 mm with an optical marker. Conclusion: Tracking the magnetic detection probe allows 3D localization of a magnetic seed, which opens doors for augmented reality target visualization during surgery. Such an approach should enhance the perception of the localized region of interest during the intervention, especially for breast tumor resection where magnetic seeds can already be used in the protocol.

3D localization
Magnetic seed
Mixed-reality
Surgery

http://resolver.tudelft.nl/uuid:da47e20a-dbd0-40d2-bf14-a31af0bf8b93

https://doi.org/10.1007/s11548-024-03066-6

1861-6410

International Journal of Computer Assisted Radiology and Surgery, 19 (4), 723-733

Institutional Repository

journal article

© 2024 P. Ambrosini, S. Azizian Amiri, Eliane Zeestraten, Tessa van Ginhoven, Ricardo Marroquim, T. van Walsum