TY - JOUR
T1 - MonoTracker
T2 - Monocular-Based Fully Automatic Registration and Real-Time Tracking Method for Neurosurgical Robots
AU - Chen, Kai
AU - Chen, Diansheng
AU - Zhang, Ruijie
AU - Meng, Cai
AU - Tang, Zhouping
N1 - Publisher Copyright:
© The Author(s) 2025.
PY - 2025/12
Y1 - 2025/12
N2 - Robot-assisted surgery has become an indispensable component in modern neurosurgical procedures. However, existing registration methods for neurosurgical robots often rely on high-end hardware and involve prolonged or unstable registration times, limiting their applicability in dynamic and time-sensitive intraoperative settings. This paper proposes a novel fully automatic monocular-based registration and real-time tracking method. First, dedicated fiducials are designed, and an automatic preoperative and intraoperative detection method for these fiducials is introduced. Second, a geometric representation of the fiducials is constructed based on a 2D KD-Tree. Through a two-stage optimization process, the depth of 2D fiducials is estimated, and 2D-3D correspondences are established to achieve monocular registration. This approach enables fully automatic intraoperative registration using only a single optical camera. Finally, a six-degree-of-freedom visual servo control strategy inspired by the mass-spring-damper system is proposed. By integrating artificial potential field and admittance control, the strategy ensures real-time responsiveness and stable tracking. Experimental results demonstrate that the proposed method achieves a registration time of 0.23 s per instance with an average error of 0.58 mm. Additionally, the motion performance of the control strategy has been validated. Preliminary experiments verify the effectiveness of MonoTracker in dynamic tracking scenarios. This method holds promise for enhancing the adaptability of neurosurgical robots and offers significant clinical application potential.
AB - Robot-assisted surgery has become an indispensable component in modern neurosurgical procedures. However, existing registration methods for neurosurgical robots often rely on high-end hardware and involve prolonged or unstable registration times, limiting their applicability in dynamic and time-sensitive intraoperative settings. This paper proposes a novel fully automatic monocular-based registration and real-time tracking method. First, dedicated fiducials are designed, and an automatic preoperative and intraoperative detection method for these fiducials is introduced. Second, a geometric representation of the fiducials is constructed based on a 2D KD-Tree. Through a two-stage optimization process, the depth of 2D fiducials is estimated, and 2D-3D correspondences are established to achieve monocular registration. This approach enables fully automatic intraoperative registration using only a single optical camera. Finally, a six-degree-of-freedom visual servo control strategy inspired by the mass-spring-damper system is proposed. By integrating artificial potential field and admittance control, the strategy ensures real-time responsiveness and stable tracking. Experimental results demonstrate that the proposed method achieves a registration time of 0.23 s per instance with an average error of 0.58 mm. Additionally, the motion performance of the control strategy has been validated. Preliminary experiments verify the effectiveness of MonoTracker in dynamic tracking scenarios. This method holds promise for enhancing the adaptability of neurosurgical robots and offers significant clinical application potential.
KW - Automatic detection
KW - Monocular registration
KW - Neurosurgical robot
KW - Visual servo control
UR - https://www.scopus.com/pages/publications/105015075954
U2 - 10.1186/s10033-025-01334-3
DO - 10.1186/s10033-025-01334-3
M3 - 文章
AN - SCOPUS:105015075954
SN - 1000-9345
VL - 38
JO - Chinese Journal of Mechanical Engineering (English Edition)
JF - Chinese Journal of Mechanical Engineering (English Edition)
IS - 1
M1 - 168
ER -