Skip to main navigation Skip to search Skip to main content

3D surgical overlay with markerless image registration using a single camera

  • Junchen Wang*
  • , Hideyuki Suenaga
  • , Liangjing Yang
  • , Hongen Liao
  • , Takehiro Ando
  • , Etsuko Kobayashi
  • , Ichiro Sakuma
  • *Corresponding author for this work
  • The University of Tokyo
  • Tsinghua University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Minimum invasive surgery can benefit from surgical visualization, which is achieved by either virtual reality or augmented reality. We previously proposed an integrated 3D image overlay based surgical visualization solution including 3D image rendering, distortion correction, and spatial projection. For correct spatial projection of the 3D image, image registration is necessary. In this paper we present a 3D image overlay based augmented reality surgical navigation system with markerless image registration using a single camera. The innovation compared with our previous work lies in the single camera based image registration method for 3D image overlay. The 3D mesh model of patient’s teeth which is created from the preoperative CT data is matched with the intraoperative image captured by a single optical camera to determine the six-degree-of-freedom pose of the model with respect to the camera. The obtained pose is used to superimpose the 3D image of critical hidden tissues on patient’s body directly via a translucent mirror for surgical visualization. The image registration performs automatically within approximate 0.2 s, which enables real-time update to tackle patient’s movement. Experimental results show that the registration accuracy is about 1mm and confirm the feasibility of the 3D surgical overlay system.

Original languageEnglish
Title of host publicationAugmented Environments for Computer-Assisted Interventions - 10th International Workshop, AE-CAI 2015 Held in Conjunction with MICCAI 2015, Proceedings
EditorsZiv Yaniv, Cristian A. Linte, Pascal Fallavollita, Ziv Yaniv
PublisherSpringer Verlag
Pages124-133
Number of pages10
ISBN (Print)9783319246000
DOIs
StatePublished - 2015
Externally publishedYes
Event10th International Workshop on Augmented Environments for Computer-Assisted Interventions, AE-CAI 2015 and Held in Conjunction with, MICCAI 2015 - Munich, Germany
Duration: 9 Oct 20159 Oct 2015

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9365
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference10th International Workshop on Augmented Environments for Computer-Assisted Interventions, AE-CAI 2015 and Held in Conjunction with, MICCAI 2015
Country/TerritoryGermany
CityMunich
Period9/10/159/10/15

Fingerprint

Dive into the research topics of '3D surgical overlay with markerless image registration using a single camera'. Together they form a unique fingerprint.

Cite this