Methods for a fusion of Optical Coherence Tomography and stereo camera image data

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autoren

  • Jan Bergmeier
  • Dennis Kundrat
  • Andreas Schoob
  • Lüder Alexander Kahrs
  • Tobias Ortmaier

Organisationseinheiten

Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des SammelwerksMedical Imaging 2015
UntertitelImage-Guided Procedures, Robotic Interventions, and Modeling
Herausgeber/-innenRobert J. Webster, Ziv R. Yaniv
Herausgeber (Verlag)SPIE
ISBN (elektronisch)9781628415056
PublikationsstatusVeröffentlicht - 2015
VeranstaltungMedical Imaging 2015: Image-Guided Procedures, Robotic Interventions, and Modeling - Orlando, USA / Vereinigte Staaten
Dauer: 22 Feb. 201524 Feb. 2015

Publikationsreihe

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
Band9415
ISSN (Print)1605-7422

Abstract

This work investigates combination of Optical Coherence Tomography and two cameras, observing a microscopic scene. Stereo vision provides realistic images, but is limited in terms of penetration depth. Optical Coherence Tomography (OCT) enables access to subcutaneous structures, but 3D-OCT volume data do not give the surgeon a familiar view. The extension of the stereo camera setup with OCT imaging combines the benefits of both modalities. In order to provide the surgeon with a convenient integration of OCT into the vision interface, we present an automated image processing analysis of OCT and stereo camera data as well as combined imaging as augmented reality visualization. Therefore, we care about OCT image noise, perform segmentation as well as develop proper registration objects and methods. The registration between stereo camera and OCT results in a Root Mean Square error of 284 μm as average of five measurements. The presented methods are fundamental for fusion of both imaging modalities. Augmented reality is shown as application of the results. Further developments lead to fused visualization of subcutaneous structures, as information of OCT images, into stereo vision.

ASJC Scopus Sachgebiete

Zitieren

Methods for a fusion of Optical Coherence Tomography and stereo camera image data. / Bergmeier, Jan; Kundrat, Dennis; Schoob, Andreas et al.
Medical Imaging 2015: Image-Guided Procedures, Robotic Interventions, and Modeling. Hrsg. / Robert J. Webster; Ziv R. Yaniv. SPIE, 2015. 94151C (Progress in Biomedical Optics and Imaging - Proceedings of SPIE; Band 9415).

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Bergmeier, J, Kundrat, D, Schoob, A, Kahrs, LA & Ortmaier, T 2015, Methods for a fusion of Optical Coherence Tomography and stereo camera image data. in RJ Webster & ZR Yaniv (Hrsg.), Medical Imaging 2015: Image-Guided Procedures, Robotic Interventions, and Modeling., 94151C, Progress in Biomedical Optics and Imaging - Proceedings of SPIE, Bd. 9415, SPIE, Medical Imaging 2015: Image-Guided Procedures, Robotic Interventions, and Modeling, Orlando, USA / Vereinigte Staaten, 22 Feb. 2015. https://doi.org/10.1117/12.2082511
Bergmeier, J., Kundrat, D., Schoob, A., Kahrs, L. A., & Ortmaier, T. (2015). Methods for a fusion of Optical Coherence Tomography and stereo camera image data. In R. J. Webster, & Z. R. Yaniv (Hrsg.), Medical Imaging 2015: Image-Guided Procedures, Robotic Interventions, and Modeling Artikel 94151C (Progress in Biomedical Optics and Imaging - Proceedings of SPIE; Band 9415). SPIE. https://doi.org/10.1117/12.2082511
Bergmeier J, Kundrat D, Schoob A, Kahrs LA, Ortmaier T. Methods for a fusion of Optical Coherence Tomography and stereo camera image data. in Webster RJ, Yaniv ZR, Hrsg., Medical Imaging 2015: Image-Guided Procedures, Robotic Interventions, and Modeling. SPIE. 2015. 94151C. (Progress in Biomedical Optics and Imaging - Proceedings of SPIE). doi: 10.1117/12.2082511
Bergmeier, Jan ; Kundrat, Dennis ; Schoob, Andreas et al. / Methods for a fusion of Optical Coherence Tomography and stereo camera image data. Medical Imaging 2015: Image-Guided Procedures, Robotic Interventions, and Modeling. Hrsg. / Robert J. Webster ; Ziv R. Yaniv. SPIE, 2015. (Progress in Biomedical Optics and Imaging - Proceedings of SPIE).
Download
@inproceedings{7c1b1651b7804c27a13d193500f5e7d3,
title = "Methods for a fusion of Optical Coherence Tomography and stereo camera image data",
abstract = "This work investigates combination of Optical Coherence Tomography and two cameras, observing a microscopic scene. Stereo vision provides realistic images, but is limited in terms of penetration depth. Optical Coherence Tomography (OCT) enables access to subcutaneous structures, but 3D-OCT volume data do not give the surgeon a familiar view. The extension of the stereo camera setup with OCT imaging combines the benefits of both modalities. In order to provide the surgeon with a convenient integration of OCT into the vision interface, we present an automated image processing analysis of OCT and stereo camera data as well as combined imaging as augmented reality visualization. Therefore, we care about OCT image noise, perform segmentation as well as develop proper registration objects and methods. The registration between stereo camera and OCT results in a Root Mean Square error of 284 μm as average of five measurements. The presented methods are fundamental for fusion of both imaging modalities. Augmented reality is shown as application of the results. Further developments lead to fused visualization of subcutaneous structures, as information of OCT images, into stereo vision.",
keywords = "Augmented reality, Multimodal registration, Optical Coherence Tomography, Stereo camera, Stereoscopic vision, Surface reconstruction",
author = "Jan Bergmeier and Dennis Kundrat and Andreas Schoob and Kahrs, {L{\"u}der Alexander} and Tobias Ortmaier",
year = "2015",
doi = "10.1117/12.2082511",
language = "English",
series = "Progress in Biomedical Optics and Imaging - Proceedings of SPIE",
publisher = "SPIE",
editor = "Webster, {Robert J.} and Yaniv, {Ziv R.}",
booktitle = "Medical Imaging 2015",
address = "United States",
note = "Medical Imaging 2015: Image-Guided Procedures, Robotic Interventions, and Modeling ; Conference date: 22-02-2015 Through 24-02-2015",

}

Download

TY - GEN

T1 - Methods for a fusion of Optical Coherence Tomography and stereo camera image data

AU - Bergmeier, Jan

AU - Kundrat, Dennis

AU - Schoob, Andreas

AU - Kahrs, Lüder Alexander

AU - Ortmaier, Tobias

PY - 2015

Y1 - 2015

N2 - This work investigates combination of Optical Coherence Tomography and two cameras, observing a microscopic scene. Stereo vision provides realistic images, but is limited in terms of penetration depth. Optical Coherence Tomography (OCT) enables access to subcutaneous structures, but 3D-OCT volume data do not give the surgeon a familiar view. The extension of the stereo camera setup with OCT imaging combines the benefits of both modalities. In order to provide the surgeon with a convenient integration of OCT into the vision interface, we present an automated image processing analysis of OCT and stereo camera data as well as combined imaging as augmented reality visualization. Therefore, we care about OCT image noise, perform segmentation as well as develop proper registration objects and methods. The registration between stereo camera and OCT results in a Root Mean Square error of 284 μm as average of five measurements. The presented methods are fundamental for fusion of both imaging modalities. Augmented reality is shown as application of the results. Further developments lead to fused visualization of subcutaneous structures, as information of OCT images, into stereo vision.

AB - This work investigates combination of Optical Coherence Tomography and two cameras, observing a microscopic scene. Stereo vision provides realistic images, but is limited in terms of penetration depth. Optical Coherence Tomography (OCT) enables access to subcutaneous structures, but 3D-OCT volume data do not give the surgeon a familiar view. The extension of the stereo camera setup with OCT imaging combines the benefits of both modalities. In order to provide the surgeon with a convenient integration of OCT into the vision interface, we present an automated image processing analysis of OCT and stereo camera data as well as combined imaging as augmented reality visualization. Therefore, we care about OCT image noise, perform segmentation as well as develop proper registration objects and methods. The registration between stereo camera and OCT results in a Root Mean Square error of 284 μm as average of five measurements. The presented methods are fundamental for fusion of both imaging modalities. Augmented reality is shown as application of the results. Further developments lead to fused visualization of subcutaneous structures, as information of OCT images, into stereo vision.

KW - Augmented reality

KW - Multimodal registration

KW - Optical Coherence Tomography

KW - Stereo camera

KW - Stereoscopic vision

KW - Surface reconstruction

UR - http://www.scopus.com/inward/record.url?scp=84943578744&partnerID=8YFLogxK

U2 - 10.1117/12.2082511

DO - 10.1117/12.2082511

M3 - Conference contribution

AN - SCOPUS:84943578744

T3 - Progress in Biomedical Optics and Imaging - Proceedings of SPIE

BT - Medical Imaging 2015

A2 - Webster, Robert J.

A2 - Yaniv, Ziv R.

PB - SPIE

T2 - Medical Imaging 2015: Image-Guided Procedures, Robotic Interventions, and Modeling

Y2 - 22 February 2015 through 24 February 2015

ER -