Methods for a fusion of Optical Coherence Tomography and stereo camera image data

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

  • Jan Bergmeier
  • Dennis Kundrat
  • Andreas Schoob
  • Lüder Alexander Kahrs
  • Tobias Ortmaier

Research Organisations

View graph of relations

Details

Original languageEnglish
Title of host publicationMedical Imaging 2015
Subtitle of host publicationImage-Guided Procedures, Robotic Interventions, and Modeling
EditorsRobert J. Webster, Ziv R. Yaniv
PublisherSPIE
ISBN (electronic)9781628415056
Publication statusPublished - 2015
EventMedical Imaging 2015: Image-Guided Procedures, Robotic Interventions, and Modeling - Orlando, United States
Duration: 22 Feb 201524 Feb 2015

Publication series

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
Volume9415
ISSN (Print)1605-7422

Abstract

This work investigates combination of Optical Coherence Tomography and two cameras, observing a microscopic scene. Stereo vision provides realistic images, but is limited in terms of penetration depth. Optical Coherence Tomography (OCT) enables access to subcutaneous structures, but 3D-OCT volume data do not give the surgeon a familiar view. The extension of the stereo camera setup with OCT imaging combines the benefits of both modalities. In order to provide the surgeon with a convenient integration of OCT into the vision interface, we present an automated image processing analysis of OCT and stereo camera data as well as combined imaging as augmented reality visualization. Therefore, we care about OCT image noise, perform segmentation as well as develop proper registration objects and methods. The registration between stereo camera and OCT results in a Root Mean Square error of 284 μm as average of five measurements. The presented methods are fundamental for fusion of both imaging modalities. Augmented reality is shown as application of the results. Further developments lead to fused visualization of subcutaneous structures, as information of OCT images, into stereo vision.

Keywords

    Augmented reality, Multimodal registration, Optical Coherence Tomography, Stereo camera, Stereoscopic vision, Surface reconstruction

ASJC Scopus subject areas

Cite this

Methods for a fusion of Optical Coherence Tomography and stereo camera image data. / Bergmeier, Jan; Kundrat, Dennis; Schoob, Andreas et al.
Medical Imaging 2015: Image-Guided Procedures, Robotic Interventions, and Modeling. ed. / Robert J. Webster; Ziv R. Yaniv. SPIE, 2015. 94151C (Progress in Biomedical Optics and Imaging - Proceedings of SPIE; Vol. 9415).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Bergmeier, J, Kundrat, D, Schoob, A, Kahrs, LA & Ortmaier, T 2015, Methods for a fusion of Optical Coherence Tomography and stereo camera image data. in RJ Webster & ZR Yaniv (eds), Medical Imaging 2015: Image-Guided Procedures, Robotic Interventions, and Modeling., 94151C, Progress in Biomedical Optics and Imaging - Proceedings of SPIE, vol. 9415, SPIE, Medical Imaging 2015: Image-Guided Procedures, Robotic Interventions, and Modeling, Orlando, United States, 22 Feb 2015. https://doi.org/10.1117/12.2082511
Bergmeier, J., Kundrat, D., Schoob, A., Kahrs, L. A., & Ortmaier, T. (2015). Methods for a fusion of Optical Coherence Tomography and stereo camera image data. In R. J. Webster, & Z. R. Yaniv (Eds.), Medical Imaging 2015: Image-Guided Procedures, Robotic Interventions, and Modeling Article 94151C (Progress in Biomedical Optics and Imaging - Proceedings of SPIE; Vol. 9415). SPIE. https://doi.org/10.1117/12.2082511
Bergmeier J, Kundrat D, Schoob A, Kahrs LA, Ortmaier T. Methods for a fusion of Optical Coherence Tomography and stereo camera image data. In Webster RJ, Yaniv ZR, editors, Medical Imaging 2015: Image-Guided Procedures, Robotic Interventions, and Modeling. SPIE. 2015. 94151C. (Progress in Biomedical Optics and Imaging - Proceedings of SPIE). doi: 10.1117/12.2082511
Bergmeier, Jan ; Kundrat, Dennis ; Schoob, Andreas et al. / Methods for a fusion of Optical Coherence Tomography and stereo camera image data. Medical Imaging 2015: Image-Guided Procedures, Robotic Interventions, and Modeling. editor / Robert J. Webster ; Ziv R. Yaniv. SPIE, 2015. (Progress in Biomedical Optics and Imaging - Proceedings of SPIE).
Download
@inproceedings{7c1b1651b7804c27a13d193500f5e7d3,
title = "Methods for a fusion of Optical Coherence Tomography and stereo camera image data",
abstract = "This work investigates combination of Optical Coherence Tomography and two cameras, observing a microscopic scene. Stereo vision provides realistic images, but is limited in terms of penetration depth. Optical Coherence Tomography (OCT) enables access to subcutaneous structures, but 3D-OCT volume data do not give the surgeon a familiar view. The extension of the stereo camera setup with OCT imaging combines the benefits of both modalities. In order to provide the surgeon with a convenient integration of OCT into the vision interface, we present an automated image processing analysis of OCT and stereo camera data as well as combined imaging as augmented reality visualization. Therefore, we care about OCT image noise, perform segmentation as well as develop proper registration objects and methods. The registration between stereo camera and OCT results in a Root Mean Square error of 284 μm as average of five measurements. The presented methods are fundamental for fusion of both imaging modalities. Augmented reality is shown as application of the results. Further developments lead to fused visualization of subcutaneous structures, as information of OCT images, into stereo vision.",
keywords = "Augmented reality, Multimodal registration, Optical Coherence Tomography, Stereo camera, Stereoscopic vision, Surface reconstruction",
author = "Jan Bergmeier and Dennis Kundrat and Andreas Schoob and Kahrs, {L{\"u}der Alexander} and Tobias Ortmaier",
year = "2015",
doi = "10.1117/12.2082511",
language = "English",
series = "Progress in Biomedical Optics and Imaging - Proceedings of SPIE",
publisher = "SPIE",
editor = "Webster, {Robert J.} and Yaniv, {Ziv R.}",
booktitle = "Medical Imaging 2015",
address = "United States",
note = "Medical Imaging 2015: Image-Guided Procedures, Robotic Interventions, and Modeling ; Conference date: 22-02-2015 Through 24-02-2015",

}

Download

TY - GEN

T1 - Methods for a fusion of Optical Coherence Tomography and stereo camera image data

AU - Bergmeier, Jan

AU - Kundrat, Dennis

AU - Schoob, Andreas

AU - Kahrs, Lüder Alexander

AU - Ortmaier, Tobias

PY - 2015

Y1 - 2015

N2 - This work investigates combination of Optical Coherence Tomography and two cameras, observing a microscopic scene. Stereo vision provides realistic images, but is limited in terms of penetration depth. Optical Coherence Tomography (OCT) enables access to subcutaneous structures, but 3D-OCT volume data do not give the surgeon a familiar view. The extension of the stereo camera setup with OCT imaging combines the benefits of both modalities. In order to provide the surgeon with a convenient integration of OCT into the vision interface, we present an automated image processing analysis of OCT and stereo camera data as well as combined imaging as augmented reality visualization. Therefore, we care about OCT image noise, perform segmentation as well as develop proper registration objects and methods. The registration between stereo camera and OCT results in a Root Mean Square error of 284 μm as average of five measurements. The presented methods are fundamental for fusion of both imaging modalities. Augmented reality is shown as application of the results. Further developments lead to fused visualization of subcutaneous structures, as information of OCT images, into stereo vision.

AB - This work investigates combination of Optical Coherence Tomography and two cameras, observing a microscopic scene. Stereo vision provides realistic images, but is limited in terms of penetration depth. Optical Coherence Tomography (OCT) enables access to subcutaneous structures, but 3D-OCT volume data do not give the surgeon a familiar view. The extension of the stereo camera setup with OCT imaging combines the benefits of both modalities. In order to provide the surgeon with a convenient integration of OCT into the vision interface, we present an automated image processing analysis of OCT and stereo camera data as well as combined imaging as augmented reality visualization. Therefore, we care about OCT image noise, perform segmentation as well as develop proper registration objects and methods. The registration between stereo camera and OCT results in a Root Mean Square error of 284 μm as average of five measurements. The presented methods are fundamental for fusion of both imaging modalities. Augmented reality is shown as application of the results. Further developments lead to fused visualization of subcutaneous structures, as information of OCT images, into stereo vision.

KW - Augmented reality

KW - Multimodal registration

KW - Optical Coherence Tomography

KW - Stereo camera

KW - Stereoscopic vision

KW - Surface reconstruction

UR - http://www.scopus.com/inward/record.url?scp=84943578744&partnerID=8YFLogxK

U2 - 10.1117/12.2082511

DO - 10.1117/12.2082511

M3 - Conference contribution

AN - SCOPUS:84943578744

T3 - Progress in Biomedical Optics and Imaging - Proceedings of SPIE

BT - Medical Imaging 2015

A2 - Webster, Robert J.

A2 - Yaniv, Ziv R.

PB - SPIE

T2 - Medical Imaging 2015: Image-Guided Procedures, Robotic Interventions, and Modeling

Y2 - 22 February 2015 through 24 February 2015

ER -