Details
| Original language | English |
|---|---|
| Pages (from-to) | 2325-2337 |
| Number of pages | 13 |
| Journal | International journal of computer assisted radiology and surgery |
| Volume | 11 |
| Issue number | 12 |
| Publication status | Published - 1 Dec 2016 |
Abstract
Purpose: Recent research has revealed that incision planning in laser surgery deploying stylus and tablet outperforms micromanipulator control. However, vision-based adaption to dynamic surgical scenes has not been addressed so far. In this study, scene motion compensation for tablet-based planning by means of tissue deformation tracking is discussed. Methods: A stereo-based method for motion tracking with piecewise affine deformation modeling is presented. Proposed parametrization relies on the epipolar constraint to enforce left–right consistency in the energy minimization problem. Furthermore, the method implements illumination-invariant tracking and appearance-based occlusion detection. Performance is assessed on laparoscopic and laryngeal in vivo data. In particular, tracking accuracy is measured under various conditions such as occlusions and simulated laser cuttings. Experimental validation is extended to a user study conducted on a tablet-based interface that integrates the tracking for image stabilization. Results: Tracking accuracy measurement reveals a root-mean-square error of 2.45 mm for the laparoscopic and 0.41 mm for the laryngeal dataset. Results successfully demonstrate stereoscopic tracking under changes in illumination, translation, rotation and scale. In particular, proposed occlusion detection scheme can increase robustness against tracking failure. Moreover, assessed user performance indicates significantly increased path tracing accuracy and usability if proposed tracking is deployed to stabilize the view during free-hand path definition. Conclusion: The presented algorithm successfully extends piecewise affine deformation tracking to stereo vision taking the epipolar constraint into account. Improved surgical performance as demonstrated for laser incision planning highlights the potential of presented method regarding further applications in computer-assisted surgery.
Keywords
- Epipolar constraint, Soft tissue deformation tracking, Stereo vision, Surgeon interface, User performance
ASJC Scopus subject areas
- Medicine(all)
- Surgery
- Engineering(all)
- Biomedical Engineering
- Medicine(all)
- Radiology Nuclear Medicine and imaging
- Computer Science(all)
- Computer Vision and Pattern Recognition
- Medicine(all)
- Health Informatics
- Computer Science(all)
- Computer Science Applications
- Computer Science(all)
- Computer Graphics and Computer-Aided Design
Cite this
- Standard
- Harvard
- Apa
- Vancouver
- BibTeX
- RIS
In: International journal of computer assisted radiology and surgery, Vol. 11, No. 12, 01.12.2016, p. 2325-2337.
Research output: Contribution to journal › Article › Research › peer review
}
TY - JOUR
T1 - Soft tissue motion tracking with application to tablet-based incision planning in laser surgery
AU - Schoob, Andreas
AU - Laves, Max Heinrich
AU - Kahrs, Lüder Alexander
AU - Ortmaier, Tobias
N1 - Funding information: This research has received funding from the European Union Seventh Framework Programme FP7/2007-2013–Challenge 2—Cognitive Systems, Interaction, Robotics—under grant agreement RALP—no 288663. We thank Giorgio Peretti from the Department of Otorhinolaryngology, University of Genoa, Italy, providing in vivo laryngeal data. We also would like to thank Guang-Zhong Yang, Danail Stoyanov and Peter Mountney for the in vivo data provided by the Hamlyn Centre for Robotic Surgery, Imperial College London, UK.
PY - 2016/12/1
Y1 - 2016/12/1
N2 - Purpose: Recent research has revealed that incision planning in laser surgery deploying stylus and tablet outperforms micromanipulator control. However, vision-based adaption to dynamic surgical scenes has not been addressed so far. In this study, scene motion compensation for tablet-based planning by means of tissue deformation tracking is discussed. Methods: A stereo-based method for motion tracking with piecewise affine deformation modeling is presented. Proposed parametrization relies on the epipolar constraint to enforce left–right consistency in the energy minimization problem. Furthermore, the method implements illumination-invariant tracking and appearance-based occlusion detection. Performance is assessed on laparoscopic and laryngeal in vivo data. In particular, tracking accuracy is measured under various conditions such as occlusions and simulated laser cuttings. Experimental validation is extended to a user study conducted on a tablet-based interface that integrates the tracking for image stabilization. Results: Tracking accuracy measurement reveals a root-mean-square error of 2.45 mm for the laparoscopic and 0.41 mm for the laryngeal dataset. Results successfully demonstrate stereoscopic tracking under changes in illumination, translation, rotation and scale. In particular, proposed occlusion detection scheme can increase robustness against tracking failure. Moreover, assessed user performance indicates significantly increased path tracing accuracy and usability if proposed tracking is deployed to stabilize the view during free-hand path definition. Conclusion: The presented algorithm successfully extends piecewise affine deformation tracking to stereo vision taking the epipolar constraint into account. Improved surgical performance as demonstrated for laser incision planning highlights the potential of presented method regarding further applications in computer-assisted surgery.
AB - Purpose: Recent research has revealed that incision planning in laser surgery deploying stylus and tablet outperforms micromanipulator control. However, vision-based adaption to dynamic surgical scenes has not been addressed so far. In this study, scene motion compensation for tablet-based planning by means of tissue deformation tracking is discussed. Methods: A stereo-based method for motion tracking with piecewise affine deformation modeling is presented. Proposed parametrization relies on the epipolar constraint to enforce left–right consistency in the energy minimization problem. Furthermore, the method implements illumination-invariant tracking and appearance-based occlusion detection. Performance is assessed on laparoscopic and laryngeal in vivo data. In particular, tracking accuracy is measured under various conditions such as occlusions and simulated laser cuttings. Experimental validation is extended to a user study conducted on a tablet-based interface that integrates the tracking for image stabilization. Results: Tracking accuracy measurement reveals a root-mean-square error of 2.45 mm for the laparoscopic and 0.41 mm for the laryngeal dataset. Results successfully demonstrate stereoscopic tracking under changes in illumination, translation, rotation and scale. In particular, proposed occlusion detection scheme can increase robustness against tracking failure. Moreover, assessed user performance indicates significantly increased path tracing accuracy and usability if proposed tracking is deployed to stabilize the view during free-hand path definition. Conclusion: The presented algorithm successfully extends piecewise affine deformation tracking to stereo vision taking the epipolar constraint into account. Improved surgical performance as demonstrated for laser incision planning highlights the potential of presented method regarding further applications in computer-assisted surgery.
KW - Epipolar constraint
KW - Soft tissue deformation tracking
KW - Stereo vision
KW - Surgeon interface
KW - User performance
UR - http://www.scopus.com/inward/record.url?scp=84973168583&partnerID=8YFLogxK
U2 - 10.1007/s11548-016-1420-5
DO - 10.1007/s11548-016-1420-5
M3 - Article
C2 - 27250855
AN - SCOPUS:84973168583
VL - 11
SP - 2325
EP - 2337
JO - International journal of computer assisted radiology and surgery
JF - International journal of computer assisted radiology and surgery
SN - 1861-6410
IS - 12
ER -