TY - JOUR

T1 - Soft tissue motion tracking with application to tablet-based incision planning in laser surgery

AU - Schoob, Andreas

AU - Laves, Max Heinrich

AU - Kahrs, Lüder Alexander

AU - Ortmaier, Tobias

N1 - Funding information: This research has received funding from the European Union Seventh Framework Programme FP7/2007-2013–Challenge 2—Cognitive Systems, Interaction, Robotics—under grant agreement RALP—no 288663. We thank Giorgio Peretti from the Department of Otorhinolaryngology, University of Genoa, Italy, providing in vivo laryngeal data. We also would like to thank Guang-Zhong Yang, Danail Stoyanov and Peter Mountney for the in vivo data provided by the Hamlyn Centre for Robotic Surgery, Imperial College London, UK.

PY - 2016/12/1

Y1 - 2016/12/1

N2 - Purpose: Recent research has revealed that incision planning in laser surgery deploying stylus and tablet outperforms micromanipulator control. However, vision-based adaption to dynamic surgical scenes has not been addressed so far. In this study, scene motion compensation for tablet-based planning by means of tissue deformation tracking is discussed. Methods: A stereo-based method for motion tracking with piecewise affine deformation modeling is presented. Proposed parametrization relies on the epipolar constraint to enforce left–right consistency in the energy minimization problem. Furthermore, the method implements illumination-invariant tracking and appearance-based occlusion detection. Performance is assessed on laparoscopic and laryngeal in vivo data. In particular, tracking accuracy is measured under various conditions such as occlusions and simulated laser cuttings. Experimental validation is extended to a user study conducted on a tablet-based interface that integrates the tracking for image stabilization. Results: Tracking accuracy measurement reveals a root-mean-square error of 2.45 mm for the laparoscopic and 0.41 mm for the laryngeal dataset. Results successfully demonstrate stereoscopic tracking under changes in illumination, translation, rotation and scale. In particular, proposed occlusion detection scheme can increase robustness against tracking failure. Moreover, assessed user performance indicates significantly increased path tracing accuracy and usability if proposed tracking is deployed to stabilize the view during free-hand path definition. Conclusion: The presented algorithm successfully extends piecewise affine deformation tracking to stereo vision taking the epipolar constraint into account. Improved surgical performance as demonstrated for laser incision planning highlights the potential of presented method regarding further applications in computer-assisted surgery.

AB - Purpose: Recent research has revealed that incision planning in laser surgery deploying stylus and tablet outperforms micromanipulator control. However, vision-based adaption to dynamic surgical scenes has not been addressed so far. In this study, scene motion compensation for tablet-based planning by means of tissue deformation tracking is discussed. Methods: A stereo-based method for motion tracking with piecewise affine deformation modeling is presented. Proposed parametrization relies on the epipolar constraint to enforce left–right consistency in the energy minimization problem. Furthermore, the method implements illumination-invariant tracking and appearance-based occlusion detection. Performance is assessed on laparoscopic and laryngeal in vivo data. In particular, tracking accuracy is measured under various conditions such as occlusions and simulated laser cuttings. Experimental validation is extended to a user study conducted on a tablet-based interface that integrates the tracking for image stabilization. Results: Tracking accuracy measurement reveals a root-mean-square error of 2.45 mm for the laparoscopic and 0.41 mm for the laryngeal dataset. Results successfully demonstrate stereoscopic tracking under changes in illumination, translation, rotation and scale. In particular, proposed occlusion detection scheme can increase robustness against tracking failure. Moreover, assessed user performance indicates significantly increased path tracing accuracy and usability if proposed tracking is deployed to stabilize the view during free-hand path definition. Conclusion: The presented algorithm successfully extends piecewise affine deformation tracking to stereo vision taking the epipolar constraint into account. Improved surgical performance as demonstrated for laser incision planning highlights the potential of presented method regarding further applications in computer-assisted surgery.

KW - Epipolar constraint

KW - Soft tissue deformation tracking

KW - Stereo vision

KW - Surgeon interface

KW - User performance

UR - http://www.scopus.com/inward/record.url?scp=84973168583&partnerID=8YFLogxK

U2 - 10.1007/s11548-016-1420-5

DO - 10.1007/s11548-016-1420-5

M3 - Article

C2 - 27250855

AN - SCOPUS:84973168583

VL - 11

SP - 2325

EP - 2337

JO - International journal of computer assisted radiology and surgery

JF - International journal of computer assisted radiology and surgery

SN - 1861-6410

IS - 12

ER -