OpenIGTLink interface for state control and visualisation of a robot for image-guided therapy systems

Research output: Contribution to journalReview articleResearchpeer review

Authors

  • Sebastian Tauscher
  • Junichi Tokuda
  • Günter Schreiber
  • Thomas Neff
  • Nobuhiko Hata
  • Tobias Ortmaier

Research Organisations

External Research Organisations

  • Harvard University
  • KUKA
View graph of relations

Details

Original languageEnglish
Pages (from-to)285-292
Number of pages8
JournalInternational journal of computer assisted radiology and surgery
Volume10
Issue number3
Publication statusPublished - Mar 2015

Abstract

Purpose:    The integration of a robot into an image-guided therapy system is still a time consuming process, due to the lack of a well-accepted standard for interdevice communication. The aim of this project is to simplify this procedure by developing an open interface based on three interface classes: state control, visualisation, and sensor. A state machine on the robot control is added to the concept because the robot has its own workflow during surgical procedures, which differs from the workflow of the surgeon.

Methods: A KUKA Light Weight Robot is integrated into the medical technology environment of the Institute of Mechatronic Systems as a proof of concept. Therefore, 3D Slicer was used as visualisation and state control software. For the network communication the OpenIGTLink protocol was implemented. In order to achieve high rate control of the robot the “KUKA Sunrise. Connectivity SmartServo” package was used. An exemplary state machine providing states typically used by image-guided therapy interventions, was implemented. Two interface classes, which allow for a direct use of OpenIGTLink for robot control on the one hand and visualisation on the other hand were developed. Additionally, a 3D Slicer module was written to operate the state control.

Results: Utilising the described software concept the state machine could be operated by the 3D Slicer module with 20 Hz cycle rate and no data loss was detected during a test phase of approximately 270 s (13,640 packages). Furthermore, the current robot pose could be sent with more than 60 Hz. No influence on the performance of the state machine by the communication thread could be measured.

Conclusion: Simplified integration was achieved by using only one programming context for the implementation of the state machine, the interfaces, and the robot control. Eventually, the exemplary state machine can be easily expanded by adding new states.

Keywords

    3D Slicer, Finite state machine, Robot control interface, Visualisation

ASJC Scopus subject areas

Cite this

OpenIGTLink interface for state control and visualisation of a robot for image-guided therapy systems. / Tauscher, Sebastian; Tokuda, Junichi; Schreiber, Günter et al.
In: International journal of computer assisted radiology and surgery, Vol. 10, No. 3, 03.2015, p. 285-292.

Research output: Contribution to journalReview articleResearchpeer review

Tauscher S, Tokuda J, Schreiber G, Neff T, Hata N, Ortmaier T. OpenIGTLink interface for state control and visualisation of a robot for image-guided therapy systems. International journal of computer assisted radiology and surgery. 2015 Mar;10(3):285-292. doi: 10.1007/s11548-014-1081-1
Tauscher, Sebastian ; Tokuda, Junichi ; Schreiber, Günter et al. / OpenIGTLink interface for state control and visualisation of a robot for image-guided therapy systems. In: International journal of computer assisted radiology and surgery. 2015 ; Vol. 10, No. 3. pp. 285-292.
Download
@article{fb143c7dc75a4bc0a3073b31a2d7bb5e,
title = "OpenIGTLink interface for state control and visualisation of a robot for image-guided therapy systems",
abstract = "Purpose:    The integration of a robot into an image-guided therapy system is still a time consuming process, due to the lack of a well-accepted standard for interdevice communication. The aim of this project is to simplify this procedure by developing an open interface based on three interface classes: state control, visualisation, and sensor. A state machine on the robot control is added to the concept because the robot has its own workflow during surgical procedures, which differs from the workflow of the surgeon.Methods: A KUKA Light Weight Robot is integrated into the medical technology environment of the Institute of Mechatronic Systems as a proof of concept. Therefore, 3D Slicer was used as visualisation and state control software. For the network communication the OpenIGTLink protocol was implemented. In order to achieve high rate control of the robot the “KUKA Sunrise. Connectivity SmartServo” package was used. An exemplary state machine providing states typically used by image-guided therapy interventions, was implemented. Two interface classes, which allow for a direct use of OpenIGTLink for robot control on the one hand and visualisation on the other hand were developed. Additionally, a 3D Slicer module was written to operate the state control.Results: Utilising the described software concept the state machine could be operated by the 3D Slicer module with 20 Hz cycle rate and no data loss was detected during a test phase of approximately 270 s (13,640 packages). Furthermore, the current robot pose could be sent with more than 60 Hz. No influence on the performance of the state machine by the communication thread could be measured.Conclusion: Simplified integration was achieved by using only one programming context for the implementation of the state machine, the interfaces, and the robot control. Eventually, the exemplary state machine can be easily expanded by adding new states.",
keywords = "3D Slicer, Finite state machine, Robot control interface, Visualisation",
author = "Sebastian Tauscher and Junichi Tokuda and G{\"u}nter Schreiber and Thomas Neff and Nobuhiko Hata and Tobias Ortmaier",
note = "Funding information: The authors wish to thank Gregory Fischer and Nirav Patel from the WPI for the provision of the java implementation of OpenIGTLink igtlink4j as well as the Organizers of the NAMIC 2013 Summer Project Week. This work is supported in part by the National Institute of Health (R01CA111288, P01CA067165, P41RR019703, P41EB015898, R01CA124377, R01CA138586, R42CA137886, and U54EB005 149) and is funded by KUKA Laboratories GmbH (Augsburg, Germany).",
year = "2015",
month = mar,
doi = "10.1007/s11548-014-1081-1",
language = "English",
volume = "10",
pages = "285--292",
journal = "International journal of computer assisted radiology and surgery",
issn = "1861-6410",
publisher = "Springer Verlag",
number = "3",

}

Download

TY - JOUR

T1 - OpenIGTLink interface for state control and visualisation of a robot for image-guided therapy systems

AU - Tauscher, Sebastian

AU - Tokuda, Junichi

AU - Schreiber, Günter

AU - Neff, Thomas

AU - Hata, Nobuhiko

AU - Ortmaier, Tobias

N1 - Funding information: The authors wish to thank Gregory Fischer and Nirav Patel from the WPI for the provision of the java implementation of OpenIGTLink igtlink4j as well as the Organizers of the NAMIC 2013 Summer Project Week. This work is supported in part by the National Institute of Health (R01CA111288, P01CA067165, P41RR019703, P41EB015898, R01CA124377, R01CA138586, R42CA137886, and U54EB005 149) and is funded by KUKA Laboratories GmbH (Augsburg, Germany).

PY - 2015/3

Y1 - 2015/3

N2 - Purpose:    The integration of a robot into an image-guided therapy system is still a time consuming process, due to the lack of a well-accepted standard for interdevice communication. The aim of this project is to simplify this procedure by developing an open interface based on three interface classes: state control, visualisation, and sensor. A state machine on the robot control is added to the concept because the robot has its own workflow during surgical procedures, which differs from the workflow of the surgeon.Methods: A KUKA Light Weight Robot is integrated into the medical technology environment of the Institute of Mechatronic Systems as a proof of concept. Therefore, 3D Slicer was used as visualisation and state control software. For the network communication the OpenIGTLink protocol was implemented. In order to achieve high rate control of the robot the “KUKA Sunrise. Connectivity SmartServo” package was used. An exemplary state machine providing states typically used by image-guided therapy interventions, was implemented. Two interface classes, which allow for a direct use of OpenIGTLink for robot control on the one hand and visualisation on the other hand were developed. Additionally, a 3D Slicer module was written to operate the state control.Results: Utilising the described software concept the state machine could be operated by the 3D Slicer module with 20 Hz cycle rate and no data loss was detected during a test phase of approximately 270 s (13,640 packages). Furthermore, the current robot pose could be sent with more than 60 Hz. No influence on the performance of the state machine by the communication thread could be measured.Conclusion: Simplified integration was achieved by using only one programming context for the implementation of the state machine, the interfaces, and the robot control. Eventually, the exemplary state machine can be easily expanded by adding new states.

AB - Purpose:    The integration of a robot into an image-guided therapy system is still a time consuming process, due to the lack of a well-accepted standard for interdevice communication. The aim of this project is to simplify this procedure by developing an open interface based on three interface classes: state control, visualisation, and sensor. A state machine on the robot control is added to the concept because the robot has its own workflow during surgical procedures, which differs from the workflow of the surgeon.Methods: A KUKA Light Weight Robot is integrated into the medical technology environment of the Institute of Mechatronic Systems as a proof of concept. Therefore, 3D Slicer was used as visualisation and state control software. For the network communication the OpenIGTLink protocol was implemented. In order to achieve high rate control of the robot the “KUKA Sunrise. Connectivity SmartServo” package was used. An exemplary state machine providing states typically used by image-guided therapy interventions, was implemented. Two interface classes, which allow for a direct use of OpenIGTLink for robot control on the one hand and visualisation on the other hand were developed. Additionally, a 3D Slicer module was written to operate the state control.Results: Utilising the described software concept the state machine could be operated by the 3D Slicer module with 20 Hz cycle rate and no data loss was detected during a test phase of approximately 270 s (13,640 packages). Furthermore, the current robot pose could be sent with more than 60 Hz. No influence on the performance of the state machine by the communication thread could be measured.Conclusion: Simplified integration was achieved by using only one programming context for the implementation of the state machine, the interfaces, and the robot control. Eventually, the exemplary state machine can be easily expanded by adding new states.

KW - 3D Slicer

KW - Finite state machine

KW - Robot control interface

KW - Visualisation

UR - http://www.scopus.com/inward/record.url?scp=84939888776&partnerID=8YFLogxK

U2 - 10.1007/s11548-014-1081-1

DO - 10.1007/s11548-014-1081-1

M3 - Review article

C2 - 24923473

AN - SCOPUS:84939888776

VL - 10

SP - 285

EP - 292

JO - International journal of computer assisted radiology and surgery

JF - International journal of computer assisted radiology and surgery

SN - 1861-6410

IS - 3

ER -