Plug-and-Play Sparse Inertial Motion Tracking With Sim-to-Real Transfer

Publikation: Beitrag in FachzeitschriftArtikelForschungPeer-Review

Autoren

  • Simon Bachhuber
  • Dustin Lehmann
  • Eva Dorschky
  • Anne D. Koelewijn
  • Thomas Seel
  • Ive Weygers

Organisationseinheiten

Externe Organisationen

  • Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU Erlangen-Nürnberg)
  • Technische Universität Berlin
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Aufsatznummer7004904
FachzeitschriftIEEE Sensors Letters
Jahrgang7
Ausgabenummer10
PublikationsstatusVeröffentlicht - 21 Aug. 2023

Abstract

Inertial measurement units (IMUs) are used for inertial motion tracking (IMT) in a growing number of applications as sensor fusion methods are being advanced in three directions: magnetometer-free IMT methods that eliminate the effect of magnetic disturbances; sparse IMT approaches that lead to reduced setup complexity; and automatic self-calibration of sensor-to-segment positions or orientations. In this letter, we propose an approach that combines all three achievements and, for the first time, enables plug-and-play, magnetometer-free, and sparse IMT. This is accomplished by training a recurrent neural-network-based observer (RNNo) on just-in-time generated simulated motion data of kinematic chains. We demonstrate that domain-specific training data augmentations lead to a trained RNNo which zero shot generalizes to previously unseen experimental data and, thus, overcomes the sim-to-real gap. The trained RNNo achieves a tracking error of < 4 degrees when estimating the relative pose of a three-segment kinematic chain with two hinge joints. The proposed method offers a novel simulation-data-driven approach for solving complex sparse sensing problems while assuring robust and plug-and-play generalizability to experimental data.

ASJC Scopus Sachgebiete

Zitieren

Plug-and-Play Sparse Inertial Motion Tracking With Sim-to-Real Transfer. / Bachhuber, Simon; Lehmann, Dustin; Dorschky, Eva et al.
in: IEEE Sensors Letters, Jahrgang 7, Nr. 10, 7004904, 21.08.2023.

Publikation: Beitrag in FachzeitschriftArtikelForschungPeer-Review

Bachhuber, S, Lehmann, D, Dorschky, E, Koelewijn, AD, Seel, T & Weygers, I 2023, 'Plug-and-Play Sparse Inertial Motion Tracking With Sim-to-Real Transfer', IEEE Sensors Letters, Jg. 7, Nr. 10, 7004904. https://doi.org/10.1109/LSENS.2023.3307122
Bachhuber, S., Lehmann, D., Dorschky, E., Koelewijn, A. D., Seel, T., & Weygers, I. (2023). Plug-and-Play Sparse Inertial Motion Tracking With Sim-to-Real Transfer. IEEE Sensors Letters, 7(10), Artikel 7004904. https://doi.org/10.1109/LSENS.2023.3307122
Bachhuber S, Lehmann D, Dorschky E, Koelewijn AD, Seel T, Weygers I. Plug-and-Play Sparse Inertial Motion Tracking With Sim-to-Real Transfer. IEEE Sensors Letters. 2023 Aug 21;7(10):7004904. doi: 10.1109/LSENS.2023.3307122
Bachhuber, Simon ; Lehmann, Dustin ; Dorschky, Eva et al. / Plug-and-Play Sparse Inertial Motion Tracking With Sim-to-Real Transfer. in: IEEE Sensors Letters. 2023 ; Jahrgang 7, Nr. 10.
Download
@article{fee9f36bdbae4a77a6a038626fda4862,
title = "Plug-and-Play Sparse Inertial Motion Tracking With Sim-to-Real Transfer",
abstract = "Inertial measurement units (IMUs) are used for inertial motion tracking (IMT) in a growing number of applications as sensor fusion methods are being advanced in three directions: magnetometer-free IMT methods that eliminate the effect of magnetic disturbances; sparse IMT approaches that lead to reduced setup complexity; and automatic self-calibration of sensor-to-segment positions or orientations. In this letter, we propose an approach that combines all three achievements and, for the first time, enables plug-and-play, magnetometer-free, and sparse IMT. This is accomplished by training a recurrent neural-network-based observer (RNNo) on just-in-time generated simulated motion data of kinematic chains. We demonstrate that domain-specific training data augmentations lead to a trained RNNo which zero shot generalizes to previously unseen experimental data and, thus, overcomes the sim-to-real gap. The trained RNNo achieves a tracking error of < 4 degrees when estimating the relative pose of a three-segment kinematic chain with two hinge joints. The proposed method offers a novel simulation-data-driven approach for solving complex sparse sensing problems while assuring robust and plug-and-play generalizability to experimental data.",
keywords = "inertial measurement units (IMUs), magnetometer-free, recurrent neural networks, sensor fusion, Sensor signal processing, sparse sensing",
author = "Simon Bachhuber and Dustin Lehmann and Eva Dorschky and Koelewijn, {Anne D.} and Thomas Seel and Ive Weygers",
year = "2023",
month = aug,
day = "21",
doi = "10.1109/LSENS.2023.3307122",
language = "English",
volume = "7",
number = "10",

}

Download

TY - JOUR

T1 - Plug-and-Play Sparse Inertial Motion Tracking With Sim-to-Real Transfer

AU - Bachhuber, Simon

AU - Lehmann, Dustin

AU - Dorschky, Eva

AU - Koelewijn, Anne D.

AU - Seel, Thomas

AU - Weygers, Ive

PY - 2023/8/21

Y1 - 2023/8/21

N2 - Inertial measurement units (IMUs) are used for inertial motion tracking (IMT) in a growing number of applications as sensor fusion methods are being advanced in three directions: magnetometer-free IMT methods that eliminate the effect of magnetic disturbances; sparse IMT approaches that lead to reduced setup complexity; and automatic self-calibration of sensor-to-segment positions or orientations. In this letter, we propose an approach that combines all three achievements and, for the first time, enables plug-and-play, magnetometer-free, and sparse IMT. This is accomplished by training a recurrent neural-network-based observer (RNNo) on just-in-time generated simulated motion data of kinematic chains. We demonstrate that domain-specific training data augmentations lead to a trained RNNo which zero shot generalizes to previously unseen experimental data and, thus, overcomes the sim-to-real gap. The trained RNNo achieves a tracking error of < 4 degrees when estimating the relative pose of a three-segment kinematic chain with two hinge joints. The proposed method offers a novel simulation-data-driven approach for solving complex sparse sensing problems while assuring robust and plug-and-play generalizability to experimental data.

AB - Inertial measurement units (IMUs) are used for inertial motion tracking (IMT) in a growing number of applications as sensor fusion methods are being advanced in three directions: magnetometer-free IMT methods that eliminate the effect of magnetic disturbances; sparse IMT approaches that lead to reduced setup complexity; and automatic self-calibration of sensor-to-segment positions or orientations. In this letter, we propose an approach that combines all three achievements and, for the first time, enables plug-and-play, magnetometer-free, and sparse IMT. This is accomplished by training a recurrent neural-network-based observer (RNNo) on just-in-time generated simulated motion data of kinematic chains. We demonstrate that domain-specific training data augmentations lead to a trained RNNo which zero shot generalizes to previously unseen experimental data and, thus, overcomes the sim-to-real gap. The trained RNNo achieves a tracking error of < 4 degrees when estimating the relative pose of a three-segment kinematic chain with two hinge joints. The proposed method offers a novel simulation-data-driven approach for solving complex sparse sensing problems while assuring robust and plug-and-play generalizability to experimental data.

KW - inertial measurement units (IMUs)

KW - magnetometer-free

KW - recurrent neural networks

KW - sensor fusion

KW - Sensor signal processing

KW - sparse sensing

UR - http://www.scopus.com/inward/record.url?scp=85168741697&partnerID=8YFLogxK

U2 - 10.1109/LSENS.2023.3307122

DO - 10.1109/LSENS.2023.3307122

M3 - Article

AN - SCOPUS:85168741697

VL - 7

JO - IEEE Sensors Letters

JF - IEEE Sensors Letters

IS - 10

M1 - 7004904

ER -

Von denselben Autoren