Marker-based registration error estimation in see-through AR applications

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

  • Lukas Jütte
  • Alexander Poschke
  • Ludger Overmeyer

External Research Organisations

  • Institut für integrierte Produktion Hannover (IPH)
View graph of relations

Details

Original languageEnglish
Title of host publicationNovel Optical Systems, Methods, and Applications XXVI
EditorsCornelius F. Hahlweg, Joseph R. Mulley
PublisherSPIE
ISBN (electronic)9781510665446
Publication statusPublished - 2 Oct 2023
EventNovel Optical Systems, Methods, and Applications XXVI 2023 - San Diego, United States
Duration: 22 Aug 202323 Aug 2023

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume12665
ISSN (Print)0277-786X
ISSN (electronic)1996-756X

Abstract

The precise overlay in see-through AR applications and the development of methods to calculate the registration error for such applications using an AR head-mounted display (HMD) present significant challenges. This difficulty arises primarily due to the absence of ground truth data (GTD) as the scene is partially hidden by view restrictions. Traditional approaches may require expensive setups, like cameras or laser scanners, to capture the hidden area and generate GTD. We propose an approach to calculate the registration error by using a marker-based pose estimation method. We use synthetic data to show the suitability of our method. The synthetic data is created in Unity, where we replicated a see-through application. Therefore, we employ image augmentation technologies for simulating a real see-through forklift application. The utilization of the simulation environment enables the generation of GT). This data forms the basis for evaluating the accuracy of our proposed method. Our primary contributions include a simulated see-through AR application in Unity, a labeled, application-specific synthetic dataset, and a validated method for determining the 3D registration error in world units (mm). This work demonstrates the suitability of the development of a marker-based registration error method to determine a 3D registration error in AR HMD see-through applications, providing an alternative to traditional, more costly approaches.

Keywords

    Accuracy, Augmented Reality, Immersive, Logistics, Registration Error, RGB-D camera, Simulation, Synthetic data

ASJC Scopus subject areas

Cite this

Marker-based registration error estimation in see-through AR applications. / Jütte, Lukas; Poschke, Alexander; Overmeyer, Ludger.
Novel Optical Systems, Methods, and Applications XXVI. ed. / Cornelius F. Hahlweg; Joseph R. Mulley. SPIE, 2023. 126650F (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 12665).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Jütte, L, Poschke, A & Overmeyer, L 2023, Marker-based registration error estimation in see-through AR applications. in CF Hahlweg & JR Mulley (eds), Novel Optical Systems, Methods, and Applications XXVI., 126650F, Proceedings of SPIE - The International Society for Optical Engineering, vol. 12665, SPIE, Novel Optical Systems, Methods, and Applications XXVI 2023, San Diego, United States, 22 Aug 2023. https://doi.org/10.1117/12.2676355
Jütte, L., Poschke, A., & Overmeyer, L. (2023). Marker-based registration error estimation in see-through AR applications. In C. F. Hahlweg, & J. R. Mulley (Eds.), Novel Optical Systems, Methods, and Applications XXVI Article 126650F (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 12665). SPIE. https://doi.org/10.1117/12.2676355
Jütte L, Poschke A, Overmeyer L. Marker-based registration error estimation in see-through AR applications. In Hahlweg CF, Mulley JR, editors, Novel Optical Systems, Methods, and Applications XXVI. SPIE. 2023. 126650F. (Proceedings of SPIE - The International Society for Optical Engineering). doi: 10.1117/12.2676355
Jütte, Lukas ; Poschke, Alexander ; Overmeyer, Ludger. / Marker-based registration error estimation in see-through AR applications. Novel Optical Systems, Methods, and Applications XXVI. editor / Cornelius F. Hahlweg ; Joseph R. Mulley. SPIE, 2023. (Proceedings of SPIE - The International Society for Optical Engineering).
Download
@inproceedings{4270c5d9ed9d4d70971074c9292a99ce,
title = "Marker-based registration error estimation in see-through AR applications",
abstract = "The precise overlay in see-through AR applications and the development of methods to calculate the registration error for such applications using an AR head-mounted display (HMD) present significant challenges. This difficulty arises primarily due to the absence of ground truth data (GTD) as the scene is partially hidden by view restrictions. Traditional approaches may require expensive setups, like cameras or laser scanners, to capture the hidden area and generate GTD. We propose an approach to calculate the registration error by using a marker-based pose estimation method. We use synthetic data to show the suitability of our method. The synthetic data is created in Unity, where we replicated a see-through application. Therefore, we employ image augmentation technologies for simulating a real see-through forklift application. The utilization of the simulation environment enables the generation of GT). This data forms the basis for evaluating the accuracy of our proposed method. Our primary contributions include a simulated see-through AR application in Unity, a labeled, application-specific synthetic dataset, and a validated method for determining the 3D registration error in world units (mm). This work demonstrates the suitability of the development of a marker-based registration error method to determine a 3D registration error in AR HMD see-through applications, providing an alternative to traditional, more costly approaches.",
keywords = "Accuracy, Augmented Reality, Immersive, Logistics, Registration Error, RGB-D camera, Simulation, Synthetic data",
author = "Lukas J{\"u}tte and Alexander Poschke and Ludger Overmeyer",
note = "Funding Information: This work is part of the research project 20158 N of the Research Foundation Intralogistics / Material Handling and Logistics (IFL) and has been funded by the AiF (Arbeitsgemeinschaft industrieller Forschungsvereinigungen „Otto von Gue-ricke“ e.V.) within the program for sponsorship by Industrial Joint Research (IGF) of the German Federal Ministry of Economic Affairs and Climate Action based on an enactment of the German Parliament.; Novel Optical Systems, Methods, and Applications XXVI 2023 ; Conference date: 22-08-2023 Through 23-08-2023",
year = "2023",
month = oct,
day = "2",
doi = "10.1117/12.2676355",
language = "English",
series = "Proceedings of SPIE - The International Society for Optical Engineering",
publisher = "SPIE",
editor = "Hahlweg, {Cornelius F.} and Mulley, {Joseph R.}",
booktitle = "Novel Optical Systems, Methods, and Applications XXVI",
address = "United States",

}

Download

TY - GEN

T1 - Marker-based registration error estimation in see-through AR applications

AU - Jütte, Lukas

AU - Poschke, Alexander

AU - Overmeyer, Ludger

N1 - Funding Information: This work is part of the research project 20158 N of the Research Foundation Intralogistics / Material Handling and Logistics (IFL) and has been funded by the AiF (Arbeitsgemeinschaft industrieller Forschungsvereinigungen „Otto von Gue-ricke“ e.V.) within the program for sponsorship by Industrial Joint Research (IGF) of the German Federal Ministry of Economic Affairs and Climate Action based on an enactment of the German Parliament.

PY - 2023/10/2

Y1 - 2023/10/2

N2 - The precise overlay in see-through AR applications and the development of methods to calculate the registration error for such applications using an AR head-mounted display (HMD) present significant challenges. This difficulty arises primarily due to the absence of ground truth data (GTD) as the scene is partially hidden by view restrictions. Traditional approaches may require expensive setups, like cameras or laser scanners, to capture the hidden area and generate GTD. We propose an approach to calculate the registration error by using a marker-based pose estimation method. We use synthetic data to show the suitability of our method. The synthetic data is created in Unity, where we replicated a see-through application. Therefore, we employ image augmentation technologies for simulating a real see-through forklift application. The utilization of the simulation environment enables the generation of GT). This data forms the basis for evaluating the accuracy of our proposed method. Our primary contributions include a simulated see-through AR application in Unity, a labeled, application-specific synthetic dataset, and a validated method for determining the 3D registration error in world units (mm). This work demonstrates the suitability of the development of a marker-based registration error method to determine a 3D registration error in AR HMD see-through applications, providing an alternative to traditional, more costly approaches.

AB - The precise overlay in see-through AR applications and the development of methods to calculate the registration error for such applications using an AR head-mounted display (HMD) present significant challenges. This difficulty arises primarily due to the absence of ground truth data (GTD) as the scene is partially hidden by view restrictions. Traditional approaches may require expensive setups, like cameras or laser scanners, to capture the hidden area and generate GTD. We propose an approach to calculate the registration error by using a marker-based pose estimation method. We use synthetic data to show the suitability of our method. The synthetic data is created in Unity, where we replicated a see-through application. Therefore, we employ image augmentation technologies for simulating a real see-through forklift application. The utilization of the simulation environment enables the generation of GT). This data forms the basis for evaluating the accuracy of our proposed method. Our primary contributions include a simulated see-through AR application in Unity, a labeled, application-specific synthetic dataset, and a validated method for determining the 3D registration error in world units (mm). This work demonstrates the suitability of the development of a marker-based registration error method to determine a 3D registration error in AR HMD see-through applications, providing an alternative to traditional, more costly approaches.

KW - Accuracy

KW - Augmented Reality

KW - Immersive

KW - Logistics

KW - Registration Error

KW - RGB-D camera

KW - Simulation

KW - Synthetic data

UR - http://www.scopus.com/inward/record.url?scp=85176242958&partnerID=8YFLogxK

U2 - 10.1117/12.2676355

DO - 10.1117/12.2676355

M3 - Conference contribution

AN - SCOPUS:85176242958

T3 - Proceedings of SPIE - The International Society for Optical Engineering

BT - Novel Optical Systems, Methods, and Applications XXVI

A2 - Hahlweg, Cornelius F.

A2 - Mulley, Joseph R.

PB - SPIE

T2 - Novel Optical Systems, Methods, and Applications XXVI 2023

Y2 - 22 August 2023 through 23 August 2023

ER -