Mixed Reality Agent-Based Framework for Pedestrian-Cyclist Interaction

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

External Research Organisations

  • Clausthal University of Technology
View graph of relations

Details

Original languageEnglish
Title of host publication2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages363-368
Number of pages6
ISBN (electronic)9781665453653
ISBN (print)978-1-6654-5366-0
Publication statusPublished - 2022
Event21st IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2022 - Singapore, Singapore
Duration: 17 Oct 202221 Oct 2022

Publication series

NameIEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2022
ISSN (Print)2771-1102
ISSN (electronic)2771-1110

Abstract

Participating in urban traffic is inherently risky for humans. There-fore, in psychology, behavioural studies have been using Virtual Reality (VR) to simulate and experiment with human behaviour. Safety critical interactions (e.g. conflict, collision or near collision) can be captured from the motion trajectories. However, the motion data in virtual settings is influenced by the modelling software used to create the virtual world, which might fail to capture one-to-one interactions accurately (such as interactions between pedestrians and cyclists in mixed traffic). Our system paper proposes a Pedestrian-in-the-Loop (PIL) Mixed Reality (MR) framework, where mobile virtual cyclist avatars co-exist with humans in a real-world outdoor space. Such a setting can be used to study a pedestrian subject, both viewing and interacting with moving holograms of cyclists in real traffic. The novelty of our approach is modelling virtual avatars as cognitive agents. To achieve this, we integrate agent-based models so that the virtual avatar can sense the environment and interact with the real user participating in the experiments. We demonstrate that this approach could contribute to effectively studying of pedestrian interactions. We also perform an evaluation to quantify the amount of trajectory error for our outdoor framework. For this, we compare the position data of a subject during an experiment to a proven benchmark for indoor motion capture. Additionally, an application of using the framework to demonstrate pedestrian dominance is presented.

Keywords

    Behaviour, Interaction modelling-shared spaces, Mixed Reality, Pedestrian in Loop, safety, Simulations

ASJC Scopus subject areas

Cite this

Mixed Reality Agent-Based Framework for Pedestrian-Cyclist Interaction. / Kamalasanan, Vinu; Mukbil, Awad; Sester, Monika et al.
2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2022. Institute of Electrical and Electronics Engineers Inc., 2022. p. 363-368 (IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2022).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Kamalasanan, V, Mukbil, A, Sester, M & Muller, JP 2022, Mixed Reality Agent-Based Framework for Pedestrian-Cyclist Interaction. in 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2022. IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2022, Institute of Electrical and Electronics Engineers Inc., pp. 363-368, 21st IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2022, Singapore, Singapore, 17 Oct 2022. https://doi.org/10.1109/ISMAR-Adjunct57072.2022.00079
Kamalasanan, V., Mukbil, A., Sester, M., & Muller, J. P. (2022). Mixed Reality Agent-Based Framework for Pedestrian-Cyclist Interaction. In 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2022 (pp. 363-368). (IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2022). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISMAR-Adjunct57072.2022.00079
Kamalasanan V, Mukbil A, Sester M, Muller JP. Mixed Reality Agent-Based Framework for Pedestrian-Cyclist Interaction. In 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2022. Institute of Electrical and Electronics Engineers Inc. 2022. p. 363-368. (IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2022). doi: 10.1109/ISMAR-Adjunct57072.2022.00079
Kamalasanan, Vinu ; Mukbil, Awad ; Sester, Monika et al. / Mixed Reality Agent-Based Framework for Pedestrian-Cyclist Interaction. 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2022. Institute of Electrical and Electronics Engineers Inc., 2022. pp. 363-368 (IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2022).
Download
@inproceedings{237a83a59a424dfeb01ab4137edf4ad3,
title = "Mixed Reality Agent-Based Framework for Pedestrian-Cyclist Interaction",
abstract = "Participating in urban traffic is inherently risky for humans. There-fore, in psychology, behavioural studies have been using Virtual Reality (VR) to simulate and experiment with human behaviour. Safety critical interactions (e.g. conflict, collision or near collision) can be captured from the motion trajectories. However, the motion data in virtual settings is influenced by the modelling software used to create the virtual world, which might fail to capture one-to-one interactions accurately (such as interactions between pedestrians and cyclists in mixed traffic). Our system paper proposes a Pedestrian-in-the-Loop (PIL) Mixed Reality (MR) framework, where mobile virtual cyclist avatars co-exist with humans in a real-world outdoor space. Such a setting can be used to study a pedestrian subject, both viewing and interacting with moving holograms of cyclists in real traffic. The novelty of our approach is modelling virtual avatars as cognitive agents. To achieve this, we integrate agent-based models so that the virtual avatar can sense the environment and interact with the real user participating in the experiments. We demonstrate that this approach could contribute to effectively studying of pedestrian interactions. We also perform an evaluation to quantify the amount of trajectory error for our outdoor framework. For this, we compare the position data of a subject during an experiment to a proven benchmark for indoor motion capture. Additionally, an application of using the framework to demonstrate pedestrian dominance is presented.",
keywords = "Behaviour, Interaction modelling-shared spaces, Mixed Reality, Pedestrian in Loop, safety, Simulations",
author = "Vinu Kamalasanan and Awad Mukbil and Monika Sester and Muller, {Jorg P.}",
note = "Funding Information: This research is funded by the German Research Foundation (DFG) through the Research Training Group SocialCars (GRK 1931).; 21st IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2022 ; Conference date: 17-10-2022 Through 21-10-2022",
year = "2022",
doi = "10.1109/ISMAR-Adjunct57072.2022.00079",
language = "English",
isbn = "978-1-6654-5366-0",
series = "IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2022",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "363--368",
booktitle = "2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2022",
address = "United States",

}

Download

TY - GEN

T1 - Mixed Reality Agent-Based Framework for Pedestrian-Cyclist Interaction

AU - Kamalasanan, Vinu

AU - Mukbil, Awad

AU - Sester, Monika

AU - Muller, Jorg P.

N1 - Funding Information: This research is funded by the German Research Foundation (DFG) through the Research Training Group SocialCars (GRK 1931).

PY - 2022

Y1 - 2022

N2 - Participating in urban traffic is inherently risky for humans. There-fore, in psychology, behavioural studies have been using Virtual Reality (VR) to simulate and experiment with human behaviour. Safety critical interactions (e.g. conflict, collision or near collision) can be captured from the motion trajectories. However, the motion data in virtual settings is influenced by the modelling software used to create the virtual world, which might fail to capture one-to-one interactions accurately (such as interactions between pedestrians and cyclists in mixed traffic). Our system paper proposes a Pedestrian-in-the-Loop (PIL) Mixed Reality (MR) framework, where mobile virtual cyclist avatars co-exist with humans in a real-world outdoor space. Such a setting can be used to study a pedestrian subject, both viewing and interacting with moving holograms of cyclists in real traffic. The novelty of our approach is modelling virtual avatars as cognitive agents. To achieve this, we integrate agent-based models so that the virtual avatar can sense the environment and interact with the real user participating in the experiments. We demonstrate that this approach could contribute to effectively studying of pedestrian interactions. We also perform an evaluation to quantify the amount of trajectory error for our outdoor framework. For this, we compare the position data of a subject during an experiment to a proven benchmark for indoor motion capture. Additionally, an application of using the framework to demonstrate pedestrian dominance is presented.

AB - Participating in urban traffic is inherently risky for humans. There-fore, in psychology, behavioural studies have been using Virtual Reality (VR) to simulate and experiment with human behaviour. Safety critical interactions (e.g. conflict, collision or near collision) can be captured from the motion trajectories. However, the motion data in virtual settings is influenced by the modelling software used to create the virtual world, which might fail to capture one-to-one interactions accurately (such as interactions between pedestrians and cyclists in mixed traffic). Our system paper proposes a Pedestrian-in-the-Loop (PIL) Mixed Reality (MR) framework, where mobile virtual cyclist avatars co-exist with humans in a real-world outdoor space. Such a setting can be used to study a pedestrian subject, both viewing and interacting with moving holograms of cyclists in real traffic. The novelty of our approach is modelling virtual avatars as cognitive agents. To achieve this, we integrate agent-based models so that the virtual avatar can sense the environment and interact with the real user participating in the experiments. We demonstrate that this approach could contribute to effectively studying of pedestrian interactions. We also perform an evaluation to quantify the amount of trajectory error for our outdoor framework. For this, we compare the position data of a subject during an experiment to a proven benchmark for indoor motion capture. Additionally, an application of using the framework to demonstrate pedestrian dominance is presented.

KW - Behaviour

KW - Interaction modelling-shared spaces

KW - Mixed Reality

KW - Pedestrian in Loop

KW - safety

KW - Simulations

UR - http://www.scopus.com/inward/record.url?scp=85146050660&partnerID=8YFLogxK

U2 - 10.1109/ISMAR-Adjunct57072.2022.00079

DO - 10.1109/ISMAR-Adjunct57072.2022.00079

M3 - Conference contribution

AN - SCOPUS:85146050660

SN - 978-1-6654-5366-0

T3 - IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2022

SP - 363

EP - 368

BT - 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2022

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 21st IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2022

Y2 - 17 October 2022 through 21 October 2022

ER -

By the same author(s)