Multi-Modal Motion Prediction with Graphormers

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autorschaft

Organisationseinheiten

Externe Organisationen

  • Volkswagen AG
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des Sammelwerks2022 IEEE 25th International Conference on Intelligent Transportation Systems
UntertitelITSC 2022
Herausgeber (Verlag)Institute of Electrical and Electronics Engineers Inc.
Seiten3521-3528
Seitenumfang8
ISBN (elektronisch)9781665468800
PublikationsstatusVeröffentlicht - 2022
Veranstaltung25th IEEE International Conference on Intelligent Transportation Systems, ITSC 2022 - Macau, China
Dauer: 8 Okt. 202212 Okt. 2022

Publikationsreihe

NameIEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC
Band2022-October

Abstract

Urban road traffic is a highly dynamic environment due to its many rules, complex road layouts and road user interactions. Consequently, accurate prediction of future positions remains a challenging task. Inspired by achievements in the Natural Language Processing domain recent motion prediction models leverage the Transformer architecture. Although the models produce state-of-the-art results, they completely neglect the graph semantics inherent in the data. Graphormer is a promising architecture that was proposed recently for tackling this challenge in the field of molecule science. In this paper, we show how the Graphormer architecture can be leveraged for addressing the motion prediction task. We propose a novel encoding strategy to create a locality aware Graphormer. In addition, we extend the architecture to be able to handle edge features with the self-attention mechanism. To demonstrate the effectiveness of all components we evaluate our model on the publicly available urban motion forecasting dataset from Argoverse. Quantitative and qualitative evaluations show that our model is able to make precise state-of-the-art predictions.

ASJC Scopus Sachgebiete

Zitieren

Multi-Modal Motion Prediction with Graphormers. / Wonsak, Shimon; Al-Rifai, Mohammad; Nolting, Michael et al.
2022 IEEE 25th International Conference on Intelligent Transportation Systems: ITSC 2022. Institute of Electrical and Electronics Engineers Inc., 2022. S. 3521-3528 (IEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC; Band 2022-October).

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Wonsak, S, Al-Rifai, M, Nolting, M & Nejdl, W 2022, Multi-Modal Motion Prediction with Graphormers. in 2022 IEEE 25th International Conference on Intelligent Transportation Systems: ITSC 2022. IEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC, Bd. 2022-October, Institute of Electrical and Electronics Engineers Inc., S. 3521-3528, 25th IEEE International Conference on Intelligent Transportation Systems, ITSC 2022, Macau, China, 8 Okt. 2022. https://doi.org/10.1109/ITSC55140.2022.9921993
Wonsak, S., Al-Rifai, M., Nolting, M., & Nejdl, W. (2022). Multi-Modal Motion Prediction with Graphormers. In 2022 IEEE 25th International Conference on Intelligent Transportation Systems: ITSC 2022 (S. 3521-3528). (IEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC; Band 2022-October). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ITSC55140.2022.9921993
Wonsak S, Al-Rifai M, Nolting M, Nejdl W. Multi-Modal Motion Prediction with Graphormers. in 2022 IEEE 25th International Conference on Intelligent Transportation Systems: ITSC 2022. Institute of Electrical and Electronics Engineers Inc. 2022. S. 3521-3528. (IEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC). doi: 10.1109/ITSC55140.2022.9921993
Wonsak, Shimon ; Al-Rifai, Mohammad ; Nolting, Michael et al. / Multi-Modal Motion Prediction with Graphormers. 2022 IEEE 25th International Conference on Intelligent Transportation Systems: ITSC 2022. Institute of Electrical and Electronics Engineers Inc., 2022. S. 3521-3528 (IEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC).
Download
@inproceedings{38ae30f2c31e439aacfe15ec7e85e380,
title = "Multi-Modal Motion Prediction with Graphormers",
abstract = "Urban road traffic is a highly dynamic environment due to its many rules, complex road layouts and road user interactions. Consequently, accurate prediction of future positions remains a challenging task. Inspired by achievements in the Natural Language Processing domain recent motion prediction models leverage the Transformer architecture. Although the models produce state-of-the-art results, they completely neglect the graph semantics inherent in the data. Graphormer is a promising architecture that was proposed recently for tackling this challenge in the field of molecule science. In this paper, we show how the Graphormer architecture can be leveraged for addressing the motion prediction task. We propose a novel encoding strategy to create a locality aware Graphormer. In addition, we extend the architecture to be able to handle edge features with the self-attention mechanism. To demonstrate the effectiveness of all components we evaluate our model on the publicly available urban motion forecasting dataset from Argoverse. Quantitative and qualitative evaluations show that our model is able to make precise state-of-the-art predictions.",
author = "Shimon Wonsak and Mohammad Al-Rifai and Michael Nolting and Wolfgang Nejdl",
note = "Funding Information: ACKNOWLEDGEMENT The first author affiliated with Volkswagen AG has received funding from Volkswagen AG to conduct this research. ; 25th IEEE International Conference on Intelligent Transportation Systems, ITSC 2022 ; Conference date: 08-10-2022 Through 12-10-2022",
year = "2022",
doi = "10.1109/ITSC55140.2022.9921993",
language = "English",
series = "IEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "3521--3528",
booktitle = "2022 IEEE 25th International Conference on Intelligent Transportation Systems",
address = "United States",

}

Download

TY - GEN

T1 - Multi-Modal Motion Prediction with Graphormers

AU - Wonsak, Shimon

AU - Al-Rifai, Mohammad

AU - Nolting, Michael

AU - Nejdl, Wolfgang

N1 - Funding Information: ACKNOWLEDGEMENT The first author affiliated with Volkswagen AG has received funding from Volkswagen AG to conduct this research.

PY - 2022

Y1 - 2022

N2 - Urban road traffic is a highly dynamic environment due to its many rules, complex road layouts and road user interactions. Consequently, accurate prediction of future positions remains a challenging task. Inspired by achievements in the Natural Language Processing domain recent motion prediction models leverage the Transformer architecture. Although the models produce state-of-the-art results, they completely neglect the graph semantics inherent in the data. Graphormer is a promising architecture that was proposed recently for tackling this challenge in the field of molecule science. In this paper, we show how the Graphormer architecture can be leveraged for addressing the motion prediction task. We propose a novel encoding strategy to create a locality aware Graphormer. In addition, we extend the architecture to be able to handle edge features with the self-attention mechanism. To demonstrate the effectiveness of all components we evaluate our model on the publicly available urban motion forecasting dataset from Argoverse. Quantitative and qualitative evaluations show that our model is able to make precise state-of-the-art predictions.

AB - Urban road traffic is a highly dynamic environment due to its many rules, complex road layouts and road user interactions. Consequently, accurate prediction of future positions remains a challenging task. Inspired by achievements in the Natural Language Processing domain recent motion prediction models leverage the Transformer architecture. Although the models produce state-of-the-art results, they completely neglect the graph semantics inherent in the data. Graphormer is a promising architecture that was proposed recently for tackling this challenge in the field of molecule science. In this paper, we show how the Graphormer architecture can be leveraged for addressing the motion prediction task. We propose a novel encoding strategy to create a locality aware Graphormer. In addition, we extend the architecture to be able to handle edge features with the self-attention mechanism. To demonstrate the effectiveness of all components we evaluate our model on the publicly available urban motion forecasting dataset from Argoverse. Quantitative and qualitative evaluations show that our model is able to make precise state-of-the-art predictions.

UR - http://www.scopus.com/inward/record.url?scp=85141867909&partnerID=8YFLogxK

U2 - 10.1109/ITSC55140.2022.9921993

DO - 10.1109/ITSC55140.2022.9921993

M3 - Conference contribution

AN - SCOPUS:85141867909

T3 - IEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC

SP - 3521

EP - 3528

BT - 2022 IEEE 25th International Conference on Intelligent Transportation Systems

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 25th IEEE International Conference on Intelligent Transportation Systems, ITSC 2022

Y2 - 8 October 2022 through 12 October 2022

ER -

Von denselben Autoren