ForceFormer: Exploring Social Force and Transformer for Pedestrian Trajectory Prediction

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschung

Autoren

Externe Organisationen

  • International Institute for Geo-Information Science and Earth Observation
  • Technische Universität Clausthal
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des Sammelwerks2023 IEEE Intelligent Vehicles Symposium (IV)
Herausgeber (Verlag)Institute of Electrical and Electronics Engineers Inc.
ISBN (elektronisch)9798350346916
ISBN (Print)979-8-3503-4692-3
PublikationsstatusVeröffentlicht - 2023
Veranstaltung34th IEEE Intelligent Vehicles Symposium, IV 2023 - Anchorage, USA / Vereinigte Staaten
Dauer: 4 Juni 20237 Juni 2023

Publikationsreihe

NameIEEE Intelligent Vehicles Symposium
ISSN (Print)1931-0587

Abstract

Predicting trajectories of pedestrians based on goal information in highly interactive scenes is a crucial step toward Intelligent Transportation Systems and Autonomous Driving. The challenges of this task come from two key sources: (1) complex social interactions in high pedestrian density scenarios and (2) limited utilization of goal information to effectively associate with past motion information. To address these difficulties, we integrate social forces into a Transformer-based stochastic generative model backbone and propose a new goal-based trajectory predictor called ForceFormer. Differentiating from most prior works that simply use the destination position as an input feature, we leverage the driving force from the destination to efficiently simulate the guidance of a target on a pedestrian. Additionally, repulsive forces are used as another input feature to describe the avoidance action among neighboring pedestrians. Extensive experiments show that our proposed method achieves on-par performance measured by distance errors with the state-of-the-art models but evidently decreases collisions, especially in dense pedestrian scenarios on widely used pedestrian datasets.

ASJC Scopus Sachgebiete

Zitieren

ForceFormer: Exploring Social Force and Transformer for Pedestrian Trajectory Prediction. / Zhang, Weicheng; Cheng, Hao; Johora, Fatema T. et al.
2023 IEEE Intelligent Vehicles Symposium (IV). Institute of Electrical and Electronics Engineers Inc., 2023. (IEEE Intelligent Vehicles Symposium).

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschung

Zhang, W, Cheng, H, Johora, FT & Sester, M 2023, ForceFormer: Exploring Social Force and Transformer for Pedestrian Trajectory Prediction. in 2023 IEEE Intelligent Vehicles Symposium (IV). IEEE Intelligent Vehicles Symposium, Institute of Electrical and Electronics Engineers Inc., 34th IEEE Intelligent Vehicles Symposium, IV 2023, Anchorage, USA / Vereinigte Staaten, 4 Juni 2023. https://doi.org/10.48550/arXiv.2302.07583, https://doi.org/10.1109/IV55152.2023.10186643
Zhang, W., Cheng, H., Johora, F. T., & Sester, M. (2023). ForceFormer: Exploring Social Force and Transformer for Pedestrian Trajectory Prediction. In 2023 IEEE Intelligent Vehicles Symposium (IV) (IEEE Intelligent Vehicles Symposium). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.48550/arXiv.2302.07583, https://doi.org/10.1109/IV55152.2023.10186643
Zhang W, Cheng H, Johora FT, Sester M. ForceFormer: Exploring Social Force and Transformer for Pedestrian Trajectory Prediction. in 2023 IEEE Intelligent Vehicles Symposium (IV). Institute of Electrical and Electronics Engineers Inc. 2023. (IEEE Intelligent Vehicles Symposium). doi: 10.48550/arXiv.2302.07583, 10.1109/IV55152.2023.10186643
Zhang, Weicheng ; Cheng, Hao ; Johora, Fatema T. et al. / ForceFormer : Exploring Social Force and Transformer for Pedestrian Trajectory Prediction. 2023 IEEE Intelligent Vehicles Symposium (IV). Institute of Electrical and Electronics Engineers Inc., 2023. (IEEE Intelligent Vehicles Symposium).
Download
@inproceedings{6ebad0bedfb84047934e32818aa45838,
title = "ForceFormer: Exploring Social Force and Transformer for Pedestrian Trajectory Prediction",
abstract = "Predicting trajectories of pedestrians based on goal information in highly interactive scenes is a crucial step toward Intelligent Transportation Systems and Autonomous Driving. The challenges of this task come from two key sources: (1) complex social interactions in high pedestrian density scenarios and (2) limited utilization of goal information to effectively associate with past motion information. To address these difficulties, we integrate social forces into a Transformer-based stochastic generative model backbone and propose a new goal-based trajectory predictor called ForceFormer. Differentiating from most prior works that simply use the destination position as an input feature, we leverage the driving force from the destination to efficiently simulate the guidance of a target on a pedestrian. Additionally, repulsive forces are used as another input feature to describe the avoidance action among neighboring pedestrians. Extensive experiments show that our proposed method achieves on-par performance measured by distance errors with the state-of-the-art models but evidently decreases collisions, especially in dense pedestrian scenarios on widely used pedestrian datasets.",
author = "Weicheng Zhang and Hao Cheng and Johora, {Fatema T.} and Monika Sester",
note = "Funding information: 1Weicheng Zhang and Monika Sester are with the Institute of Cartography and Geoinformatics, Leibniz University Hannover, Appelstr. 9, 30167 Hannover, Germany weicheng.zhang@stud.uni-hannover.de, Monika.Sester@ikg.uni-hannover.de 2Hao Cheng is with the Faculty of Geo-Information Science and Earth Observation, University of Twente, 7500 AE Enschede, The Netherlands. Cheng is funded by MSCA European Postdoctoral Fellowships under the 101062870 VeVuSafety project. h.cheng-2@utwente.nl 2Fatema T. Johora is with the Department of Informatics, Clausthal University of Technology, Julius-Albert-Str. 4, 38678 Clausthal-Zellerfeld, Germany fatema.tuj.johora@tu-clausthal.de *Corresponding author; 34th IEEE Intelligent Vehicles Symposium, IV 2023 ; Conference date: 04-06-2023 Through 07-06-2023",
year = "2023",
doi = "10.48550/arXiv.2302.07583",
language = "English",
isbn = "979-8-3503-4692-3",
series = "IEEE Intelligent Vehicles Symposium",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
booktitle = "2023 IEEE Intelligent Vehicles Symposium (IV)",
address = "United States",

}

Download

TY - GEN

T1 - ForceFormer

T2 - 34th IEEE Intelligent Vehicles Symposium, IV 2023

AU - Zhang, Weicheng

AU - Cheng, Hao

AU - Johora, Fatema T.

AU - Sester, Monika

N1 - Funding information: 1Weicheng Zhang and Monika Sester are with the Institute of Cartography and Geoinformatics, Leibniz University Hannover, Appelstr. 9, 30167 Hannover, Germany weicheng.zhang@stud.uni-hannover.de, Monika.Sester@ikg.uni-hannover.de 2Hao Cheng is with the Faculty of Geo-Information Science and Earth Observation, University of Twente, 7500 AE Enschede, The Netherlands. Cheng is funded by MSCA European Postdoctoral Fellowships under the 101062870 VeVuSafety project. h.cheng-2@utwente.nl 2Fatema T. Johora is with the Department of Informatics, Clausthal University of Technology, Julius-Albert-Str. 4, 38678 Clausthal-Zellerfeld, Germany fatema.tuj.johora@tu-clausthal.de *Corresponding author

PY - 2023

Y1 - 2023

N2 - Predicting trajectories of pedestrians based on goal information in highly interactive scenes is a crucial step toward Intelligent Transportation Systems and Autonomous Driving. The challenges of this task come from two key sources: (1) complex social interactions in high pedestrian density scenarios and (2) limited utilization of goal information to effectively associate with past motion information. To address these difficulties, we integrate social forces into a Transformer-based stochastic generative model backbone and propose a new goal-based trajectory predictor called ForceFormer. Differentiating from most prior works that simply use the destination position as an input feature, we leverage the driving force from the destination to efficiently simulate the guidance of a target on a pedestrian. Additionally, repulsive forces are used as another input feature to describe the avoidance action among neighboring pedestrians. Extensive experiments show that our proposed method achieves on-par performance measured by distance errors with the state-of-the-art models but evidently decreases collisions, especially in dense pedestrian scenarios on widely used pedestrian datasets.

AB - Predicting trajectories of pedestrians based on goal information in highly interactive scenes is a crucial step toward Intelligent Transportation Systems and Autonomous Driving. The challenges of this task come from two key sources: (1) complex social interactions in high pedestrian density scenarios and (2) limited utilization of goal information to effectively associate with past motion information. To address these difficulties, we integrate social forces into a Transformer-based stochastic generative model backbone and propose a new goal-based trajectory predictor called ForceFormer. Differentiating from most prior works that simply use the destination position as an input feature, we leverage the driving force from the destination to efficiently simulate the guidance of a target on a pedestrian. Additionally, repulsive forces are used as another input feature to describe the avoidance action among neighboring pedestrians. Extensive experiments show that our proposed method achieves on-par performance measured by distance errors with the state-of-the-art models but evidently decreases collisions, especially in dense pedestrian scenarios on widely used pedestrian datasets.

UR - http://www.scopus.com/inward/record.url?scp=85168003419&partnerID=8YFLogxK

U2 - 10.48550/arXiv.2302.07583

DO - 10.48550/arXiv.2302.07583

M3 - Conference contribution

AN - SCOPUS:85168003419

SN - 979-8-3503-4692-3

T3 - IEEE Intelligent Vehicles Symposium

BT - 2023 IEEE Intelligent Vehicles Symposium (IV)

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 4 June 2023 through 7 June 2023

ER -

Von denselben Autoren