ForceFormer: Exploring Social Force and Transformer for Pedestrian Trajectory Prediction

Research output: Chapter in book/report/conference proceedingConference contributionResearch

Authors

External Research Organisations

  • International Institute for Geo-Information Science and Earth Observation - ITC
  • Clausthal University of Technology
View graph of relations

Details

Original languageEnglish
Title of host publication2023 IEEE Intelligent Vehicles Symposium (IV)
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (electronic)9798350346916
ISBN (print)979-8-3503-4692-3
Publication statusPublished - 2023
Event34th IEEE Intelligent Vehicles Symposium, IV 2023 - Anchorage, United States
Duration: 4 Jun 20237 Jun 2023

Publication series

NameIEEE Intelligent Vehicles Symposium
ISSN (Print)1931-0587

Abstract

Predicting trajectories of pedestrians based on goal information in highly interactive scenes is a crucial step toward Intelligent Transportation Systems and Autonomous Driving. The challenges of this task come from two key sources: (1) complex social interactions in high pedestrian density scenarios and (2) limited utilization of goal information to effectively associate with past motion information. To address these difficulties, we integrate social forces into a Transformer-based stochastic generative model backbone and propose a new goal-based trajectory predictor called ForceFormer. Differentiating from most prior works that simply use the destination position as an input feature, we leverage the driving force from the destination to efficiently simulate the guidance of a target on a pedestrian. Additionally, repulsive forces are used as another input feature to describe the avoidance action among neighboring pedestrians. Extensive experiments show that our proposed method achieves on-par performance measured by distance errors with the state-of-the-art models but evidently decreases collisions, especially in dense pedestrian scenarios on widely used pedestrian datasets.

ASJC Scopus subject areas

Cite this

ForceFormer: Exploring Social Force and Transformer for Pedestrian Trajectory Prediction. / Zhang, Weicheng; Cheng, Hao; Johora, Fatema T. et al.
2023 IEEE Intelligent Vehicles Symposium (IV). Institute of Electrical and Electronics Engineers Inc., 2023. (IEEE Intelligent Vehicles Symposium).

Research output: Chapter in book/report/conference proceedingConference contributionResearch

Zhang, W, Cheng, H, Johora, FT & Sester, M 2023, ForceFormer: Exploring Social Force and Transformer for Pedestrian Trajectory Prediction. in 2023 IEEE Intelligent Vehicles Symposium (IV). IEEE Intelligent Vehicles Symposium, Institute of Electrical and Electronics Engineers Inc., 34th IEEE Intelligent Vehicles Symposium, IV 2023, Anchorage, United States, 4 Jun 2023. https://doi.org/10.48550/arXiv.2302.07583, https://doi.org/10.1109/IV55152.2023.10186643
Zhang, W., Cheng, H., Johora, F. T., & Sester, M. (2023). ForceFormer: Exploring Social Force and Transformer for Pedestrian Trajectory Prediction. In 2023 IEEE Intelligent Vehicles Symposium (IV) (IEEE Intelligent Vehicles Symposium). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.48550/arXiv.2302.07583, https://doi.org/10.1109/IV55152.2023.10186643
Zhang W, Cheng H, Johora FT, Sester M. ForceFormer: Exploring Social Force and Transformer for Pedestrian Trajectory Prediction. In 2023 IEEE Intelligent Vehicles Symposium (IV). Institute of Electrical and Electronics Engineers Inc. 2023. (IEEE Intelligent Vehicles Symposium). doi: 10.48550/arXiv.2302.07583, 10.1109/IV55152.2023.10186643
Zhang, Weicheng ; Cheng, Hao ; Johora, Fatema T. et al. / ForceFormer : Exploring Social Force and Transformer for Pedestrian Trajectory Prediction. 2023 IEEE Intelligent Vehicles Symposium (IV). Institute of Electrical and Electronics Engineers Inc., 2023. (IEEE Intelligent Vehicles Symposium).
Download
@inproceedings{6ebad0bedfb84047934e32818aa45838,
title = "ForceFormer: Exploring Social Force and Transformer for Pedestrian Trajectory Prediction",
abstract = "Predicting trajectories of pedestrians based on goal information in highly interactive scenes is a crucial step toward Intelligent Transportation Systems and Autonomous Driving. The challenges of this task come from two key sources: (1) complex social interactions in high pedestrian density scenarios and (2) limited utilization of goal information to effectively associate with past motion information. To address these difficulties, we integrate social forces into a Transformer-based stochastic generative model backbone and propose a new goal-based trajectory predictor called ForceFormer. Differentiating from most prior works that simply use the destination position as an input feature, we leverage the driving force from the destination to efficiently simulate the guidance of a target on a pedestrian. Additionally, repulsive forces are used as another input feature to describe the avoidance action among neighboring pedestrians. Extensive experiments show that our proposed method achieves on-par performance measured by distance errors with the state-of-the-art models but evidently decreases collisions, especially in dense pedestrian scenarios on widely used pedestrian datasets.",
author = "Weicheng Zhang and Hao Cheng and Johora, {Fatema T.} and Monika Sester",
note = "Funding information: 1Weicheng Zhang and Monika Sester are with the Institute of Cartography and Geoinformatics, Leibniz University Hannover, Appelstr. 9, 30167 Hannover, Germany weicheng.zhang@stud.uni-hannover.de, Monika.Sester@ikg.uni-hannover.de 2Hao Cheng is with the Faculty of Geo-Information Science and Earth Observation, University of Twente, 7500 AE Enschede, The Netherlands. Cheng is funded by MSCA European Postdoctoral Fellowships under the 101062870 VeVuSafety project. h.cheng-2@utwente.nl 2Fatema T. Johora is with the Department of Informatics, Clausthal University of Technology, Julius-Albert-Str. 4, 38678 Clausthal-Zellerfeld, Germany fatema.tuj.johora@tu-clausthal.de *Corresponding author; 34th IEEE Intelligent Vehicles Symposium, IV 2023 ; Conference date: 04-06-2023 Through 07-06-2023",
year = "2023",
doi = "10.48550/arXiv.2302.07583",
language = "English",
isbn = "979-8-3503-4692-3",
series = "IEEE Intelligent Vehicles Symposium",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
booktitle = "2023 IEEE Intelligent Vehicles Symposium (IV)",
address = "United States",

}

Download

TY - GEN

T1 - ForceFormer

T2 - 34th IEEE Intelligent Vehicles Symposium, IV 2023

AU - Zhang, Weicheng

AU - Cheng, Hao

AU - Johora, Fatema T.

AU - Sester, Monika

N1 - Funding information: 1Weicheng Zhang and Monika Sester are with the Institute of Cartography and Geoinformatics, Leibniz University Hannover, Appelstr. 9, 30167 Hannover, Germany weicheng.zhang@stud.uni-hannover.de, Monika.Sester@ikg.uni-hannover.de 2Hao Cheng is with the Faculty of Geo-Information Science and Earth Observation, University of Twente, 7500 AE Enschede, The Netherlands. Cheng is funded by MSCA European Postdoctoral Fellowships under the 101062870 VeVuSafety project. h.cheng-2@utwente.nl 2Fatema T. Johora is with the Department of Informatics, Clausthal University of Technology, Julius-Albert-Str. 4, 38678 Clausthal-Zellerfeld, Germany fatema.tuj.johora@tu-clausthal.de *Corresponding author

PY - 2023

Y1 - 2023

N2 - Predicting trajectories of pedestrians based on goal information in highly interactive scenes is a crucial step toward Intelligent Transportation Systems and Autonomous Driving. The challenges of this task come from two key sources: (1) complex social interactions in high pedestrian density scenarios and (2) limited utilization of goal information to effectively associate with past motion information. To address these difficulties, we integrate social forces into a Transformer-based stochastic generative model backbone and propose a new goal-based trajectory predictor called ForceFormer. Differentiating from most prior works that simply use the destination position as an input feature, we leverage the driving force from the destination to efficiently simulate the guidance of a target on a pedestrian. Additionally, repulsive forces are used as another input feature to describe the avoidance action among neighboring pedestrians. Extensive experiments show that our proposed method achieves on-par performance measured by distance errors with the state-of-the-art models but evidently decreases collisions, especially in dense pedestrian scenarios on widely used pedestrian datasets.

AB - Predicting trajectories of pedestrians based on goal information in highly interactive scenes is a crucial step toward Intelligent Transportation Systems and Autonomous Driving. The challenges of this task come from two key sources: (1) complex social interactions in high pedestrian density scenarios and (2) limited utilization of goal information to effectively associate with past motion information. To address these difficulties, we integrate social forces into a Transformer-based stochastic generative model backbone and propose a new goal-based trajectory predictor called ForceFormer. Differentiating from most prior works that simply use the destination position as an input feature, we leverage the driving force from the destination to efficiently simulate the guidance of a target on a pedestrian. Additionally, repulsive forces are used as another input feature to describe the avoidance action among neighboring pedestrians. Extensive experiments show that our proposed method achieves on-par performance measured by distance errors with the state-of-the-art models but evidently decreases collisions, especially in dense pedestrian scenarios on widely used pedestrian datasets.

UR - http://www.scopus.com/inward/record.url?scp=85168003419&partnerID=8YFLogxK

U2 - 10.48550/arXiv.2302.07583

DO - 10.48550/arXiv.2302.07583

M3 - Conference contribution

AN - SCOPUS:85168003419

SN - 979-8-3503-4692-3

T3 - IEEE Intelligent Vehicles Symposium

BT - 2023 IEEE Intelligent Vehicles Symposium (IV)

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 4 June 2023 through 7 June 2023

ER -

By the same author(s)