Trajectory Modelling in Shared Spaces: Expert-Based vs. Deep Learning Approach?

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

External Research Organisations

  • Clausthal University of Technology
View graph of relations

Details

Original languageEnglish
Title of host publicationMulti-Agent-Based Simulation XXI
Subtitle of host publication21st International Workshop, MABS 2020, Revised Selected Papers
EditorsSamarth Swarup, Bastin Tony Savarimuthu
Place of PublicationCham
PublisherSpringer Science and Business Media Deutschland GmbH
Pages13-27
Number of pages15
ISBN (electronic)978-3-030-66888-4
ISBN (print)9783030668877
Publication statusPublished - 19 Jan 2021
Event20th International Workshop on Multi-Agent-Based Simulation, MABS 2020 - Auckland, New Zealand
Duration: 10 May 202010 May 2020

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12316 LNAI
ISSN (Print)0302-9743
ISSN (electronic)1611-3349

Abstract

Realistically modelling behaviour and interaction of heterogeneous road users (pedestrians and vehicles) in mixed-traffic zones (a.k.a. shared spaces) is challenging. The dynamic nature of the environment, heterogeneity of transport modes, and the absence of classical traffic rules make realistic microscopic traffic simulation hard problems. Existing multi-agent-based simulations of shared spaces largely use an expert-based approach, combining a symbolic (e.g. rule-based) modelling and reasoning paradigm (e.g. using BDI representations of beliefs and plans) with the hand-crafted encoding of the actual decision logic. More recently, deep learning (DL) models are largely used to derive and predict trajectories based on e.g. video data. In-depth studies comparing these two kinds of approaches are missing. In this work, we propose an expert-based model called GSFM that combines Social Force Model and Game theory and a DL model called LSTM-DBSCAN that manipulates Long Short-Term Memories and density-based clustering for multi-agent trajectory prediction. We create a common framework to run these two models in parallel to guarantee a fair comparison. Real-world mixed traffic data from shared spaces of different layout are used to calibrate/train and evaluate the models. The empirical results imply that both models can generate realistic predictions, but they differ in the way of handling collisions and mimicking heterogeneous behaviour. Via a thorough study, we draw the conclusion of their respective strengths and weaknesses.

Keywords

    Deep learning, Game theory, Mixed-traffic interaction

ASJC Scopus subject areas

Cite this

Trajectory Modelling in Shared Spaces: Expert-Based vs. Deep Learning Approach? / Cheng, Hao; Johora, Fatema T.; Sester, Monika et al.
Multi-Agent-Based Simulation XXI: 21st International Workshop, MABS 2020, Revised Selected Papers. ed. / Samarth Swarup; Bastin Tony Savarimuthu. Cham: Springer Science and Business Media Deutschland GmbH, 2021. p. 13-27 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 12316 LNAI).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Cheng, H, Johora, FT, Sester, M & Müller, JP 2021, Trajectory Modelling in Shared Spaces: Expert-Based vs. Deep Learning Approach? in S Swarup & BT Savarimuthu (eds), Multi-Agent-Based Simulation XXI: 21st International Workshop, MABS 2020, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 12316 LNAI, Springer Science and Business Media Deutschland GmbH, Cham, pp. 13-27, 20th International Workshop on Multi-Agent-Based Simulation, MABS 2020, Auckland, New Zealand, 10 May 2020. https://doi.org/10.1007/978-3-030-66888-4_2
Cheng, H., Johora, F. T., Sester, M., & Müller, J. P. (2021). Trajectory Modelling in Shared Spaces: Expert-Based vs. Deep Learning Approach? In S. Swarup, & B. T. Savarimuthu (Eds.), Multi-Agent-Based Simulation XXI: 21st International Workshop, MABS 2020, Revised Selected Papers (pp. 13-27). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 12316 LNAI). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-030-66888-4_2
Cheng H, Johora FT, Sester M, Müller JP. Trajectory Modelling in Shared Spaces: Expert-Based vs. Deep Learning Approach? In Swarup S, Savarimuthu BT, editors, Multi-Agent-Based Simulation XXI: 21st International Workshop, MABS 2020, Revised Selected Papers. Cham: Springer Science and Business Media Deutschland GmbH. 2021. p. 13-27. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-030-66888-4_2
Cheng, Hao ; Johora, Fatema T. ; Sester, Monika et al. / Trajectory Modelling in Shared Spaces : Expert-Based vs. Deep Learning Approach?. Multi-Agent-Based Simulation XXI: 21st International Workshop, MABS 2020, Revised Selected Papers. editor / Samarth Swarup ; Bastin Tony Savarimuthu. Cham : Springer Science and Business Media Deutschland GmbH, 2021. pp. 13-27 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
Download
@inproceedings{b3e0d8b2d3214706acb23b701e9543d2,
title = "Trajectory Modelling in Shared Spaces: Expert-Based vs. Deep Learning Approach?",
abstract = "Realistically modelling behaviour and interaction of heterogeneous road users (pedestrians and vehicles) in mixed-traffic zones (a.k.a. shared spaces) is challenging. The dynamic nature of the environment, heterogeneity of transport modes, and the absence of classical traffic rules make realistic microscopic traffic simulation hard problems. Existing multi-agent-based simulations of shared spaces largely use an expert-based approach, combining a symbolic (e.g. rule-based) modelling and reasoning paradigm (e.g. using BDI representations of beliefs and plans) with the hand-crafted encoding of the actual decision logic. More recently, deep learning (DL) models are largely used to derive and predict trajectories based on e.g. video data. In-depth studies comparing these two kinds of approaches are missing. In this work, we propose an expert-based model called GSFM that combines Social Force Model and Game theory and a DL model called LSTM-DBSCAN that manipulates Long Short-Term Memories and density-based clustering for multi-agent trajectory prediction. We create a common framework to run these two models in parallel to guarantee a fair comparison. Real-world mixed traffic data from shared spaces of different layout are used to calibrate/train and evaluate the models. The empirical results imply that both models can generate realistic predictions, but they differ in the way of handling collisions and mimicking heterogeneous behaviour. Via a thorough study, we draw the conclusion of their respective strengths and weaknesses.",
keywords = "Deep learning, Game theory, Mixed-traffic interaction",
author = "Hao Cheng and Johora, {Fatema T.} and Monika Sester and M{\"u}ller, {J{\"o}rg P.}",
note = "Funding Information: Supported by the German Research Foundation (DFG) through the Research Training Group SocialCars (GRK 1931). The authors thank the participants of the DFG research project MODIS (DFG project #248905318) for providing data sets. F.T. Johora and H. Cheng—Contribute equally to this work.; 20th International Workshop on Multi-Agent-Based Simulation, MABS 2020 ; Conference date: 10-05-2020 Through 10-05-2020",
year = "2021",
month = jan,
day = "19",
doi = "10.1007/978-3-030-66888-4_2",
language = "English",
isbn = "9783030668877",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Science and Business Media Deutschland GmbH",
pages = "13--27",
editor = "Samarth Swarup and Savarimuthu, {Bastin Tony}",
booktitle = "Multi-Agent-Based Simulation XXI",
address = "Germany",

}

Download

TY - GEN

T1 - Trajectory Modelling in Shared Spaces

T2 - 20th International Workshop on Multi-Agent-Based Simulation, MABS 2020

AU - Cheng, Hao

AU - Johora, Fatema T.

AU - Sester, Monika

AU - Müller, Jörg P.

N1 - Funding Information: Supported by the German Research Foundation (DFG) through the Research Training Group SocialCars (GRK 1931). The authors thank the participants of the DFG research project MODIS (DFG project #248905318) for providing data sets. F.T. Johora and H. Cheng—Contribute equally to this work.

PY - 2021/1/19

Y1 - 2021/1/19

N2 - Realistically modelling behaviour and interaction of heterogeneous road users (pedestrians and vehicles) in mixed-traffic zones (a.k.a. shared spaces) is challenging. The dynamic nature of the environment, heterogeneity of transport modes, and the absence of classical traffic rules make realistic microscopic traffic simulation hard problems. Existing multi-agent-based simulations of shared spaces largely use an expert-based approach, combining a symbolic (e.g. rule-based) modelling and reasoning paradigm (e.g. using BDI representations of beliefs and plans) with the hand-crafted encoding of the actual decision logic. More recently, deep learning (DL) models are largely used to derive and predict trajectories based on e.g. video data. In-depth studies comparing these two kinds of approaches are missing. In this work, we propose an expert-based model called GSFM that combines Social Force Model and Game theory and a DL model called LSTM-DBSCAN that manipulates Long Short-Term Memories and density-based clustering for multi-agent trajectory prediction. We create a common framework to run these two models in parallel to guarantee a fair comparison. Real-world mixed traffic data from shared spaces of different layout are used to calibrate/train and evaluate the models. The empirical results imply that both models can generate realistic predictions, but they differ in the way of handling collisions and mimicking heterogeneous behaviour. Via a thorough study, we draw the conclusion of their respective strengths and weaknesses.

AB - Realistically modelling behaviour and interaction of heterogeneous road users (pedestrians and vehicles) in mixed-traffic zones (a.k.a. shared spaces) is challenging. The dynamic nature of the environment, heterogeneity of transport modes, and the absence of classical traffic rules make realistic microscopic traffic simulation hard problems. Existing multi-agent-based simulations of shared spaces largely use an expert-based approach, combining a symbolic (e.g. rule-based) modelling and reasoning paradigm (e.g. using BDI representations of beliefs and plans) with the hand-crafted encoding of the actual decision logic. More recently, deep learning (DL) models are largely used to derive and predict trajectories based on e.g. video data. In-depth studies comparing these two kinds of approaches are missing. In this work, we propose an expert-based model called GSFM that combines Social Force Model and Game theory and a DL model called LSTM-DBSCAN that manipulates Long Short-Term Memories and density-based clustering for multi-agent trajectory prediction. We create a common framework to run these two models in parallel to guarantee a fair comparison. Real-world mixed traffic data from shared spaces of different layout are used to calibrate/train and evaluate the models. The empirical results imply that both models can generate realistic predictions, but they differ in the way of handling collisions and mimicking heterogeneous behaviour. Via a thorough study, we draw the conclusion of their respective strengths and weaknesses.

KW - Deep learning

KW - Game theory

KW - Mixed-traffic interaction

UR - http://www.scopus.com/inward/record.url?scp=85101310823&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-66888-4_2

DO - 10.1007/978-3-030-66888-4_2

M3 - Conference contribution

SN - 9783030668877

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 13

EP - 27

BT - Multi-Agent-Based Simulation XXI

A2 - Swarup, Samarth

A2 - Savarimuthu, Bastin Tony

PB - Springer Science and Business Media Deutschland GmbH

CY - Cham

Y2 - 10 May 2020 through 10 May 2020

ER -

By the same author(s)