Comap: A synthetic dataset for collective multi-agent perception of autonomous driving

Publikation: Beitrag in FachzeitschriftKonferenzaufsatz in FachzeitschriftForschungPeer-Review

Autoren

Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Seiten (von - bis)255-263
Seitenumfang9
FachzeitschriftInternational Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives
Jahrgang43
AusgabenummerB2-2021
PublikationsstatusVeröffentlicht - 28 Juni 2021
Veranstaltung2021 24th ISPRS Congress Commission II: Imaging Today, Foreseeing Tomorrow - Virtual, Online, Frankreich
Dauer: 5 Juli 20219 Juli 2021

Abstract

Collective perception of connected vehicles can sufficiently increase the safety and reliability of autonomous driving by sharing perception information. However, collecting real experimental data for such scenarios is extremely expensive. Therefore, we built a computational efficient co-simulation synthetic data generator through CARLA and SUMO simulators. The simulated data contain image and point cloud data as well as ground truth for object detection and semantic segmentation tasks. To verify the superior performance gain of collective perception over single-vehicle perception, we conducted experiments of vehicle detection, which is one of the most important perception tasks for autonomous driving, on this data set. A 3D object detector and a Bird's Eye View (BEV) detector are trained and then test with different configurations of the number of cooperative vehicles and vehicle communication ranges. The experiment results showed that collective perception can not only dramatically increase the overall mean detection accuracy but also the localization accuracy of detected bounding boxes. Besides, a vehicle detection comparison experiment showed that the detection performance drop caused by sensor observation noise can be canceled out by redundant information collected by multiple vehicles.

ASJC Scopus Sachgebiete

Zitieren

Comap: A synthetic dataset for collective multi-agent perception of autonomous driving. / Yuan, Y.; Sester, M.
in: International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives, Jahrgang 43, Nr. B2-2021, 28.06.2021, S. 255-263.

Publikation: Beitrag in FachzeitschriftKonferenzaufsatz in FachzeitschriftForschungPeer-Review

Yuan, Y & Sester, M 2021, 'Comap: A synthetic dataset for collective multi-agent perception of autonomous driving', International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives, Jg. 43, Nr. B2-2021, S. 255-263. https://doi.org/10.5194/isprs-archives-XLIII-B2-2021-255-2021
Yuan, Y., & Sester, M. (2021). Comap: A synthetic dataset for collective multi-agent perception of autonomous driving. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives, 43(B2-2021), 255-263. https://doi.org/10.5194/isprs-archives-XLIII-B2-2021-255-2021
Yuan Y, Sester M. Comap: A synthetic dataset for collective multi-agent perception of autonomous driving. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives. 2021 Jun 28;43(B2-2021):255-263. doi: 10.5194/isprs-archives-XLIII-B2-2021-255-2021
Yuan, Y. ; Sester, M. / Comap : A synthetic dataset for collective multi-agent perception of autonomous driving. in: International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives. 2021 ; Jahrgang 43, Nr. B2-2021. S. 255-263.
Download
@article{3b9f87ec77344782bf28dad1a2edabab,
title = "Comap: A synthetic dataset for collective multi-agent perception of autonomous driving",
abstract = "Collective perception of connected vehicles can sufficiently increase the safety and reliability of autonomous driving by sharing perception information. However, collecting real experimental data for such scenarios is extremely expensive. Therefore, we built a computational efficient co-simulation synthetic data generator through CARLA and SUMO simulators. The simulated data contain image and point cloud data as well as ground truth for object detection and semantic segmentation tasks. To verify the superior performance gain of collective perception over single-vehicle perception, we conducted experiments of vehicle detection, which is one of the most important perception tasks for autonomous driving, on this data set. A 3D object detector and a Bird's Eye View (BEV) detector are trained and then test with different configurations of the number of cooperative vehicles and vehicle communication ranges. The experiment results showed that collective perception can not only dramatically increase the overall mean detection accuracy but also the localization accuracy of detected bounding boxes. Besides, a vehicle detection comparison experiment showed that the detection performance drop caused by sensor observation noise can be canceled out by redundant information collected by multiple vehicles. ",
keywords = "3D Object Detection, Collective Perception, Data Fusion, Point Cloud, Semantic Segmentation, Simulation, Uncertainty Estimation",
author = "Y. Yuan and M. Sester",
year = "2021",
month = jun,
day = "28",
doi = "10.5194/isprs-archives-XLIII-B2-2021-255-2021",
language = "English",
volume = "43",
pages = "255--263",
number = "B2-2021",
note = "2021 24th ISPRS Congress Commission II: Imaging Today, Foreseeing Tomorrow ; Conference date: 05-07-2021 Through 09-07-2021",

}

Download

TY - JOUR

T1 - Comap

T2 - 2021 24th ISPRS Congress Commission II: Imaging Today, Foreseeing Tomorrow

AU - Yuan, Y.

AU - Sester, M.

PY - 2021/6/28

Y1 - 2021/6/28

N2 - Collective perception of connected vehicles can sufficiently increase the safety and reliability of autonomous driving by sharing perception information. However, collecting real experimental data for such scenarios is extremely expensive. Therefore, we built a computational efficient co-simulation synthetic data generator through CARLA and SUMO simulators. The simulated data contain image and point cloud data as well as ground truth for object detection and semantic segmentation tasks. To verify the superior performance gain of collective perception over single-vehicle perception, we conducted experiments of vehicle detection, which is one of the most important perception tasks for autonomous driving, on this data set. A 3D object detector and a Bird's Eye View (BEV) detector are trained and then test with different configurations of the number of cooperative vehicles and vehicle communication ranges. The experiment results showed that collective perception can not only dramatically increase the overall mean detection accuracy but also the localization accuracy of detected bounding boxes. Besides, a vehicle detection comparison experiment showed that the detection performance drop caused by sensor observation noise can be canceled out by redundant information collected by multiple vehicles.

AB - Collective perception of connected vehicles can sufficiently increase the safety and reliability of autonomous driving by sharing perception information. However, collecting real experimental data for such scenarios is extremely expensive. Therefore, we built a computational efficient co-simulation synthetic data generator through CARLA and SUMO simulators. The simulated data contain image and point cloud data as well as ground truth for object detection and semantic segmentation tasks. To verify the superior performance gain of collective perception over single-vehicle perception, we conducted experiments of vehicle detection, which is one of the most important perception tasks for autonomous driving, on this data set. A 3D object detector and a Bird's Eye View (BEV) detector are trained and then test with different configurations of the number of cooperative vehicles and vehicle communication ranges. The experiment results showed that collective perception can not only dramatically increase the overall mean detection accuracy but also the localization accuracy of detected bounding boxes. Besides, a vehicle detection comparison experiment showed that the detection performance drop caused by sensor observation noise can be canceled out by redundant information collected by multiple vehicles.

KW - 3D Object Detection

KW - Collective Perception

KW - Data Fusion

KW - Point Cloud

KW - Semantic Segmentation

KW - Simulation

KW - Uncertainty Estimation

UR - http://www.scopus.com/inward/record.url?scp=85116028629&partnerID=8YFLogxK

U2 - 10.5194/isprs-archives-XLIII-B2-2021-255-2021

DO - 10.5194/isprs-archives-XLIII-B2-2021-255-2021

M3 - Conference article

AN - SCOPUS:85116028629

VL - 43

SP - 255

EP - 263

JO - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives

JF - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives

SN - 1682-1750

IS - B2-2021

Y2 - 5 July 2021 through 9 July 2021

ER -

Von denselben Autoren