Provident vehicle detection at night for advanced driver assistance systems

Publikation: Beitrag in FachzeitschriftArtikelForschungPeer-Review

Autoren

  • Lukas Ewecker
  • Ebubekir Asan
  • Lars Ohnemus
  • Sascha Saralajew

Externe Organisationen

  • Dr. Ing. h.c. F. Porsche AG
  • Robert Bosch GmbH
  • Karlsruher Institut für Technologie (KIT)
  • NEC Corporation
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Seiten (von - bis)313-335
Seitenumfang23
FachzeitschriftAutonomous robots
Jahrgang47
Ausgabenummer3
Frühes Online-Datum19 Nov. 2022
PublikationsstatusVeröffentlicht - März 2023

Abstract

In recent years, computer vision algorithms have become more powerful, which enabled technologies such as autonomous driving to evolve rapidly. However, current algorithms mainly share one limitation: They rely on directly visible objects. This is a significant drawback compared to human behavior, where visual cues caused by objects (e. g., shadows) are already used intuitively to retrieve information or anticipate occurring objects. While driving at night, this performance deficit becomes even more obvious: Humans already process the light artifacts caused by the headlamps of oncoming vehicles to estimate where they appear, whereas current object detection systems require that the oncoming vehicle is directly visible before it can be detected. Based on previous work on this subject, in this paper, we present a complete system that can detect light artifacts caused by the headlights of oncoming vehicles so that it detects that a vehicle is approaching providently (denoted as provident vehicle detection). For that, an entire algorithm architecture is investigated, including the detection in the image space, the three-dimensional localization, and the tracking of light artifacts. To demonstrate the usefulness of such an algorithm, the proposed algorithm is deployed in a test vehicle to use the detected light artifacts to control the glare-free high beam system proactively (react before the oncoming vehicle is directly visible). Using this experimental setting, the provident vehicle detection system’s time benefit compared to an in-production computer vision system is quantified. Additionally, the glare-free high beam use case provides a real-time and real-world visualization interface of the detection results by considering the adaptive headlamps as projectors. With this investigation of provident vehicle detection, we want to put awareness on the unconventional sensing task of detecting objects providently (detection based on observable visual cues the objects cause before they are visible) and further close the performance gap between human behavior and computer vision algorithms to bring autonomous and automated driving a step forward.

ASJC Scopus Sachgebiete

Zitieren

Provident vehicle detection at night for advanced driver assistance systems. / Ewecker, Lukas; Asan, Ebubekir; Ohnemus, Lars et al.
in: Autonomous robots, Jahrgang 47, Nr. 3, 03.2023, S. 313-335.

Publikation: Beitrag in FachzeitschriftArtikelForschungPeer-Review

Ewecker L, Asan E, Ohnemus L, Saralajew S. Provident vehicle detection at night for advanced driver assistance systems. Autonomous robots. 2023 Mär;47(3):313-335. Epub 2022 Nov 19. doi: 10.48550/arXiv.2107.11302, 10.1007/s10514-022-10072-7
Ewecker, Lukas ; Asan, Ebubekir ; Ohnemus, Lars et al. / Provident vehicle detection at night for advanced driver assistance systems. in: Autonomous robots. 2023 ; Jahrgang 47, Nr. 3. S. 313-335.
Download
@article{33c9b5375a92498b9216de35e603520a,
title = "Provident vehicle detection at night for advanced driver assistance systems",
abstract = "In recent years, computer vision algorithms have become more powerful, which enabled technologies such as autonomous driving to evolve rapidly. However, current algorithms mainly share one limitation: They rely on directly visible objects. This is a significant drawback compared to human behavior, where visual cues caused by objects (e. g., shadows) are already used intuitively to retrieve information or anticipate occurring objects. While driving at night, this performance deficit becomes even more obvious: Humans already process the light artifacts caused by the headlamps of oncoming vehicles to estimate where they appear, whereas current object detection systems require that the oncoming vehicle is directly visible before it can be detected. Based on previous work on this subject, in this paper, we present a complete system that can detect light artifacts caused by the headlights of oncoming vehicles so that it detects that a vehicle is approaching providently (denoted as provident vehicle detection). For that, an entire algorithm architecture is investigated, including the detection in the image space, the three-dimensional localization, and the tracking of light artifacts. To demonstrate the usefulness of such an algorithm, the proposed algorithm is deployed in a test vehicle to use the detected light artifacts to control the glare-free high beam system proactively (react before the oncoming vehicle is directly visible). Using this experimental setting, the provident vehicle detection system{\textquoteright}s time benefit compared to an in-production computer vision system is quantified. Additionally, the glare-free high beam use case provides a real-time and real-world visualization interface of the detection results by considering the adaptive headlamps as projectors. With this investigation of provident vehicle detection, we want to put awareness on the unconventional sensing task of detecting objects providently (detection based on observable visual cues the objects cause before they are visible) and further close the performance gap between human behavior and computer vision algorithms to bring autonomous and automated driving a step forward.",
keywords = "Advanced driver assistance systems, Provident object detection, Vehicle detection",
author = "Lukas Ewecker and Ebubekir Asan and Lars Ohnemus and Sascha Saralajew",
note = "Funding: Open Access funding enabled and organized by Projekt DEAL.",
year = "2023",
month = mar,
doi = "10.48550/arXiv.2107.11302",
language = "English",
volume = "47",
pages = "313--335",
journal = "Autonomous robots",
issn = "0929-5593",
publisher = "Springer Netherlands",
number = "3",

}

Download

TY - JOUR

T1 - Provident vehicle detection at night for advanced driver assistance systems

AU - Ewecker, Lukas

AU - Asan, Ebubekir

AU - Ohnemus, Lars

AU - Saralajew, Sascha

N1 - Funding: Open Access funding enabled and organized by Projekt DEAL.

PY - 2023/3

Y1 - 2023/3

N2 - In recent years, computer vision algorithms have become more powerful, which enabled technologies such as autonomous driving to evolve rapidly. However, current algorithms mainly share one limitation: They rely on directly visible objects. This is a significant drawback compared to human behavior, where visual cues caused by objects (e. g., shadows) are already used intuitively to retrieve information or anticipate occurring objects. While driving at night, this performance deficit becomes even more obvious: Humans already process the light artifacts caused by the headlamps of oncoming vehicles to estimate where they appear, whereas current object detection systems require that the oncoming vehicle is directly visible before it can be detected. Based on previous work on this subject, in this paper, we present a complete system that can detect light artifacts caused by the headlights of oncoming vehicles so that it detects that a vehicle is approaching providently (denoted as provident vehicle detection). For that, an entire algorithm architecture is investigated, including the detection in the image space, the three-dimensional localization, and the tracking of light artifacts. To demonstrate the usefulness of such an algorithm, the proposed algorithm is deployed in a test vehicle to use the detected light artifacts to control the glare-free high beam system proactively (react before the oncoming vehicle is directly visible). Using this experimental setting, the provident vehicle detection system’s time benefit compared to an in-production computer vision system is quantified. Additionally, the glare-free high beam use case provides a real-time and real-world visualization interface of the detection results by considering the adaptive headlamps as projectors. With this investigation of provident vehicle detection, we want to put awareness on the unconventional sensing task of detecting objects providently (detection based on observable visual cues the objects cause before they are visible) and further close the performance gap between human behavior and computer vision algorithms to bring autonomous and automated driving a step forward.

AB - In recent years, computer vision algorithms have become more powerful, which enabled technologies such as autonomous driving to evolve rapidly. However, current algorithms mainly share one limitation: They rely on directly visible objects. This is a significant drawback compared to human behavior, where visual cues caused by objects (e. g., shadows) are already used intuitively to retrieve information or anticipate occurring objects. While driving at night, this performance deficit becomes even more obvious: Humans already process the light artifacts caused by the headlamps of oncoming vehicles to estimate where they appear, whereas current object detection systems require that the oncoming vehicle is directly visible before it can be detected. Based on previous work on this subject, in this paper, we present a complete system that can detect light artifacts caused by the headlights of oncoming vehicles so that it detects that a vehicle is approaching providently (denoted as provident vehicle detection). For that, an entire algorithm architecture is investigated, including the detection in the image space, the three-dimensional localization, and the tracking of light artifacts. To demonstrate the usefulness of such an algorithm, the proposed algorithm is deployed in a test vehicle to use the detected light artifacts to control the glare-free high beam system proactively (react before the oncoming vehicle is directly visible). Using this experimental setting, the provident vehicle detection system’s time benefit compared to an in-production computer vision system is quantified. Additionally, the glare-free high beam use case provides a real-time and real-world visualization interface of the detection results by considering the adaptive headlamps as projectors. With this investigation of provident vehicle detection, we want to put awareness on the unconventional sensing task of detecting objects providently (detection based on observable visual cues the objects cause before they are visible) and further close the performance gap between human behavior and computer vision algorithms to bring autonomous and automated driving a step forward.

KW - Advanced driver assistance systems

KW - Provident object detection

KW - Vehicle detection

UR - http://www.scopus.com/inward/record.url?scp=85142258652&partnerID=8YFLogxK

U2 - 10.48550/arXiv.2107.11302

DO - 10.48550/arXiv.2107.11302

M3 - Article

AN - SCOPUS:85142258652

VL - 47

SP - 313

EP - 335

JO - Autonomous robots

JF - Autonomous robots

SN - 0929-5593

IS - 3

ER -