ZuSE KI-AVF: Application-Specific AI Processor for Intelligent Sensor Signal Processing in Autonomous Driving

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autoren

  • Gia Bao Thieu
  • Sven Gesper
  • Guillermo Payá-Vayá
  • Christoph Riggers
  • Oliver Renke
  • Till Niklas Fiedler
  • Jakob Marten
  • Tobias Stuckenberg
  • Holger Blume
  • Christian Weis
  • Lukas Steinert
  • Chirag Sudarshan
  • Norbert Wehn
  • Lennart M. Reimann
  • Rainer Leupers
  • Michael Beyer
  • Daniel Köhler
  • Alisa Jauch
  • Jan Micha Borrmann
  • Setareh Jaberansari
  • Tim Berthold
  • Meinolf Blawat
  • Markus Kock
  • Gregor Schewior
  • Jens Benndorf
  • Frederik Kautz
  • Hans-Martin Bluethgen
  • Christian Sauer

Externe Organisationen

  • Rheinisch-Westfälische Technische Hochschule Aachen (RWTH)
  • Robert Bosch GmbH
  • Dream Chip Technologies GmbH
  • Cadence Design Systems
  • Technische Universität Braunschweig
  • Technische Universität Kaiserslautern
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des Sammelwerks2023 Design, Automation and Test in Europe Conference and Exhibition, DATE 2023 - Proceedings
ISBN (elektronisch)9783981926378
PublikationsstatusVeröffentlicht - 2023

Publikationsreihe

NameDesign, automation and test in Europe conference
ISSN (Print)1530-1591
ISSN (elektronisch)1558-1101

Abstract

Modern and future AI-based automotive applications, such as autonomous driving, require the efficient real-time processing of huge amounts of data from different sensors, like camera, radar, and LiDAR. In the ZuSE-KI-AVF project, multiple university, and industry partners collaborate to develop a novel massive parallel processor architecture, based on a cus-tomized RISC-V host processor, and an efficient high-performance vertical vector coprocessor. In addition, a software development framework is also provided to efficiently program AI-based sensor processing applications. The proposed processor system was verified and evaluated on a state-of-the-art UltraScale+ FPGA board, reaching a processing performance of up to 126.9 FPS, while executing the YOLO-LITE CNN on 224x224 input images. Further optimizations of the FPGA design and the realization of the processor system on a 22nm FDSOI CMOS technology are planned.

ASJC Scopus Sachgebiete

Zitieren

ZuSE KI-AVF: Application-Specific AI Processor for Intelligent Sensor Signal Processing in Autonomous Driving. / Thieu, Gia Bao; Gesper, Sven; Payá-Vayá, Guillermo et al.
2023 Design, Automation and Test in Europe Conference and Exhibition, DATE 2023 - Proceedings. 2023. (Design, automation and test in Europe conference).

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Thieu, GB, Gesper, S, Payá-Vayá, G, Riggers, C, Renke, O, Fiedler, TN, Marten, J, Stuckenberg, T, Blume, H, Weis, C, Steinert, L, Sudarshan, C, Wehn, N, Reimann, LM, Leupers, R, Beyer, M, Köhler, D, Jauch, A, Borrmann, JM, Jaberansari, S, Berthold, T, Blawat, M, Kock, M, Schewior, G, Benndorf, J, Kautz, F, Bluethgen, H-M & Sauer, C 2023, ZuSE KI-AVF: Application-Specific AI Processor for Intelligent Sensor Signal Processing in Autonomous Driving. in 2023 Design, Automation and Test in Europe Conference and Exhibition, DATE 2023 - Proceedings. Design, automation and test in Europe conference. https://doi.org/10.23919/date56975.2023.10136978
Thieu, G. B., Gesper, S., Payá-Vayá, G., Riggers, C., Renke, O., Fiedler, T. N., Marten, J., Stuckenberg, T., Blume, H., Weis, C., Steinert, L., Sudarshan, C., Wehn, N., Reimann, L. M., Leupers, R., Beyer, M., Köhler, D., Jauch, A., Borrmann, J. M., ... Sauer, C. (2023). ZuSE KI-AVF: Application-Specific AI Processor for Intelligent Sensor Signal Processing in Autonomous Driving. In 2023 Design, Automation and Test in Europe Conference and Exhibition, DATE 2023 - Proceedings (Design, automation and test in Europe conference). https://doi.org/10.23919/date56975.2023.10136978
Thieu GB, Gesper S, Payá-Vayá G, Riggers C, Renke O, Fiedler TN et al. ZuSE KI-AVF: Application-Specific AI Processor for Intelligent Sensor Signal Processing in Autonomous Driving. in 2023 Design, Automation and Test in Europe Conference and Exhibition, DATE 2023 - Proceedings. 2023. (Design, automation and test in Europe conference). doi: 10.23919/date56975.2023.10136978
Thieu, Gia Bao ; Gesper, Sven ; Payá-Vayá, Guillermo et al. / ZuSE KI-AVF : Application-Specific AI Processor for Intelligent Sensor Signal Processing in Autonomous Driving. 2023 Design, Automation and Test in Europe Conference and Exhibition, DATE 2023 - Proceedings. 2023. (Design, automation and test in Europe conference).
Download
@inproceedings{df2f8f134ccc4510aa65ca01e42442d9,
title = "ZuSE KI-AVF: Application-Specific AI Processor for Intelligent Sensor Signal Processing in Autonomous Driving",
abstract = "Modern and future AI-based automotive applications, such as autonomous driving, require the efficient real-time processing of huge amounts of data from different sensors, like camera, radar, and LiDAR. In the ZuSE-KI-AVF project, multiple university, and industry partners collaborate to develop a novel massive parallel processor architecture, based on a cus-tomized RISC-V host processor, and an efficient high-performance vertical vector coprocessor. In addition, a software development framework is also provided to efficiently program AI-based sensor processing applications. The proposed processor system was verified and evaluated on a state-of-the-art UltraScale+ FPGA board, reaching a processing performance of up to 126.9 FPS, while executing the YOLO-LITE CNN on 224x224 input images. Further optimizations of the FPGA design and the realization of the processor system on a 22nm FDSOI CMOS technology are planned.",
keywords = "AI acceleration, ASIC, FPGA, RISC-V, hardware-software system, sensor processing, vertical vector processor",
author = "Thieu, {Gia Bao} and Sven Gesper and Guillermo Pay{\'a}-Vay{\'a} and Christoph Riggers and Oliver Renke and Fiedler, {Till Niklas} and Jakob Marten and Tobias Stuckenberg and Holger Blume and Christian Weis and Lukas Steinert and Chirag Sudarshan and Norbert Wehn and Reimann, {Lennart M.} and Rainer Leupers and Michael Beyer and Daniel K{\"o}hler and Alisa Jauch and Borrmann, {Jan Micha} and Setareh Jaberansari and Tim Berthold and Meinolf Blawat and Markus Kock and Gregor Schewior and Jens Benndorf and Frederik Kautz and Hans-Martin Bluethgen and Christian Sauer",
note = "Funding Information: ACKNOWLEDGMENT The work is supported in part by the German Federal Ministry of Education and Research (BMBF) within the project ZuSE-KI-AVF under contract no. 16ME0379.",
year = "2023",
doi = "10.23919/date56975.2023.10136978",
language = "English",
isbn = "979-8-3503-9624-9",
series = "Design, automation and test in Europe conference",
booktitle = "2023 Design, Automation and Test in Europe Conference and Exhibition, DATE 2023 - Proceedings",

}

Download

TY - GEN

T1 - ZuSE KI-AVF

T2 - Application-Specific AI Processor for Intelligent Sensor Signal Processing in Autonomous Driving

AU - Thieu, Gia Bao

AU - Gesper, Sven

AU - Payá-Vayá, Guillermo

AU - Riggers, Christoph

AU - Renke, Oliver

AU - Fiedler, Till Niklas

AU - Marten, Jakob

AU - Stuckenberg, Tobias

AU - Blume, Holger

AU - Weis, Christian

AU - Steinert, Lukas

AU - Sudarshan, Chirag

AU - Wehn, Norbert

AU - Reimann, Lennart M.

AU - Leupers, Rainer

AU - Beyer, Michael

AU - Köhler, Daniel

AU - Jauch, Alisa

AU - Borrmann, Jan Micha

AU - Jaberansari, Setareh

AU - Berthold, Tim

AU - Blawat, Meinolf

AU - Kock, Markus

AU - Schewior, Gregor

AU - Benndorf, Jens

AU - Kautz, Frederik

AU - Bluethgen, Hans-Martin

AU - Sauer, Christian

N1 - Funding Information: ACKNOWLEDGMENT The work is supported in part by the German Federal Ministry of Education and Research (BMBF) within the project ZuSE-KI-AVF under contract no. 16ME0379.

PY - 2023

Y1 - 2023

N2 - Modern and future AI-based automotive applications, such as autonomous driving, require the efficient real-time processing of huge amounts of data from different sensors, like camera, radar, and LiDAR. In the ZuSE-KI-AVF project, multiple university, and industry partners collaborate to develop a novel massive parallel processor architecture, based on a cus-tomized RISC-V host processor, and an efficient high-performance vertical vector coprocessor. In addition, a software development framework is also provided to efficiently program AI-based sensor processing applications. The proposed processor system was verified and evaluated on a state-of-the-art UltraScale+ FPGA board, reaching a processing performance of up to 126.9 FPS, while executing the YOLO-LITE CNN on 224x224 input images. Further optimizations of the FPGA design and the realization of the processor system on a 22nm FDSOI CMOS technology are planned.

AB - Modern and future AI-based automotive applications, such as autonomous driving, require the efficient real-time processing of huge amounts of data from different sensors, like camera, radar, and LiDAR. In the ZuSE-KI-AVF project, multiple university, and industry partners collaborate to develop a novel massive parallel processor architecture, based on a cus-tomized RISC-V host processor, and an efficient high-performance vertical vector coprocessor. In addition, a software development framework is also provided to efficiently program AI-based sensor processing applications. The proposed processor system was verified and evaluated on a state-of-the-art UltraScale+ FPGA board, reaching a processing performance of up to 126.9 FPS, while executing the YOLO-LITE CNN on 224x224 input images. Further optimizations of the FPGA design and the realization of the processor system on a 22nm FDSOI CMOS technology are planned.

KW - AI acceleration

KW - ASIC

KW - FPGA

KW - RISC-V

KW - hardware-software system

KW - sensor processing

KW - vertical vector processor

UR - http://www.scopus.com/inward/record.url?scp=85162648667&partnerID=8YFLogxK

U2 - 10.23919/date56975.2023.10136978

DO - 10.23919/date56975.2023.10136978

M3 - Conference contribution

SN - 979-8-3503-9624-9

T3 - Design, automation and test in Europe conference

BT - 2023 Design, Automation and Test in Europe Conference and Exhibition, DATE 2023 - Proceedings

ER -

Von denselben Autoren