Recovering the 3D pose and shape of vehicles from stereo images

Publikation: Beitrag in FachzeitschriftKonferenzaufsatz in FachzeitschriftForschungPeer-Review

Autorschaft

Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Seiten (von - bis)73-80
Seitenumfang8
FachzeitschriftISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Jahrgang4
Ausgabenummer2
PublikationsstatusVeröffentlicht - 28 Mai 2018
Veranstaltung2018 ISPRS TC II Mid-term Symposium "Towards Photogrammetry 2020" - Riva del Garda, Italien
Dauer: 4 Juni 20187 Juni 2018

Abstract

The precise reconstruction and pose estimation of vehicles plays an important role, e.g. for autonomous driving. We tackle this problem on the basis of street level stereo images obtained from a moving vehicle. Starting from initial vehicle detections, we use a deformable vehicle shape prior learned from CAD vehicle data to fully reconstruct the vehicles in 3D and to recover their 3D pose and shape. To fit a deformable vehicle model to each detection by inferring the optimal parameters for pose and shape, we define an energy function leveraging reconstructed 3D data, image information, the vehicle model and derived scene knowledge. To minimise the energy function, we apply a robust model fitting procedure based on iterative Monte Carlo model particle sampling. We evaluate our approach using the object detection and orientation estimation benchmark of the KITTI dataset (Geiger et al., 2012). Our approach can deal with very coarse pose initialisations and we achieve encouraging results with up to 82 % correct pose estimations. Moreover, we are able to deliver very precise orientation estimation results with an average absolute error smaller than 4°.

ASJC Scopus Sachgebiete

Zitieren

Recovering the 3D pose and shape of vehicles from stereo images. / Coenen, M.; Rottensteiner, F.; Heipke, C.
in: ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Jahrgang 4, Nr. 2, 28.05.2018, S. 73-80.

Publikation: Beitrag in FachzeitschriftKonferenzaufsatz in FachzeitschriftForschungPeer-Review

Coenen, M, Rottensteiner, F & Heipke, C 2018, 'Recovering the 3D pose and shape of vehicles from stereo images', ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Jg. 4, Nr. 2, S. 73-80. https://doi.org/10.5194/isprs-annals-IV-2-73-2018
Coenen, M., Rottensteiner, F., & Heipke, C. (2018). Recovering the 3D pose and shape of vehicles from stereo images. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 4(2), 73-80. https://doi.org/10.5194/isprs-annals-IV-2-73-2018
Coenen M, Rottensteiner F, Heipke C. Recovering the 3D pose and shape of vehicles from stereo images. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences. 2018 Mai 28;4(2):73-80. doi: 10.5194/isprs-annals-IV-2-73-2018
Coenen, M. ; Rottensteiner, F. ; Heipke, C. / Recovering the 3D pose and shape of vehicles from stereo images. in: ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences. 2018 ; Jahrgang 4, Nr. 2. S. 73-80.
Download
@article{a3a086f3bc43422891ae2ec6f84beac4,
title = "Recovering the 3D pose and shape of vehicles from stereo images",
abstract = "The precise reconstruction and pose estimation of vehicles plays an important role, e.g. for autonomous driving. We tackle this problem on the basis of street level stereo images obtained from a moving vehicle. Starting from initial vehicle detections, we use a deformable vehicle shape prior learned from CAD vehicle data to fully reconstruct the vehicles in 3D and to recover their 3D pose and shape. To fit a deformable vehicle model to each detection by inferring the optimal parameters for pose and shape, we define an energy function leveraging reconstructed 3D data, image information, the vehicle model and derived scene knowledge. To minimise the energy function, we apply a robust model fitting procedure based on iterative Monte Carlo model particle sampling. We evaluate our approach using the object detection and orientation estimation benchmark of the KITTI dataset (Geiger et al., 2012). Our approach can deal with very coarse pose initialisations and we achieve encouraging results with up to 82 % correct pose estimations. Moreover, we are able to deliver very precise orientation estimation results with an average absolute error smaller than 4°.",
keywords = "3D Modelling, 3D Reconstruction, Active Shape Model, Object Detection, Pose Estimation, Stereo Images",
author = "M. Coenen and F. Rottensteiner and C. Heipke",
note = "Funding Information: This work was supported by the German Research Foundation (DFG) as a part of the Research Training Group i.c.sens [GRK2159].; 2018 ISPRS TC II Mid-term Symposium {"}Towards Photogrammetry 2020{"} ; Conference date: 04-06-2018 Through 07-06-2018",
year = "2018",
month = may,
day = "28",
doi = "10.5194/isprs-annals-IV-2-73-2018",
language = "English",
volume = "4",
pages = "73--80",
number = "2",

}

Download

TY - JOUR

T1 - Recovering the 3D pose and shape of vehicles from stereo images

AU - Coenen, M.

AU - Rottensteiner, F.

AU - Heipke, C.

N1 - Funding Information: This work was supported by the German Research Foundation (DFG) as a part of the Research Training Group i.c.sens [GRK2159].

PY - 2018/5/28

Y1 - 2018/5/28

N2 - The precise reconstruction and pose estimation of vehicles plays an important role, e.g. for autonomous driving. We tackle this problem on the basis of street level stereo images obtained from a moving vehicle. Starting from initial vehicle detections, we use a deformable vehicle shape prior learned from CAD vehicle data to fully reconstruct the vehicles in 3D and to recover their 3D pose and shape. To fit a deformable vehicle model to each detection by inferring the optimal parameters for pose and shape, we define an energy function leveraging reconstructed 3D data, image information, the vehicle model and derived scene knowledge. To minimise the energy function, we apply a robust model fitting procedure based on iterative Monte Carlo model particle sampling. We evaluate our approach using the object detection and orientation estimation benchmark of the KITTI dataset (Geiger et al., 2012). Our approach can deal with very coarse pose initialisations and we achieve encouraging results with up to 82 % correct pose estimations. Moreover, we are able to deliver very precise orientation estimation results with an average absolute error smaller than 4°.

AB - The precise reconstruction and pose estimation of vehicles plays an important role, e.g. for autonomous driving. We tackle this problem on the basis of street level stereo images obtained from a moving vehicle. Starting from initial vehicle detections, we use a deformable vehicle shape prior learned from CAD vehicle data to fully reconstruct the vehicles in 3D and to recover their 3D pose and shape. To fit a deformable vehicle model to each detection by inferring the optimal parameters for pose and shape, we define an energy function leveraging reconstructed 3D data, image information, the vehicle model and derived scene knowledge. To minimise the energy function, we apply a robust model fitting procedure based on iterative Monte Carlo model particle sampling. We evaluate our approach using the object detection and orientation estimation benchmark of the KITTI dataset (Geiger et al., 2012). Our approach can deal with very coarse pose initialisations and we achieve encouraging results with up to 82 % correct pose estimations. Moreover, we are able to deliver very precise orientation estimation results with an average absolute error smaller than 4°.

KW - 3D Modelling

KW - 3D Reconstruction

KW - Active Shape Model

KW - Object Detection

KW - Pose Estimation

KW - Stereo Images

UR - http://www.scopus.com/inward/record.url?scp=85048426161&partnerID=8YFLogxK

U2 - 10.5194/isprs-annals-IV-2-73-2018

DO - 10.5194/isprs-annals-IV-2-73-2018

M3 - Conference article

AN - SCOPUS:85048426161

VL - 4

SP - 73

EP - 80

JO - ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences

JF - ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences

SN - 2194-9042

IS - 2

T2 - 2018 ISPRS TC II Mid-term Symposium "Towards Photogrammetry 2020"

Y2 - 4 June 2018 through 7 June 2018

ER -

Von denselben Autoren