Joint 3D estimation of vehicles and scene flow

Publikation: Beitrag in FachzeitschriftKonferenzaufsatz in FachzeitschriftForschungPeer-Review

Autoren

  • M. Menze
  • C. Heipke
  • A. Geiger

Externe Organisationen

  • Max-Planck-Institut für Intelligente Systeme (Stuttgart)
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Seiten (von - bis)427-434
Seitenumfang8
FachzeitschriftISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
JahrgangII-3/W5
PublikationsstatusVeröffentlicht - 20 Aug. 2015
VeranstaltungISPRS Geospatial Week 2015 - La Grande Motte, Frankreich
Dauer: 28 Sept. 20153 Okt. 2015

Abstract

driving. While much progress has been made in recent years, imaging conditions in natural outdoor environments are still very challenging for current reconstruction and recognition methods. In this paper, we propose a novel unified approach which reasons jointly about 3D scene flow as well as the pose, shape and motion of vehicles in the scene. Towards this goal, we incorporate a deformable CAD model into a slanted-plane conditional random field for scene flow estimation and enforce shape consistency between the rendered 3D models and the parameters of all superpixels in the image. The association of superpixels to objects is established by an index variable which implicitly enables model selection. We evaluate our approach on the challenging KITTI scene flow dataset in terms of object and scene flow estimation. Our results provide a prove of concept and demonstrate the usefulness of our method.

ASJC Scopus Sachgebiete

Zitieren

Joint 3D estimation of vehicles and scene flow. / Menze, M.; Heipke, C.; Geiger, A.
in: ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Jahrgang II-3/W5, 20.08.2015, S. 427-434.

Publikation: Beitrag in FachzeitschriftKonferenzaufsatz in FachzeitschriftForschungPeer-Review

Menze, M, Heipke, C & Geiger, A 2015, 'Joint 3D estimation of vehicles and scene flow', ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Jg. II-3/W5, S. 427-434. https://doi.org/10.5194/isprsannals-II-3-W5-427-2015, https://doi.org/10.15488/13541
Menze, M., Heipke, C., & Geiger, A. (2015). Joint 3D estimation of vehicles and scene flow. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, II-3/W5, 427-434. https://doi.org/10.5194/isprsannals-II-3-W5-427-2015, https://doi.org/10.15488/13541
Menze M, Heipke C, Geiger A. Joint 3D estimation of vehicles and scene flow. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences. 2015 Aug 20;II-3/W5:427-434. doi: 10.5194/isprsannals-II-3-W5-427-2015, 10.15488/13541
Menze, M. ; Heipke, C. ; Geiger, A. / Joint 3D estimation of vehicles and scene flow. in: ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences. 2015 ; Jahrgang II-3/W5. S. 427-434.
Download
@article{cab59581beba4d8898e2c62269446fb6,
title = "Joint 3D estimation of vehicles and scene flow",
abstract = "driving. While much progress has been made in recent years, imaging conditions in natural outdoor environments are still very challenging for current reconstruction and recognition methods. In this paper, we propose a novel unified approach which reasons jointly about 3D scene flow as well as the pose, shape and motion of vehicles in the scene. Towards this goal, we incorporate a deformable CAD model into a slanted-plane conditional random field for scene flow estimation and enforce shape consistency between the rendered 3D models and the parameters of all superpixels in the image. The association of superpixels to objects is established by an index variable which implicitly enables model selection. We evaluate our approach on the challenging KITTI scene flow dataset in terms of object and scene flow estimation. Our results provide a prove of concept and demonstrate the usefulness of our method.",
keywords = "3D Reconstruction, Active Shape Model, Motion Estimation, Object Detection, Scene Flow",
author = "M. Menze and C. Heipke and A. Geiger",
year = "2015",
month = aug,
day = "20",
doi = "10.5194/isprsannals-II-3-W5-427-2015",
language = "English",
volume = "II-3/W5",
pages = "427--434",
note = "ISPRS Geospatial Week 2015 ; Conference date: 28-09-2015 Through 03-10-2015",

}

Download

TY - JOUR

T1 - Joint 3D estimation of vehicles and scene flow

AU - Menze, M.

AU - Heipke, C.

AU - Geiger, A.

PY - 2015/8/20

Y1 - 2015/8/20

N2 - driving. While much progress has been made in recent years, imaging conditions in natural outdoor environments are still very challenging for current reconstruction and recognition methods. In this paper, we propose a novel unified approach which reasons jointly about 3D scene flow as well as the pose, shape and motion of vehicles in the scene. Towards this goal, we incorporate a deformable CAD model into a slanted-plane conditional random field for scene flow estimation and enforce shape consistency between the rendered 3D models and the parameters of all superpixels in the image. The association of superpixels to objects is established by an index variable which implicitly enables model selection. We evaluate our approach on the challenging KITTI scene flow dataset in terms of object and scene flow estimation. Our results provide a prove of concept and demonstrate the usefulness of our method.

AB - driving. While much progress has been made in recent years, imaging conditions in natural outdoor environments are still very challenging for current reconstruction and recognition methods. In this paper, we propose a novel unified approach which reasons jointly about 3D scene flow as well as the pose, shape and motion of vehicles in the scene. Towards this goal, we incorporate a deformable CAD model into a slanted-plane conditional random field for scene flow estimation and enforce shape consistency between the rendered 3D models and the parameters of all superpixels in the image. The association of superpixels to objects is established by an index variable which implicitly enables model selection. We evaluate our approach on the challenging KITTI scene flow dataset in terms of object and scene flow estimation. Our results provide a prove of concept and demonstrate the usefulness of our method.

KW - 3D Reconstruction

KW - Active Shape Model

KW - Motion Estimation

KW - Object Detection

KW - Scene Flow

UR - http://www.scopus.com/inward/record.url?scp=85014234386&partnerID=8YFLogxK

U2 - 10.5194/isprsannals-II-3-W5-427-2015

DO - 10.5194/isprsannals-II-3-W5-427-2015

M3 - Conference article

AN - SCOPUS:85014234386

VL - II-3/W5

SP - 427

EP - 434

JO - ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences

JF - ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences

SN - 2194-9042

T2 - ISPRS Geospatial Week 2015

Y2 - 28 September 2015 through 3 October 2015

ER -