Joint 3D estimation of vehicles and scene flow

Research output: Contribution to journalConference articleResearchpeer review

Authors

  • M. Menze
  • C. Heipke
  • A. Geiger

External Research Organisations

  • Max Planck Institute for Intelligent Systems
View graph of relations

Details

Original languageEnglish
Pages (from-to)427-434
Number of pages8
JournalISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
VolumeII-3/W5
Publication statusPublished - 20 Aug 2015
EventISPRS Geospatial Week 2015 - La Grande Motte, France
Duration: 28 Sept 20153 Oct 2015

Abstract

driving. While much progress has been made in recent years, imaging conditions in natural outdoor environments are still very challenging for current reconstruction and recognition methods. In this paper, we propose a novel unified approach which reasons jointly about 3D scene flow as well as the pose, shape and motion of vehicles in the scene. Towards this goal, we incorporate a deformable CAD model into a slanted-plane conditional random field for scene flow estimation and enforce shape consistency between the rendered 3D models and the parameters of all superpixels in the image. The association of superpixels to objects is established by an index variable which implicitly enables model selection. We evaluate our approach on the challenging KITTI scene flow dataset in terms of object and scene flow estimation. Our results provide a prove of concept and demonstrate the usefulness of our method.

Keywords

    3D Reconstruction, Active Shape Model, Motion Estimation, Object Detection, Scene Flow

ASJC Scopus subject areas

Cite this

Joint 3D estimation of vehicles and scene flow. / Menze, M.; Heipke, C.; Geiger, A.
In: ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. II-3/W5, 20.08.2015, p. 427-434.

Research output: Contribution to journalConference articleResearchpeer review

Menze, M, Heipke, C & Geiger, A 2015, 'Joint 3D estimation of vehicles and scene flow', ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. II-3/W5, pp. 427-434. https://doi.org/10.5194/isprsannals-II-3-W5-427-2015, https://doi.org/10.15488/13541
Menze, M., Heipke, C., & Geiger, A. (2015). Joint 3D estimation of vehicles and scene flow. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, II-3/W5, 427-434. https://doi.org/10.5194/isprsannals-II-3-W5-427-2015, https://doi.org/10.15488/13541
Menze M, Heipke C, Geiger A. Joint 3D estimation of vehicles and scene flow. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences. 2015 Aug 20;II-3/W5:427-434. doi: 10.5194/isprsannals-II-3-W5-427-2015, 10.15488/13541
Menze, M. ; Heipke, C. ; Geiger, A. / Joint 3D estimation of vehicles and scene flow. In: ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences. 2015 ; Vol. II-3/W5. pp. 427-434.
Download
@article{cab59581beba4d8898e2c62269446fb6,
title = "Joint 3D estimation of vehicles and scene flow",
abstract = "driving. While much progress has been made in recent years, imaging conditions in natural outdoor environments are still very challenging for current reconstruction and recognition methods. In this paper, we propose a novel unified approach which reasons jointly about 3D scene flow as well as the pose, shape and motion of vehicles in the scene. Towards this goal, we incorporate a deformable CAD model into a slanted-plane conditional random field for scene flow estimation and enforce shape consistency between the rendered 3D models and the parameters of all superpixels in the image. The association of superpixels to objects is established by an index variable which implicitly enables model selection. We evaluate our approach on the challenging KITTI scene flow dataset in terms of object and scene flow estimation. Our results provide a prove of concept and demonstrate the usefulness of our method.",
keywords = "3D Reconstruction, Active Shape Model, Motion Estimation, Object Detection, Scene Flow",
author = "M. Menze and C. Heipke and A. Geiger",
year = "2015",
month = aug,
day = "20",
doi = "10.5194/isprsannals-II-3-W5-427-2015",
language = "English",
volume = "II-3/W5",
pages = "427--434",
note = "ISPRS Geospatial Week 2015 ; Conference date: 28-09-2015 Through 03-10-2015",

}

Download

TY - JOUR

T1 - Joint 3D estimation of vehicles and scene flow

AU - Menze, M.

AU - Heipke, C.

AU - Geiger, A.

PY - 2015/8/20

Y1 - 2015/8/20

N2 - driving. While much progress has been made in recent years, imaging conditions in natural outdoor environments are still very challenging for current reconstruction and recognition methods. In this paper, we propose a novel unified approach which reasons jointly about 3D scene flow as well as the pose, shape and motion of vehicles in the scene. Towards this goal, we incorporate a deformable CAD model into a slanted-plane conditional random field for scene flow estimation and enforce shape consistency between the rendered 3D models and the parameters of all superpixels in the image. The association of superpixels to objects is established by an index variable which implicitly enables model selection. We evaluate our approach on the challenging KITTI scene flow dataset in terms of object and scene flow estimation. Our results provide a prove of concept and demonstrate the usefulness of our method.

AB - driving. While much progress has been made in recent years, imaging conditions in natural outdoor environments are still very challenging for current reconstruction and recognition methods. In this paper, we propose a novel unified approach which reasons jointly about 3D scene flow as well as the pose, shape and motion of vehicles in the scene. Towards this goal, we incorporate a deformable CAD model into a slanted-plane conditional random field for scene flow estimation and enforce shape consistency between the rendered 3D models and the parameters of all superpixels in the image. The association of superpixels to objects is established by an index variable which implicitly enables model selection. We evaluate our approach on the challenging KITTI scene flow dataset in terms of object and scene flow estimation. Our results provide a prove of concept and demonstrate the usefulness of our method.

KW - 3D Reconstruction

KW - Active Shape Model

KW - Motion Estimation

KW - Object Detection

KW - Scene Flow

UR - http://www.scopus.com/inward/record.url?scp=85014234386&partnerID=8YFLogxK

U2 - 10.5194/isprsannals-II-3-W5-427-2015

DO - 10.5194/isprsannals-II-3-W5-427-2015

M3 - Conference article

AN - SCOPUS:85014234386

VL - II-3/W5

SP - 427

EP - 434

JO - ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences

JF - ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences

SN - 2194-9042

T2 - ISPRS Geospatial Week 2015

Y2 - 28 September 2015 through 3 October 2015

ER -