Multimodal Dense Stereo Matching

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

View graph of relations

Details

Original languageEnglish
Title of host publicationPattern Recognition - 40th German Conference, GCPR 2018, Proceedings
EditorsAndrés Bruhn, Mario Fritz, Thomas Brox
PublisherSpringer Verlag
Pages407-421
Number of pages15
ISBN (print)9783030129385
Publication statusPublished - 9 Oct 2018
Event40th German Conference on Pattern Recognition, GCPR 2018 - Stuttgart, Germany
Duration: 9 Oct 201812 Oct 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11269 LNCS
ISSN (Print)0302-9743
ISSN (electronic)1611-3349

Abstract

In this paper, we propose a new approach for dense depth estimation based on multimodal stereo images. Our approach employs a combined cost function utilizing robust metrics and a transformation to an illumination independent representation. Additionally, we present a confidence based weighting scheme which allows a pixel-wise weight adjustment within the cost function. We demonstrate the capabilities of our approach using RGB- and thermal images. The resulting depth maps are evaluated by comparing them to depth measurements of a Velodyne HDL-64E LiDAR sensor. We show that our method outperforms current state of the art dense matching methods regarding depth estimation based on multimodal input images.

ASJC Scopus subject areas

Cite this

Multimodal Dense Stereo Matching. / Mehltretter, Max; Kleinschmidt, Sebastian P.; Wagner, Bernardo et al.
Pattern Recognition - 40th German Conference, GCPR 2018, Proceedings. ed. / Andrés Bruhn; Mario Fritz; Thomas Brox. Springer Verlag, 2018. p. 407-421 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11269 LNCS).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Mehltretter, M, Kleinschmidt, SP, Wagner, B & Heipke, C 2018, Multimodal Dense Stereo Matching. in A Bruhn, M Fritz & T Brox (eds), Pattern Recognition - 40th German Conference, GCPR 2018, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11269 LNCS, Springer Verlag, pp. 407-421, 40th German Conference on Pattern Recognition, GCPR 2018, Stuttgart, Germany, 9 Oct 2018. https://doi.org/10.1007/978-3-030-12939-2_28
Mehltretter, M., Kleinschmidt, S. P., Wagner, B., & Heipke, C. (2018). Multimodal Dense Stereo Matching. In A. Bruhn, M. Fritz, & T. Brox (Eds.), Pattern Recognition - 40th German Conference, GCPR 2018, Proceedings (pp. 407-421). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11269 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-030-12939-2_28
Mehltretter M, Kleinschmidt SP, Wagner B, Heipke C. Multimodal Dense Stereo Matching. In Bruhn A, Fritz M, Brox T, editors, Pattern Recognition - 40th German Conference, GCPR 2018, Proceedings. Springer Verlag. 2018. p. 407-421. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-030-12939-2_28
Mehltretter, Max ; Kleinschmidt, Sebastian P. ; Wagner, Bernardo et al. / Multimodal Dense Stereo Matching. Pattern Recognition - 40th German Conference, GCPR 2018, Proceedings. editor / Andrés Bruhn ; Mario Fritz ; Thomas Brox. Springer Verlag, 2018. pp. 407-421 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
Download
@inproceedings{4fad8e9603534bdc866dd6648a2d77db,
title = "Multimodal Dense Stereo Matching",
abstract = "In this paper, we propose a new approach for dense depth estimation based on multimodal stereo images. Our approach employs a combined cost function utilizing robust metrics and a transformation to an illumination independent representation. Additionally, we present a confidence based weighting scheme which allows a pixel-wise weight adjustment within the cost function. We demonstrate the capabilities of our approach using RGB- and thermal images. The resulting depth maps are evaluated by comparing them to depth measurements of a Velodyne HDL-64E LiDAR sensor. We show that our method outperforms current state of the art dense matching methods regarding depth estimation based on multimodal input images.",
author = "Max Mehltretter and Kleinschmidt, {Sebastian P.} and Bernardo Wagner and Christian Heipke",
note = "Funding information:. This work was supported by the German Research Foundation (DFG) as a part of the Research Training Group i.c.sens [GRK2159] and the MOBILISE initiative of the Leibniz Universit{\"a}t Hannover and TU Braunschweig.; 40th German Conference on Pattern Recognition, GCPR 2018 ; Conference date: 09-10-2018 Through 12-10-2018",
year = "2018",
month = oct,
day = "9",
doi = "10.1007/978-3-030-12939-2_28",
language = "English",
isbn = "9783030129385",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "407--421",
editor = "Andr{\'e}s Bruhn and Mario Fritz and Thomas Brox",
booktitle = "Pattern Recognition - 40th German Conference, GCPR 2018, Proceedings",
address = "Germany",

}

Download

TY - GEN

T1 - Multimodal Dense Stereo Matching

AU - Mehltretter, Max

AU - Kleinschmidt, Sebastian P.

AU - Wagner, Bernardo

AU - Heipke, Christian

N1 - Funding information:. This work was supported by the German Research Foundation (DFG) as a part of the Research Training Group i.c.sens [GRK2159] and the MOBILISE initiative of the Leibniz Universität Hannover and TU Braunschweig.

PY - 2018/10/9

Y1 - 2018/10/9

N2 - In this paper, we propose a new approach for dense depth estimation based on multimodal stereo images. Our approach employs a combined cost function utilizing robust metrics and a transformation to an illumination independent representation. Additionally, we present a confidence based weighting scheme which allows a pixel-wise weight adjustment within the cost function. We demonstrate the capabilities of our approach using RGB- and thermal images. The resulting depth maps are evaluated by comparing them to depth measurements of a Velodyne HDL-64E LiDAR sensor. We show that our method outperforms current state of the art dense matching methods regarding depth estimation based on multimodal input images.

AB - In this paper, we propose a new approach for dense depth estimation based on multimodal stereo images. Our approach employs a combined cost function utilizing robust metrics and a transformation to an illumination independent representation. Additionally, we present a confidence based weighting scheme which allows a pixel-wise weight adjustment within the cost function. We demonstrate the capabilities of our approach using RGB- and thermal images. The resulting depth maps are evaluated by comparing them to depth measurements of a Velodyne HDL-64E LiDAR sensor. We show that our method outperforms current state of the art dense matching methods regarding depth estimation based on multimodal input images.

UR - http://www.scopus.com/inward/record.url?scp=85063499082&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-12939-2_28

DO - 10.1007/978-3-030-12939-2_28

M3 - Conference contribution

AN - SCOPUS:85063499082

SN - 9783030129385

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 407

EP - 421

BT - Pattern Recognition - 40th German Conference, GCPR 2018, Proceedings

A2 - Bruhn, Andrés

A2 - Fritz, Mario

A2 - Brox, Thomas

PB - Springer Verlag

T2 - 40th German Conference on Pattern Recognition, GCPR 2018

Y2 - 9 October 2018 through 12 October 2018

ER -

By the same author(s)