Classification of Stereo Images from Mobile Mapping Data Using Conditional Random Fields

Research output: Contribution to journalArticleResearchpeer review

Authors

View graph of relations

Details

Original languageEnglish
Pages (from-to)17-30
Number of pages14
JournalJournal of photogrammetry, remote sensing and geoinformation science
Volume85
Issue number1
Early online date21 Feb 2017
Publication statusPublished - Feb 2017

Abstract

We propose a new method for the context-based classification of point clouds from stereo images using Conditional Random Fields (CRF). The classification is based on segments as nodes for the CRF. The segmentation is conducted on the image and is transferred to the 3D point cloud obtained by image matching. This allows the computation of 3D features additionally to the image features as well as the definition of realistic adjacencies between the segments in object space. We also propose a variant of the contrast-sensitive Potts model that is tailored for the contextual classification of point cloud segments. The evaluation of our method is performed on stereo sequences of a benchmark dataset, recorded in an urban area, and yields results with an overall accuracy of more than 90%. Moreover, we can show that the consideration of contextual information during the classification leads to an improvement of the overall accuracy.

Keywords

    3D reconstruction, Classification, Conditional random fields, Mobile mapping, Segmentation, Stereo images

ASJC Scopus subject areas

Cite this

Classification of Stereo Images from Mobile Mapping Data Using Conditional Random Fields. / Coenen, Max; Rottensteiner, Franz; Heipke, Christian.
In: Journal of photogrammetry, remote sensing and geoinformation science, Vol. 85, No. 1, 02.2017, p. 17-30.

Research output: Contribution to journalArticleResearchpeer review

Download
@article{6d5a4c2ea898430eb87aa014704c2038,
title = "Classification of Stereo Images from Mobile Mapping Data Using Conditional Random Fields",
abstract = "We propose a new method for the context-based classification of point clouds from stereo images using Conditional Random Fields (CRF). The classification is based on segments as nodes for the CRF. The segmentation is conducted on the image and is transferred to the 3D point cloud obtained by image matching. This allows the computation of 3D features additionally to the image features as well as the definition of realistic adjacencies between the segments in object space. We also propose a variant of the contrast-sensitive Potts model that is tailored for the contextual classification of point cloud segments. The evaluation of our method is performed on stereo sequences of a benchmark dataset, recorded in an urban area, and yields results with an overall accuracy of more than 90%. Moreover, we can show that the consideration of contextual information during the classification leads to an improvement of the overall accuracy.",
keywords = "3D reconstruction, Classification, Conditional random fields, Mobile mapping, Segmentation, Stereo images",
author = "Max Coenen and Franz Rottensteiner and Christian Heipke",
note = "Publisher Copyright: {\textcopyright} 2017 Deutsche Gesellschaft f{\"u}r Photogrammetrie, Fernerkundung und Geoinformation (DGPF) e.V. Copyright: Copyright 2017 Elsevier B.V., All rights reserved.",
year = "2017",
month = feb,
doi = "10.1007/s41064-017-0004-5",
language = "English",
volume = "85",
pages = "17--30",
journal = "Journal of photogrammetry, remote sensing and geoinformation science",
issn = "1432-8364",
publisher = "E. Schweizerbartsche Verlagsbuchhandlung",
number = "1",

}

Download

TY - JOUR

T1 - Classification of Stereo Images from Mobile Mapping Data Using Conditional Random Fields

AU - Coenen, Max

AU - Rottensteiner, Franz

AU - Heipke, Christian

N1 - Publisher Copyright: © 2017 Deutsche Gesellschaft für Photogrammetrie, Fernerkundung und Geoinformation (DGPF) e.V. Copyright: Copyright 2017 Elsevier B.V., All rights reserved.

PY - 2017/2

Y1 - 2017/2

N2 - We propose a new method for the context-based classification of point clouds from stereo images using Conditional Random Fields (CRF). The classification is based on segments as nodes for the CRF. The segmentation is conducted on the image and is transferred to the 3D point cloud obtained by image matching. This allows the computation of 3D features additionally to the image features as well as the definition of realistic adjacencies between the segments in object space. We also propose a variant of the contrast-sensitive Potts model that is tailored for the contextual classification of point cloud segments. The evaluation of our method is performed on stereo sequences of a benchmark dataset, recorded in an urban area, and yields results with an overall accuracy of more than 90%. Moreover, we can show that the consideration of contextual information during the classification leads to an improvement of the overall accuracy.

AB - We propose a new method for the context-based classification of point clouds from stereo images using Conditional Random Fields (CRF). The classification is based on segments as nodes for the CRF. The segmentation is conducted on the image and is transferred to the 3D point cloud obtained by image matching. This allows the computation of 3D features additionally to the image features as well as the definition of realistic adjacencies between the segments in object space. We also propose a variant of the contrast-sensitive Potts model that is tailored for the contextual classification of point cloud segments. The evaluation of our method is performed on stereo sequences of a benchmark dataset, recorded in an urban area, and yields results with an overall accuracy of more than 90%. Moreover, we can show that the consideration of contextual information during the classification leads to an improvement of the overall accuracy.

KW - 3D reconstruction

KW - Classification

KW - Conditional random fields

KW - Mobile mapping

KW - Segmentation

KW - Stereo images

UR - http://www.scopus.com/inward/record.url?scp=85013799278&partnerID=8YFLogxK

U2 - 10.1007/s41064-017-0004-5

DO - 10.1007/s41064-017-0004-5

M3 - Article

AN - SCOPUS:85013799278

VL - 85

SP - 17

EP - 30

JO - Journal of photogrammetry, remote sensing and geoinformation science

JF - Journal of photogrammetry, remote sensing and geoinformation science

SN - 1432-8364

IS - 1

ER -

By the same author(s)