Learning Object Appearance from Occlusions Using Structure and Motion Recovery

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

Research Organisations

View graph of relations

Details

Original languageEnglish
Title of host publicationComputer Vision - ACCV 201
Subtitle of host publication11th Asian Conference on Computer Vision, Revised Selected Papers
Pages611-623
Number of pages13
ISBN (electronic)978-3-642-37431-9
Publication statusPublished - 2013
Event11th Asian Conference on Computer Vision, ACCV 2012 - Daejeon, Korea, Republic of
Duration: 5 Nov 20129 Nov 2012

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 3
Volume7726 LNCS
ISSN (Print)0302-9743
ISSN (electronic)1611-3349

Abstract

Visual effect creation as used in movie production often require structure and motion recovery and video segmentation. Both techniques are essential to integrate virtual objects between scene elements. In this paper, a new method for video segmentation is presented. It incorporates 3D scene information from the structure and motion recovery. By connecting and evaluating discontinued feature tracks, occlusion and reappearance information is obtained during sequential camera and scene estimation. The foreground is characterized as image regions which temporarily occlude the rigid scene structure. The scene structure is represented by reconstructed object points. Their projections onto the camera images provide the cues for regions classified as foreground or background. The knowledge of occluded parts of a connected feature track is used to feed the object segmentation which crops the foreground image regions automatically. Two applications are presented: the occlusion of integrated virtual objects and the blurred background effect. Several demonstrations on official and self-made data show very realistic results in augmented reality.

ASJC Scopus subject areas

Cite this

Learning Object Appearance from Occlusions Using Structure and Motion Recovery. / Cordes, Kai; Scheuermann, Björn; Rosenhahn, Bodo et al.
Computer Vision - ACCV 201: 11th Asian Conference on Computer Vision, Revised Selected Papers. 2013. p. 611-623 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7726 LNCS, No. PART 3).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Cordes, K, Scheuermann, B, Rosenhahn, B & Ostermann, J 2013, Learning Object Appearance from Occlusions Using Structure and Motion Recovery. in Computer Vision - ACCV 201: 11th Asian Conference on Computer Vision, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), no. PART 3, vol. 7726 LNCS, pp. 611-623, 11th Asian Conference on Computer Vision, ACCV 2012, Daejeon, Korea, Republic of, 5 Nov 2012. https://doi.org/10.1007/978-3-642-37431-9_47
Cordes, K., Scheuermann, B., Rosenhahn, B., & Ostermann, J. (2013). Learning Object Appearance from Occlusions Using Structure and Motion Recovery. In Computer Vision - ACCV 201: 11th Asian Conference on Computer Vision, Revised Selected Papers (pp. 611-623). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7726 LNCS, No. PART 3). https://doi.org/10.1007/978-3-642-37431-9_47
Cordes K, Scheuermann B, Rosenhahn B, Ostermann J. Learning Object Appearance from Occlusions Using Structure and Motion Recovery. In Computer Vision - ACCV 201: 11th Asian Conference on Computer Vision, Revised Selected Papers. 2013. p. 611-623. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 3). doi: 10.1007/978-3-642-37431-9_47
Cordes, Kai ; Scheuermann, Björn ; Rosenhahn, Bodo et al. / Learning Object Appearance from Occlusions Using Structure and Motion Recovery. Computer Vision - ACCV 201: 11th Asian Conference on Computer Vision, Revised Selected Papers. 2013. pp. 611-623 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 3).
Download
@inproceedings{0e3d9f99b7e94799b7a2953b67d89974,
title = "Learning Object Appearance from Occlusions Using Structure and Motion Recovery",
abstract = "Visual effect creation as used in movie production often require structure and motion recovery and video segmentation. Both techniques are essential to integrate virtual objects between scene elements. In this paper, a new method for video segmentation is presented. It incorporates 3D scene information from the structure and motion recovery. By connecting and evaluating discontinued feature tracks, occlusion and reappearance information is obtained during sequential camera and scene estimation. The foreground is characterized as image regions which temporarily occlude the rigid scene structure. The scene structure is represented by reconstructed object points. Their projections onto the camera images provide the cues for regions classified as foreground or background. The knowledge of occluded parts of a connected feature track is used to feed the object segmentation which crops the foreground image regions automatically. Two applications are presented: the occlusion of integrated virtual objects and the blurred background effect. Several demonstrations on official and self-made data show very realistic results in augmented reality.",
author = "Kai Cordes and Bj{\"o}rn Scheuermann and Bodo Rosenhahn and J{\"o}rn Ostermann",
year = "2013",
doi = "10.1007/978-3-642-37431-9_47",
language = "English",
isbn = "9783642374302",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
number = "PART 3",
pages = "611--623",
booktitle = "Computer Vision - ACCV 201",
note = "11th Asian Conference on Computer Vision, ACCV 2012 ; Conference date: 05-11-2012 Through 09-11-2012",

}

Download

TY - GEN

T1 - Learning Object Appearance from Occlusions Using Structure and Motion Recovery

AU - Cordes, Kai

AU - Scheuermann, Björn

AU - Rosenhahn, Bodo

AU - Ostermann, Jörn

PY - 2013

Y1 - 2013

N2 - Visual effect creation as used in movie production often require structure and motion recovery and video segmentation. Both techniques are essential to integrate virtual objects between scene elements. In this paper, a new method for video segmentation is presented. It incorporates 3D scene information from the structure and motion recovery. By connecting and evaluating discontinued feature tracks, occlusion and reappearance information is obtained during sequential camera and scene estimation. The foreground is characterized as image regions which temporarily occlude the rigid scene structure. The scene structure is represented by reconstructed object points. Their projections onto the camera images provide the cues for regions classified as foreground or background. The knowledge of occluded parts of a connected feature track is used to feed the object segmentation which crops the foreground image regions automatically. Two applications are presented: the occlusion of integrated virtual objects and the blurred background effect. Several demonstrations on official and self-made data show very realistic results in augmented reality.

AB - Visual effect creation as used in movie production often require structure and motion recovery and video segmentation. Both techniques are essential to integrate virtual objects between scene elements. In this paper, a new method for video segmentation is presented. It incorporates 3D scene information from the structure and motion recovery. By connecting and evaluating discontinued feature tracks, occlusion and reappearance information is obtained during sequential camera and scene estimation. The foreground is characterized as image regions which temporarily occlude the rigid scene structure. The scene structure is represented by reconstructed object points. Their projections onto the camera images provide the cues for regions classified as foreground or background. The knowledge of occluded parts of a connected feature track is used to feed the object segmentation which crops the foreground image regions automatically. Two applications are presented: the occlusion of integrated virtual objects and the blurred background effect. Several demonstrations on official and self-made data show very realistic results in augmented reality.

UR - http://www.scopus.com/inward/record.url?scp=84875879880&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-37431-9_47

DO - 10.1007/978-3-642-37431-9_47

M3 - Conference contribution

AN - SCOPUS:84875879880

SN - 9783642374302

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 611

EP - 623

BT - Computer Vision - ACCV 201

T2 - 11th Asian Conference on Computer Vision, ACCV 2012

Y2 - 5 November 2012 through 9 November 2012

ER -

By the same author(s)