Foreground Segmentation from Occlusions Using Structure and Motion Recovery

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autoren

Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des SammelwerksComputer Vision, Imaging and Computer Graphics
UntertitelTheory and Application - 7th International Joint Conference, VISIGRAPP 2012, Revised Selected Papers
Herausgeber (Verlag)Springer Verlag
Seiten340-353
Seitenumfang14
ISBN (Print)9783642382406
PublikationsstatusVeröffentlicht - 2013
Veranstaltung7th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP 2012 - Rome, Italien
Dauer: 24 Feb. 201226 Feb. 2012

Publikationsreihe

NameCommunications in Computer and Information Science
Band359 CCIS
ISSN (Print)1865-0929

Abstract

The segmentation of foreground objects in camera images is a fundamental step in many computer vision applications. For visual effect creation, the foreground segmentation is required for the integration of virtual objects between scene elements. On the other hand, camera and scene estimation is needed to integrate the objects perspectively correct into the video. In this paper, discontinued feature tracks are used to detect occlusions. If these features reappear after their occlusion, they are connected to the correct previously discontinued trajectory during sequential camera and scene estimation. The combination of optical flow for features in consecutive frames and SIFT matching for the wide baseline feature connection provides accurate and stable feature tracking. The knowledge of occluded parts of a connected feature track is used to feed an efficient segmentation algorithm which crops the foreground image regions automatically. The presented graph cut based segmentation uses a graph contraction technique to minimize the computational expense. The presented application in the integration of virtual objects into video. For this application, the accurate estimation of camera and scene is crucial. The segmentation is used for the automatic occlusion of the integrated objects with foreground scene content. Demonstrations show very realistic results.

Zitieren

Foreground Segmentation from Occlusions Using Structure and Motion Recovery. / Cordes, Kai; Scheuermann, Björn; Rosenhahn, Bodo et al.
Computer Vision, Imaging and Computer Graphics: Theory and Application - 7th International Joint Conference, VISIGRAPP 2012, Revised Selected Papers. Springer Verlag, 2013. S. 340-353 (Communications in Computer and Information Science; Band 359 CCIS).

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Cordes, K, Scheuermann, B, Rosenhahn, B & Ostermann, J 2013, Foreground Segmentation from Occlusions Using Structure and Motion Recovery. in Computer Vision, Imaging and Computer Graphics: Theory and Application - 7th International Joint Conference, VISIGRAPP 2012, Revised Selected Papers. Communications in Computer and Information Science, Bd. 359 CCIS, Springer Verlag, S. 340-353, 7th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP 2012, Rome, Italien, 24 Feb. 2012. https://doi.org/10.1007/978-3-642-38241-3_23
Cordes, K., Scheuermann, B., Rosenhahn, B., & Ostermann, J. (2013). Foreground Segmentation from Occlusions Using Structure and Motion Recovery. In Computer Vision, Imaging and Computer Graphics: Theory and Application - 7th International Joint Conference, VISIGRAPP 2012, Revised Selected Papers (S. 340-353). (Communications in Computer and Information Science; Band 359 CCIS). Springer Verlag. https://doi.org/10.1007/978-3-642-38241-3_23
Cordes K, Scheuermann B, Rosenhahn B, Ostermann J. Foreground Segmentation from Occlusions Using Structure and Motion Recovery. in Computer Vision, Imaging and Computer Graphics: Theory and Application - 7th International Joint Conference, VISIGRAPP 2012, Revised Selected Papers. Springer Verlag. 2013. S. 340-353. (Communications in Computer and Information Science). doi: 10.1007/978-3-642-38241-3_23
Cordes, Kai ; Scheuermann, Björn ; Rosenhahn, Bodo et al. / Foreground Segmentation from Occlusions Using Structure and Motion Recovery. Computer Vision, Imaging and Computer Graphics: Theory and Application - 7th International Joint Conference, VISIGRAPP 2012, Revised Selected Papers. Springer Verlag, 2013. S. 340-353 (Communications in Computer and Information Science).
Download
@inproceedings{aa7e842e94294b6488e1bc72bc16923e,
title = "Foreground Segmentation from Occlusions Using Structure and Motion Recovery",
abstract = "The segmentation of foreground objects in camera images is a fundamental step in many computer vision applications. For visual effect creation, the foreground segmentation is required for the integration of virtual objects between scene elements. On the other hand, camera and scene estimation is needed to integrate the objects perspectively correct into the video. In this paper, discontinued feature tracks are used to detect occlusions. If these features reappear after their occlusion, they are connected to the correct previously discontinued trajectory during sequential camera and scene estimation. The combination of optical flow for features in consecutive frames and SIFT matching for the wide baseline feature connection provides accurate and stable feature tracking. The knowledge of occluded parts of a connected feature track is used to feed an efficient segmentation algorithm which crops the foreground image regions automatically. The presented graph cut based segmentation uses a graph contraction technique to minimize the computational expense. The presented application in the integration of virtual objects into video. For this application, the accurate estimation of camera and scene is crucial. The segmentation is used for the automatic occlusion of the integrated objects with foreground scene content. Demonstrations show very realistic results.",
author = "Kai Cordes and Bj{\"o}rn Scheuermann and Bodo Rosenhahn and J{\"o}rn Ostermann",
year = "2013",
doi = "10.1007/978-3-642-38241-3_23",
language = "English",
isbn = "9783642382406",
series = "Communications in Computer and Information Science",
publisher = "Springer Verlag",
pages = "340--353",
booktitle = "Computer Vision, Imaging and Computer Graphics",
address = "Germany",
note = "7th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP 2012 ; Conference date: 24-02-2012 Through 26-02-2012",

}

Download

TY - GEN

T1 - Foreground Segmentation from Occlusions Using Structure and Motion Recovery

AU - Cordes, Kai

AU - Scheuermann, Björn

AU - Rosenhahn, Bodo

AU - Ostermann, Jörn

PY - 2013

Y1 - 2013

N2 - The segmentation of foreground objects in camera images is a fundamental step in many computer vision applications. For visual effect creation, the foreground segmentation is required for the integration of virtual objects between scene elements. On the other hand, camera and scene estimation is needed to integrate the objects perspectively correct into the video. In this paper, discontinued feature tracks are used to detect occlusions. If these features reappear after their occlusion, they are connected to the correct previously discontinued trajectory during sequential camera and scene estimation. The combination of optical flow for features in consecutive frames and SIFT matching for the wide baseline feature connection provides accurate and stable feature tracking. The knowledge of occluded parts of a connected feature track is used to feed an efficient segmentation algorithm which crops the foreground image regions automatically. The presented graph cut based segmentation uses a graph contraction technique to minimize the computational expense. The presented application in the integration of virtual objects into video. For this application, the accurate estimation of camera and scene is crucial. The segmentation is used for the automatic occlusion of the integrated objects with foreground scene content. Demonstrations show very realistic results.

AB - The segmentation of foreground objects in camera images is a fundamental step in many computer vision applications. For visual effect creation, the foreground segmentation is required for the integration of virtual objects between scene elements. On the other hand, camera and scene estimation is needed to integrate the objects perspectively correct into the video. In this paper, discontinued feature tracks are used to detect occlusions. If these features reappear after their occlusion, they are connected to the correct previously discontinued trajectory during sequential camera and scene estimation. The combination of optical flow for features in consecutive frames and SIFT matching for the wide baseline feature connection provides accurate and stable feature tracking. The knowledge of occluded parts of a connected feature track is used to feed an efficient segmentation algorithm which crops the foreground image regions automatically. The presented graph cut based segmentation uses a graph contraction technique to minimize the computational expense. The presented application in the integration of virtual objects into video. For this application, the accurate estimation of camera and scene is crucial. The segmentation is used for the automatic occlusion of the integrated objects with foreground scene content. Demonstrations show very realistic results.

UR - http://www.scopus.com/inward/record.url?scp=84904666774&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-38241-3_23

DO - 10.1007/978-3-642-38241-3_23

M3 - Conference contribution

AN - SCOPUS:84904666774

SN - 9783642382406

T3 - Communications in Computer and Information Science

SP - 340

EP - 353

BT - Computer Vision, Imaging and Computer Graphics

PB - Springer Verlag

T2 - 7th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP 2012

Y2 - 24 February 2012 through 26 February 2012

ER -

Von denselben Autoren