Interactive Segmentation of High-Resolution Video Content Using Temporally Coherent Superpixels and Graph Cut

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

Research Organisations

External Research Organisations

  • Technicolor Research & Innovation
View graph of relations

Details

Original languageEnglish
Title of host publicationAdvances in Visual Computing
Subtitle of host publication10th International Symposium, ISVC 2014, Proceedings
EditorsGeorge Bebis, Richard Boyle, Bahram Parvin, Darko Koracin, Ryan McMahan, Jason Jerald, Hui Zhang, Steven M. Drucker, Kambhamettu Chandra, El Choubassi Maha, Zhigang Deng, Mark Carlson
PublisherSpringer Verlag
Pages281-292
Number of pages12
ISBN (electronic)9783319142487
Publication statusPublished - 2014
Event10th International Symposium on Visual Computing, ISVC 2014 - Las Vegas, United States
Duration: 8 Dec 201410 Dec 2014

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume8887
ISSN (Print)0302-9743
ISSN (electronic)1611-3349

Abstract

Interactive video segmentation has become a popular topic in computer vision and computer graphics. Discrete optimization using maximum flow algorithms is one of the preferred techniques to perform interactive video segmentation. This paper extends pixel based graph cut approaches to overcome the problem of high memory requirements. The basic idea is to use a graph cut optimization framework on top of temporally coherent superpixels. While grouping spatially coherent pixels sharing similar color, these algorithms additionally exploit the temporal connections between those image regions. Thereby the number of variables in the optimization framework is severely reduced. The effectiveness of the proposed algorithm is shown quantitatively, qualitatively and through timing comparisons of different temporally coherent superpixel approaches. Experiments on video sequences show that temporally coherent superpixels lead to significant speed-up and reduced memory consumption. Thus, video sequences can be interactively segmented in a more efficient manner while producing better segmentation quality when compared to other approaches.

ASJC Scopus subject areas

Cite this

Interactive Segmentation of High-Resolution Video Content Using Temporally Coherent Superpixels and Graph Cut. / Reso, Matthias; Scheuermann, Björn; Jachalsky, Jörn et al.
Advances in Visual Computing : 10th International Symposium, ISVC 2014, Proceedings. ed. / George Bebis; Richard Boyle; Bahram Parvin; Darko Koracin; Ryan McMahan; Jason Jerald; Hui Zhang; Steven M. Drucker; Kambhamettu Chandra; El Choubassi Maha; Zhigang Deng; Mark Carlson. Springer Verlag, 2014. p. 281-292 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8887).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Reso, M, Scheuermann, B, Jachalsky, J, Rosenhahn, B & Ostermann, J 2014, Interactive Segmentation of High-Resolution Video Content Using Temporally Coherent Superpixels and Graph Cut. in G Bebis, R Boyle, B Parvin, D Koracin, R McMahan, J Jerald, H Zhang, SM Drucker, K Chandra, EC Maha, Z Deng & M Carlson (eds), Advances in Visual Computing : 10th International Symposium, ISVC 2014, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 8887, Springer Verlag, pp. 281-292, 10th International Symposium on Visual Computing, ISVC 2014, Las Vegas, United States, 8 Dec 2014. https://doi.org/10.1007/978-3-319-14249-4_27
Reso, M., Scheuermann, B., Jachalsky, J., Rosenhahn, B., & Ostermann, J. (2014). Interactive Segmentation of High-Resolution Video Content Using Temporally Coherent Superpixels and Graph Cut. In G. Bebis, R. Boyle, B. Parvin, D. Koracin, R. McMahan, J. Jerald, H. Zhang, S. M. Drucker, K. Chandra, E. C. Maha, Z. Deng, & M. Carlson (Eds.), Advances in Visual Computing : 10th International Symposium, ISVC 2014, Proceedings (pp. 281-292). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8887). Springer Verlag. https://doi.org/10.1007/978-3-319-14249-4_27
Reso M, Scheuermann B, Jachalsky J, Rosenhahn B, Ostermann J. Interactive Segmentation of High-Resolution Video Content Using Temporally Coherent Superpixels and Graph Cut. In Bebis G, Boyle R, Parvin B, Koracin D, McMahan R, Jerald J, Zhang H, Drucker SM, Chandra K, Maha EC, Deng Z, Carlson M, editors, Advances in Visual Computing : 10th International Symposium, ISVC 2014, Proceedings. Springer Verlag. 2014. p. 281-292. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-319-14249-4_27
Reso, Matthias ; Scheuermann, Björn ; Jachalsky, Jörn et al. / Interactive Segmentation of High-Resolution Video Content Using Temporally Coherent Superpixels and Graph Cut. Advances in Visual Computing : 10th International Symposium, ISVC 2014, Proceedings. editor / George Bebis ; Richard Boyle ; Bahram Parvin ; Darko Koracin ; Ryan McMahan ; Jason Jerald ; Hui Zhang ; Steven M. Drucker ; Kambhamettu Chandra ; El Choubassi Maha ; Zhigang Deng ; Mark Carlson. Springer Verlag, 2014. pp. 281-292 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
Download
@inproceedings{f0717da882564b4da003e8b421d1e355,
title = "Interactive Segmentation of High-Resolution Video Content Using Temporally Coherent Superpixels and Graph Cut",
abstract = "Interactive video segmentation has become a popular topic in computer vision and computer graphics. Discrete optimization using maximum flow algorithms is one of the preferred techniques to perform interactive video segmentation. This paper extends pixel based graph cut approaches to overcome the problem of high memory requirements. The basic idea is to use a graph cut optimization framework on top of temporally coherent superpixels. While grouping spatially coherent pixels sharing similar color, these algorithms additionally exploit the temporal connections between those image regions. Thereby the number of variables in the optimization framework is severely reduced. The effectiveness of the proposed algorithm is shown quantitatively, qualitatively and through timing comparisons of different temporally coherent superpixel approaches. Experiments on video sequences show that temporally coherent superpixels lead to significant speed-up and reduced memory consumption. Thus, video sequences can be interactively segmented in a more efficient manner while producing better segmentation quality when compared to other approaches.",
author = "Matthias Reso and Bj{\"o}rn Scheuermann and J{\"o}rn Jachalsky and Bodo Rosenhahn and J{\"o}rn Ostermann",
year = "2014",
doi = "10.1007/978-3-319-14249-4_27",
language = "English",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "281--292",
editor = "George Bebis and Richard Boyle and Bahram Parvin and Darko Koracin and Ryan McMahan and Jason Jerald and Hui Zhang and Drucker, {Steven M.} and Kambhamettu Chandra and Maha, {El Choubassi} and Zhigang Deng and Mark Carlson",
booktitle = "Advances in Visual Computing",
address = "Germany",
note = "10th International Symposium on Visual Computing, ISVC 2014 ; Conference date: 08-12-2014 Through 10-12-2014",

}

Download

TY - GEN

T1 - Interactive Segmentation of High-Resolution Video Content Using Temporally Coherent Superpixels and Graph Cut

AU - Reso, Matthias

AU - Scheuermann, Björn

AU - Jachalsky, Jörn

AU - Rosenhahn, Bodo

AU - Ostermann, Jörn

PY - 2014

Y1 - 2014

N2 - Interactive video segmentation has become a popular topic in computer vision and computer graphics. Discrete optimization using maximum flow algorithms is one of the preferred techniques to perform interactive video segmentation. This paper extends pixel based graph cut approaches to overcome the problem of high memory requirements. The basic idea is to use a graph cut optimization framework on top of temporally coherent superpixels. While grouping spatially coherent pixels sharing similar color, these algorithms additionally exploit the temporal connections between those image regions. Thereby the number of variables in the optimization framework is severely reduced. The effectiveness of the proposed algorithm is shown quantitatively, qualitatively and through timing comparisons of different temporally coherent superpixel approaches. Experiments on video sequences show that temporally coherent superpixels lead to significant speed-up and reduced memory consumption. Thus, video sequences can be interactively segmented in a more efficient manner while producing better segmentation quality when compared to other approaches.

AB - Interactive video segmentation has become a popular topic in computer vision and computer graphics. Discrete optimization using maximum flow algorithms is one of the preferred techniques to perform interactive video segmentation. This paper extends pixel based graph cut approaches to overcome the problem of high memory requirements. The basic idea is to use a graph cut optimization framework on top of temporally coherent superpixels. While grouping spatially coherent pixels sharing similar color, these algorithms additionally exploit the temporal connections between those image regions. Thereby the number of variables in the optimization framework is severely reduced. The effectiveness of the proposed algorithm is shown quantitatively, qualitatively and through timing comparisons of different temporally coherent superpixel approaches. Experiments on video sequences show that temporally coherent superpixels lead to significant speed-up and reduced memory consumption. Thus, video sequences can be interactively segmented in a more efficient manner while producing better segmentation quality when compared to other approaches.

UR - http://www.scopus.com/inward/record.url?scp=84916618690&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-14249-4_27

DO - 10.1007/978-3-319-14249-4_27

M3 - Conference contribution

AN - SCOPUS:84916618690

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 281

EP - 292

BT - Advances in Visual Computing

A2 - Bebis, George

A2 - Boyle, Richard

A2 - Parvin, Bahram

A2 - Koracin, Darko

A2 - McMahan, Ryan

A2 - Jerald, Jason

A2 - Zhang, Hui

A2 - Drucker, Steven M.

A2 - Chandra, Kambhamettu

A2 - Maha, El Choubassi

A2 - Deng, Zhigang

A2 - Carlson, Mark

PB - Springer Verlag

T2 - 10th International Symposium on Visual Computing, ISVC 2014

Y2 - 8 December 2014 through 10 December 2014

ER -

By the same author(s)