Fast label propagation for real-time superpixels for video content

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autoren

Externe Organisationen

  • Technicolor Research & Innovation
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des Sammelwerks2015 IEEE International Conference on Image Processing, ICIP 2015 - Proceedings
Herausgeber (Verlag)IEEE Computer Society
Seiten902-906
Seitenumfang5
ISBN (elektronisch)9781479983391
PublikationsstatusVeröffentlicht - 9 Dez. 2015
VeranstaltungIEEE International Conference on Image Processing, ICIP 2015 - Quebec City, Kanada
Dauer: 27 Sept. 201530 Sept. 2015

Publikationsreihe

NameProceedings - International Conference on Image Processing, ICIP
Band2015-December
ISSN (Print)1522-4880

Abstract

Many recent superpixel algorithms for video content rely on dense optical flow vectors to propagate segmentation results from one frame to the next. In this paper, we assess the impact of the optical flow quality on the over-segmentation quality. Our evaluation shows that it is indispensable for videos with large object displacement and camera motion. But due to the high computational costs high-quality, dense optical flow is not suitable for real-time applications. Therefore, we propose a fast propagation scheme that is based on sparse feature tracking and mesh-based image warping. In a thorough evaluation, we compare our proposed scheme to the results of other state-of-the-art propagation methods using established benchmarks. The results show that our method speeds up the propagation process by a factor of 100 while producing a comparable segmentation quality.

ASJC Scopus Sachgebiete

Zitieren

Fast label propagation for real-time superpixels for video content. / Reso, Matthias; Jachalsky, Jorn; Rosenhahn, Bodo et al.
2015 IEEE International Conference on Image Processing, ICIP 2015 - Proceedings. IEEE Computer Society, 2015. S. 902-906 7350930 (Proceedings - International Conference on Image Processing, ICIP; Band 2015-December).

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Reso, M, Jachalsky, J, Rosenhahn, B & Ostermann, J 2015, Fast label propagation for real-time superpixels for video content. in 2015 IEEE International Conference on Image Processing, ICIP 2015 - Proceedings., 7350930, Proceedings - International Conference on Image Processing, ICIP, Bd. 2015-December, IEEE Computer Society, S. 902-906, IEEE International Conference on Image Processing, ICIP 2015, Quebec City, Kanada, 27 Sept. 2015. https://doi.org/10.1109/icip.2015.7350930
Reso, M., Jachalsky, J., Rosenhahn, B., & Ostermann, J. (2015). Fast label propagation for real-time superpixels for video content. In 2015 IEEE International Conference on Image Processing, ICIP 2015 - Proceedings (S. 902-906). Artikel 7350930 (Proceedings - International Conference on Image Processing, ICIP; Band 2015-December). IEEE Computer Society. https://doi.org/10.1109/icip.2015.7350930
Reso M, Jachalsky J, Rosenhahn B, Ostermann J. Fast label propagation for real-time superpixels for video content. in 2015 IEEE International Conference on Image Processing, ICIP 2015 - Proceedings. IEEE Computer Society. 2015. S. 902-906. 7350930. (Proceedings - International Conference on Image Processing, ICIP). doi: 10.1109/icip.2015.7350930
Reso, Matthias ; Jachalsky, Jorn ; Rosenhahn, Bodo et al. / Fast label propagation for real-time superpixels for video content. 2015 IEEE International Conference on Image Processing, ICIP 2015 - Proceedings. IEEE Computer Society, 2015. S. 902-906 (Proceedings - International Conference on Image Processing, ICIP).
Download
@inproceedings{a867dada3ea340649267ccccfc9e8642,
title = "Fast label propagation for real-time superpixels for video content",
abstract = "Many recent superpixel algorithms for video content rely on dense optical flow vectors to propagate segmentation results from one frame to the next. In this paper, we assess the impact of the optical flow quality on the over-segmentation quality. Our evaluation shows that it is indispensable for videos with large object displacement and camera motion. But due to the high computational costs high-quality, dense optical flow is not suitable for real-time applications. Therefore, we propose a fast propagation scheme that is based on sparse feature tracking and mesh-based image warping. In a thorough evaluation, we compare our proposed scheme to the results of other state-of-the-art propagation methods using established benchmarks. The results show that our method speeds up the propagation process by a factor of 100 while producing a comparable segmentation quality.",
keywords = "optical flow, Superpixel, supervoxel",
author = "Matthias Reso and Jorn Jachalsky and Bodo Rosenhahn and J{\"o}rn Ostermann",
year = "2015",
month = dec,
day = "9",
doi = "10.1109/icip.2015.7350930",
language = "English",
series = "Proceedings - International Conference on Image Processing, ICIP",
publisher = "IEEE Computer Society",
pages = "902--906",
booktitle = "2015 IEEE International Conference on Image Processing, ICIP 2015 - Proceedings",
address = "United States",
note = "IEEE International Conference on Image Processing, ICIP 2015 ; Conference date: 27-09-2015 Through 30-09-2015",

}

Download

TY - GEN

T1 - Fast label propagation for real-time superpixels for video content

AU - Reso, Matthias

AU - Jachalsky, Jorn

AU - Rosenhahn, Bodo

AU - Ostermann, Jörn

PY - 2015/12/9

Y1 - 2015/12/9

N2 - Many recent superpixel algorithms for video content rely on dense optical flow vectors to propagate segmentation results from one frame to the next. In this paper, we assess the impact of the optical flow quality on the over-segmentation quality. Our evaluation shows that it is indispensable for videos with large object displacement and camera motion. But due to the high computational costs high-quality, dense optical flow is not suitable for real-time applications. Therefore, we propose a fast propagation scheme that is based on sparse feature tracking and mesh-based image warping. In a thorough evaluation, we compare our proposed scheme to the results of other state-of-the-art propagation methods using established benchmarks. The results show that our method speeds up the propagation process by a factor of 100 while producing a comparable segmentation quality.

AB - Many recent superpixel algorithms for video content rely on dense optical flow vectors to propagate segmentation results from one frame to the next. In this paper, we assess the impact of the optical flow quality on the over-segmentation quality. Our evaluation shows that it is indispensable for videos with large object displacement and camera motion. But due to the high computational costs high-quality, dense optical flow is not suitable for real-time applications. Therefore, we propose a fast propagation scheme that is based on sparse feature tracking and mesh-based image warping. In a thorough evaluation, we compare our proposed scheme to the results of other state-of-the-art propagation methods using established benchmarks. The results show that our method speeds up the propagation process by a factor of 100 while producing a comparable segmentation quality.

KW - optical flow

KW - Superpixel

KW - supervoxel

UR - http://www.scopus.com/inward/record.url?scp=84956658538&partnerID=8YFLogxK

U2 - 10.1109/icip.2015.7350930

DO - 10.1109/icip.2015.7350930

M3 - Conference contribution

AN - SCOPUS:84956658538

T3 - Proceedings - International Conference on Image Processing, ICIP

SP - 902

EP - 906

BT - 2015 IEEE International Conference on Image Processing, ICIP 2015 - Proceedings

PB - IEEE Computer Society

T2 - IEEE International Conference on Image Processing, ICIP 2015

Y2 - 27 September 2015 through 30 September 2015

ER -

Von denselben Autoren