Self-supervised learning for robust video indexing

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

  • Ralph Ewerth
  • Bernd Freisleben

External Research Organisations

  • Philipps-Universität Marburg
View graph of relations

Details

Original languageEnglish
Title of host publication2006 IEEE International Conference on Multimedia and Expo, ICME 2006
Subtitle of host publicationProceedings
Pages1749-1752
Number of pages4
Publication statusPublished - 26 Dec 2006
Externally publishedYes
Event2006 IEEE International Conference on Multimedia and Expo, ICME 2006 - Toronto, ON, Canada
Duration: 9 Jul 200612 Jul 2006

Publication series

Name2006 IEEE International Conference on Multimedia and Expo, ICME 2006 - Proceedings
Volume2006

Abstract

The performance of video analysis and indexing algorithms strongly depends on the type, content and recording characteristics of the analyzed video. Current video indexing approaches often make use of thresholding techniques or supervised learning which requires labeling of possibly large training sets. Furthermore, the application of the same training model or parameters might lead to a suboptimal indexing accuracy for a given video. In this paper, we propose to use a novel self-supervised learning framework for robust video indexing to address this issue. Based on an initial classification result for a given video, the best features are selected by Adaboost and are then used to train SVM (support vector machine) classifiers, all on the given video. Finally, a specialized ensemble of classifiers is employed for the given video for decision making. Experimental results show that a state-of-the-art video cut detection approach can be significantly improved by the self-supervised learning approach.

ASJC Scopus subject areas

Cite this

Self-supervised learning for robust video indexing. / Ewerth, Ralph; Freisleben, Bernd.
2006 IEEE International Conference on Multimedia and Expo, ICME 2006 : Proceedings. 2006. p. 1749-1752 4036958 (2006 IEEE International Conference on Multimedia and Expo, ICME 2006 - Proceedings; Vol. 2006).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Ewerth, R & Freisleben, B 2006, Self-supervised learning for robust video indexing. in 2006 IEEE International Conference on Multimedia and Expo, ICME 2006 : Proceedings., 4036958, 2006 IEEE International Conference on Multimedia and Expo, ICME 2006 - Proceedings, vol. 2006, pp. 1749-1752, 2006 IEEE International Conference on Multimedia and Expo, ICME 2006, Toronto, ON, Canada, 9 Jul 2006. https://doi.org/10.1109/ICME.2006.262889
Ewerth, R., & Freisleben, B. (2006). Self-supervised learning for robust video indexing. In 2006 IEEE International Conference on Multimedia and Expo, ICME 2006 : Proceedings (pp. 1749-1752). Article 4036958 (2006 IEEE International Conference on Multimedia and Expo, ICME 2006 - Proceedings; Vol. 2006). https://doi.org/10.1109/ICME.2006.262889
Ewerth R, Freisleben B. Self-supervised learning for robust video indexing. In 2006 IEEE International Conference on Multimedia and Expo, ICME 2006 : Proceedings. 2006. p. 1749-1752. 4036958. (2006 IEEE International Conference on Multimedia and Expo, ICME 2006 - Proceedings). doi: 10.1109/ICME.2006.262889
Ewerth, Ralph ; Freisleben, Bernd. / Self-supervised learning for robust video indexing. 2006 IEEE International Conference on Multimedia and Expo, ICME 2006 : Proceedings. 2006. pp. 1749-1752 (2006 IEEE International Conference on Multimedia and Expo, ICME 2006 - Proceedings).
Download
@inproceedings{3f29c555b22d40a2bad4f84e2e7cad85,
title = "Self-supervised learning for robust video indexing",
abstract = "The performance of video analysis and indexing algorithms strongly depends on the type, content and recording characteristics of the analyzed video. Current video indexing approaches often make use of thresholding techniques or supervised learning which requires labeling of possibly large training sets. Furthermore, the application of the same training model or parameters might lead to a suboptimal indexing accuracy for a given video. In this paper, we propose to use a novel self-supervised learning framework for robust video indexing to address this issue. Based on an initial classification result for a given video, the best features are selected by Adaboost and are then used to train SVM (support vector machine) classifiers, all on the given video. Finally, a specialized ensemble of classifiers is employed for the given video for decision making. Experimental results show that a state-of-the-art video cut detection approach can be significantly improved by the self-supervised learning approach.",
author = "Ralph Ewerth and Bernd Freisleben",
year = "2006",
month = dec,
day = "26",
doi = "10.1109/ICME.2006.262889",
language = "English",
isbn = "1424403677",
series = "2006 IEEE International Conference on Multimedia and Expo, ICME 2006 - Proceedings",
pages = "1749--1752",
booktitle = "2006 IEEE International Conference on Multimedia and Expo, ICME 2006",
note = "2006 IEEE International Conference on Multimedia and Expo, ICME 2006 ; Conference date: 09-07-2006 Through 12-07-2006",

}

Download

TY - GEN

T1 - Self-supervised learning for robust video indexing

AU - Ewerth, Ralph

AU - Freisleben, Bernd

PY - 2006/12/26

Y1 - 2006/12/26

N2 - The performance of video analysis and indexing algorithms strongly depends on the type, content and recording characteristics of the analyzed video. Current video indexing approaches often make use of thresholding techniques or supervised learning which requires labeling of possibly large training sets. Furthermore, the application of the same training model or parameters might lead to a suboptimal indexing accuracy for a given video. In this paper, we propose to use a novel self-supervised learning framework for robust video indexing to address this issue. Based on an initial classification result for a given video, the best features are selected by Adaboost and are then used to train SVM (support vector machine) classifiers, all on the given video. Finally, a specialized ensemble of classifiers is employed for the given video for decision making. Experimental results show that a state-of-the-art video cut detection approach can be significantly improved by the self-supervised learning approach.

AB - The performance of video analysis and indexing algorithms strongly depends on the type, content and recording characteristics of the analyzed video. Current video indexing approaches often make use of thresholding techniques or supervised learning which requires labeling of possibly large training sets. Furthermore, the application of the same training model or parameters might lead to a suboptimal indexing accuracy for a given video. In this paper, we propose to use a novel self-supervised learning framework for robust video indexing to address this issue. Based on an initial classification result for a given video, the best features are selected by Adaboost and are then used to train SVM (support vector machine) classifiers, all on the given video. Finally, a specialized ensemble of classifiers is employed for the given video for decision making. Experimental results show that a state-of-the-art video cut detection approach can be significantly improved by the self-supervised learning approach.

UR - http://www.scopus.com/inward/record.url?scp=34247597368&partnerID=8YFLogxK

U2 - 10.1109/ICME.2006.262889

DO - 10.1109/ICME.2006.262889

M3 - Conference contribution

AN - SCOPUS:34247597368

SN - 1424403677

SN - 9781424403677

T3 - 2006 IEEE International Conference on Multimedia and Expo, ICME 2006 - Proceedings

SP - 1749

EP - 1752

BT - 2006 IEEE International Conference on Multimedia and Expo, ICME 2006

T2 - 2006 IEEE International Conference on Multimedia and Expo, ICME 2006

Y2 - 9 July 2006 through 12 July 2006

ER -