Self-supervised learning of face appearances in TV casts and movies

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autorschaft

  • Ralph Ewerth
  • Markus Mühling
  • Bernd Freisleben

Externe Organisationen

  • Philipps-Universität Marburg
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des SammelwerksISM 2006
Untertitel8th IEEE International Symposium on Multimedia
Seiten78-85
Seitenumfang8
PublikationsstatusVeröffentlicht - 2006
Extern publiziertJa
VeranstaltungISM 2006 - 8th IEEE International Symposium on Multimedia - San Diego, CA, USA / Vereinigte Staaten
Dauer: 11 Dez. 200613 Dez. 2006

Publikationsreihe

NameISM 2006 - 8th IEEE International Symposium on Multimedia

Abstract

Retrieving information about the occurrences of persons in a video is an important task in many video indexing and retrieval applications. The problem is to answer the question "In which shots and scenes does person X appear?". In this paper, we present an automatic video annotation system with respect to a person's appearance based on state-of-the-art algorithms for face detection, tracking and recognition. In contrast to many related approaches, knowledge about the persons in a given video is not assumed in advance. Adaboost is employed after an initial clustering of faces to select the best features describing a person's face. These features are then used to train new classifiers based only on the faces extracted from the video under consideration. Several possibilities to train Adaboost and Support Vector Machine (ensemble) classifiers directly on a video are compared. Finally, experimental results demonstrate the effectiveness of correcting in-plane face rotation and of the employed self-supervised learning method.

ASJC Scopus Sachgebiete

Zitieren

Self-supervised learning of face appearances in TV casts and movies. / Ewerth, Ralph; Mühling, Markus; Freisleben, Bernd.
ISM 2006 : 8th IEEE International Symposium on Multimedia. 2006. S. 78-85 4061154 (ISM 2006 - 8th IEEE International Symposium on Multimedia).

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Ewerth, R, Mühling, M & Freisleben, B 2006, Self-supervised learning of face appearances in TV casts and movies. in ISM 2006 : 8th IEEE International Symposium on Multimedia., 4061154, ISM 2006 - 8th IEEE International Symposium on Multimedia, S. 78-85, ISM 2006 - 8th IEEE International Symposium on Multimedia, San Diego, CA, USA / Vereinigte Staaten, 11 Dez. 2006. https://doi.org/10.1109/ISM.2006.136
Ewerth, R., Mühling, M., & Freisleben, B. (2006). Self-supervised learning of face appearances in TV casts and movies. In ISM 2006 : 8th IEEE International Symposium on Multimedia (S. 78-85). Artikel 4061154 (ISM 2006 - 8th IEEE International Symposium on Multimedia). https://doi.org/10.1109/ISM.2006.136
Ewerth R, Mühling M, Freisleben B. Self-supervised learning of face appearances in TV casts and movies. in ISM 2006 : 8th IEEE International Symposium on Multimedia. 2006. S. 78-85. 4061154. (ISM 2006 - 8th IEEE International Symposium on Multimedia). doi: 10.1109/ISM.2006.136
Ewerth, Ralph ; Mühling, Markus ; Freisleben, Bernd. / Self-supervised learning of face appearances in TV casts and movies. ISM 2006 : 8th IEEE International Symposium on Multimedia. 2006. S. 78-85 (ISM 2006 - 8th IEEE International Symposium on Multimedia).
Download
@inproceedings{9e4583b9a0fe4f15974fa9e7d43ec260,
title = "Self-supervised learning of face appearances in TV casts and movies",
abstract = "Retrieving information about the occurrences of persons in a video is an important task in many video indexing and retrieval applications. The problem is to answer the question {"}In which shots and scenes does person X appear?{"}. In this paper, we present an automatic video annotation system with respect to a person's appearance based on state-of-the-art algorithms for face detection, tracking and recognition. In contrast to many related approaches, knowledge about the persons in a given video is not assumed in advance. Adaboost is employed after an initial clustering of faces to select the best features describing a person's face. These features are then used to train new classifiers based only on the faces extracted from the video under consideration. Several possibilities to train Adaboost and Support Vector Machine (ensemble) classifiers directly on a video are compared. Finally, experimental results demonstrate the effectiveness of correcting in-plane face rotation and of the employed self-supervised learning method.",
author = "Ralph Ewerth and Markus M{\"u}hling and Bernd Freisleben",
year = "2006",
doi = "10.1109/ISM.2006.136",
language = "English",
isbn = "0769527469",
series = "ISM 2006 - 8th IEEE International Symposium on Multimedia",
pages = "78--85",
booktitle = "ISM 2006",
note = "ISM 2006 - 8th IEEE International Symposium on Multimedia ; Conference date: 11-12-2006 Through 13-12-2006",

}

Download

TY - GEN

T1 - Self-supervised learning of face appearances in TV casts and movies

AU - Ewerth, Ralph

AU - Mühling, Markus

AU - Freisleben, Bernd

PY - 2006

Y1 - 2006

N2 - Retrieving information about the occurrences of persons in a video is an important task in many video indexing and retrieval applications. The problem is to answer the question "In which shots and scenes does person X appear?". In this paper, we present an automatic video annotation system with respect to a person's appearance based on state-of-the-art algorithms for face detection, tracking and recognition. In contrast to many related approaches, knowledge about the persons in a given video is not assumed in advance. Adaboost is employed after an initial clustering of faces to select the best features describing a person's face. These features are then used to train new classifiers based only on the faces extracted from the video under consideration. Several possibilities to train Adaboost and Support Vector Machine (ensemble) classifiers directly on a video are compared. Finally, experimental results demonstrate the effectiveness of correcting in-plane face rotation and of the employed self-supervised learning method.

AB - Retrieving information about the occurrences of persons in a video is an important task in many video indexing and retrieval applications. The problem is to answer the question "In which shots and scenes does person X appear?". In this paper, we present an automatic video annotation system with respect to a person's appearance based on state-of-the-art algorithms for face detection, tracking and recognition. In contrast to many related approaches, knowledge about the persons in a given video is not assumed in advance. Adaboost is employed after an initial clustering of faces to select the best features describing a person's face. These features are then used to train new classifiers based only on the faces extracted from the video under consideration. Several possibilities to train Adaboost and Support Vector Machine (ensemble) classifiers directly on a video are compared. Finally, experimental results demonstrate the effectiveness of correcting in-plane face rotation and of the employed self-supervised learning method.

UR - http://www.scopus.com/inward/record.url?scp=36849088984&partnerID=8YFLogxK

U2 - 10.1109/ISM.2006.136

DO - 10.1109/ISM.2006.136

M3 - Conference contribution

AN - SCOPUS:36849088984

SN - 0769527469

SN - 9780769527468

T3 - ISM 2006 - 8th IEEE International Symposium on Multimedia

SP - 78

EP - 85

BT - ISM 2006

T2 - ISM 2006 - 8th IEEE International Symposium on Multimedia

Y2 - 11 December 2006 through 13 December 2006

ER -