Improving semantic video retrieval via object-based features

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

  • Markus Mühling
  • Ralph Ewerth
  • Bernd Freisleben

External Research Organisations

  • Philipps-Universität Marburg
View graph of relations

Details

Original languageEnglish
Title of host publicationICSC 2009
Subtitle of host publication2009 IEEE International Conference on Semantic Computing
Pages109-115
Number of pages7
Publication statusPublished - 30 Oct 2009
Externally publishedYes
EventICSC 2009 - 2009 IEEE International Conference on Semantic Computing - Berkeley, CA, United States
Duration: 14 Sept 200916 Sept 2009

Publication series

NameICSC 2009 - 2009 IEEE International Conference on Semantic Computing

Abstract

State-of-the-art systems for generic concept detection rely on low-level features, and in some cases additionally on features based on face detection, optical character recognition and/or speech recognition. In this paper, an approach for the task of semantic video retrieval is presented that systematically utilizes results of specialized object detectors. Using these object detectors trained on separate public data sets, object-based features are generated by assembling detection results to object sequences. A shot-based confidence score as well as further features, such as position, frame coverage and movement, are computed for each object class. Experimental results on TRECVID test data show significant improvements in terms of retrieval performance not only for the object classes, but also in particular for a large number of indirectly related concepts.

Keywords

    Object detection, Semantic concept detection, Video retrieval

ASJC Scopus subject areas

Cite this

Improving semantic video retrieval via object-based features. / Mühling, Markus; Ewerth, Ralph; Freisleben, Bernd.
ICSC 2009 : 2009 IEEE International Conference on Semantic Computing. 2009. p. 109-115 5298597 (ICSC 2009 - 2009 IEEE International Conference on Semantic Computing).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Mühling, M, Ewerth, R & Freisleben, B 2009, Improving semantic video retrieval via object-based features. in ICSC 2009 : 2009 IEEE International Conference on Semantic Computing., 5298597, ICSC 2009 - 2009 IEEE International Conference on Semantic Computing, pp. 109-115, ICSC 2009 - 2009 IEEE International Conference on Semantic Computing, Berkeley, CA, United States, 14 Sept 2009. https://doi.org/10.1109/ICSC.2009.85
Mühling, M., Ewerth, R., & Freisleben, B. (2009). Improving semantic video retrieval via object-based features. In ICSC 2009 : 2009 IEEE International Conference on Semantic Computing (pp. 109-115). Article 5298597 (ICSC 2009 - 2009 IEEE International Conference on Semantic Computing). https://doi.org/10.1109/ICSC.2009.85
Mühling M, Ewerth R, Freisleben B. Improving semantic video retrieval via object-based features. In ICSC 2009 : 2009 IEEE International Conference on Semantic Computing. 2009. p. 109-115. 5298597. (ICSC 2009 - 2009 IEEE International Conference on Semantic Computing). doi: 10.1109/ICSC.2009.85
Mühling, Markus ; Ewerth, Ralph ; Freisleben, Bernd. / Improving semantic video retrieval via object-based features. ICSC 2009 : 2009 IEEE International Conference on Semantic Computing. 2009. pp. 109-115 (ICSC 2009 - 2009 IEEE International Conference on Semantic Computing).
Download
@inproceedings{113a107d5bbf4ab79f0868ee261bd255,
title = "Improving semantic video retrieval via object-based features",
abstract = "State-of-the-art systems for generic concept detection rely on low-level features, and in some cases additionally on features based on face detection, optical character recognition and/or speech recognition. In this paper, an approach for the task of semantic video retrieval is presented that systematically utilizes results of specialized object detectors. Using these object detectors trained on separate public data sets, object-based features are generated by assembling detection results to object sequences. A shot-based confidence score as well as further features, such as position, frame coverage and movement, are computed for each object class. Experimental results on TRECVID test data show significant improvements in terms of retrieval performance not only for the object classes, but also in particular for a large number of indirectly related concepts.",
keywords = "Object detection, Semantic concept detection, Video retrieval",
author = "Markus M{\"u}hling and Ralph Ewerth and Bernd Freisleben",
year = "2009",
month = oct,
day = "30",
doi = "10.1109/ICSC.2009.85",
language = "English",
isbn = "9780769538006",
series = "ICSC 2009 - 2009 IEEE International Conference on Semantic Computing",
pages = "109--115",
booktitle = "ICSC 2009",
note = "ICSC 2009 - 2009 IEEE International Conference on Semantic Computing ; Conference date: 14-09-2009 Through 16-09-2009",

}

Download

TY - GEN

T1 - Improving semantic video retrieval via object-based features

AU - Mühling, Markus

AU - Ewerth, Ralph

AU - Freisleben, Bernd

PY - 2009/10/30

Y1 - 2009/10/30

N2 - State-of-the-art systems for generic concept detection rely on low-level features, and in some cases additionally on features based on face detection, optical character recognition and/or speech recognition. In this paper, an approach for the task of semantic video retrieval is presented that systematically utilizes results of specialized object detectors. Using these object detectors trained on separate public data sets, object-based features are generated by assembling detection results to object sequences. A shot-based confidence score as well as further features, such as position, frame coverage and movement, are computed for each object class. Experimental results on TRECVID test data show significant improvements in terms of retrieval performance not only for the object classes, but also in particular for a large number of indirectly related concepts.

AB - State-of-the-art systems for generic concept detection rely on low-level features, and in some cases additionally on features based on face detection, optical character recognition and/or speech recognition. In this paper, an approach for the task of semantic video retrieval is presented that systematically utilizes results of specialized object detectors. Using these object detectors trained on separate public data sets, object-based features are generated by assembling detection results to object sequences. A shot-based confidence score as well as further features, such as position, frame coverage and movement, are computed for each object class. Experimental results on TRECVID test data show significant improvements in terms of retrieval performance not only for the object classes, but also in particular for a large number of indirectly related concepts.

KW - Object detection

KW - Semantic concept detection

KW - Video retrieval

UR - http://www.scopus.com/inward/record.url?scp=73449126520&partnerID=8YFLogxK

U2 - 10.1109/ICSC.2009.85

DO - 10.1109/ICSC.2009.85

M3 - Conference contribution

AN - SCOPUS:73449126520

SN - 9780769538006

T3 - ICSC 2009 - 2009 IEEE International Conference on Semantic Computing

SP - 109

EP - 115

BT - ICSC 2009

T2 - ICSC 2009 - 2009 IEEE International Conference on Semantic Computing

Y2 - 14 September 2009 through 16 September 2009

ER -