Visual Summarization of Scholarly Videos Using Word Embeddings and Keyphrase Extraction

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autoren

  • Hang Zhou
  • Christian Otto
  • Ralph Ewerth

Organisationseinheiten

Externe Organisationen

  • Technische Informationsbibliothek (TIB) Leibniz-Informationszentrum Technik und Naturwissenschaften und Universitätsbibliothek
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des SammelwerksDigital Libraries for Open Knowledge
Untertitel23rd International Conference on Theory and Practice of Digital Libraries, TPDL 2019, Proceedings
Herausgeber/-innenAntoine Doucet, Antoine Isaac, Koraljka Golub, Trond Aalberg, Adam Jatowt
Herausgeber (Verlag)Springer Verlag
Seiten327-335
Seitenumfang9
Auflage1.
ISBN (elektronisch)978-3-030-30760-8
ISBN (Print)978-3-030-30759-2
PublikationsstatusVeröffentlicht - 30 Aug. 2019
Veranstaltung23rd International Conference on Theory and Practice of Digital Libraries, TPDL 2019 - Oslo, Norwegen
Dauer: 9 Sept. 201912 Sept. 2019

Publikationsreihe

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Band11799 LNCS
ISSN (Print)0302-9743
ISSN (elektronisch)1611-3349

Abstract

Effective learning with audiovisual content depends on many factors. Besides the quality of the learning resource’s content, it is essential to discover the most relevant and suitable video in order to support the learning process most effectively. Video summarization techniques facilitate this goal by providing a quick overview over the content. It is especially useful for longer recordings such as conference presentations or lectures. In this paper, we present a domain specific approach that generates a visual summary of video content using solely textual information. For this purpose, we exploit video annotations that are automatically generated by speech recognition and video OCR (optical character recognition). Textual information is represented by semantic word embeddings and extracted keyphrases. We demonstrate the feasibility of the proposed approach through its incorporation into the TIB AV-Portal (http://av.tib.eu/ ), which is a platform for scientific videos. The accuracy and usefulness of the generated video content visualizations is evaluated in a user study.

ASJC Scopus Sachgebiete

Zitieren

Visual Summarization of Scholarly Videos Using Word Embeddings and Keyphrase Extraction. / Zhou, Hang; Otto, Christian; Ewerth, Ralph.
Digital Libraries for Open Knowledge: 23rd International Conference on Theory and Practice of Digital Libraries, TPDL 2019, Proceedings. Hrsg. / Antoine Doucet; Antoine Isaac; Koraljka Golub; Trond Aalberg; Adam Jatowt. 1. Aufl. Springer Verlag, 2019. S. 327-335 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Band 11799 LNCS).

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Zhou, H, Otto, C & Ewerth, R 2019, Visual Summarization of Scholarly Videos Using Word Embeddings and Keyphrase Extraction. in A Doucet, A Isaac, K Golub, T Aalberg & A Jatowt (Hrsg.), Digital Libraries for Open Knowledge: 23rd International Conference on Theory and Practice of Digital Libraries, TPDL 2019, Proceedings. 1. Aufl., Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Bd. 11799 LNCS, Springer Verlag, S. 327-335, 23rd International Conference on Theory and Practice of Digital Libraries, TPDL 2019, Oslo, Norwegen, 9 Sept. 2019. https://doi.org/10.1007/978-3-030-30760-8_28, https://doi.org/10.1007/978-3-030-30760-8_28
Zhou, H., Otto, C., & Ewerth, R. (2019). Visual Summarization of Scholarly Videos Using Word Embeddings and Keyphrase Extraction. In A. Doucet, A. Isaac, K. Golub, T. Aalberg, & A. Jatowt (Hrsg.), Digital Libraries for Open Knowledge: 23rd International Conference on Theory and Practice of Digital Libraries, TPDL 2019, Proceedings (1. Aufl., S. 327-335). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Band 11799 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-030-30760-8_28, https://doi.org/10.1007/978-3-030-30760-8_28
Zhou H, Otto C, Ewerth R. Visual Summarization of Scholarly Videos Using Word Embeddings and Keyphrase Extraction. in Doucet A, Isaac A, Golub K, Aalberg T, Jatowt A, Hrsg., Digital Libraries for Open Knowledge: 23rd International Conference on Theory and Practice of Digital Libraries, TPDL 2019, Proceedings. 1. Aufl. Springer Verlag. 2019. S. 327-335. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-030-30760-8_28, 10.1007/978-3-030-30760-8_28
Zhou, Hang ; Otto, Christian ; Ewerth, Ralph. / Visual Summarization of Scholarly Videos Using Word Embeddings and Keyphrase Extraction. Digital Libraries for Open Knowledge: 23rd International Conference on Theory and Practice of Digital Libraries, TPDL 2019, Proceedings. Hrsg. / Antoine Doucet ; Antoine Isaac ; Koraljka Golub ; Trond Aalberg ; Adam Jatowt. 1. Aufl. Springer Verlag, 2019. S. 327-335 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
Download
@inproceedings{52dd24e22a3b4093afbcb7807759f61e,
title = "Visual Summarization of Scholarly Videos Using Word Embeddings and Keyphrase Extraction",
abstract = "Effective learning with audiovisual content depends on many factors. Besides the quality of the learning resource{\textquoteright}s content, it is essential to discover the most relevant and suitable video in order to support the learning process most effectively. Video summarization techniques facilitate this goal by providing a quick overview over the content. It is especially useful for longer recordings such as conference presentations or lectures. In this paper, we present a domain specific approach that generates a visual summary of video content using solely textual information. For this purpose, we exploit video annotations that are automatically generated by speech recognition and video OCR (optical character recognition). Textual information is represented by semantic word embeddings and extracted keyphrases. We demonstrate the feasibility of the proposed approach through its incorporation into the TIB AV-Portal (http://av.tib.eu/ ), which is a platform for scientific videos. The accuracy and usefulness of the generated video content visualizations is evaluated in a user study.",
keywords = "Scientific videos, Video summarization, Word embeddings",
author = "Hang Zhou and Christian Otto and Ralph Ewerth",
note = "Funding information: Part of this work is financially supported by the Leibniz Association, Germany (Leibniz Competition 2018, funding line “Collaborative Excellence”, project SALIENT [K68/2017]).; 23rd International Conference on Theory and Practice of Digital Libraries, TPDL 2019 ; Conference date: 09-09-2019 Through 12-09-2019",
year = "2019",
month = aug,
day = "30",
doi = "10.1007/978-3-030-30760-8_28",
language = "English",
isbn = "978-3-030-30759-2",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "327--335",
editor = "Antoine Doucet and Antoine Isaac and Koraljka Golub and Trond Aalberg and Adam Jatowt",
booktitle = "Digital Libraries for Open Knowledge",
address = "Germany",
edition = "1.",

}

Download

TY - GEN

T1 - Visual Summarization of Scholarly Videos Using Word Embeddings and Keyphrase Extraction

AU - Zhou, Hang

AU - Otto, Christian

AU - Ewerth, Ralph

N1 - Funding information: Part of this work is financially supported by the Leibniz Association, Germany (Leibniz Competition 2018, funding line “Collaborative Excellence”, project SALIENT [K68/2017]).

PY - 2019/8/30

Y1 - 2019/8/30

N2 - Effective learning with audiovisual content depends on many factors. Besides the quality of the learning resource’s content, it is essential to discover the most relevant and suitable video in order to support the learning process most effectively. Video summarization techniques facilitate this goal by providing a quick overview over the content. It is especially useful for longer recordings such as conference presentations or lectures. In this paper, we present a domain specific approach that generates a visual summary of video content using solely textual information. For this purpose, we exploit video annotations that are automatically generated by speech recognition and video OCR (optical character recognition). Textual information is represented by semantic word embeddings and extracted keyphrases. We demonstrate the feasibility of the proposed approach through its incorporation into the TIB AV-Portal (http://av.tib.eu/ ), which is a platform for scientific videos. The accuracy and usefulness of the generated video content visualizations is evaluated in a user study.

AB - Effective learning with audiovisual content depends on many factors. Besides the quality of the learning resource’s content, it is essential to discover the most relevant and suitable video in order to support the learning process most effectively. Video summarization techniques facilitate this goal by providing a quick overview over the content. It is especially useful for longer recordings such as conference presentations or lectures. In this paper, we present a domain specific approach that generates a visual summary of video content using solely textual information. For this purpose, we exploit video annotations that are automatically generated by speech recognition and video OCR (optical character recognition). Textual information is represented by semantic word embeddings and extracted keyphrases. We demonstrate the feasibility of the proposed approach through its incorporation into the TIB AV-Portal (http://av.tib.eu/ ), which is a platform for scientific videos. The accuracy and usefulness of the generated video content visualizations is evaluated in a user study.

KW - Scientific videos

KW - Video summarization

KW - Word embeddings

UR - http://www.scopus.com/inward/record.url?scp=85072865951&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-30760-8_28

DO - 10.1007/978-3-030-30760-8_28

M3 - Conference contribution

AN - SCOPUS:85072865951

SN - 978-3-030-30759-2

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 327

EP - 335

BT - Digital Libraries for Open Knowledge

A2 - Doucet, Antoine

A2 - Isaac, Antoine

A2 - Golub, Koraljka

A2 - Aalberg, Trond

A2 - Jatowt, Adam

PB - Springer Verlag

T2 - 23rd International Conference on Theory and Practice of Digital Libraries, TPDL 2019

Y2 - 9 September 2019 through 12 September 2019

ER -