The Potential of Using Vision Videos for CrowdRE: Video Comments as a Source of Feedback

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autoren

Organisationseinheiten

Externe Organisationen

  • Technische Informationsbibliothek (TIB) Leibniz-Informationszentrum Technik und Naturwissenschaften und Universitätsbibliothek
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des Sammelwerks2021 IEEE 29th International Requirements Engineering Conference Workshops (REW)
Herausgeber/-innenTao Yue, Mehdi Mirakhorli
Herausgeber (Verlag)IEEE Computer Society
Seiten298-305
Seitenumfang8
ISBN (elektronisch)9781665418980
PublikationsstatusVeröffentlicht - 2021
Veranstaltung2021 IEEE 29th International Requirements Engineering Conference Workshops (REW) - Virtual, Notre Dame, USA / Vereinigte Staaten
Dauer: 20 Sept. 202124 Sept. 2021
Konferenznummer: 29

Publikationsreihe

NameProceedings of the IEEE International Conference on Requirements Engineering
Band2021-September
ISSN (Print)1090-705X
ISSN (elektronisch)2332-6441

Abstract

Vision videos are established for soliciting feedback and stimulating discussions in requirements engineering (RE) practices such as focus groups. Different researchers motivated the transfer of these benefits into crowd-based RE (CrowdRE) by using vision videos on social media platforms. So far, however, little research explored the potential of using vision videos for CrowdRE in detail. In this paper, we analyze and assess this potential, in particular, focusing on video comments as a source of feedback. In a case study, we analyzed 4505 comments on a vision video from YouTube. We found that the video solicited 2770 comments from 2660 viewers in four days. This is more than 50% of all comments the video received in four years. Even though only a certain fraction of these comments are relevant to RE, the relevant comments address typical intentions and topics of user feedback, such as feature request or problem report. Besides the typical user feedback categories, we found more than 300 comments that address the topic safety which has not appeared in previous analyses of user feedback. In an automated analysis, we compared the performance of three machine learning algorithms on classifying the video comments. Despite certain differences, the algorithms classified the video comments well. Based on these findings, we conclude that the use of vision videos for CrowdRE has a large potential. Despite the preliminary nature of the case study, we are optimistic that vision videos can motivate stakeholders to actively participate in a crowd and solicit numerous of video comments as a valuable source of feedback.

ASJC Scopus Sachgebiete

Zitieren

The Potential of Using Vision Videos for CrowdRE: Video Comments as a Source of Feedback. / Karras, Oliver; Kristo, Eklekta; Klünder, Jil.
2021 IEEE 29th International Requirements Engineering Conference Workshops (REW). Hrsg. / Tao Yue; Mehdi Mirakhorli. IEEE Computer Society, 2021. S. 298-305 (Proceedings of the IEEE International Conference on Requirements Engineering; Band 2021-September).

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Karras, O, Kristo, E & Klünder, J 2021, The Potential of Using Vision Videos for CrowdRE: Video Comments as a Source of Feedback. in T Yue & M Mirakhorli (Hrsg.), 2021 IEEE 29th International Requirements Engineering Conference Workshops (REW). Proceedings of the IEEE International Conference on Requirements Engineering, Bd. 2021-September, IEEE Computer Society, S. 298-305, 2021 IEEE 29th International Requirements Engineering Conference Workshops (REW), Virtual, Notre Dame, USA / Vereinigte Staaten, 20 Sept. 2021. https://doi.org/10.15488/16379, https://doi.org/10.1109/REW53955.2021.00053
Karras, O., Kristo, E., & Klünder, J. (2021). The Potential of Using Vision Videos for CrowdRE: Video Comments as a Source of Feedback. In T. Yue, & M. Mirakhorli (Hrsg.), 2021 IEEE 29th International Requirements Engineering Conference Workshops (REW) (S. 298-305). (Proceedings of the IEEE International Conference on Requirements Engineering; Band 2021-September). IEEE Computer Society. https://doi.org/10.15488/16379, https://doi.org/10.1109/REW53955.2021.00053
Karras O, Kristo E, Klünder J. The Potential of Using Vision Videos for CrowdRE: Video Comments as a Source of Feedback. in Yue T, Mirakhorli M, Hrsg., 2021 IEEE 29th International Requirements Engineering Conference Workshops (REW). IEEE Computer Society. 2021. S. 298-305. (Proceedings of the IEEE International Conference on Requirements Engineering). doi: 10.15488/16379, 10.1109/REW53955.2021.00053
Karras, Oliver ; Kristo, Eklekta ; Klünder, Jil. / The Potential of Using Vision Videos for CrowdRE : Video Comments as a Source of Feedback. 2021 IEEE 29th International Requirements Engineering Conference Workshops (REW). Hrsg. / Tao Yue ; Mehdi Mirakhorli. IEEE Computer Society, 2021. S. 298-305 (Proceedings of the IEEE International Conference on Requirements Engineering).
Download
@inproceedings{70470fac6311467882f1d1682f4a8500,
title = "The Potential of Using Vision Videos for CrowdRE: Video Comments as a Source of Feedback",
abstract = "Vision videos are established for soliciting feedback and stimulating discussions in requirements engineering (RE) practices such as focus groups. Different researchers motivated the transfer of these benefits into crowd-based RE (CrowdRE) by using vision videos on social media platforms. So far, however, little research explored the potential of using vision videos for CrowdRE in detail. In this paper, we analyze and assess this potential, in particular, focusing on video comments as a source of feedback. In a case study, we analyzed 4505 comments on a vision video from YouTube. We found that the video solicited 2770 comments from 2660 viewers in four days. This is more than 50% of all comments the video received in four years. Even though only a certain fraction of these comments are relevant to RE, the relevant comments address typical intentions and topics of user feedback, such as feature request or problem report. Besides the typical user feedback categories, we found more than 300 comments that address the topic safety which has not appeared in previous analyses of user feedback. In an automated analysis, we compared the performance of three machine learning algorithms on classifying the video comments. Despite certain differences, the algorithms classified the video comments well. Based on these findings, we conclude that the use of vision videos for CrowdRE has a large potential. Despite the preliminary nature of the case study, we are optimistic that vision videos can motivate stakeholders to actively participate in a crowd and solicit numerous of video comments as a valuable source of feedback. ",
keywords = "classification, crowd, feedback, Requirements engineering, video comment, vision video",
author = "Oliver Karras and Eklekta Kristo and Jil Kl{\"u}nder",
year = "2021",
doi = "10.15488/16379",
language = "English",
series = "Proceedings of the IEEE International Conference on Requirements Engineering",
publisher = "IEEE Computer Society",
pages = "298--305",
editor = "Tao Yue and Mehdi Mirakhorli",
booktitle = "2021 IEEE 29th International Requirements Engineering Conference Workshops (REW)",
address = "United States",
note = "29th IEEE International Requirements Engineering Conference Workshops, REW 2021 ; Conference date: 20-09-2021 Through 24-09-2021",

}

Download

TY - GEN

T1 - The Potential of Using Vision Videos for CrowdRE

T2 - 29th IEEE International Requirements Engineering Conference Workshops, REW 2021

AU - Karras, Oliver

AU - Kristo, Eklekta

AU - Klünder, Jil

N1 - Conference code: 29

PY - 2021

Y1 - 2021

N2 - Vision videos are established for soliciting feedback and stimulating discussions in requirements engineering (RE) practices such as focus groups. Different researchers motivated the transfer of these benefits into crowd-based RE (CrowdRE) by using vision videos on social media platforms. So far, however, little research explored the potential of using vision videos for CrowdRE in detail. In this paper, we analyze and assess this potential, in particular, focusing on video comments as a source of feedback. In a case study, we analyzed 4505 comments on a vision video from YouTube. We found that the video solicited 2770 comments from 2660 viewers in four days. This is more than 50% of all comments the video received in four years. Even though only a certain fraction of these comments are relevant to RE, the relevant comments address typical intentions and topics of user feedback, such as feature request or problem report. Besides the typical user feedback categories, we found more than 300 comments that address the topic safety which has not appeared in previous analyses of user feedback. In an automated analysis, we compared the performance of three machine learning algorithms on classifying the video comments. Despite certain differences, the algorithms classified the video comments well. Based on these findings, we conclude that the use of vision videos for CrowdRE has a large potential. Despite the preliminary nature of the case study, we are optimistic that vision videos can motivate stakeholders to actively participate in a crowd and solicit numerous of video comments as a valuable source of feedback.

AB - Vision videos are established for soliciting feedback and stimulating discussions in requirements engineering (RE) practices such as focus groups. Different researchers motivated the transfer of these benefits into crowd-based RE (CrowdRE) by using vision videos on social media platforms. So far, however, little research explored the potential of using vision videos for CrowdRE in detail. In this paper, we analyze and assess this potential, in particular, focusing on video comments as a source of feedback. In a case study, we analyzed 4505 comments on a vision video from YouTube. We found that the video solicited 2770 comments from 2660 viewers in four days. This is more than 50% of all comments the video received in four years. Even though only a certain fraction of these comments are relevant to RE, the relevant comments address typical intentions and topics of user feedback, such as feature request or problem report. Besides the typical user feedback categories, we found more than 300 comments that address the topic safety which has not appeared in previous analyses of user feedback. In an automated analysis, we compared the performance of three machine learning algorithms on classifying the video comments. Despite certain differences, the algorithms classified the video comments well. Based on these findings, we conclude that the use of vision videos for CrowdRE has a large potential. Despite the preliminary nature of the case study, we are optimistic that vision videos can motivate stakeholders to actively participate in a crowd and solicit numerous of video comments as a valuable source of feedback.

KW - classification

KW - crowd

KW - feedback

KW - Requirements engineering

KW - video comment

KW - vision video

UR - http://www.scopus.com/inward/record.url?scp=85118422812&partnerID=8YFLogxK

U2 - 10.15488/16379

DO - 10.15488/16379

M3 - Conference contribution

AN - SCOPUS:85118422812

T3 - Proceedings of the IEEE International Conference on Requirements Engineering

SP - 298

EP - 305

BT - 2021 IEEE 29th International Requirements Engineering Conference Workshops (REW)

A2 - Yue, Tao

A2 - Mirakhorli, Mehdi

PB - IEEE Computer Society

Y2 - 20 September 2021 through 24 September 2021

ER -

Von denselben Autoren