The Potential of Using Vision Videos for CrowdRE: Video Comments as a Source of Feedback

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

Research Organisations

External Research Organisations

  • German National Library of Science and Technology (TIB)
View graph of relations

Details

Original languageEnglish
Title of host publication2021 IEEE 29th International Requirements Engineering Conference Workshops (REW)
EditorsTao Yue, Mehdi Mirakhorli
PublisherIEEE Computer Society
Pages298-305
Number of pages8
ISBN (electronic)9781665418980
Publication statusPublished - 2021
Event29th IEEE International Requirements Engineering Conference Workshops, REW 2021 - Virtual, Notre Dame, United States
Duration: 20 Sept 202124 Sept 2021
Conference number: 29

Publication series

NameProceedings of the IEEE International Conference on Requirements Engineering
Volume2021-September
ISSN (Print)1090-705X
ISSN (electronic)2332-6441

Abstract

Vision videos are established for soliciting feedback and stimulating discussions in requirements engineering (RE) practices such as focus groups. Different researchers motivated the transfer of these benefits into crowd-based RE (CrowdRE) by using vision videos on social media platforms. So far, however, little research explored the potential of using vision videos for CrowdRE in detail. In this paper, we analyze and assess this potential, in particular, focusing on video comments as a source of feedback. In a case study, we analyzed 4505 comments on a vision video from YouTube. We found that the video solicited 2770 comments from 2660 viewers in four days. This is more than 50% of all comments the video received in four years. Even though only a certain fraction of these comments are relevant to RE, the relevant comments address typical intentions and topics of user feedback, such as feature request or problem report. Besides the typical user feedback categories, we found more than 300 comments that address the topic safety which has not appeared in previous analyses of user feedback. In an automated analysis, we compared the performance of three machine learning algorithms on classifying the video comments. Despite certain differences, the algorithms classified the video comments well. Based on these findings, we conclude that the use of vision videos for CrowdRE has a large potential. Despite the preliminary nature of the case study, we are optimistic that vision videos can motivate stakeholders to actively participate in a crowd and solicit numerous of video comments as a valuable source of feedback.

Keywords

    classification, crowd, feedback, Requirements engineering, video comment, vision video

ASJC Scopus subject areas

Cite this

The Potential of Using Vision Videos for CrowdRE: Video Comments as a Source of Feedback. / Karras, Oliver; Kristo, Eklekta; Klünder, Jil.
2021 IEEE 29th International Requirements Engineering Conference Workshops (REW). ed. / Tao Yue; Mehdi Mirakhorli. IEEE Computer Society, 2021. p. 298-305 (Proceedings of the IEEE International Conference on Requirements Engineering; Vol. 2021-September).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Karras, O, Kristo, E & Klünder, J 2021, The Potential of Using Vision Videos for CrowdRE: Video Comments as a Source of Feedback. in T Yue & M Mirakhorli (eds), 2021 IEEE 29th International Requirements Engineering Conference Workshops (REW). Proceedings of the IEEE International Conference on Requirements Engineering, vol. 2021-September, IEEE Computer Society, pp. 298-305, 29th IEEE International Requirements Engineering Conference Workshops, REW 2021, Virtual, Notre Dame, United States, 20 Sept 2021. https://doi.org/10.15488/16379, https://doi.org/10.1109/REW53955.2021.00053
Karras, O., Kristo, E., & Klünder, J. (2021). The Potential of Using Vision Videos for CrowdRE: Video Comments as a Source of Feedback. In T. Yue, & M. Mirakhorli (Eds.), 2021 IEEE 29th International Requirements Engineering Conference Workshops (REW) (pp. 298-305). (Proceedings of the IEEE International Conference on Requirements Engineering; Vol. 2021-September). IEEE Computer Society. https://doi.org/10.15488/16379, https://doi.org/10.1109/REW53955.2021.00053
Karras O, Kristo E, Klünder J. The Potential of Using Vision Videos for CrowdRE: Video Comments as a Source of Feedback. In Yue T, Mirakhorli M, editors, 2021 IEEE 29th International Requirements Engineering Conference Workshops (REW). IEEE Computer Society. 2021. p. 298-305. (Proceedings of the IEEE International Conference on Requirements Engineering). doi: 10.15488/16379, 10.1109/REW53955.2021.00053
Karras, Oliver ; Kristo, Eklekta ; Klünder, Jil. / The Potential of Using Vision Videos for CrowdRE : Video Comments as a Source of Feedback. 2021 IEEE 29th International Requirements Engineering Conference Workshops (REW). editor / Tao Yue ; Mehdi Mirakhorli. IEEE Computer Society, 2021. pp. 298-305 (Proceedings of the IEEE International Conference on Requirements Engineering).
Download
@inproceedings{70470fac6311467882f1d1682f4a8500,
title = "The Potential of Using Vision Videos for CrowdRE: Video Comments as a Source of Feedback",
abstract = "Vision videos are established for soliciting feedback and stimulating discussions in requirements engineering (RE) practices such as focus groups. Different researchers motivated the transfer of these benefits into crowd-based RE (CrowdRE) by using vision videos on social media platforms. So far, however, little research explored the potential of using vision videos for CrowdRE in detail. In this paper, we analyze and assess this potential, in particular, focusing on video comments as a source of feedback. In a case study, we analyzed 4505 comments on a vision video from YouTube. We found that the video solicited 2770 comments from 2660 viewers in four days. This is more than 50% of all comments the video received in four years. Even though only a certain fraction of these comments are relevant to RE, the relevant comments address typical intentions and topics of user feedback, such as feature request or problem report. Besides the typical user feedback categories, we found more than 300 comments that address the topic safety which has not appeared in previous analyses of user feedback. In an automated analysis, we compared the performance of three machine learning algorithms on classifying the video comments. Despite certain differences, the algorithms classified the video comments well. Based on these findings, we conclude that the use of vision videos for CrowdRE has a large potential. Despite the preliminary nature of the case study, we are optimistic that vision videos can motivate stakeholders to actively participate in a crowd and solicit numerous of video comments as a valuable source of feedback. ",
keywords = "classification, crowd, feedback, Requirements engineering, video comment, vision video",
author = "Oliver Karras and Eklekta Kristo and Jil Kl{\"u}nder",
year = "2021",
doi = "10.15488/16379",
language = "English",
series = "Proceedings of the IEEE International Conference on Requirements Engineering",
publisher = "IEEE Computer Society",
pages = "298--305",
editor = "Tao Yue and Mehdi Mirakhorli",
booktitle = "2021 IEEE 29th International Requirements Engineering Conference Workshops (REW)",
address = "United States",
note = "29th IEEE International Requirements Engineering Conference Workshops, REW 2021 ; Conference date: 20-09-2021 Through 24-09-2021",

}

Download

TY - GEN

T1 - The Potential of Using Vision Videos for CrowdRE

T2 - 29th IEEE International Requirements Engineering Conference Workshops, REW 2021

AU - Karras, Oliver

AU - Kristo, Eklekta

AU - Klünder, Jil

N1 - Conference code: 29

PY - 2021

Y1 - 2021

N2 - Vision videos are established for soliciting feedback and stimulating discussions in requirements engineering (RE) practices such as focus groups. Different researchers motivated the transfer of these benefits into crowd-based RE (CrowdRE) by using vision videos on social media platforms. So far, however, little research explored the potential of using vision videos for CrowdRE in detail. In this paper, we analyze and assess this potential, in particular, focusing on video comments as a source of feedback. In a case study, we analyzed 4505 comments on a vision video from YouTube. We found that the video solicited 2770 comments from 2660 viewers in four days. This is more than 50% of all comments the video received in four years. Even though only a certain fraction of these comments are relevant to RE, the relevant comments address typical intentions and topics of user feedback, such as feature request or problem report. Besides the typical user feedback categories, we found more than 300 comments that address the topic safety which has not appeared in previous analyses of user feedback. In an automated analysis, we compared the performance of three machine learning algorithms on classifying the video comments. Despite certain differences, the algorithms classified the video comments well. Based on these findings, we conclude that the use of vision videos for CrowdRE has a large potential. Despite the preliminary nature of the case study, we are optimistic that vision videos can motivate stakeholders to actively participate in a crowd and solicit numerous of video comments as a valuable source of feedback.

AB - Vision videos are established for soliciting feedback and stimulating discussions in requirements engineering (RE) practices such as focus groups. Different researchers motivated the transfer of these benefits into crowd-based RE (CrowdRE) by using vision videos on social media platforms. So far, however, little research explored the potential of using vision videos for CrowdRE in detail. In this paper, we analyze and assess this potential, in particular, focusing on video comments as a source of feedback. In a case study, we analyzed 4505 comments on a vision video from YouTube. We found that the video solicited 2770 comments from 2660 viewers in four days. This is more than 50% of all comments the video received in four years. Even though only a certain fraction of these comments are relevant to RE, the relevant comments address typical intentions and topics of user feedback, such as feature request or problem report. Besides the typical user feedback categories, we found more than 300 comments that address the topic safety which has not appeared in previous analyses of user feedback. In an automated analysis, we compared the performance of three machine learning algorithms on classifying the video comments. Despite certain differences, the algorithms classified the video comments well. Based on these findings, we conclude that the use of vision videos for CrowdRE has a large potential. Despite the preliminary nature of the case study, we are optimistic that vision videos can motivate stakeholders to actively participate in a crowd and solicit numerous of video comments as a valuable source of feedback.

KW - classification

KW - crowd

KW - feedback

KW - Requirements engineering

KW - video comment

KW - vision video

UR - http://www.scopus.com/inward/record.url?scp=85118422812&partnerID=8YFLogxK

U2 - 10.15488/16379

DO - 10.15488/16379

M3 - Conference contribution

AN - SCOPUS:85118422812

T3 - Proceedings of the IEEE International Conference on Requirements Engineering

SP - 298

EP - 305

BT - 2021 IEEE 29th International Requirements Engineering Conference Workshops (REW)

A2 - Yue, Tao

A2 - Mirakhorli, Mehdi

PB - IEEE Computer Society

Y2 - 20 September 2021 through 24 September 2021

ER -

By the same author(s)