Details
| Originalsprache | Englisch |
|---|---|
| Titel des Sammelwerks | 2023 IEEE 31st International Requirements Engineering Conference Workshops (REW) |
| Herausgeber/-innen | Kurt Schneider, Fabiano Dalpiaz, Jennifer Horkoff |
| Seiten | 146-153 |
| Seitenumfang | 8 |
| ISBN (elektronisch) | 979-8-3503-2691-8 |
| Publikationsstatus | Veröffentlicht - 2023 |
| Veranstaltung | 2023 IEEE 31st International Requirements Engineering Conference Workshops (REW) - Hannover, Germany, Hannover, Deutschland Dauer: 4 Sept. 2023 → 5 Sept. 2023 Konferenznummer: 31 |
Publikationsreihe
| Name | IEEE International Requirements Engineering Conference Workshops (REW) |
|---|---|
| ISSN (Print) | 2770-6826 |
Abstract
[Context] Software with graphical user interfaces (GUIs) is used in everyday life. Users expect working software when they interact with a software product. For this reason, testing and defect corrections are required. However, understanding GUI tests is challenging, as the generated textual test reports lack the dynamic details about interaction steps to reproduce a GUI defect. [Objective] We want to revise the practice of GUI testing and use videos as a by-product to capture and convey these dynamic details. [Method] Based on the video as a by-product approach, we propose to generate videos as a by-product of GUI testing, integrating annotations and test outputs directly into the videos. These videos serve as supplementary material for documenting dynamic test executions in addition to static test reports (e.g., texts, screenshots). In an experiment, we asked 11 participants to distinguish between true and false defects in watching videos and screenshots of four test cases. We also conducted structured interviews to ask the participants about their opinions for these two documentation options. [Results & Conclusion] Our results show visible differences between the video and the screenshots in effectiveness and efficiency in defect analysis, but cannot prove the differences statistically. The listed advantages and disadvantages of both documentations are complemental. Both documentations are helpful and thus videos as a by-product of GUI testing can foster the understanding of GUI tests.
ASJC Scopus Sachgebiete
- Informatik (insg.)
- Software
- Ingenieurwesen (insg.)
- Sicherheit, Risiko, Zuverlässigkeit und Qualität
- Sozialwissenschaften (insg.)
- Ausbildung bzw. Denomination
- Psychologie (insg.)
- Pädagogische und Entwicklungspsychologie
- Betriebswirtschaft, Management und Rechnungswesen (insg.)
- Organisationslehre und Personalmanagement
Zitieren
- Standard
- Harvard
- Apa
- Vancouver
- BibTex
- RIS
2023 IEEE 31st International Requirements Engineering Conference Workshops (REW). Hrsg. / Kurt Schneider; Fabiano Dalpiaz; Jennifer Horkoff. 2023. S. 146-153 (IEEE International Requirements Engineering Conference Workshops (REW)).
Publikation: Beitrag in Buch/Bericht/Sammelwerk/Konferenzband › Aufsatz in Konferenzband › Forschung › Peer-Review
}
TY - GEN
T1 - Can Videos as a By-Product of GUI Testing Help Developers Understand GUI Tests?
AU - Shi, Jianwei
AU - Karras, Oliver
AU - Obaidi, Martin
AU - Tandun, Malvin
N1 - Conference code: 31
PY - 2023
Y1 - 2023
N2 - [Context] Software with graphical user interfaces (GUIs) is used in everyday life. Users expect working software when they interact with a software product. For this reason, testing and defect corrections are required. However, understanding GUI tests is challenging, as the generated textual test reports lack the dynamic details about interaction steps to reproduce a GUI defect. [Objective] We want to revise the practice of GUI testing and use videos as a by-product to capture and convey these dynamic details. [Method] Based on the video as a by-product approach, we propose to generate videos as a by-product of GUI testing, integrating annotations and test outputs directly into the videos. These videos serve as supplementary material for documenting dynamic test executions in addition to static test reports (e.g., texts, screenshots). In an experiment, we asked 11 participants to distinguish between true and false defects in watching videos and screenshots of four test cases. We also conducted structured interviews to ask the participants about their opinions for these two documentation options. [Results & Conclusion] Our results show visible differences between the video and the screenshots in effectiveness and efficiency in defect analysis, but cannot prove the differences statistically. The listed advantages and disadvantages of both documentations are complemental. Both documentations are helpful and thus videos as a by-product of GUI testing can foster the understanding of GUI tests.
AB - [Context] Software with graphical user interfaces (GUIs) is used in everyday life. Users expect working software when they interact with a software product. For this reason, testing and defect corrections are required. However, understanding GUI tests is challenging, as the generated textual test reports lack the dynamic details about interaction steps to reproduce a GUI defect. [Objective] We want to revise the practice of GUI testing and use videos as a by-product to capture and convey these dynamic details. [Method] Based on the video as a by-product approach, we propose to generate videos as a by-product of GUI testing, integrating annotations and test outputs directly into the videos. These videos serve as supplementary material for documenting dynamic test executions in addition to static test reports (e.g., texts, screenshots). In an experiment, we asked 11 participants to distinguish between true and false defects in watching videos and screenshots of four test cases. We also conducted structured interviews to ask the participants about their opinions for these two documentation options. [Results & Conclusion] Our results show visible differences between the video and the screenshots in effectiveness and efficiency in defect analysis, but cannot prove the differences statistically. The listed advantages and disadvantages of both documentations are complemental. Both documentations are helpful and thus videos as a by-product of GUI testing can foster the understanding of GUI tests.
KW - GUI test
KW - by-product
KW - video
UR - http://www.scopus.com/inward/record.url?scp=85174712260&partnerID=8YFLogxK
U2 - 10.15488/16374
DO - 10.15488/16374
M3 - Conference contribution
SN - 979-8-3503-2692-5
T3 - IEEE International Requirements Engineering Conference Workshops (REW)
SP - 146
EP - 153
BT - 2023 IEEE 31st International Requirements Engineering Conference Workshops (REW)
A2 - Schneider, Kurt
A2 - Dalpiaz, Fabiano
A2 - Horkoff, Jennifer
T2 - 31st IEEE International Requirements Engineering Conference Workshops, REW 2023
Y2 - 4 September 2023 through 5 September 2023
ER -