Details
| Original language | English |
|---|---|
| Title of host publication | 2023 IEEE 31st International Requirements Engineering Conference Workshops (REW) |
| Editors | Kurt Schneider, Fabiano Dalpiaz, Jennifer Horkoff |
| Pages | 146-153 |
| Number of pages | 8 |
| ISBN (electronic) | 979-8-3503-2691-8 |
| Publication status | Published - 2023 |
| Event | 31st IEEE International Requirements Engineering Conference Workshops, REW 2023 - Hannover, Germany, Hannover, Germany Duration: 4 Sept 2023 → 5 Sept 2023 Conference number: 31 |
Publication series
| Name | IEEE International Requirements Engineering Conference Workshops (REW) |
|---|---|
| ISSN (Print) | 2770-6826 |
Abstract
[Context] Software with graphical user interfaces (GUIs) is used in everyday life. Users expect working software when they interact with a software product. For this reason, testing and defect corrections are required. However, understanding GUI tests is challenging, as the generated textual test reports lack the dynamic details about interaction steps to reproduce a GUI defect. [Objective] We want to revise the practice of GUI testing and use videos as a by-product to capture and convey these dynamic details. [Method] Based on the video as a by-product approach, we propose to generate videos as a by-product of GUI testing, integrating annotations and test outputs directly into the videos. These videos serve as supplementary material for documenting dynamic test executions in addition to static test reports (e.g., texts, screenshots). In an experiment, we asked 11 participants to distinguish between true and false defects in watching videos and screenshots of four test cases. We also conducted structured interviews to ask the participants about their opinions for these two documentation options. [Results & Conclusion] Our results show visible differences between the video and the screenshots in effectiveness and efficiency in defect analysis, but cannot prove the differences statistically. The listed advantages and disadvantages of both documentations are complemental. Both documentations are helpful and thus videos as a by-product of GUI testing can foster the understanding of GUI tests.
Keywords
- GUI test, by-product, video
ASJC Scopus subject areas
- Computer Science(all)
- Software
- Engineering(all)
- Safety, Risk, Reliability and Quality
- Social Sciences(all)
- Education
- Psychology(all)
- Developmental and Educational Psychology
- Business, Management and Accounting(all)
- Organizational Behavior and Human Resource Management
Cite this
- Standard
- Harvard
- Apa
- Vancouver
- BibTeX
- RIS
2023 IEEE 31st International Requirements Engineering Conference Workshops (REW). ed. / Kurt Schneider; Fabiano Dalpiaz; Jennifer Horkoff. 2023. p. 146-153 (IEEE International Requirements Engineering Conference Workshops (REW)).
Research output: Chapter in book/report/conference proceeding › Conference contribution › Research › peer review
}
TY - GEN
T1 - Can Videos as a By-Product of GUI Testing Help Developers Understand GUI Tests?
AU - Shi, Jianwei
AU - Karras, Oliver
AU - Obaidi, Martin
AU - Tandun, Malvin
N1 - Conference code: 31
PY - 2023
Y1 - 2023
N2 - [Context] Software with graphical user interfaces (GUIs) is used in everyday life. Users expect working software when they interact with a software product. For this reason, testing and defect corrections are required. However, understanding GUI tests is challenging, as the generated textual test reports lack the dynamic details about interaction steps to reproduce a GUI defect. [Objective] We want to revise the practice of GUI testing and use videos as a by-product to capture and convey these dynamic details. [Method] Based on the video as a by-product approach, we propose to generate videos as a by-product of GUI testing, integrating annotations and test outputs directly into the videos. These videos serve as supplementary material for documenting dynamic test executions in addition to static test reports (e.g., texts, screenshots). In an experiment, we asked 11 participants to distinguish between true and false defects in watching videos and screenshots of four test cases. We also conducted structured interviews to ask the participants about their opinions for these two documentation options. [Results & Conclusion] Our results show visible differences between the video and the screenshots in effectiveness and efficiency in defect analysis, but cannot prove the differences statistically. The listed advantages and disadvantages of both documentations are complemental. Both documentations are helpful and thus videos as a by-product of GUI testing can foster the understanding of GUI tests.
AB - [Context] Software with graphical user interfaces (GUIs) is used in everyday life. Users expect working software when they interact with a software product. For this reason, testing and defect corrections are required. However, understanding GUI tests is challenging, as the generated textual test reports lack the dynamic details about interaction steps to reproduce a GUI defect. [Objective] We want to revise the practice of GUI testing and use videos as a by-product to capture and convey these dynamic details. [Method] Based on the video as a by-product approach, we propose to generate videos as a by-product of GUI testing, integrating annotations and test outputs directly into the videos. These videos serve as supplementary material for documenting dynamic test executions in addition to static test reports (e.g., texts, screenshots). In an experiment, we asked 11 participants to distinguish between true and false defects in watching videos and screenshots of four test cases. We also conducted structured interviews to ask the participants about their opinions for these two documentation options. [Results & Conclusion] Our results show visible differences between the video and the screenshots in effectiveness and efficiency in defect analysis, but cannot prove the differences statistically. The listed advantages and disadvantages of both documentations are complemental. Both documentations are helpful and thus videos as a by-product of GUI testing can foster the understanding of GUI tests.
KW - GUI test
KW - by-product
KW - video
UR - http://www.scopus.com/inward/record.url?scp=85174712260&partnerID=8YFLogxK
U2 - 10.15488/16374
DO - 10.15488/16374
M3 - Conference contribution
SN - 979-8-3503-2692-5
T3 - IEEE International Requirements Engineering Conference Workshops (REW)
SP - 146
EP - 153
BT - 2023 IEEE 31st International Requirements Engineering Conference Workshops (REW)
A2 - Schneider, Kurt
A2 - Dalpiaz, Fabiano
A2 - Horkoff, Jennifer
T2 - 31st IEEE International Requirements Engineering Conference Workshops, REW 2023
Y2 - 4 September 2023 through 5 September 2023
ER -