If You Can't Get Them to the Lab: Evaluating a Virtual Study Environment with Security InformationWorkers

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autoren

  • Nicolas Huaman
  • Alexander Krause
  • Dominik Wermke
  • Jan H. Klemmer
  • Christian Stransky
  • Yasemin Acar
  • Sascha Fahl

Organisationseinheiten

Externe Organisationen

  • Helmholtz-Zentrum für Informationssicherheit (CISPA)
  • George Washington University
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des SammelwerksProceedings of the 18th Symposium on Usable Privacy and Security, SOUPS 2022
Seiten313-330
Seitenumfang18
ISBN (elektronisch)9781939133304
PublikationsstatusVeröffentlicht - 2022
Veranstaltung18th Symposium on Usable Privacy and Security, SOUPS 2022 - Boston, USA / Vereinigte Staaten
Dauer: 7 Aug. 20229 Aug. 2022

Abstract

Usable security and privacy researchers use many study methodologies, including interviews, surveys, and laboratory studies. Of those, lab studies allow for particularly flexible setups, including programming experiments or usability evaluations of software. However, lab studies also come with challenges: Often, it is particularly challenging to recruit enough skilled participants for in-person studies. Especially researchers studying security information workers reported on similar recruitment challenges in the past. Additionally, situations like the COVID-19 pandemic can make in-person lab studies even more challenging. Finally, institutions with limited resources may not be able to conduct lab studies. Therefore, we present and evaluate a novel virtual study environment prototype, called OLab, that allows researchers to conduct lab-like studies remotely using a commodity browser. Our environment overcomes lab-like study challenges and supports flexible setups and comprehensive data collection. In an iterative engineering process, we design and implement a prototype based on requirements we identified in previous work and conduct a comprehensive evaluation including a cognitive walkthrough with usable security experts, a guided and supervised online study with DevOps, and an unguided and unsupervised online study with computer science students. We can confirm that our prototype supports a wide variety of lab-like study setups and received positive feedback from all study participants.

ASJC Scopus Sachgebiete

Zitieren

If You Can't Get Them to the Lab: Evaluating a Virtual Study Environment with Security InformationWorkers. / Huaman, Nicolas; Krause, Alexander; Wermke, Dominik et al.
Proceedings of the 18th Symposium on Usable Privacy and Security, SOUPS 2022. 2022. S. 313-330.

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Huaman, N, Krause, A, Wermke, D, Klemmer, JH, Stransky, C, Acar, Y & Fahl, S 2022, If You Can't Get Them to the Lab: Evaluating a Virtual Study Environment with Security InformationWorkers. in Proceedings of the 18th Symposium on Usable Privacy and Security, SOUPS 2022. S. 313-330, 18th Symposium on Usable Privacy and Security, SOUPS 2022, Boston, USA / Vereinigte Staaten, 7 Aug. 2022. <https://edocs.tib.eu/files/e01mr22/1816468819.pdf>
Huaman, N., Krause, A., Wermke, D., Klemmer, J. H., Stransky, C., Acar, Y., & Fahl, S. (2022). If You Can't Get Them to the Lab: Evaluating a Virtual Study Environment with Security InformationWorkers. In Proceedings of the 18th Symposium on Usable Privacy and Security, SOUPS 2022 (S. 313-330) https://edocs.tib.eu/files/e01mr22/1816468819.pdf
Huaman N, Krause A, Wermke D, Klemmer JH, Stransky C, Acar Y et al. If You Can't Get Them to the Lab: Evaluating a Virtual Study Environment with Security InformationWorkers. in Proceedings of the 18th Symposium on Usable Privacy and Security, SOUPS 2022. 2022. S. 313-330
Huaman, Nicolas ; Krause, Alexander ; Wermke, Dominik et al. / If You Can't Get Them to the Lab : Evaluating a Virtual Study Environment with Security InformationWorkers. Proceedings of the 18th Symposium on Usable Privacy and Security, SOUPS 2022. 2022. S. 313-330
Download
@inproceedings{eb7df5d8a28247bb9832e8b18bf5c19c,
title = "If You Can't Get Them to the Lab: Evaluating a Virtual Study Environment with Security InformationWorkers",
abstract = "Usable security and privacy researchers use many study methodologies, including interviews, surveys, and laboratory studies. Of those, lab studies allow for particularly flexible setups, including programming experiments or usability evaluations of software. However, lab studies also come with challenges: Often, it is particularly challenging to recruit enough skilled participants for in-person studies. Especially researchers studying security information workers reported on similar recruitment challenges in the past. Additionally, situations like the COVID-19 pandemic can make in-person lab studies even more challenging. Finally, institutions with limited resources may not be able to conduct lab studies. Therefore, we present and evaluate a novel virtual study environment prototype, called OLab, that allows researchers to conduct lab-like studies remotely using a commodity browser. Our environment overcomes lab-like study challenges and supports flexible setups and comprehensive data collection. In an iterative engineering process, we design and implement a prototype based on requirements we identified in previous work and conduct a comprehensive evaluation including a cognitive walkthrough with usable security experts, a guided and supervised online study with DevOps, and an unguided and unsupervised online study with computer science students. We can confirm that our prototype supports a wide variety of lab-like study setups and received positive feedback from all study participants.",
author = "Nicolas Huaman and Alexander Krause and Dominik Wermke and Klemmer, {Jan H.} and Christian Stransky and Yasemin Acar and Sascha Fahl",
year = "2022",
language = "English",
pages = "313--330",
booktitle = "Proceedings of the 18th Symposium on Usable Privacy and Security, SOUPS 2022",
note = "18th Symposium on Usable Privacy and Security, SOUPS 2022 ; Conference date: 07-08-2022 Through 09-08-2022",

}

Download

TY - GEN

T1 - If You Can't Get Them to the Lab

T2 - 18th Symposium on Usable Privacy and Security, SOUPS 2022

AU - Huaman, Nicolas

AU - Krause, Alexander

AU - Wermke, Dominik

AU - Klemmer, Jan H.

AU - Stransky, Christian

AU - Acar, Yasemin

AU - Fahl, Sascha

PY - 2022

Y1 - 2022

N2 - Usable security and privacy researchers use many study methodologies, including interviews, surveys, and laboratory studies. Of those, lab studies allow for particularly flexible setups, including programming experiments or usability evaluations of software. However, lab studies also come with challenges: Often, it is particularly challenging to recruit enough skilled participants for in-person studies. Especially researchers studying security information workers reported on similar recruitment challenges in the past. Additionally, situations like the COVID-19 pandemic can make in-person lab studies even more challenging. Finally, institutions with limited resources may not be able to conduct lab studies. Therefore, we present and evaluate a novel virtual study environment prototype, called OLab, that allows researchers to conduct lab-like studies remotely using a commodity browser. Our environment overcomes lab-like study challenges and supports flexible setups and comprehensive data collection. In an iterative engineering process, we design and implement a prototype based on requirements we identified in previous work and conduct a comprehensive evaluation including a cognitive walkthrough with usable security experts, a guided and supervised online study with DevOps, and an unguided and unsupervised online study with computer science students. We can confirm that our prototype supports a wide variety of lab-like study setups and received positive feedback from all study participants.

AB - Usable security and privacy researchers use many study methodologies, including interviews, surveys, and laboratory studies. Of those, lab studies allow for particularly flexible setups, including programming experiments or usability evaluations of software. However, lab studies also come with challenges: Often, it is particularly challenging to recruit enough skilled participants for in-person studies. Especially researchers studying security information workers reported on similar recruitment challenges in the past. Additionally, situations like the COVID-19 pandemic can make in-person lab studies even more challenging. Finally, institutions with limited resources may not be able to conduct lab studies. Therefore, we present and evaluate a novel virtual study environment prototype, called OLab, that allows researchers to conduct lab-like studies remotely using a commodity browser. Our environment overcomes lab-like study challenges and supports flexible setups and comprehensive data collection. In an iterative engineering process, we design and implement a prototype based on requirements we identified in previous work and conduct a comprehensive evaluation including a cognitive walkthrough with usable security experts, a guided and supervised online study with DevOps, and an unguided and unsupervised online study with computer science students. We can confirm that our prototype supports a wide variety of lab-like study setups and received positive feedback from all study participants.

UR - http://www.scopus.com/inward/record.url?scp=85140925492&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:85140925492

SP - 313

EP - 330

BT - Proceedings of the 18th Symposium on Usable Privacy and Security, SOUPS 2022

Y2 - 7 August 2022 through 9 August 2022

ER -