Who’s Cheating? Mining Patterns of Collusion from Text and Events in Online Exams

Publikation: Beitrag in FachzeitschriftArtikelForschungPeer-Review

Autoren

  • Catherine Cleophas
  • Christoph Hönnige
  • Frank Meisel
  • Philipp Meyer

Organisationseinheiten

Externe Organisationen

  • Christian-Albrechts-Universität zu Kiel (CAU)
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Aufsatznummer57-135
Seiten (von - bis)84-94
Seitenumfang11
FachzeitschriftINFORMS Transactions on Education
Jahrgang23
Ausgabenummer2
PublikationsstatusVeröffentlicht - 1 Okt. 2021

Abstract

As the COVID-19 pandemic motivated a shift to virtual teaching, exams have increasingly moved online too. Detecting cheating through collusion is not easy when tech-savvy students take online exams at home and on their own devices. Such online at-home exams may tempt students to collude and share materials and answers. However, online exams’ digital output also enables computer-aided detection of collusion patterns. This paper presents two simple data-driven techniques to analyze exam event logs and essay-form answers. Based on examples from exams in social sciences, we show that such analyses can reveal patterns of student collusion. We suggest using these patterns to quantify the degree of collusion. Finally, we summarize a set of lessons learned about designing and analyzing online exams.

ASJC Scopus Sachgebiete

Zitieren

Who’s Cheating? Mining Patterns of Collusion from Text and Events in Online Exams. / Cleophas, Catherine; Hönnige, Christoph; Meisel, Frank et al.
in: INFORMS Transactions on Education, Jahrgang 23, Nr. 2, 57-135, 01.10.2021, S. 84-94.

Publikation: Beitrag in FachzeitschriftArtikelForschungPeer-Review

Cleophas, C, Hönnige, C, Meisel, F & Meyer, P 2021, 'Who’s Cheating? Mining Patterns of Collusion from Text and Events in Online Exams', INFORMS Transactions on Education, Jg. 23, Nr. 2, 57-135, S. 84-94. https://doi.org/10.1287/ited.2021.0260
Cleophas, C., Hönnige, C., Meisel, F., & Meyer, P. (2021). Who’s Cheating? Mining Patterns of Collusion from Text and Events in Online Exams. INFORMS Transactions on Education, 23(2), 84-94. Artikel 57-135. https://doi.org/10.1287/ited.2021.0260
Cleophas C, Hönnige C, Meisel F, Meyer P. Who’s Cheating? Mining Patterns of Collusion from Text and Events in Online Exams. INFORMS Transactions on Education. 2021 Okt 1;23(2):84-94. 57-135. doi: 10.1287/ited.2021.0260
Cleophas, Catherine ; Hönnige, Christoph ; Meisel, Frank et al. / Who’s Cheating? Mining Patterns of Collusion from Text and Events in Online Exams. in: INFORMS Transactions on Education. 2021 ; Jahrgang 23, Nr. 2. S. 84-94.
Download
@article{2002bc35b6934772b5dd97f78ace55dc,
title = "Who{\textquoteright}s Cheating?: Mining Patterns of Collusion from Text and Events in Online Exams",
abstract = "As the COVID-19 pandemic motivated a shift to virtual teaching, exams have increasingly moved online too. Detecting cheating through collusion is not easy when tech-savvy students take online exams at home and on their own devices. Such online at-home exams may tempt students to collude and share materials and answers. However, online exams{\textquoteright} digital output also enables computer-aided detection of collusion patterns. This paper presents two simple data-driven techniques to analyze exam event logs and essay-form answers. Based on examples from exams in social sciences, we show that such analyses can reveal patterns of student collusion. We suggest using these patterns to quantify the degree of collusion. Finally, we summarize a set of lessons learned about designing and analyzing online exams.",
keywords = "learning analytics, event mining, text mining, online assessment",
author = "Catherine Cleophas and Christoph H{\"o}nnige and Frank Meisel and Philipp Meyer",
year = "2021",
month = oct,
day = "1",
doi = "10.1287/ited.2021.0260",
language = "English",
volume = "23",
pages = "84--94",
number = "2",

}

Download

TY - JOUR

T1 - Who’s Cheating?

T2 - Mining Patterns of Collusion from Text and Events in Online Exams

AU - Cleophas, Catherine

AU - Hönnige, Christoph

AU - Meisel, Frank

AU - Meyer, Philipp

PY - 2021/10/1

Y1 - 2021/10/1

N2 - As the COVID-19 pandemic motivated a shift to virtual teaching, exams have increasingly moved online too. Detecting cheating through collusion is not easy when tech-savvy students take online exams at home and on their own devices. Such online at-home exams may tempt students to collude and share materials and answers. However, online exams’ digital output also enables computer-aided detection of collusion patterns. This paper presents two simple data-driven techniques to analyze exam event logs and essay-form answers. Based on examples from exams in social sciences, we show that such analyses can reveal patterns of student collusion. We suggest using these patterns to quantify the degree of collusion. Finally, we summarize a set of lessons learned about designing and analyzing online exams.

AB - As the COVID-19 pandemic motivated a shift to virtual teaching, exams have increasingly moved online too. Detecting cheating through collusion is not easy when tech-savvy students take online exams at home and on their own devices. Such online at-home exams may tempt students to collude and share materials and answers. However, online exams’ digital output also enables computer-aided detection of collusion patterns. This paper presents two simple data-driven techniques to analyze exam event logs and essay-form answers. Based on examples from exams in social sciences, we show that such analyses can reveal patterns of student collusion. We suggest using these patterns to quantify the degree of collusion. Finally, we summarize a set of lessons learned about designing and analyzing online exams.

KW - learning analytics

KW - event mining

KW - text mining

KW - online assessment

UR - http://www.scopus.com/inward/record.url?scp=85154534946&partnerID=8YFLogxK

U2 - 10.1287/ited.2021.0260

DO - 10.1287/ited.2021.0260

M3 - Article

VL - 23

SP - 84

EP - 94

JO - INFORMS Transactions on Education

JF - INFORMS Transactions on Education

SN - 1532-0545

IS - 2

M1 - 57-135

ER -