Who’s Cheating? Mining Patterns of Collusion from Text and Events in Online Exams

Research output: Contribution to journalArticleResearchpeer review

Authors

  • Catherine Cleophas
  • Christoph Hönnige
  • Frank Meisel
  • Philipp Meyer

Research Organisations

External Research Organisations

  • Kiel University
View graph of relations

Details

Original languageEnglish
Article number57-135
Pages (from-to)84-94
Number of pages11
JournalINFORMS Transactions on Education
Volume23
Issue number2
Publication statusPublished - 1 Oct 2021

Abstract

As the COVID-19 pandemic motivated a shift to virtual teaching, exams have increasingly moved online too. Detecting cheating through collusion is not easy when tech-savvy students take online exams at home and on their own devices. Such online at-home exams may tempt students to collude and share materials and answers. However, online exams’ digital output also enables computer-aided detection of collusion patterns. This paper presents two simple data-driven techniques to analyze exam event logs and essay-form answers. Based on examples from exams in social sciences, we show that such analyses can reveal patterns of student collusion. We suggest using these patterns to quantify the degree of collusion. Finally, we summarize a set of lessons learned about designing and analyzing online exams.

Keywords

    learning analytics, event mining, text mining, online assessment

ASJC Scopus subject areas

Cite this

Who’s Cheating? Mining Patterns of Collusion from Text and Events in Online Exams. / Cleophas, Catherine; Hönnige, Christoph; Meisel, Frank et al.
In: INFORMS Transactions on Education, Vol. 23, No. 2, 57-135, 01.10.2021, p. 84-94.

Research output: Contribution to journalArticleResearchpeer review

Cleophas, C, Hönnige, C, Meisel, F & Meyer, P 2021, 'Who’s Cheating? Mining Patterns of Collusion from Text and Events in Online Exams', INFORMS Transactions on Education, vol. 23, no. 2, 57-135, pp. 84-94. https://doi.org/10.1287/ited.2021.0260
Cleophas, C., Hönnige, C., Meisel, F., & Meyer, P. (2021). Who’s Cheating? Mining Patterns of Collusion from Text and Events in Online Exams. INFORMS Transactions on Education, 23(2), 84-94. Article 57-135. https://doi.org/10.1287/ited.2021.0260
Cleophas C, Hönnige C, Meisel F, Meyer P. Who’s Cheating? Mining Patterns of Collusion from Text and Events in Online Exams. INFORMS Transactions on Education. 2021 Oct 1;23(2):84-94. 57-135. doi: 10.1287/ited.2021.0260
Cleophas, Catherine ; Hönnige, Christoph ; Meisel, Frank et al. / Who’s Cheating? Mining Patterns of Collusion from Text and Events in Online Exams. In: INFORMS Transactions on Education. 2021 ; Vol. 23, No. 2. pp. 84-94.
Download
@article{2002bc35b6934772b5dd97f78ace55dc,
title = "Who{\textquoteright}s Cheating?: Mining Patterns of Collusion from Text and Events in Online Exams",
abstract = "As the COVID-19 pandemic motivated a shift to virtual teaching, exams have increasingly moved online too. Detecting cheating through collusion is not easy when tech-savvy students take online exams at home and on their own devices. Such online at-home exams may tempt students to collude and share materials and answers. However, online exams{\textquoteright} digital output also enables computer-aided detection of collusion patterns. This paper presents two simple data-driven techniques to analyze exam event logs and essay-form answers. Based on examples from exams in social sciences, we show that such analyses can reveal patterns of student collusion. We suggest using these patterns to quantify the degree of collusion. Finally, we summarize a set of lessons learned about designing and analyzing online exams.",
keywords = "learning analytics, event mining, text mining, online assessment",
author = "Catherine Cleophas and Christoph H{\"o}nnige and Frank Meisel and Philipp Meyer",
year = "2021",
month = oct,
day = "1",
doi = "10.1287/ited.2021.0260",
language = "English",
volume = "23",
pages = "84--94",
number = "2",

}

Download

TY - JOUR

T1 - Who’s Cheating?

T2 - Mining Patterns of Collusion from Text and Events in Online Exams

AU - Cleophas, Catherine

AU - Hönnige, Christoph

AU - Meisel, Frank

AU - Meyer, Philipp

PY - 2021/10/1

Y1 - 2021/10/1

N2 - As the COVID-19 pandemic motivated a shift to virtual teaching, exams have increasingly moved online too. Detecting cheating through collusion is not easy when tech-savvy students take online exams at home and on their own devices. Such online at-home exams may tempt students to collude and share materials and answers. However, online exams’ digital output also enables computer-aided detection of collusion patterns. This paper presents two simple data-driven techniques to analyze exam event logs and essay-form answers. Based on examples from exams in social sciences, we show that such analyses can reveal patterns of student collusion. We suggest using these patterns to quantify the degree of collusion. Finally, we summarize a set of lessons learned about designing and analyzing online exams.

AB - As the COVID-19 pandemic motivated a shift to virtual teaching, exams have increasingly moved online too. Detecting cheating through collusion is not easy when tech-savvy students take online exams at home and on their own devices. Such online at-home exams may tempt students to collude and share materials and answers. However, online exams’ digital output also enables computer-aided detection of collusion patterns. This paper presents two simple data-driven techniques to analyze exam event logs and essay-form answers. Based on examples from exams in social sciences, we show that such analyses can reveal patterns of student collusion. We suggest using these patterns to quantify the degree of collusion. Finally, we summarize a set of lessons learned about designing and analyzing online exams.

KW - learning analytics

KW - event mining

KW - text mining

KW - online assessment

UR - http://www.scopus.com/inward/record.url?scp=85154534946&partnerID=8YFLogxK

U2 - 10.1287/ited.2021.0260

DO - 10.1287/ited.2021.0260

M3 - Article

VL - 23

SP - 84

EP - 94

JO - INFORMS Transactions on Education

JF - INFORMS Transactions on Education

SN - 1532-0545

IS - 2

M1 - 57-135

ER -