Concept maps for formative assessment: Creation and implementation of an automatic and intelligent evaluation method

Research output: Contribution to journalArticleResearchpeer review

Authors

  • Tom Bleckmann
  • Gunnar Friege
View graph of relations

Details

Translated title of the contributionKonzeptkarten für die formative Beurteilung: Erstellung und Implementierung einer automatischen und intelligenten Bewertungsmethode
Original languageEnglish
Pages (from-to)433-447
Number of pages15
JournalKnowledge Management & E-Learning
Volume15
Issue number3
Publication statusPublished - 2023

Abstract

Formative assessment is about providing and using feedback and
diagnostic information. On this basis, further learning or further teaching should
be adaptive and, in the best case, optimized. However, this aspect is difficult to
implement in reality, as teachers work with a large number of students and the
whole process of formative assessment, especially the evaluation of student
performance takes a lot of time. To address this problem, this paper presents an
approach in which student performance is collected through a concept map and
quickly evaluated using Machine Learning techniques. For this purpose, a
concept map on the topic of mechanics was developed and used in 14 physics
classes in Germany. After the student maps were analysed by two human raters
on the basis of a four-level feedback scheme, a supervised Machine Learning
algorithm was trained on the data. The results show a very good agreement
between the human and Machine Learning evaluation. Based on these results, an
embedding in everyday school life is conceivable, especially as support for
teachers. In this way, the teacher can use and interpret the automatic evaluation
and use it in the classroom.

Keywords

    Concept maps, Feedback, Formative assessment, Machine learning

ASJC Scopus subject areas

Cite this

Concept maps for formative assessment: Creation and implementation of an automatic and intelligent evaluation method. / Bleckmann, Tom; Friege, Gunnar.
In: Knowledge Management & E-Learning, Vol. 15, No. 3, 2023, p. 433-447.

Research output: Contribution to journalArticleResearchpeer review

Bleckmann T, Friege G. Concept maps for formative assessment: Creation and implementation of an automatic and intelligent evaluation method. Knowledge Management & E-Learning. 2023;15(3):433-447. doi: 10.34105/j.kmel.2023.15.025
Bleckmann, Tom ; Friege, Gunnar. / Concept maps for formative assessment: Creation and implementation of an automatic and intelligent evaluation method. In: Knowledge Management & E-Learning. 2023 ; Vol. 15, No. 3. pp. 433-447.
Download
@article{4c996bd50b91406ea01d7e9a3eea70f2,
title = "Concept maps for formative assessment: Creation and implementation of an automatic and intelligent evaluation method",
abstract = "Formative assessment is about providing and using feedback and diagnostic information. On this basis, further learning or further teaching should be adaptive and, in the best case, optimized. However, this aspect is difficult to implement in reality, as teachers work with a large number of students and the whole process of formative assessment, especially the evaluation of student performance takes a lot of time. To address this problem, this paper presents an approach in which student performance is collected through a concept map and quickly evaluated using Machine Learning techniques. For this purpose, a concept map on the topic of mechanics was developed and used in 14 physics classes in Germany. After the student maps were analysed by two human raters on the basis of a four-level feedback scheme, a supervised Machine Learning algorithm was trained on the data. The results show a very good agreement between the human and Machine Learning evaluation. Based on these results, an embedding in everyday school life is conceivable, especially as support for teachers. In this way, the teacher can use and interpret the automatic evaluation and use it in the classroom.",
keywords = "Concept maps, Feedback, Formative assessment, Machine learning",
author = "Tom Bleckmann and Gunnar Friege",
note = "This work has been partly supported by the Ministry of Science and Education of Lower Saxony, Germany, through the Graduate training network “LernMINT: Data-assisted classroom teaching in the STEM subjects” (project no. 51410078).",
year = "2023",
doi = "10.34105/j.kmel.2023.15.025",
language = "English",
volume = "15",
pages = "433--447",
number = "3",

}

Download

TY - JOUR

T1 - Concept maps for formative assessment: Creation and implementation of an automatic and intelligent evaluation method

AU - Bleckmann, Tom

AU - Friege, Gunnar

N1 - This work has been partly supported by the Ministry of Science and Education of Lower Saxony, Germany, through the Graduate training network “LernMINT: Data-assisted classroom teaching in the STEM subjects” (project no. 51410078).

PY - 2023

Y1 - 2023

N2 - Formative assessment is about providing and using feedback and diagnostic information. On this basis, further learning or further teaching should be adaptive and, in the best case, optimized. However, this aspect is difficult to implement in reality, as teachers work with a large number of students and the whole process of formative assessment, especially the evaluation of student performance takes a lot of time. To address this problem, this paper presents an approach in which student performance is collected through a concept map and quickly evaluated using Machine Learning techniques. For this purpose, a concept map on the topic of mechanics was developed and used in 14 physics classes in Germany. After the student maps were analysed by two human raters on the basis of a four-level feedback scheme, a supervised Machine Learning algorithm was trained on the data. The results show a very good agreement between the human and Machine Learning evaluation. Based on these results, an embedding in everyday school life is conceivable, especially as support for teachers. In this way, the teacher can use and interpret the automatic evaluation and use it in the classroom.

AB - Formative assessment is about providing and using feedback and diagnostic information. On this basis, further learning or further teaching should be adaptive and, in the best case, optimized. However, this aspect is difficult to implement in reality, as teachers work with a large number of students and the whole process of formative assessment, especially the evaluation of student performance takes a lot of time. To address this problem, this paper presents an approach in which student performance is collected through a concept map and quickly evaluated using Machine Learning techniques. For this purpose, a concept map on the topic of mechanics was developed and used in 14 physics classes in Germany. After the student maps were analysed by two human raters on the basis of a four-level feedback scheme, a supervised Machine Learning algorithm was trained on the data. The results show a very good agreement between the human and Machine Learning evaluation. Based on these results, an embedding in everyday school life is conceivable, especially as support for teachers. In this way, the teacher can use and interpret the automatic evaluation and use it in the classroom.

KW - Concept maps

KW - Feedback

KW - Formative assessment

KW - Machine learning

UR - http://www.scopus.com/inward/record.url?scp=85173934739&partnerID=8YFLogxK

U2 - 10.34105/j.kmel.2023.15.025

DO - 10.34105/j.kmel.2023.15.025

M3 - Article

VL - 15

SP - 433

EP - 447

JO - Knowledge Management & E-Learning

JF - Knowledge Management & E-Learning

SN - 2073-7904

IS - 3

ER -