Automatic Analysis of Student Drawings in Chemistry Classes

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autoren

  • Markos Stamatakis
  • Wolfgang Gritz
  • Jos Oldag
  • Anett Hoppe
  • Sascha Schanze
  • Ralph Ewerth

Externe Organisationen

  • Technische Informationsbibliothek (TIB) Leibniz-Informationszentrum Technik und Naturwissenschaften und Universitätsbibliothek
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des SammelwerksArtificial Intelligence in Education
Untertitel24th International Conference, AIED 2023, Proceedings
Herausgeber/-innenNing Wang, Genaro Rebolledo-Mendez, Noboru Matsuda, Olga C. Santos, Vania Dimitrova
ErscheinungsortCham
Herausgeber (Verlag)Springer Science and Business Media Deutschland GmbH
Seiten824-829
Seitenumfang6
ISBN (elektronisch)978-3-031-36272-9
ISBN (Print)9783031362712
PublikationsstatusVeröffentlicht - 26 Juni 2023
Veranstaltung24th International Conference on Artificial Intelligence in Education, AIED 2023 - Tokyo, Japan
Dauer: 3 Juli 20237 Juli 2023

Publikationsreihe

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Band13916 LNAI
ISSN (Print)0302-9743
ISSN (elektronisch)1611-3349

Abstract

Automatic analyses of student drawings in chemistry education have the potential to support classroom teaching. To date, related work on handwritten chemical structures or formulas is limited to well-defined presentation formats, e.g., Lewis structures. However, the large variety of possible illustrations in student drawings in chemical education has not been addressed yet. In this paper, we present a novel approach to identify visual primitives in student drawings from chemistry classes. Since the field lacks suitable datasets for the given task, we introduce a method to synthetically create a dataset for visual primitives. We demonstrate how detected visual primitives can be used to automatically classify drawings according to a taxonomy of drawing characteristics in chemistry and physics. Our experiments show that (1) the detection of visual primitives in student drawings, and (2) the subsequent classification of chemistry- and physics-specific drawing characteristics is possible.

ASJC Scopus Sachgebiete

Zitieren

Automatic Analysis of Student Drawings in Chemistry Classes. / Stamatakis, Markos; Gritz, Wolfgang; Oldag, Jos et al.
Artificial Intelligence in Education: 24th International Conference, AIED 2023, Proceedings. Hrsg. / Ning Wang; Genaro Rebolledo-Mendez; Noboru Matsuda; Olga C. Santos; Vania Dimitrova. Cham: Springer Science and Business Media Deutschland GmbH, 2023. S. 824-829 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Band 13916 LNAI).

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Stamatakis, M, Gritz, W, Oldag, J, Hoppe, A, Schanze, S & Ewerth, R 2023, Automatic Analysis of Student Drawings in Chemistry Classes. in N Wang, G Rebolledo-Mendez, N Matsuda, OC Santos & V Dimitrova (Hrsg.), Artificial Intelligence in Education: 24th International Conference, AIED 2023, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Bd. 13916 LNAI, Springer Science and Business Media Deutschland GmbH, Cham, S. 824-829, 24th International Conference on Artificial Intelligence in Education, AIED 2023, Tokyo, Japan, 3 Juli 2023. https://doi.org/10.1007/978-3-031-36272-9_78
Stamatakis, M., Gritz, W., Oldag, J., Hoppe, A., Schanze, S., & Ewerth, R. (2023). Automatic Analysis of Student Drawings in Chemistry Classes. In N. Wang, G. Rebolledo-Mendez, N. Matsuda, O. C. Santos, & V. Dimitrova (Hrsg.), Artificial Intelligence in Education: 24th International Conference, AIED 2023, Proceedings (S. 824-829). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Band 13916 LNAI). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-031-36272-9_78
Stamatakis M, Gritz W, Oldag J, Hoppe A, Schanze S, Ewerth R. Automatic Analysis of Student Drawings in Chemistry Classes. in Wang N, Rebolledo-Mendez G, Matsuda N, Santos OC, Dimitrova V, Hrsg., Artificial Intelligence in Education: 24th International Conference, AIED 2023, Proceedings. Cham: Springer Science and Business Media Deutschland GmbH. 2023. S. 824-829. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-031-36272-9_78
Stamatakis, Markos ; Gritz, Wolfgang ; Oldag, Jos et al. / Automatic Analysis of Student Drawings in Chemistry Classes. Artificial Intelligence in Education: 24th International Conference, AIED 2023, Proceedings. Hrsg. / Ning Wang ; Genaro Rebolledo-Mendez ; Noboru Matsuda ; Olga C. Santos ; Vania Dimitrova. Cham : Springer Science and Business Media Deutschland GmbH, 2023. S. 824-829 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
Download
@inproceedings{1af37ed6b3344da7aa07274f2e06546a,
title = "Automatic Analysis of Student Drawings in Chemistry Classes",
abstract = "Automatic analyses of student drawings in chemistry education have the potential to support classroom teaching. To date, related work on handwritten chemical structures or formulas is limited to well-defined presentation formats, e.g., Lewis structures. However, the large variety of possible illustrations in student drawings in chemical education has not been addressed yet. In this paper, we present a novel approach to identify visual primitives in student drawings from chemistry classes. Since the field lacks suitable datasets for the given task, we introduce a method to synthetically create a dataset for visual primitives. We demonstrate how detected visual primitives can be used to automatically classify drawings according to a taxonomy of drawing characteristics in chemistry and physics. Our experiments show that (1) the detection of visual primitives in student drawings, and (2) the subsequent classification of chemistry- and physics-specific drawing characteristics is possible.",
keywords = "Chemistry Education, Computer Vision, Synthetic Data, Visual Analysis, Visual Primitives",
author = "Markos Stamatakis and Wolfgang Gritz and Jos Oldag and Anett Hoppe and Sascha Schanze and Ralph Ewerth",
note = "Funding Information: This work has been mainly supported by the Ministry of Science and Culture of Lower Saxony, Germany, through the PhD Program “LernMINT: Data-assisted classroom teaching in the MINT subjects”.; 24th International Conference on Artificial Intelligence in Education, AIED 2023 ; Conference date: 03-07-2023 Through 07-07-2023",
year = "2023",
month = jun,
day = "26",
doi = "10.1007/978-3-031-36272-9_78",
language = "English",
isbn = "9783031362712",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Science and Business Media Deutschland GmbH",
pages = "824--829",
editor = "Ning Wang and Genaro Rebolledo-Mendez and Noboru Matsuda and Santos, {Olga C.} and Vania Dimitrova",
booktitle = "Artificial Intelligence in Education",
address = "Germany",

}

Download

TY - GEN

T1 - Automatic Analysis of Student Drawings in Chemistry Classes

AU - Stamatakis, Markos

AU - Gritz, Wolfgang

AU - Oldag, Jos

AU - Hoppe, Anett

AU - Schanze, Sascha

AU - Ewerth, Ralph

N1 - Funding Information: This work has been mainly supported by the Ministry of Science and Culture of Lower Saxony, Germany, through the PhD Program “LernMINT: Data-assisted classroom teaching in the MINT subjects”.

PY - 2023/6/26

Y1 - 2023/6/26

N2 - Automatic analyses of student drawings in chemistry education have the potential to support classroom teaching. To date, related work on handwritten chemical structures or formulas is limited to well-defined presentation formats, e.g., Lewis structures. However, the large variety of possible illustrations in student drawings in chemical education has not been addressed yet. In this paper, we present a novel approach to identify visual primitives in student drawings from chemistry classes. Since the field lacks suitable datasets for the given task, we introduce a method to synthetically create a dataset for visual primitives. We demonstrate how detected visual primitives can be used to automatically classify drawings according to a taxonomy of drawing characteristics in chemistry and physics. Our experiments show that (1) the detection of visual primitives in student drawings, and (2) the subsequent classification of chemistry- and physics-specific drawing characteristics is possible.

AB - Automatic analyses of student drawings in chemistry education have the potential to support classroom teaching. To date, related work on handwritten chemical structures or formulas is limited to well-defined presentation formats, e.g., Lewis structures. However, the large variety of possible illustrations in student drawings in chemical education has not been addressed yet. In this paper, we present a novel approach to identify visual primitives in student drawings from chemistry classes. Since the field lacks suitable datasets for the given task, we introduce a method to synthetically create a dataset for visual primitives. We demonstrate how detected visual primitives can be used to automatically classify drawings according to a taxonomy of drawing characteristics in chemistry and physics. Our experiments show that (1) the detection of visual primitives in student drawings, and (2) the subsequent classification of chemistry- and physics-specific drawing characteristics is possible.

KW - Chemistry Education

KW - Computer Vision

KW - Synthetic Data

KW - Visual Analysis

KW - Visual Primitives

UR - http://www.scopus.com/inward/record.url?scp=85164970202&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-36272-9_78

DO - 10.1007/978-3-031-36272-9_78

M3 - Conference contribution

AN - SCOPUS:85164970202

SN - 9783031362712

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 824

EP - 829

BT - Artificial Intelligence in Education

A2 - Wang, Ning

A2 - Rebolledo-Mendez, Genaro

A2 - Matsuda, Noboru

A2 - Santos, Olga C.

A2 - Dimitrova, Vania

PB - Springer Science and Business Media Deutschland GmbH

CY - Cham

T2 - 24th International Conference on Artificial Intelligence in Education, AIED 2023

Y2 - 3 July 2023 through 7 July 2023

ER -

Von denselben Autoren