Empirical Definition of Object-oriented Programming Competencies: Combining Automated Assessment and Item Response Theory to Define Competencies for Implementing Abstract Data Types

Research output: Book/ReportProject report/research reportResearch

Authors

External Research Organisations

  • Technical University of Munich (TUM)
  • University of Duisburg-Essen
View graph of relations

Details

Original languageGerman
Publication statusPublished - 2022

Abstract

International large-scale educational investigations and the focus on learners' competencies powered a veritable revolution in teaching and learning approaches as well as in educational research methodologies. In the relatively young field of computer science education research, however, there is a considerable lack of empirical studies on the definition and measurement of competencies. The central goal of the presented research project is to identify, describe, and measure competencies for object-oriented programming, in particular for implementing abstract data types. We use an automated assessment system to evaluate and score a large number of students' solutions of programming tasks. Item Response Theory analyses of the results identify subsets of tasks suitable for defining typical programming competencies. Further qualitative analyses reveal the internal structure of the competencies and allow a classification in a competency structure model. This article presents in detail our rigorous methodology and exemplary results for the empirical definition and decomposition of the competency named "Ability to implement the abstract data type Binary Search Tree".

Cite this

Download
@book{8a4e448b8c4e4bf3a9f58db170035299,
title = "Empirical Definition of Object-oriented Programming Competencies: Combining Automated Assessment and Item Response Theory to Define Competencies for Implementing Abstract Data Types",
abstract = "International large-scale educational investigations and the focus on learners' competencies powered a veritable revolution in teaching and learning approaches as well as in educational research methodologies. In the relatively young field of computer science education research, however, there is a considerable lack of empirical studies on the definition and measurement of competencies. The central goal of the presented research project is to identify, describe, and measure competencies for object-oriented programming, in particular for implementing abstract data types. We use an automated assessment system to evaluate and score a large number of students' solutions of programming tasks. Item Response Theory analyses of the results identify subsets of tasks suitable for defining typical programming competencies. Further qualitative analyses reveal the internal structure of the competencies and allow a classification in a competency structure model. This article presents in detail our rigorous methodology and exemplary results for the empirical definition and decomposition of the competency named {"}Ability to implement the abstract data type Binary Search Tree{"}.",
author = "Peter Hubwieser and Krugel, {Johannes Arno} and Mike Talbot and Michael Striewe and Michael Goedicke",
year = "2022",
doi = "10.15488/11962",
language = "Deutsch",

}

Download

TY - BOOK

T1 - Empirical Definition of Object-oriented Programming Competencies

T2 - Combining Automated Assessment and Item Response Theory to Define Competencies for Implementing Abstract Data Types

AU - Hubwieser, Peter

AU - Krugel, Johannes Arno

AU - Talbot, Mike

AU - Striewe, Michael

AU - Goedicke, Michael

PY - 2022

Y1 - 2022

N2 - International large-scale educational investigations and the focus on learners' competencies powered a veritable revolution in teaching and learning approaches as well as in educational research methodologies. In the relatively young field of computer science education research, however, there is a considerable lack of empirical studies on the definition and measurement of competencies. The central goal of the presented research project is to identify, describe, and measure competencies for object-oriented programming, in particular for implementing abstract data types. We use an automated assessment system to evaluate and score a large number of students' solutions of programming tasks. Item Response Theory analyses of the results identify subsets of tasks suitable for defining typical programming competencies. Further qualitative analyses reveal the internal structure of the competencies and allow a classification in a competency structure model. This article presents in detail our rigorous methodology and exemplary results for the empirical definition and decomposition of the competency named "Ability to implement the abstract data type Binary Search Tree".

AB - International large-scale educational investigations and the focus on learners' competencies powered a veritable revolution in teaching and learning approaches as well as in educational research methodologies. In the relatively young field of computer science education research, however, there is a considerable lack of empirical studies on the definition and measurement of competencies. The central goal of the presented research project is to identify, describe, and measure competencies for object-oriented programming, in particular for implementing abstract data types. We use an automated assessment system to evaluate and score a large number of students' solutions of programming tasks. Item Response Theory analyses of the results identify subsets of tasks suitable for defining typical programming competencies. Further qualitative analyses reveal the internal structure of the competencies and allow a classification in a competency structure model. This article presents in detail our rigorous methodology and exemplary results for the empirical definition and decomposition of the competency named "Ability to implement the abstract data type Binary Search Tree".

U2 - 10.15488/11962

DO - 10.15488/11962

M3 - Projektbericht/Forschungsbericht

BT - Empirical Definition of Object-oriented Programming Competencies

ER -

By the same author(s)