Employing game analytics techniques in the psychometric measurement of game-based assessments with dynamic content

Yasser Jaffal, Dieter Wloka

Abstract


The adaptation Game-Based Assessment (GBA) (Mislevy et al., 2014) has been growing in the last years backed by video games’ capability of offering a task model to assess learners’ complex knowledge. Since the variables generated from such performances are not directly interpretable, assessment frameworks such as Evidence-Centred Design (ECD) came into play (Mislevy & Almond, 2003). In this work we show our initial findings when using game analytics techniques (Saif El-Nasr et al., 2013) such as play metrics to analyse players’ performance in an open world 3D game for traffic education. The results show that play metrics can be used in cases where game has a dynamic user-generated content of unknown structure. Additionally, we discuss how these metrics can form the basis of measuring psychometric principles that ECD uses to evaluate assessments, which are validity, reliability, comparability and fairness (Mislevy & Wilson, 2003).

Keywords


Game-based assessment, psychometric measurement, serious games, simulation, game analytics

Full Text:

PDF


DOI: https://doi.org/10.20368/1971-8829/1063



Journal of e-Learning and Knowledge Society | ISSN (online) 1971 - 8829 | ISSN (paper) 1826 - 6223 © 2017 Je-LKS - Italian e-Learning Association (SIe-L).