28
Asessment and Game Analytics Iván Martínez-Ortiz Ángel Serrano Laguna e-UCM Research Group http://www.e-ucm.es SEGAN 2nd Summer School, July 13 Tallinn
Asessment and Game Analytics
Iván Martínez-OrtizÁngel Serrano Laguna
e-UCM Research Group http://www.e-ucm.es
SEGAN 2nd Summer School, July 13 Tallinn
According to Corti (2011):
“Serious games will only grow as an industry if the learning experience is definable, quantifiable and measurable."
● Formative assessment (FA)– During learning (process)
– Purpose: gather evidence for actions to improve learning
– Assessment FOR learning
● Summative assessment (SA)– After learning (product)
– Purpose: gather evidence of learning
– Assessment OF learning
Types of Assessment
Embedded Assessment
Score Assessment
External Assessment
Shameless plug
● Platform to create Seriuos Games● Free and Libre Software● No programming is required !● http://e-adventure.e-ucm.es
– Platform
– Games repository → You can download You can download and adapt them !and adapt them !
– Users and Developers comunities
Lost in XML
● Game for teaching XML– Played by students in the classroom
– Uses Gleaner to log interaction
● Metrics– Start and end game
– Phases changes
– Significant variables:● XML commands introduced by the students● Phases scores
● Realtime observations:– Teacher sees student progress in real time from its
computer
– Before the end of the class, he knows how many students have completed the game
● Post-analysis– Most common pitfalls in XML commands where
detected
– Identification of troublesome levels
●
The big Party
● Game to teach students with disabilities about habits on their daily life
●
Metrics in the “Big Party”
● Implemented with a add-on to an eAdventure game
● Information collected– User interactions
● All mouse interactions (including movement)
– Phases changes
– Times spent in every phase
– Order in phase discovery
● Some Results– Heatmaps showing elements with most
interaction
– Tracing ALL interactions allow us to reproudce the entire game play
●
Y la aclaro
The Foolish Lady
From real actor to a game avatar ...
Time to grow up
Analytics
DataProcessing
Visualization
Gleaner
type: 'input', device: 'mouse', action: 'press',
data: { button: 0, x: 250, y: 600 }
Input Logic
type: 'logic', event: ‘one_up'
X 100000
Goals
Gleaner Analysis
