Asessment and Game Analytics

Iván Martínez-OrtizÁngel Serrano Laguna

e-UCM Research Group http://www.e-ucm.es

SEGAN 2nd Summer School, July 13 Tallinn

According to Corti (2011):

“Serious games will only grow as an industry if the learning experience is definable, quantifiable and measurable."

● Formative assessment (FA)– During learning (process)

– Purpose: gather evidence for actions to improve learning

– Assessment FOR learning

● Summative assessment (SA)– After learning (product)

– Purpose: gather evidence of learning

– Assessment OF learning

Types of Assessment

Embedded Assessment

Score Assessment

External Assessment

Shameless plug

● Platform to create Seriuos Games● Free and Libre Software● No programming is required !● http://e-adventure.e-ucm.es

– Platform

– Games repository → You can download You can download and adapt them !and adapt them !

– Users and Developers comunities

Lost in XML

● Game for teaching XML– Played by students in the classroom

– Uses Gleaner to log interaction

● Metrics– Start and end game

– Phases changes

– Significant variables:● XML commands introduced by the students● Phases scores

● Realtime observations:– Teacher sees student progress in real time from its

computer

– Before the end of the class, he knows how many students have completed the game

● Post-analysis– Most common pitfalls in XML commands where

detected

– Identification of troublesome levels

●

The big Party

● Game to teach students with disabilities about habits on their daily life

●

Metrics in the “Big Party”

● Implemented with a add-on to an eAdventure game

● Information collected– User interactions

● All mouse interactions (including movement)

– Phases changes

– Times spent in every phase

– Order in phase discovery

● Some Results– Heatmaps showing elements with most

interaction

– Tracing ALL interactions allow us to reproudce the entire game play

●

Y la aclaro

The Foolish Lady

From real actor to a game avatar ...

Time to grow up

Analytics

DataProcessing

Visualization

Gleaner

type: 'input', device: 'mouse', action: 'press',

data: { button: 0, x: 250, y: 600 }

Input Logic

type: 'logic', event: ‘one_up'

X 100000

Goals

Gleaner Analysis

Ivan Martinez-Ortizimartinez@fdi.ucm.es

Associate Professor in Computer ScienceUniversidad Complutense de Madrid