Learning analytics

Katrien Verbert@katrien_v

Symposium on awareness in technology-enhanced learning

11 September 2012

Sabermetricsobjective evidencemeasure in-game activity

Sabermetricsobjective evidencemeasure in-game activity

Learning analytics…

http://bit.ly/A4CwZU

dataTEL challenge & dataTEL cafe event

• a call for TEL datasets

• eight data sets submitted

http://bit.ly/ieqmWW

http://dev.mendeley.com/datachallenge/

Mendeley

APOSDLE

ReMashed

Organic.edunet

Mace Melt

Collection period

1 year 3 months

2 years 9 months

3 years

6 months

Users 200.000 6 140 1.000 1.148 98

Items 1.857.912 163 96.000 11.000 12.000 1.923

Activities 4.848.725 1.500 23.264 920 461.982

16.353

reads + + - - + -

tags - (+) + + + +

ratings (+) - + + + +

downloads + + - - + +

search - + - - + -

collaborations - + - - - -

tasks/goals - + + - - -

sequence - + - - - -

competence - + - - + -

time - - - - + +

http://bit.ly/acBKsp

tracking traces

Rescuetime Rabbit- eclipse plugin

Blogs

Twitter

tracking traces

Student Activity Meter (SAM)

Santos Odriozola, Jose Luis; Govaerts, Sten; Verbert, Katrien; Duval, Erik Goal-oriented visualizations of activity tracking: a case study with engineering students, Proceedings of LAK12: 2nd International Conference on Learning Analytics and Knowledge, pages 10, ACM (to appear)

Human-Computer Interaction Course

http://bit.ly/I7hfbe

Profile

Design Based Research Methodology

• Rapid prototyping

• Evaluate Ideas in short iteration cycles of Design, Implementation & Evaluation

• Focus on Usefulness & Usability

• Think-aloud evaluations, SUS (System Usability

Scale) surveys, usability lab, ...

Sco

re

teachers

students

Perceivedusefulness

#thesissupervisors

#thesisstudents

Sco

re

teachers

students

#lak #cgiar#chikul

Awareness of effort

twitterblogstinyarm moodletoggl

#thesissupervisors

#thesisstudents

Sco

re

teachers

students

#lak #cgiar#chikul

Awareness of resource / tool use

twitterblogstinyarm moodletoggl

#thesissupervisors

#thesisstudents

Sco

re

teachers

students

#lak #cgiar#chikul

Understand how students communicate

Dashboards help… #chikul

#thesis11

#thesis11-sup

#peno3

#cgiar

#lak11

#uc3m

…to be aware of effort /time?

…to be aware of resource/tool use?

…to be aware of how students communicate?

…find students at risk?

✔

✔

✔

✔

✔ ✔✔ ✔

✔ ✔ ✔ ✔

✔✔

✔ ✔ ✔✗

✗ ?

?

? ?

find students

…doing well • Good distribution of effort over

time

• Much time spent

• Much debugging

• Much programming errors

• Active tweeter / blogger

…at risk

• Too much time spent

• Too much debugging

• Many programming errors

• Too many tweets

1

2

3

4

1

2

3

4

5

http://lakconference.org/

Questions?

katrien.verbert@cs.kuleuven.betwitter: @katrien_v