Learning analytics dashboards

transcript

Katrien Verbert

HCI research group – KU Leuven @katrien_v��

Seminar Opportunities and Challenges of Learning with Technologies: Evidence-based Education Brussels, 12 November 2014

Human-Computer Interaction

Erik Duval Joris Klerkx Katrien Verbert

“Flexible Interaction between people and information”

Awareness & sense-making

Computer Graphics

Language Intelligence & Information Retrieval

Phil Dutré

Sien Moens

http://hci.cs.kuleuven.be/

Sabermetrics objective evidence measure in-game activity

Learning analytics

“Collecting traces that learners leave behind and

using those traces to improve learning.”

Duval, E., & Verbert, K. (2012). Learning analytics. E-Learning and Education, 1(8).

Learning analytics

LEARNING DASHBOARDS

Student Activity Meter (SAM)

Govaerts, S., Verbert, K., Duval, E., & Pardo, A. (2012, May). The student activity meter for awareness and self-reflection. In CHI'12 Extended Abstracts on Human Factors in Computing Systems (pp. 869-884). ACM.

ariadne.cs.kuleuven.be/LARAe/

ARTEL 2014 . Graz, Austria LARAe

Derick Leony, Pedro J. Munoz-Merino, Carlos Delgado Kloos, Katrien Verbert. Evaluating Affectvis, a learning dashboard for emotions in projects. Submitted to Computers & Education, Nov. 2014.

Research questions • RQ1: What are relevant user actions?

• RQ2: How can data on relevant actions be captured?

• RQ3: How is awareness & self-reflection enabled for different

kinds of users through appropriate devices?

• RQ4: How can learning analytics dashboard applications be

evaluated? How can the impact of these visualizations on user

behavior be measured?

RQ2: How can data on relevant actions be captured?

tracking traces

www.role-project.eu

https://www.rescuetime.com/

Software sensors ��

Self-reporting

RQ3: How is awareness & self-reflection enabled for different kinds of users

through appropriate devices?

http://www.engadget.com/2013/01/09/kno-launches-kno-me-interactive-textbook-metrics-lets-you-stu/

Bachour, K., Kaplan, F., & Dillenbourg, P. (2010). An interactive table for supporting participation balance in face-to-face collaborative learning. Learning Technologies, IEEE Transactions on, 3(3), 203-213.

http://gigaom.com/2013/06/19/new-augmented-reality-glasses-let-teachers-know-when-their-students-are-falling-behind/"

T. Zarraonandia, I. Aedo, P. Dıaz, and A. Montero. An augmented lecture feedback system to support learner and teacher communication. British Journal of Educational Technology, 44(4):616–628, 2013.

RQ4: How can learning analytics dashboard

applications be evaluated?

Verbert, K., Duval, E., Klerkx, J., Govaerts, S., & Santos, J. L. (2013). Learning analytics dashboard applications. American Behavioral Scientist

demographics tool deployed tracking tools data tracked

#cgiar 19 teachers SAM LMS

resource use, communication, time

#lak11 12 participants SAM LMS

resource use, communication, time

#uc3m 11 teachers SAM Virtual machine

resource use, programming errors, debugging, time spent;

artefacts produced

#thesis11 13 students Step-Up! Twitter, Tinyarm, blogs resource use, artefacts

produced

#thesis11-sup

5 teachers Step-Up! Twitter, Tinyarm, blogs resource use, artefacts produced

#peno3 10 students Step-Up!

Toggl Time spent, resource and application use

#chikul 30 students Step-Up! Toggl, twitter, blogs twitter, blogs, time spent,

resource use

Verbert, K., Govaerts, S., Duval, E., Santos, J. L., Van Assche, F., Parra, G., & Klerkx, J. (2013). Learning dashboards: an overview and future research opportunities. Personal and Ubiquitous Computing, 1-16.

http://lak15.solaresearch.org/

Thank you! Questions?

katrien.verbert@cs.kuleuven.be twitter : @katrien_v