r2hoxFlickrAnalytics to understand learningenvironments

Chai Seminar, 14 April 2014

Dr Abelardo Pardo (@abelardopardo)School of Electrical and Information Engineering

slideshare.net/abelardo_pardo

Abelardo Pardo Analytics to understand learning environments 2

Abelardo Pardo Analytics to understand learning environments 3

State

Records

NS

WFlickr

Lecturer at School of EIE

Two coursesGrad/Undergrad

Active learning

Use of technology

Tech to empower individualsand communities

Behavioral analytics

User validation

Abelardo Pardo Analytics to understand learning environments 4

dianetellFlickrPragmaticapproach

Dogfooding!

Maximize impact

Abelardo Pardo Analytics to understand learning environments 5

VanessaOflickr.com

“Historically, humanity has made sense of the worldthrough discourse, dialogue, artifacts, myth, story,and metaphor. While those sensemaking approacheswon’t disappear, they will be augmented by data andanalytics.”

(Siemens, 2014 www.elearnspace.org/blog)

Abelardo Pardo Analytics to understand learning environments 6

Quinn

Anya

flickr.com

LearningAnalytics

Observe andCollect

View and Act

Self-motivation

Flippedclassroom

Abelardo Pardo Analytics to understand learning environments 7

Quinn

Anya

flickr.com

LearningAnalytics

Abelardo Pardo Analytics to understand learning environments 8

Unhindered

byTalentflickr.com

Many colleges and universities have demonstratedthat analytics can help significantly advance aninstitution in such strategic areas as resourceallocation, student success, and finance

(Bichsel, 2012)

WSJ 19/07/12

Abelardo Pardo Analytics to understand learning environments 9

How do you read?

NY Times 24/11/12

Abelardo Pardo Analytics to understand learning environments 10

Humans are Subjective

Abelardo Pardo Analytics to understand learning environments 11

Mind Sights: Original Visual Illusions, Ambiguities, and Other Anomalies, With a Commentary on the Play of Mind in Perception and Art, Roger N. Shepard, 1990

Abelardo Pardo Analytics to understand learning environments 12

apasciutoflickr.com

Tools, technology,algorithms

Educational design,pedagogical strategies

Abelardo Pardo Analytics to understand learning environments 13

Kurafire

flickr.com

Feedback as a dialogue

Abelardo Pardo Analytics to understand learning environments 14

TanakaJuuyoh

flickr.com

Tight feedback loop

“We need better evaluationto acknowledge and esteem

excellence when it occurs,as it does.”

Abelardo Pardo Analytics to understand learning environments 15

Bencrow

eFlickr

(Hattie, 2009)

Abelardo Pardo Analytics to understand learning environments 16

Quinn

Anya

flickr.com

LearningAnalytics

Observe andCollect

Abelardo Pardo Analytics to understand learning environments 17

ChefC

ookeFlickr.comObserve while

working oncourse

activities

A clearly identifiedenvironment within

your computer

Abelardo Pardo Analytics to understand learning environments 18

Kevin

Davies

flickr.com

(Pardo & Delgado Kloos, 2011)

InstrumentationPersonal Computer

ComputerTool 1

ComputerTool 2

ComputerTool 3

ComputerTool 4

Authenticated

Virtual Computer

ComputerTool

ComputerTool

ComputerTool

ComputerTool

ComputerTool

EventDataset

PersonalData

Encoding

Report

Infer

Act

InstructorStudent

Abelardo Pardo Analytics to understand learning environments 19

Abelardo Pardo Analytics to understand learning environments 20

Horia

Varlanflickr.com

Tool usage vs academic performance

(Romero-Zaldívar et al., 2012)

Abelardo Pardo Analytics to understand learning environments 21

Chiot’s

Run

Flickr.com

Collect URLs Compare withcourse notes

Detect newresources

(Romero-Zaldívar et al., 2011)

Abelardo Pardo Analytics to understand learning environments 22

Adventures

inLibrarianship

flickr.com

Detect engagementwhile writing

(Calvo et al., 2011, Liu et al., 2013)

Facial expressions

Detect emotions

Abelardo Pardo Analytics to understand learning environments 23

(Monkaresi et al., 2012)

Abelardo Pardo Analytics to understand learning environments 24

Quinn

Anya

flickr.com

LearningAnalytics

Observe andCollect

View and Act

Learning glass

Abelardo Pardo Analytics to understand learning environments 25

(Crespo et al. 2012, Leony et al., 2012)

Abelardo Pardo Analytics to understand learning environments 26

Showquestion

Showcorrect

Showincorrect

Showsolutions

again

again

Abelardo Pardo Analytics to understand learning environments 27

Transitions are recorded(Pardo et al., 2012)

Abelardo Pardo Analytics to understand learning environments 28

Just in time teaching

Abelardo Pardo Analytics to understand learning environments 29

Browser add-in

Abelardo Pardo Analytics to understand learning environments 30

Quinn

Anya

flickr.com

LearningAnalytics

Observe andCollect

View and Act

Self-motivation

“Transition” for patients with a chronic illness

Abelardo Pardo Analytics to understand learning environments 31

(Calvo et al., 2013)

Self-determination theory and types ofmotivation

Abelardo Pardo Analytics to understand learning environments 32

(Ryan and Deci, 2000)

Explore the most adequate channels to dialoguewith the patient.

Abelardo Pardo Analytics to understand learning environments 33

(Yu Zhao, ASWEC Doctoral Consortium 2014)

Abelardo Pardo Analytics to understand learning environments 34

Matheson

LearningC

omm

onsflickr.com

First-year transition

Abelardo Pardo Analytics to understand learning environments 35

KeoniC

abralflickr.com

Tech for high stakes finite time periods

Abelardo Pardo Analytics to understand learning environments 36

Quinn

Anya

flickr.com

LearningAnalytics

Observe andCollect

View and Act

Self-motivation

Flippedclassroom

Increasing use of videos

Abelardo Pardo Analytics to understand learning environments 37

What is missing?

AnnotationHighlight areas of importanceCollaborationIntegration in learning environment

Abelardo Pardo Analytics to understand learning environments 38

Students “comment” on video with someguidance

Abelardo Pardo Analytics to understand learning environments 39

(OLT Project, Using video annotation software to develop student self-regulated learning)

Abelardo Pardo Analytics to understand learning environments 40

KreativeK

ewlflickr.com

Flipped Classroomdoes not exist!

(Bergmann & Sams, 2012)

Abelardo Pardo Analytics to understand learning environments 41

MIT

CH

EL

Lflickr.com

Old idea, but revived due to two reasons

Abelardo Pardo Analytics to understand learning environments 42

Krugazorflickr.com

(Mazur, 2009)

Simple transfer of information is not optimal!

Abelardo Pardo Analytics to understand learning environments 43

Juantan

Kw

onflickr.com

Resourceseverywhere!

Abelardo Pardo Analytics to understand learning environments 44

Fellmannia

flickr.com

Face-to-face timeis very valuable!

Abelardo Pardo Analytics to understand learning environments 45

-NA

CH

-flickr.com

Remember

Understand

Apply

Analyze

Evaluate

Create

Incl

ass

Ass

ignm

ents

Can we do better?

Abelardo Pardo Analytics to understand learning environments 46

-NA

CH

-flickr.com

Remember

Understand

Apply

Analyze

Evaluate

Create

Pre

-ass

ignm

ents

Incl

ass

Abelardo Pardo Analytics to understand learning environments 47

p_a_hflickr.com

A) Previous activities (Be prepared!)

Abelardo Pardo Analytics to understand learning environments 48

Hijukalflickr.com

B) Activities face-to-face

Abelardo Pardo Analytics to understand learning environments 49

Flyinggflickr.com

Great case for datasupported decisions!

Weekly activities

Abelardo Pardo Analytics to understand learning environments 50

Previous andin-class activitiesfor each session

Abelardo Pardo Analytics to understand learning environments 51

Detecting when blocks of text are visualized

Abelardo Pardo Analytics to understand learning environments 52

Interactions with videos

Abelardo Pardo Analytics to understand learning environments 53

Questions embedded in text

Abelardo Pardo Analytics to understand learning environments 54

Problem Sequences

Abelardo Pardo Analytics to understand learning environments 55

Data back to the students

Abelardo Pardo Analytics to understand learning environments 56

Your activity with respect to the rest of the class

Abelardo Pardo Analytics to understand learning environments 57

Abelardo Pardo Analytics to understand learning environments 58

Eleafflickr.com

• Will students use dataabout their events?

• Will they act on what theysee?

• Will the tips have anyeffect?

Abelardo Pardo Analytics to understand learning environments 59

(OLT Project, Radical transformation: re-imagining engineeringeducation through flipping the classroom in a global learningpartnership)

r2hoxFlickrAnalytics to understand learningenvironments

Chai Seminar, 14 April 2014

Dr Abelardo Pardo (@abelardopardo)School of Electrical and Information Engineering

slideshare.net/abelardo_pardo

References

Bichsel, J. (2012).Analytics in Higher Education Benefits, Barriers, Progress, and Recommendations.EDUCAUSE Center for Applied Research

Hattie, J. A. C. (2009).Visible learning: A synthesis of over 800 meta-analyses related to achievement.New York: Routledge.

Pardo, A., Delgado Kloos, C., 2011,Stepping out of the box. Towards analytics outside the Learning Management SystemInternational Conference on Learning Analytics and Knowledge, pp, 163-167, ACM New York, USA

Romero-Zaldívar, V.A., Pardo, A., Burgos, D., Delgado Kloos, C., 2012Monitoring Student Progress Using Virtual Appliances: A Case StudyComputer & Education, 58(4):10580–1067, 2012

Romero-Zaldívar, V.A., Crespo García, R., Burgos, D., Delgado Kloos, C., Pardo, A., 2012Automatic Discovery of Complementary Learning ResourcesEuropean Conference on Technology Enhanced Learning, 2011

Abelardo Pardo Analytics to understand learning environments 61

References II

Liu M., Calvo, R.; Pardo, A., 2013Visualizing the effect of actions in personal informatics systemsWorkshop on Personal Informatics, CHI’13

Calvo, R., O’Rourke, S.T., Jones, J., Yacef, K., Reimann, P., 2011Collaborative Writing Support Tools on the CloudIEEE Transactions on Learning Technologies, 4(1):88–97

Monkaresi, H., Hussain, M. S., Calvo, R., 2012A dynamic approach for detecting naturalistic affective states from facial videos during HCIAustralasian Joint Conference on Artificial Intelligence, Sydney, Australia. LNAI, Springer 2012, pp.170-181

Crespo García, R.M., Pardo, A., Delgado Kloos, C., Niemann, K., Scheffel, M., Wolpers, M., 2012Peeking into the black box: visualising learning activities.International Journal on Technology Enhanced Learning, 4(1/2), 2012

Leony, D., Pardo A., De la Fuente Valentín, L., Sánchez de Castro, D., Delgado Kloos, C. 2012GLASS : A Learning Analytics Visualization ToolInternational Conference on Learning Analytics and Knowledge, pp. 162-163, ACM Press.

Abelardo Pardo Analytics to understand learning environments 62

References III

Calvo, R. A., Pardo, A., Zhao, Y., Klineberg, E., Lam, M., and Steinbeck, K. 2013.TransitionMate: a mobile application for chronic illness transition support.In C. Röcker, M. Ziefle, A. Holzinger, K. McGee, S. Hansen, and J. Meyer (Eds.), Fifth InternationalWorkshop on Smart Healthcare and Wellness Applications (SmartHealth’13) - OzCHI 2013, Nov 25-26.Adelaide, South Australia: ACM.

Ryan, R., and Deci, E. (2000).Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being.American Psychologist, 55(1), 68–78.

Bergmann, J., Sams, A., (2012)Flip Your Classroom: Reach Every Student in Every Class Every DayHawker Brownlow Education

Mazur, E., (2009)Farewell, Lecture?Science, 323, pp. 50-51.

Abelardo Pardo Analytics to understand learning environments 63