Getting ready for learning analytics
Getting ready for learning analytics
Introductions
Facilitators»Paul Bailey»Shri Footring»Niall Sclater»Rob Wyn Jones»George Munroe
3/03/2016
Overview
»Toolkit› Discovery› Code of practice› Technical and data
definitions»Community› Network Meetings› http://analytics.jiscinvolve.org/
wp/ › [email protected]
»Technical architectureJisc learning analytics project
3/03/2016 Getting ready for learning analytics
Activity 1
1. How would you define learning analytics?2. What do you want to gain from using learning
analytics at your institution?
Discussion questions
3/03/2016 Getting ready for learning analytics
A definition of learning analytics
“Learning analytics is the measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimising learning and the environments in which it occurs”
SoLAR – Society for learning analytics research
3/03/2016 Getting ready for learning analytics
Finding a starting point…
“I think one of the main problems with analytics is finding a starting point. Going through the Discovery phase does give a number of starting points.”
Sheila MacNeillhttps://howsheilaseesit.wordpress.com/2016/02/09/clawing-my-way-up-through-the-trough-of-disillusionment-with-learning-analytics/
3/03/2016 Getting ready for learning analytics
Activity 2: Getting ready…
Activity 2: Getting Ready….
1. Are you aware of the Legal and Ethical issues relating to learning analytics?
2. What the technical and data challenges you need to consider?
3. Are you culturally ready for learning analytics?
3/03/2016 Getting ready for learning analytics
Legal and ethical
3/03/2016 Getting ready for learning analytics
Legal and ethical
3/03/2016 Getting ready for learning analytics
Group Name QuestionMain type
Importance Responsibility
2 Consent Adverse impact of opting out on individual
If a student is allowed to opt out of data collection and analysis could this have a negative impact on their academic progress?
Ethical 1 Analytics Committee
7 Action Conflict with study goals
What should a student do if the suggestions are in conflict with their study goals?
Ethical 3 Student
8 Adverse impact
Oversimplification How can institutions avoid overly simplistic metrics and decision making which ignore personal circumstances?
Ethical 1 Educational researcher
86 issues in 9 groups
Legal and ethical
Code of practice for learning analytics.
Available at:jisc.ac.uk/guides/code-of-practice-for-learning-analytics
3/03/2016 Getting ready for learning analytics
Technical and data
»What data must be collected to provide useful learning analytics? You might need…› Historical (18 months minimum) for Predictive
modelling › LIVE data to refine the model moving forwards› Student data, assignment and examination marks
plus results/ grade data, etc. › Activity data – VLE, library, attendance, etc.
»How long should data be preserved?
3/03/2016 Getting ready for learning analytics
Technical and data
»How can this be collected from the various systems involved?› Do data from different systems need to be mapped to
each other to be useful?› How can any required mappings be achieved?› Should mapped data be stored separately from the
sources?› Where should mapped data be stored?
3/03/2016 Getting ready for learning analytics
Technical and data
»What analysis outputs are of most interest?› What would bring confidence to making important
decisions based on analysis outputs?› What would erode confidence in making those
important decisions?
3/03/2016 Getting ready for learning analytics
Getting ready for learning analytics
Culture
»Leadership»Wide engagement»A shared vision
»Staff skills»Effective interventions»Support for learners
3/03/2016
Discussion Questions…
»Should students be asked for consent to use their data for learning analytics?
»Can students access all the data held about them in your institution?
»Should interventions always be human-mediated?
Legal and Ethical
3/03/2016 Getting ready for learning analytics
Discussion Questions…
»What sources/ good indicators of student engagement or activity exist?
»What problems are foreseen with LIVE student data capture?
Institutional Culture»Who will you involve in implementing learning
analytics in your institution?
»What is the strategic driver? Quality, finance,student satisfaction?
Technical and Data
3/03/2016 Getting ready for learning analytics
Plenary
1. Are you aware of the Legal and Ethical issues relating to learning analytics?
2.What the technical and data challenges you need to consider?3.Are you culturally ready for learning analytics?
3/03/2016 Getting ready for learning analytics
jisc.ac.uk
Learning analytics
Further information
Paul BaileySenior Co-design [email protected]
3/03/2016 Getting ready for learning analytics