36
AN INTRODUCTION TO XAPI AND LEARNING ANALYTICS Tim Dickinson Director, Learning Analytics Strategy | Watershed @watershedLRS
AN INTRODUCTION TO XAPI AND LEARNING ANALYTICS
Tim DickinsonDirector, Learning Analytics Strategy | Watershed @watershedLRS
@WatershedLRS
Today’s sessionagenda
02
Introducing Experience APIHistory, purpose and why organizations use it.
03
The LRS and Learning AnalyticsWhat does an LRS do and where does it sit in the Learning Analytics ecosystem?
Case StudiesWhat are some organizations already doing today?
01
What exactly is xAPI?
@WatershedLRS
xAPI is to learning technologieswhat USB is to electronic devices
USB
USB is a technical specification that makes it easier and cheaper to connect electronic devices.
With USB, you normally need a computer to connect devices to.
xAPI is a technical specification that makes it easier and cheaper to connect learning technologies.
With xAPI, you need a Learning Record Store (LRS).
xAPI
@WatershedLRS
Why connectwith USB?
To transfer dataFor example: when you get a new laptop
For devices with different functions to work togetherFor example: your laptop and a printer
To back up dataFor example: in case your laptop breaks down
@WatershedLRS
Why connectwith xAPI?
To transfer learning recordsFor example: when you get a new learning platform
For products with different functions to work togetherFor example: your LMS and a social learning platform
To back up learning recordsFor example: in case your LMS breaks down
@WatershedLRS
Components of anxAPI project
@WatershedLRS
Do all productsuse these specifications?
USB
Not all devices implement USB. For example: Apple use their own connections in many cases.
Some products implement USB badly.For example: Some uncertified USB-C cables have damaged phones and computers.
Not all learning technologies. implement xAPI. For example:many LMSs have been slow to adopt.
Some products implement xAPI badly. For example: 1. Data may be incomplete or difficult to interpret. 2. You may not be able to get data out.
xAPI
https://www.theguardian.com/technology/2016/mar/30/amazon-clamps-down-dangerous-usb-c-cables
@WatershedLRS
Can I leverage xAPI if my product doesn’t support it?Yes!
And once you have the connector, you can connect the product to other xAPI-enabled learning technologies in future as well!
You can use a connector
@WatershedLRS
Types ofconnector
Product-specificConnectors exist for some popular products or other learning tech specifications.
DIYYou can also implement xAPI on your own.
Multi-connectorFor example: Zapier connects hundreds of applications and has an xAPI output.
Universal connectorWatershed’s CSV import is effectively a universal connector for any data source.
!
@WatershedLRS
Why should learning professionals care about
a technical specification?
@WatershedLRS
Design learning programs and ecosystemsthat fit better and are more connected.
Best of breed learning ecosystem instead of one monolithic system
Example: an LMS for formal training, a social platform for informal learning and apps to support mentoring and track event attendance
A tightly blended learning experience across multiple platforms and providers
Example: promoting different e-learning courses based on job task observations or social learning activity
Centralized learning and performance reportingacross the complete ecosystem
Example: evaluating the impact of learning programs on job performance and business metrics in Watershed
@WatershedLRS
Utilize xAPI for robustlearning evaluation.
Align Define Discover Design
Monitor Analyze Explore
For more info: watershedlrs.com/blog
@WatershedLRS
“Without data you’re just another person with an opinion.”
W. Edwards DemingManagement Systems Legend
@WatershedLRS
@WatershedLRS
“L&D is responsible for improving our most important asset, our people. If we can improve L&D, we can improve the world.”
@WatershedLRS
Mike RusticiFounder & CEO of Watershed
@WatershedLRS
attitudestrategy
Think strategically and develop a culture of constant improvement. It’s learning’s turn
@WatershedLRS
Marketingevolution
Source: 5 Reasons Learning Needs to Think Like Marketing, Tribridge (2015)
@WatershedLRS
A brief history ofLearning Technologies Interoperability
SCORM 1.2
2001
Executive Order 13111
1999
SCORM 20044th Edition
2009
Project Tin Can
20102004 20062013
Experience API1.0.0
2012 2014 20172000
1.0 1.1 2004
20042nd ed.
20043rd
ed.
DoDI 1322.26 Enterprise-Scale
Deployments
1.0.1 1.0.2 1.0.30.9 0.95
2016
UpdatedDoDI 1322.26
@WatershedLRS
xAPI &learning analytics platform
all data
Learning is so much bigger than the LMS. Track informal and
experiential activities.
xAPI and the LRS present a transformative technology for learning analytics. Seamlessly bring all your data together in one platform and perform real-time analytics tailor made for L&D.
business impact
Include data about behaviors and performance in your learning analytics real time
Create, view and distribute reports seamlessly in real-time.
LAP
@WatershedLRS
Understanding learning analytics: Complexity
measurement
The simple act of tracking things and recording values. Can be passively or actively collected.
evaluation
The process of trying to make meaning from the data measured. Descriptive analytics. Does the data mean something “good” or “bad”?
advanced evaluationWhen data sets get large enough we can use advanced evaluation techniques to discover powerful insights. Data mining, AI, machine learning, etc.
predictive and prescriptiveMake predictions and decisions based on data and advanced algorithms. Recommendations engines are the best example in learning.
@WatershedLRS
Learning Experience Learner Learning
Program
Understanding learning analytics: Categories
Understand an overall learning program. Is this initiative helping to meet
business objectives.
Understand a learner or group of learners. Ensure organizational readiness
and compliance.
Understand more about a specific learning activity. Maximize
effectiveness and spot problems.
The future in practice.
@WatershedLRS
next generationlearning ecosystem
03connected to outcomesLearning outcomes on their own are only marginally interesting. Incorporate learning into larger business objectives and bring the data together to show their effectiveness.
02mobile, social, informal
Learning happens everywhere and now we can track it. The constraints of old are gone. Embrace the types of learning that your learners want to use. Provide resources in the moment of need where the learners live.01
away from the LMS
How much of what you’ve learning in your lifetime has come from an e-learning course in an LMS? LMSs aren’t going away, but it’s time for us to recognize that learning happens everywhere.
Visa University:A new
ecosystem
A next generation learning ecosystem brings this all together.
This example from Visa shows that the LMS is just one small part of a modern learning ecosystem.
@WatershedLRS
Source: Getting Buy-In From the Boss. Andy Webb, Applied
Comprehension vs. Application
Source: Getting Buy-In From the Boss. Andy Webb, Applied
@WatershedLRS
Source: Getting Buy-In From the Boss. Andy Webb, Applied
@WatershedLRS
Source: Getting Buy-In From the Boss. Andy Webb, Applied
@WatershedLRS
Source: Getting Buy-In From the Boss. Andy Webb, Applied
Code Blue
When a patient's heart stops and needs to be resuscitated.
Key Metrics
Time to first drug
Time todefibrillation
Time to chest
@WatershedLRS
Learning Ecosystem
LMS
Mobile app Mock code blue
Learning Analytics Platform
@WatershedLRS
Mock Code Blue/ In person Observation
Mobile Simulation/ Defibrillator App
LMS Training Lab
Learning Analytics Platform (Watershed)
Learning Ecosystem
@WatershedLRS
Getting Startedyes you can!
01 Gather your dataJust start collecting data in a common format in a central location. Make it low friction and ensure you have access.
04 Explore your dataStarting to understand not just “what” is happening but “why.” Form questions and see if your data can answer them. Often, the best answer another question. Can you see impacts on the larger business?
02 Get to know your dataUnderstand what you have. What is out there, what is reliable, and what is missing? Do some simple evaluations and create baselines.
05 Experiment with your dataStart a new learning program with analytics in mind. Set up well controlled experiments and A/B tests to validate a hypothesis. Create a culture of continuous improvement.
03 Operationalize your dataAutomate your way out of “Excel hell.” Define some interesting metrics and KPIs, start monitoring them routinely. What trends do you notice?
06 Show off your dataWe’ve long known that learning is vital, not we can probe it. Go forth and show the world!
@WatershedLRS
ourcontacts
watershed
210 Gothic Ct
Franklin, TN 37067
+1-844-220-0822
http://watershedlrs.com
@watershedlrs
me
Tim Dickinson
Director, Learning Analytics Strategy
