STEWART ROGERSDirector Product Management, Lambda Solutions

5 Steps for Data-Driven Online Learning & Training

Housekeeping

2

1. Sound & Audio2. Poll Questions3. Q&A at the end4. Presentation Recording & Slides5. Post-webinar Survey

Lambda Solutions

3

LMS experts – complete solutions provider, including

technology, training, & services

Beyond technology – our solutions

help you see when (and how)

eLearning is achieving goals.

12+ years, 600+ LMS

implementations, 1M active user accounts across most industry

sectors

Our Clients

4

What Is Data-driven Training?

“A data-driven approach used to optimize how your organization manages and deploys learning and development to support the execution of your business strategy.” - Chief Learning Officer, 2015

5

What Is Data-driven Training?

“A data-driven approach used to optimize how your organization manages and deploys learning and development to support the execution of your business strategy.” - Chief Learning Officer, 2015

6

Poll Question #1

Are you currently using a data-driven approach?

7

Poll Question #1

Are you currently using a data-driven approach?1. Yes, we’re getting there!2. A bit, but not fully.3. No, not at all.

8

15%

60%

25%

Step 1: Embrace A Data-driven Mindset• Make analytics part of the fabric of daily operations• Must view data as central to identifying opportunities and

solving problems• Identify 2-4 key requirements that data can address• Take inventory of your "data assets." Explore the data

available both within learning solutions and across your ecosystem

• Assess your capabilities against what is required to support your goals

9

Step 2: Establish Shared Goals• Democratizing data access and shared accountability for

meeting those goals• Set department and individual goals - transparently• Debate is encouraged, along with "healthy tension"• Everybody in the department, from the CLO down to the

instructional designer, should share a common goal for alignment.

10

Step 3: Offer Continuous Training & Coaching• Find those who are interested• Use Aryng’s Analytical Aptitude Assessment to assess fit for

a data driven role or an analytics career• Identify the skills gap• Choose the most appropriate training option

11

“50% of L&D organizations lack the analytics skills necessary to use the data available”

Unleashing the Power of Analytics:Driving Performance at the Intersection of Learning and Business

Raytheon Whitepaper (November 2015)

Step 3 (Continued): Training And CoachingSKILLS• Ability to pull data from multiple sources and collate (experience

in writing SQL queries)• Hands-on experience with basic statistical techniques: Profiling,

Correlation analysis, Trend analysis, Segmentation• Ability to work effectively with stakeholders by building

alignment, effective communication and influencing• Hands-on comfort with advance techniques: Time Series,

Predictive Analytics – Regression and Decision Tree, Segmentation and Text Analytics

12

Step 4: Provide Access To The Right Tools

…. AND THE RIGHT DATA• Equip your learning solutions with robust reporting

and analytics capabilities– Probably not Excel– Probably not the reporting options in your LMS

• Complement with one or more statistical tools like SAS, R, SPSS, Knime or others

13

Poll Question #2

Does your Learning Management System (LMS) have a robust reporting tool to a data-driven approach?

14

Poll Question #2

Does your Learning Management System (LMS) have a robust reporting tool to a data-driven approach?Yes, and we use it!Yes, but it doesn’t provide all the information we need.No, it does not.We do not use an LMS

15

25%

45%

20%

10%

Measuring Training EffectivenessUsing a methodical approach…Donald Kirkpatrick first published his Four-Level Training Evaluation Model in 1959, in the US Training and Development Journal. The model was then updated in 1975, and again in 1994.

Four Levels of Evaluation:1. Reaction2. Learning3. Behavior4. Results

16

The Kirkpatrick Ladder

17

REACTIONLevel 1

LEARNINGLevel 2

BEHAVIOURLevel 3

RESULTSLevel 4

Level 0

Impa

ct

Time

The Kirkpatrick Ladder

18

REACTIONLevel 1

LEARNINGLevel 2

BEHAVIOURLevel 3

RESULTSLevel 4

Level 0

Impa

ct

Time

Doing nothing.

The Kirkpatrick Ladder

19

REACTIONLevel 1

LEARNINGLevel 2

BEHAVIOURLevel 3

RESULTSLevel 4

Level 0

Impa

ct

Time

Measures how the people being trained, reacted to the training.

The Kirkpatrick Ladder

20

REACTIONLevel 1

LEARNINGLevel 2

BEHAVIOURLevel 3

RESULTSLevel 4

Level 0

Impa

ct

Time

Measure what your trainees have learned.

The Kirkpatrick Ladder

21

REACTIONLevel 1

LEARNINGLevel 2

BEHAVIOURLevel 3

RESULTSLevel 4

Level 0

Impa

ct

Time

Evaluate how far your trainees have changed their behavior.

The Kirkpatrick Ladder

22

REACTIONLevel 1

LEARNINGLevel 2

BEHAVIOURLevel 3

RESULTSLevel 4

Level 0

Impa

ct

Time

Analyze the outcomes that you or your organization have determined to be good for business or the employees.

The Kirkpatrick Ladder

23

REACTIONLevel 1

LEARNINGLevel 2

BEHAVIOURLevel 3

RESULTSLevel 4

Level 0

Impa

ct

Time

UTOPIA

Poll Question 3What evaluation level have you achieved?

1. None yet.2. Level 13. Level 24. Level 35. Level 4

24

Poll Question 3What evaluation level have you achieved?

1. None yet.2. Level 13. Level 24. Level 35. Level 4

25

10%20%30%20%10%

Typical Barriers To Climbing The Ladder1. Your LMS has limited access to data2. Your LMS has limited in capabilities to analyze data3. Your LMS has limited options to present and share data4. You have limited time

26

The Real Barrier

“50% of L&D organizations lack the analytics skills necessary to use the data available”

Unleashing the Power of Analytics:Driving Performance at the Intersection of Learning and Business

Raytheon Whitepaper (November 2015)

27

Poll Question 4

What prevents you from reaching higher levels?

1. Not enough time, we’re so busy delivering training2. We do not have access to the data3. We do not have software to analyze the data4. We do not have skills to analyze the data5. We can’t clearly connect learning the business results

28

ZoolaTM Analytics

Zoola Analytics is a cloud-based reporting solution that empowers you to better understand your learners and continuously improve learning programs and related resources. • Canned reports + ad hoc reports + custom reports• Charts, Tables, Crosstabs• Interactive dashboards • On-demand exports• Scheduled report delivery• Localized for 8 languages

29

30

Questions?

31

Book a Free 1-on-1 Consultation

32

• Free 30 minute session with our reporting expert• Explore your organizations reporting potential, and

brainstorm reporting ideas • Interested? Contact stewart.rogers@lambdasolutions.net

Follow-up

33

• Recording & slides to follow• Post-webinar satisfaction survey• Further questions - Don’t hesitate to contact us

CONTACT US

TOLL FREE +1.877.700.1118

EMAIL SALES@LAMBDASOLUTIONS.NET

WWW LAMBDASOLUTIONS.NET