Measurement ofInformal
Workforce Learning
LEV KAYE | Founder and CEO, CredSpark+
SARAH AZIZI | Director of Business Development & Partnerships, Degreed
+
Formality Is Fading Everywhere.
Formal Learning Is No Exception.
+
As Our Lives Have Become Less Formal...
… So Too Has Our Learning.
(especially for grownups)
+
8000BCE
2050CE
Pre-Diploma Era
Learn On the Job (or starve)Job-Relevant LearningHigh ROI on Learning (i.e. survival)Immediate Feedback on Progress
Learn On the Job (or lose it)Job-Relevant LearningHigh ROI on the Right LearningImmediate Feedback on Progress
10,000 Years of Workforce Learning
Learning Before the JobMuch Job-Irrelevant LearningROI Rises, Then Plateaus (as student debts grow)
Delayed Feedback On Progress
Diploma Era
Post-Diploma Era
+
1100CE
Shift to Informal Learning:
Who LOSES?
Traditional Post-Secondary Programs (disconnected from workforce reality)
Seat-Time Trainers (learning measured by time spent)
Monolithic Credentials (broad-brush, catch-all, slow to adapt)
+
Shift to Informal Learning:
Who WINS?
Learning Curators
Micro-Credentials
Personalized, Data-Informed Learning Providers
+
What Ties Together The Winners:
Have a Teacher’s Mindset
Define ‘Learners’ Broadly
Invest in Learner Engagement
Provide ‘Snackable and Nutritious’ Content
Do Frequent, Low-Stakes Measurement
+
Informal Workforce Learning:
The Promised Land
You know your Learners as Individuals.
You support their journey as a Great Teacher would support her students.
You’ve personalized their learning, informed by data.
Because of the above, you’ve earned their Engagement and Trust.
+
Shift: Teachers
OLD:• University faculty• Corporate trainers
NEW:• Industry Influencers• Trade Press and Event Organizers• Colleagues and Peers
+
Shift: Learners
OLD:• Enrolled students• Employees in training
programs
NEW:• Any and all employees• Potential hires• Suppliers and Partners• Customers
+
Shift: Content
OLD:• One-Size-Fits-All• Long Form
NEW:• Personalized Based On
Individual Data• Delivered In-Stream, At Point
of Need
+
Shift: Measurement
OLD:• Formal, High-stakes
Assessment (certification, licensure)
• Otherwise, little/no measurement at all
NEW:• Knowledege Checks• Quizzes/Polls/Surveys• “Stealth Assessment”
+
Shift: If You’re Prepared, You Will…
Deepen your knowledge about your learners’ knowledge
Personalize their learning opportunities
Increase learners’ engagement and trust
Unlock new areas for your learners to grow within your organization
Gain higher overall employee engagement, skill, and job satisfaction
+
The Informal Learning Shift Is Upon You.
How Do You Measure It?
+
Learning Assessment
Formative vs. Summative
+
What is formative assessment versus summative assessment?
Example: End of chapter quiz vs. final exam
Goals/Uses of formative assessment
How formative assessments are used in the workplace
How to measure (pre vs. post, etc.)
Types of metrics you can capture
Formative Assessment in the Workplace
+
How it reinforces the learning, etc.
Best practices
Assessment as Employee Engagement
+
Example of a Degreed customer leveraging informal assessment
How you can make the move
Best practices
Case Studies
Degreed Clients Measuring Informal Learning
+
Evaluate your assessment approach
How do you measure learning engagement today?
How much data do you have on how individuals are learning?
Do you have the insights to deliver personalized learning based on skill needs?
Signal to incorporate informal assessment
What are the Key Takeaways?
+