EduQare… e-learning/e-assessment
in a hospital setting
Liesbeth Verbanck
Staff member Quality / EduQare
Jan Yperman hospital
How the success story of a small hospital became the
reference for the sector in Belgium
JYZ = hospital of 500 beds in ”Flanders Fields”
110 specialists
750 FTE or 1200 employees•
500 official beds•
88 day hospital beds
Jan Yperman Ziekenhuis
= first accredited hospital in Flanders (5th edition)
• Continuously working on Quality
• Formal confirmation
• Commitment of all JYZ staff
• Standardize/enhance Care processes
Accreditation? Yes!
A positive choice after a positive visitation!
• American accreditation board
• International division
• ISQua approved
• Not only hospitals
• Global with local accents
• Specific framework for Patient Care:Joint Commission International Standards for Hospitals
Joint Commission International
Patient-centered standards
Access to care en continuity of care (ACC)
Patient and family rights (PFR)
Assessment of patients (AOP)
Care of patients (COP)
Anesthesia and surgical care (ASC)
Medication management and use (MMU)
Patient and family education (PFE)
Health care organization management standards
Quality improvement and patient
safety (QPS)
Prevention and control of infections (PCI)
Governance, leadership and direction (GLD)
Facility management and safety (FMS)
Staff qualifications and education (SQE)
Management of information (MOI)
Framework JCIInternational patient safety goals (IPSG) 100%
• Identification
• Effective communication
• High alert Medication
• Right patient, right intervention,right side
• Hospital infection prevention
• Fall prevention
= framework for
item banking in
Edumatic
The report: the numbers…Met elements from 5th framework score totaal
1146 measurables 10 11460
Fully met 1118 10 11180
Partially met 26 (35)5 26 x 5 = 130
Not met 2 (6)0 2 x 10 = 20
Eindscore 11460 – 130 – 20 = 11310/11460 = 98,7%
ResultUnprecedented collaboration and teamwork between staff, doctors anddepartments
Result
1e hospital in Western Europe to be rewarded for the 5th
framework
3e general hospital to be accredited in Belgium ever
(after UZ Leuven and AZ Groeninge)
E-learning(or blended learning)
The role of e-learning in the accrediation story
Why e-learning?
• Need for motivated and highly qualified staff.
• Classic trainings didn’t fit anymore
(flexibility, time consuming, repeat needed, no practising,
no exercises…)
• Flexible and individual training program needed
Number crunching…• 15 trainings for all staff
• 8 sessions (1h) per training
• 120 trainings for Q&S (JCI)
• 15 h trainings/employee
• Monthly newcomers training
• …
• 1.100 standards in hospital policy
• 14 official notes
• 14 résumés
• 3 films on IPSG were developed
• Fire security training
Why e-learning / EduQare?van het
• EduQare was not a ‘quick’ decision
first the need -> then the tool
• Sence of urgency through JCI accredition at alle levels
• Solution: online individual, flexible tool
• Flexible in time & space
• Individual learning pads (several targetgroups linked to the AD)
• Positive choice for EduQare (Edumatic)
• Low implementation time
• Intuitive
• Online / cloudbased
• No maintance by the hospital
• SSO with AD
• Assessment and tests in one tool
EduQare within accreditation story
• Exercises
after collective trainings
• Online / flexible / anytime, any place
(unique in hospital; typically strong
influence of unions!)
• Exercises and tests relevant
per target group
• Participation was free:876 unique users (in July and August!) <-> 1200 employees
EduQare within accreditation story
• Keys to success:
– Staff is convinced aboutusefulness of the exercises!
– Sense of urgency
– Supported by accreditation key persons
– Lots of info/marketing internally
– Success stories spread in a viral way!
– Ease of use
– No login, no install
– Direct feedback and result
EduQare
• Important:
– Exercises not too long (start & stop possible)
– Individual follow-up in training room for people who feel less comfortable with the format.
– Think about questions (variation, use media, cartoons,…).
– All questions relevant for the specific target group.
– Questions not too easy, not too difficult!
– Clear communication about expectations and results (not compulsory – no “hard” consequences – intrinsic motivation)
– Extensive pre-testing with IT for a smooth implementation
EduQare after accreditation
• Anchoring in organisation‘sense of urgency’ disappears until next accreditation cycle
– Embed in normal training paths for newcomers
– Custom projects started about specific topics
– New Fire procedures
– New machines
– As an add-on for other formats
• EduQare as internal evaluation tool:
– Based on positive exercises with accreditation
– New staff ~ new management ~ new company culture –the learning organisation
– Again clear communication about use of results
– Efforts are rewarded
EduQare - workflow
• Structure item bank
• Item types
• Topics
• Formats
• Analysis
Kessels, J. & Smit, C. (1996). Het acht velden instrument: analyse kader voor opleidingseffecten. Utrecht: The learning Company.
Probleem tot item
EduQare – From problem
=> item
Workflow EduQare
EduQare – item bank• Structure
– Input – linked to JCIframework:
• Folderstructure
• Item names: number norm/ q# / title
Editable in case of norm changes
Finding questions
– Output – linked to hospital organisation (AD)
• Metadata linked to
professional groups
EduQare – itembank
• Structure
– Fixed layout
• Introduction/context (pt 14).
• Question
• Instruction (what to do)
– All authors
• Objective
– User friendliness
– Recognizable
TIP:Better to do input all at
once.
TIP:Checklist ‘what to
do for each
question’.
EduQare – itembank
• Different item types.
• Designing good activities/items/questions
– Most important part of the design!
– Author needs to think.(Edumatic: question type cannot be changed…)
• Variation
– Fun for users
• Question typology
– Content
– Competence
• Reproduce?
• Apply?
• Recognize? TIP:Invent
meaningful ‘wrong’
answers for
multiple choice.
EduQare – topics• E-assessment & e-testing in a process of information-
transfer.
• First information then practise then test.
– = blended learning
– Tranfer the practice into clear questions =the practice in test!
• Almost any subject can be transferred into a digital item
• Take your time
• Enrich with media and feedback
• Time to correct?
• Authors need training but also “grow” in it rapidly
EduQare – scenario’s
•Scenario = filtering items into exams
•Different scenarios
•Per professional group
•Per topic for everyone
•Published as exercise or test
EduQare – publications
EvaluationAssessment
Practice Exercises
EduQare – Feedback
•Always feedback to users
(motivation)
–On the questions individually
–On the full test
•Conclusion/End message
at the end
EduQare –
– Through badge
•Directly to portal
– Through internet / link
• With password
• From home (anywhere)
– Mobile devices
EduQare – reports• Basic and
Advanced reportering
– Check basic reports
– Create your own filtered
reports
EduQare – analysis
• Digitization => Big data How to make it => Rich data ?
– Results of staff members
– Item bank can be reused instantly
– Item analysis!
• Wrong items?
• Content not clear?
• Very rewarding learning process for all involved
