Post on 05-Oct-2020
transcript
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Introduction to SimulationLevel 1 Course
South London Simulation Network Faculty Development Framework
WelcomePlease help yourself to Tea and Coffee
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Faculty
Colette Laws-Chapman, Deputy Director, SaIL Centre
Seema Nathoo, Simulation Fellow
Nik Karydis, Consultant
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Acknowledgements
• South London Simulation Network• Health Education England• International Nursing Association for Clinical Simulation and
Learning (INACSL)• Association for Simulated Practice in Healthcare (ASPiH)• Society for Simulation in Healthcare (SSH)• Society in Europe for Simulation as Applied to Medicine
(SESAM)• Centre for Medical Simulation (CMS) and Harvard Business
School, Boston
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Experience Survey #1Your experience teaching clinical skills
Expert +5 years teach, design, curriculum planning, published
Proficient2-5 years teach, design and contribute to sessions or course development
Competent 1-2 years skills-based teaching
Novice 0-1 years bedside teaching
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Experience Survey #2Your experience in simulation
Expert +5 years debrief, design, support faculty (debrief the debrief), curriculum planning,
published in the field
Proficient2-5 years debrief, design and contribute to sessions or course development
Competent 1-2 years intermittent debrief practice, some experience in other areas of sim
Novice 0-1 years experience as a participant
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Participant Introductions
• Your name
• Your professional background & clinical expertise
• Your favourite pastime
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Social Media Guidelines
• tweeters - use the hashtag
#SaILintro2sim
• tweet about your experiences - our twitter handle
@huMANikin
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Faculty Development Framework SLSN 2017
Level 1 -Novice
Preparatory learning (readings, observation,
experience)
Introduction to Simulation
(Two days, including basic debriefing skills)
Essential Debriefing (Debriefing with
Diamond or other model)
Introduction to Human Factors in Healthcare
Level 2 -Advanced
Advancing your Debriefing
Teaching the skills of Human Factors
Debriefing in in situ environments
Human Factors 2.0: Understanding Patient
Safety
Level 3 -Expert
Advanced reflective practice and debriefing
the debrief
Simulation as a Teaching Tool (Harvard CMS Instructor Course)
CPD or training in further models of
debriefing
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Faculty Development Programme
Day one•Identifying & Writing Learning Objectives
•Designing Simulation-based Training
•Delivering Simulation-based Training
Day two•Practice: Deliver & debrief your own scenario
•Evaluate Your Simulation Practice
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Research & the Informed Consent Process
• Simulation is an emerging field of scholarship & research
• Colleagues around South London are exploring various aspects of simulation, including links between simulation training, your learning outcomes and patient safety
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Research & the Informed Consent Process
• Through examination of video data, questionnaires, interviews, & focus groups, we hope to demonstrate the value of simulation in the training of healthcare professionals
• We seek your consent for all aspects of this research
• Please read the information sheet & complete the consent form
• If you do not wish to consent for any aspect of this research your training will not be affected
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Learning Objectives
By the end of the course, you will be able to:
• Identify & write learning objectives for clinical skills or scenario-
based simulation training appropriate to your clinical setting
• Design a clinical scenario aligned with learning objectives
• Create an effective learning environment in the workplace
• Use low technology simulators, part-task trainers or manikins to
create realistic learning opportunities
• Use basic debriefing skills to contribute to simulation learning
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Hopes and Concerns
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Course Director’s Role
• Manage schedule (stick to time)
• Manage people (the go-to person)
• Responsible for the learning environment
• Facilitator
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Organisation
• Venue – rooms / environment / fire exits
• Refreshments
• Bio breaks & rest breaks
• Copyright
• Cameras – live feed / accessible by centre staff only
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
SaIL Centre- STH
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Course Principles
• Your previous experience is an important asset – & the starting point for our work
• To that we add some new knowledge & practice over the course
• We are all learners, working together • We strive to create a learning environment
where it’s safe to take risks & to try new things
• Basic assumption:– Our colleagues are capable, want to do their best,
& want to improve
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Course Principles (continued)
• Experiential learning • Sharing our learning together
– Mistakes are ok– Curious stance
• Embedded participant• Safety • Code Phrase ‘this is not a
simulation’• Evaluation
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Rapid Learning Needs Assessment
In pairs:
• What topic do you hope to develop?
• What information do you need to facilitate an interactive learning session in your dept?
• Who can help you?
• What resources do you need / have?
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
A Few Important Reminders
• Registration & data management
• Questionnaires
• Belongings
• Phones / computers
• Check / clean equipment
• Tidy up
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Break
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Circle of Learning Modules
Evaluation and
ReviewIdentifying and
writing learning
objectives
Designing
simulation
training
Simulation
training
delivery
Stage
1
Stage
2
Stage
3
Stage
4
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
•Identifying and Writing Learning Objectives
Module 1
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Module 1:Identifying & Writing Learning Objectives
Module Objectives
Upon completion of this module, you should be able to:
• Describe learning needs assessment in the process of educational planning.
• Use different methods of learning needs assessment.
• Write simple, practical and specific learning objectives.
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
‘Learning is more likely to lead to change when a
needs assessment has been conducted’
Definition:
A Learning Needs Assessment (LNA) is a review of
learning and development requirements designed to
support individual, team and organisational
development. Grant, J (2001) BMJ
Where do we start? What do our learners need?
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Why?
• Starting point for all training design• Identify training needs• For effective learner-centred training• To determine the gap between existing & desired skills,
knowledge, abilities• Enables focussed educational interventions• Engagement of stakeholders• Funding• Evaluation
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
But how?
Individual / Team:
• Interviews / focus groups
• Questionnaires / Surveys
• Observation
• Self / peer assessment
• Reflection
• Formal assessment
Organisational / clinical governance:
• Critical incident analysis
• Patient / staff surveys
• Risk assessment
• Morbidity patterns
• Trust priorities
• Audit/ research data
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Small Group Activity
Planning your learning needs assessment• The medical director has announced a trust-wide push to
educate & inform everyone about the Sepsis Six, with a large communications campaign across the site. She also has a small budget for some training, & has asked you to help.
In pairs, consider: • What information do you need to collect?• Who from?• How do you get that information?
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Small Group Activity
Planning your learning needs assessment
• You have returned from a meeting with the Chief Nurse. She would like all the nursing assistants to have extended roles in venepuncture & cannulation.
In pairs, consider:
• What information do you need to collect?
• Who from?
• How do you get that information?
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Small Group Activity
Planning your learning needs assessment
• A consultant in obstetrics has approached you for help thinking about a training programme that she has received funding for that is intended to improve handoffs between midwives & obstetricians.
In pairs, consider:
• What information do you need to collect?
• Who from?
• How do you get that information?
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Great… now what?
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Writing Learning Objectives
• Writing clearly defined learning objectives is crucial to the design, delivery & evaluation of training
• Focus on learning (what will students learn today?)rather than teaching (What will I teach today?)
• Essential to plan, carry out, & eventually (if appropriate) assess learning
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Bloom’s Taxonomy, 1956The Cognitive Domain
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
A learning objective consists of…
Action Verb What Insert a central line
Condition How Guided by ultrasound
Criteria How Well Successfully / Safely
‘At the end of this module, participants will be able to
successfully insert a central line guided by ultrasound.’
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Use Bloom's taxonomy to identify verbs
• Knowledge/Remembering: define, list, recognise
• Comprehension/Understanding: characterise, describe, explain, identify, locate, recognise, sort
• Application/Applying: choose, demonstrate, implement, perform
• Analysis/Analysing: analyse, categorise, compare, differentiate
• Evaluation/Evaluating: assess, critique, evaluate, rank, rate
• Synthesis/Creating: construct, design, formulate, organise, synthesise
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Revisit – Our Objectives
By the end of the course, you will be able to:
• Identify & write learning objectives for clinical skills or scenario-
based simulation training appropriate to your clinical setting
• Design a clinical scenario aligned with learning objectives
• Create an effective learning environment in the workplace
• Use low technology simulators, part-task trainers or manikins to
create realistic learning opportunities
• Use basic debriefing skills to contribute to simulation learning
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Verbs to avoid
• Understand
• Appreciate
• Know about
• Become familiar with
• Learn about
• Become aware of
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Small group activityIn pairs,
• Watch the Videohttps://www.youtube.com/watch?v=IJNR2EpS0jw
• Write three learning objectives that you think might have been intended from this video. Include one for:
1. Knowledge recall
2. Skill comprehension
3. Application (this could be a utilisation of 1 & 2)
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
•Designing Simulation Training
Module 2
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Module 2: Designing simulation training
Module Objectives
Brief overview of theory & key principles
• Define the experiential learning cycle
• Consider how learning using simulation methods can be enhanced
• Describe what is required to develop clear, engaging & clinically accurate scenarios
• Design a clinical scenario aligned with learning objectives
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Why simulation-based education (SBE)?
• Naturalistic learning
• Simulation
• Skill acquisition
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Experiential Learning Cycle (Kolb, 1984)
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Gibbs’ Reflective Cycle, 1988
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Novice to Expert
Dreyfus Model of Skill
Acquisition, 1980
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Deliberate PracticeEricsson, 1993
• What’s important is the amount of deliberate practice as compared to the amount of sheer practice
• Four components to achieve expert level:
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Activity: Experiential Learning
In pairs
– 1 x physical limitation suit
– 1 x caring role (be yourself)
• Tasks
– Feed yourself
– Assisted feeding by partner in caring role
– Give your partner feedback
– Assisted feeding again applying feedback received
• Reflect on your feelings & share on flipchart
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Lunch
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Designing Simulation Scenarios
Driven by - LNA & objectives
• Review your commission remit / the brief- what have you been asked to do?
• Generate ideas / options – involve your technical team
• Work out ‘best’ plan to trial (run through)
• Consider fidelity, mode of delivery, who will be faculty
– Develop a draft plan and share with stakeholders
• Plan a run-through date
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Scenario Design
Run through
• Create a draft timetable
• Develop your scenarios / teaching sessions
• Determine faculty support - inc. a technician
• Create a props/ equipment list
• Share with your faculty
• Test your scenarios with kit/ people/ timings
• Adjust and prepare to run your pilot
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Top tips
• Have a session/ course director
• Keep scenarios simple
• Develop a maximum amount of learning objectives– Remember that learners may have their own objectives too!
• Use the best simulator suited to your needs
• Consider timing for the session/ scenario/ debrief
• Brief your faculty & actors– All ‘roles’ should have a story
– If role playing – be subtle
– Stay in role
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Scenario Design Template
• Patients name / age / DOB / hospital number
• Main medical problem
• Learning goals
– Clinical
– Human Factor skills
• Narrative description/ Case overview
• Staffing / faculty
– Embedded participants/ standardized patient/ actor
– Director/ technician/ role player(s)
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Scenario Design Template 2
Participant outline
– Intended participants for scenario/ session
Case briefing
– To participants
Room set-up & skills station/ manikin preparation
– Position & dressing of patient (manikin) inc. cannula, catheter etc.
– Dressing the scene / specialist equipment / Special effects
Simulator operation
– Starting observations
– Observations as scenario progresses & post-interventions
• Props / consumables needed to run the scenario
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Scenario Design Template 3
Ensure:
• Consistency of information
• Abbreviations explained
• No jargon
• Lots of social history & background
• Explanation of medical condition where necessary
• Expected behaviours during scenario
• Keep scenarios simple
• Ensure it can be run by anyone
• Be flexible
• Be prepared for anything
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Activity: Scenario Design
In small groups or pairs, using template provided, write and plan for the following scenario.
Vignette:
35-year-old female admitted to the ward with pyelonephritis, prescribed co-amoxiclav and gentamicin. No previous history. Patient develops anaphylaxis on the ward.
Her partner is present as it is visiting time.
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
•Simulation Training Delivery
Module 3
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Module Three: Simulation Training Delivery
Module Objectives
At the end of this module, you will be able to:
• Create an effective learning environment in the workplace
• Use low technology simulators, part-task trainers or manikins to create realistic learning opportunities in the workplace
• Use basic debriefing skills to contribute to simulation learning
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Adult Learning Principles (Knowles, 1984)
http://elearninginfographics.com/adult-learning-theory-andragogy-infographic
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Creating the Environment for Change & Learning (Safety)
http://www.foamem.com/2014/07/13/7-simulation-pearls/
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Ways to Create Trust & Enhance Engagement
• Confidentiality contract- not an assessment– Free to share learning principles – but keep confidentiality personal issues shared
• Basic assumption – everyone is capable, wants to do their best & are looking to improve
• Fidelity & Realism• Mistakes are ok• Maintain a curious stance• Give people time to think & reflect• A good introduction• Orientate to the environment / equipment• Explain the learning objectives• Set ground rules • Be respectful, courteous & curious
– To each other– To self
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Engaging in Simulation: Realism
• Immersion / Reality
• Initial thoughts on realism?
• The Fiction Contract - Suspension of Disbelief
• Acknowledge limitations
– Simulation isn’t perfect
– Ask for buy-in
– Act as if it is – AND be yourself
– Work to resolve the problem / case presentation
– You may act differently - but it’s ok
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Teaching Skills: Peyton’s Four Stage Approach, 1998
• Demonstration: show skill at normal speed (no explanation)
• Deconstruction: repeat demonstration with full explanation. Encourage questions
• Comprehension: repeat demonstration with the learner providing explanation of each step & being questioned on key issues
• Performance: learner demonstrates while describing steps
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Exercise
• 4 Stage technique
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Break
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Debriefing for Learning
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
What is Debriefing?
A conversation between two or more people to review an event, real or simulated, in which participants
analyse their actions and reflect on the role of their thought processes, psychomotor skills and emotions to
improve or sustain their performance in the future.
(Center for Medical Simulation, Boston)
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Feedback vs. Debriefing
•Feedback: provision of information
•Debriefing: facilitated discussion of a prior event
Feedback definition
Specific information about the comparison between a trainee’s observed performance & an expected
standard, given with the intent to improve the trainee’s performance.
adapted from Van der Ridder et al (2008)
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Basic Debriefing Objectives
• Review simulation events
• Sort out and clarify thinking
• Release emotional tension
• Reinforce specific teaching points
• Alter thought patterns
• Correct misconceptions
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Tone of Debriefing
Ideal debriefs have:
• Structure
• Deliberate positive tone
• Room for all to have a voice
• Inclusive language
• Open questions
• Skillful and sensitive facilitation
• Engaged and interested facilitator
Potential Pitfalls:
• Disorganised
• Judgmental
• Facilitator dominated
• Language that excludes
• Closed questions
• Controlled by facilitator
• Facilitator appears tired or disinterested
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Theory-based Models
• DAA
• Diamond
• Debriefing with Good Judgment
• 3D
• 4E’s
• TeamGains (hybrid)
• PEARLS (hybrid)
• Plus Delta (+/Δ)
• GAS
• SHARP
• DEBRIEF / AAR
• GREAT
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Diamond debrief model
• Sophisticated model & skill
• Includes scripted questions & prompts to use while learning the model
• Re-framing ways we think & learn – applying human factors
• Requires practice & further reading to develop the knowledge & skill
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Plus / Delta (+/∆) (Decker 2009, Jeffries 2010)
+: What went well? And why?
∆: What would you change? And how?
• Simple method developed for military use,
• Adopted for civilian use after notable accidents in 1970s
• + Plus: positive, desirable aspects of performance or behaviour
• ∆ : Greek letter Delta used to denote change or uncertainty
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
How to use +/∆ for debriefing
• Consider level of facilitation – aim for a learner-led process
• Open, leading & exploring questions
• Record insights on a flipchart (+ / ∆)
• Strategies to maintain psychological safety
• Avoid PLUS=POSITIVE and DELTA=NEGATIVE
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Advantages Disadvantages
Easy and quick to learn and use Can be superficial – may not promote
deeper reflective learning
Non-threatening No opportunity for venting of strong
emotional responses
Useful for focusing on specific behaviours May neglect non-technical aspects of
performance which can be explored by
addressing feelings and thinking
Useful for testing systems, processes,
protocols
Can generate meaningful, practical action
plans
Advantages and Disadvantages
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Your Homework for our Next Session
• Design a 10 minute scenario (or skills session)
• Use the template provided
• Work together in small groups of 3 (4 x groups)
• Make sure you have each others’ contact information
• Think about all the aspects of learning that we’ve gone through today
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Whip around and +/∆
• Whip around: share one significant moment / learning from today
• Take a few minutes and create at least two post-it notes for +/∆ chart on your way out:
– +: What was a real ‘plus’ of today (what went well & should be repeated)?
– ∆: What could we change to improve the course?
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Further learning opportunities
To develop your simulation experience it is worth attending as a participant: whole range of courses:
• Taking Care Safer Tracheostomy management• Skilful Response End-of Life Care• Hospital @ Home Delirium and Dementia• Building Resilience for change Safer Sepsis six
Join us as volunteers on Hands up For Health, working with local schoolchildren
• Come and learn to be a faculty member, leading debriefs..• Introduction to In situ Simulation Based-Education & Essential Debriefing
Email: Simulation@gstt.nhs.uk
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
• Kolb, D. A. 1984. Experiential learning: Experience as the source of learning and development. Englewood Cliffs, JNJ: Prentice-Hall.
• Bloom, B.S. (Ed.). Engelhart, M.D., Furst, E.J., Hill, W.H., Krathwohl, D.R. (1956). Taxonomy of Educational Objectives, Handbook I: The Cognitive Domain. New York: David McKay Co Inc.
• Dreyfus, Stuart E.; Dreyfus, Hubert L. (February 1980). "A Five-Stage Model of the Mental Activities Involved in Directed Skill Acquisition"
• Ericsson, K. A., Krampe, R. Th., & Tesch-Römer, C. (1993). The role of deliberate practice in the acquisition of expert performance. Psychological Review, 100, 363–406.
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Introduction to Simulation
Day 2
WelcomePlease help yourself to Tea and Coffee
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Faculty
Colette Laws-Chapman, Deputy Director, SaIL
Centre
Seema Nathoo, Simulation Fellow
Nik Karydis, Consultant
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Icebreaker and Introduction
• Choose an adjective that describes yourself & starts with the same first letter as your name. Add it to the front of your name.
• Introduce yourself:
“Hi my name is Bubbly Beth.”
• The person next to you will introduce you
and then himself/herself: “You are ‘Bubbly Beth’ and I am ____.”
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Learning Objectives
By the end of the course, you will be able to:
• Identify and write learning objectives for clinical skills or scenario-based
simulation training appropriate to your clinical setting
• Design a clinical scenario aligned with learning objectives
• Create an effective learning environment in the workplace
• Use low technology simulators, part-task trainers or manikins to create realistic
learning opportunities
• Use basic debriefing skills to contribute to simulation learning
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Course Principles
• Your previous experience is an important asset – & the starting point for our work
• To that we add some new knowledge and practice over the course
• We are all learners, working together
• We strive to create a learning environment where it’s safe to take risks and to try new things
• Basic assumption:– Our colleagues are capable, want to do their
best, and want to improve
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Course Principles (continued)
• Experiential learning
• Sharing our learning together– Mistakes are ok
– Curious stance
• Embedded participant
• Safety
• Code phrase ‘this is not a simulation’
• Evaluation
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Review your scenarios
In your small groups with a facilitator
• Review scenarios/ provide a list of equipment
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Exercise
• Simulated group exercise and model debrief with Plus/ Delta
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Exercise
• All participate in abstract exercise & facilitated debrief
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
•Simulation Training Delivery
Module 3
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Module Three: Simulation Training Delivery
Module Objectives
At the end of this module, you will be able to:
• Create an effective learning environment in the workplace
• Use low technology simulators, part-task trainers or manikins to create realistic learning opportunities in the workplace
• Use basic debriefing skills to contribute to simulation learning
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Circle of Learning Modules
Evaluation and
ReviewIdentifying and
writing learning
objectives
Designing
simulation
training
Simulation
training
delivery
Stage
1
Stage
2
Stage
3
Stage
4
@southlondonsim http://southlondonsim.com/
Group planner
Running Concurrently – 30 minutes Simulation Debriefing – 30
minutes Practice Debriefs Scenario Set-Up
Group A (debriefers)
Groups B & C (participants)
Group D Group D – delivering, facilitating &
debriefing A, B, C
Group B (debriefers)
Groups A & D (participants)
Group C Group C – delivering, facilitating &
debriefing A, B, D
Group D (debriefers)
Groups A & C (participants)
Group B Group B – delivering, facilitating &
debriefing A, C, D
Group C (debriefers)
Groups B & D (participants)
Group A Group A – delivering facilitating &
debriefing B, C, D
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Practice debrief exercise
This exercise is designed to help facilitators ask +/∆debriefing questions. The aim is to share stories and to:
– Acknowledge successes and challenges
– Help your group learn from their experiences
In your groups, think of a time (to share) when you:
A. hosted a party
B. attended a job interview
C. planned a holiday
D. delivered a training session
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Lunch
@southlondonsim http://southlondonsim.com/
Group planner
Running Concurrently – 30 minutes Simulation Debriefing – 30
minutes Practice Debriefs Scenario Set-Up
Group A (debriefers)
Groups B & C (participants)
Group D Group D – delivering, facilitating &
debriefing A, B, C
Group B (debriefers)
Groups A & D (participants)
Group C Group C – delivering, facilitating &
debriefing A, B, D
Group D (debriefers)
Groups A & C (participants)
Group B Group B – delivering, facilitating &
debriefing A, C, D
Group C (debriefers)
Groups B & D (participants)
Group A Group A – delivering facilitating &
debriefing B, C, D
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
•Evaluation and Review
Module 4
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Evaluation and Review
Module Objectives
At the end of this module, you will be able to:
• Describe why evaluating educational interventions is critical to maintaining and enhancing educational quality
• Apply Kirkpatrick’s four-level model of evaluation to simulation training
• Develop an evaluation strategy for your training intervention that measures Kirkpatrick levels 1 and 2 outcomes
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
What is evaluation?
• Evaluation is defined as a systematic process by which the worth or value of something is judged.
• In education it is concerned with the measurement of:– The performance of learners
– The effectiveness of teachers
– The quality of the programme
• In relation to educational objectives
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Why do we evaluate?
Good practice to determine:
• the effectiveness of the educational intervention to meet its outcomes– what worked well and what could be improved
• the experience of the learners (drivers for motivation)
• the impact and value of what you are doing (ROI)
• teaching effectiveness (feedback and reflective practice)
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
What do we consider when evaluating?
• Who is the evaluation for?
• What do you need / want to know?
• Why do you need / want to know it?
• Will the evaluation make a difference?
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Three Boxes of Evaluation
Evaluation of effects,
without
addressing the
components that make
up the programmes
Components
of a
programme
are discerned
but inner
workings not
fully revealed
Addresses effects but
also the inner workings
and operations of the
components of a
programme and how
they are connected, as
well as their connections
to other systems
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Or Evaluation can be about...
Process:
• Strengthen or improve the learning process / training intervention while it’s happening
Outcome:
• Examine the effects or outcomes of the learning process / training intervention
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Activity: Thinking about Evaluation
Group 1:
• What methods / tools / instruments might be used to evaluate the LEARNING that has occured?
• Differentiate between those that might be process and those that might be output.
Group 2:
• What methods / tools / instruments can be used to evaluate your TEACHING effectiveness?
• Differentiate between those that might be process and those that might be output.
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Examples
Formative methods:
• Rubrics / rating scales
• Discussions
• Checklists
• Observations / Observational rating scale
• Questionnaires
• Journals / progress notes
• Self-evaluations / reflections
• Conferences / interviews
• Peer-evaluations / observations
Summative Methods
•Rubrics / rating scales•Written assessments / reports•Creative assignments•Presentations•Portfolios•Oral assessments•Practical assessments (in real situation or in simulated conditions)•Direct observation•Projects / products•Peer / self-evaluation•Individual or group interviews•Clinical / performance audits
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Kirkpatrick’s four-level evaluation model (1959)
Level 1 – REACTION: Measures learners perception (thoughts & feelings) of the learning event.
Not indicative of skills or performance.
Level 3 – BEHAVIOUR: Measures change in behaviour (performance) and transfer of
learning to the workplace. Can be measured in the workplace.
Level 2 – LEARNING: Measures the change in knowledge, skills and attitude.
Evaluated pre and post training through learner assessment.
Level 4 – RESULTS / IMPACT:Measures the impact of learning on the organisation (ROI).
Often evaluated through clinical and quality outcomes.
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Kirkpatrick’s four-level evaluation model (1959)
• Impact / Results
• Behaviour / Performance
• Learning
• Reaction
Increasing:
• complexity
• difficulty to measure
• time and cost
• expertise required to
evaluate!
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Activity: Evaluation
In your groups, based on the scenario you delivered today, list two ways you would measure each of the following:
1. Reactions
2. Learning
Be specific, getting right down to the type of data you might collect, and even right down to the level of questions you might ask!
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Evaluation is:
• an essential component of any educational development
• considered carefully before implementation of any training intervention
• directly related to educational objectives.
• realistic and practical
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Review
• Closes the loop in the curriculum development cycle
– maintaining and enhancing educational quality
• A successful training intervention must respond to:
– evaluation and feedback
– internal and external requirements
– changes in learners, resources, knowledge and competency requirements, institutional and societal needs and values etc.
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Now What?• Coaching in Practice
• Develop your scenario & add to it
• Develop evaluation tools
• Book your Kit / Date
• Run session
• Debrief your debrief
• simulation@gstt.nhs.uk
• Observe in centre or in situ
• Book onto the Essential Debriefing Skills course
Advancing Your Debriefing
Practice
Teaching the Circle of Care
Practice
Introduction to Human Factors
Practice
Essential Debriefing Skills
Practice
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Whip around and +/∆
• Whip around: share one significant moment / learning from today
• Take a few minutes and create at least two stick notes for +/∆ chart on your way out:
– +: What was a real ‘plus’ of today (what went well & should be repeated)?
– ∆: What could we change / improve?
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Further learning opportunities
To develop your simulation experience it is worth attending as a participant: whole range of courses:
• Taking Care Safer Tracheostomy management• Skilful Response End-of Life Care• Hospital @ Home Delirium and Dementia• Building Resilience for change Safer Sepsis six
Join us as volunteers on Hands up For Health, working with local schoolchildren
• Come and learn to be a faculty member, leading debriefs..• Introduction to In situ Simulation Based-Education & Essential Debriefing
Email: Simulation@gstt.nhs.uk
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
Further reading
@southlondonsim http://southlondonsim.com/SLSN Intro to Sim2017
• Kolb, D. A. 1984. Experiential learning: Experience as the source of learning and development. Englewood Cliffs, JNJ: Prentice-Hall.
• Bloom, B.S. (Ed.). Engelhart, M.D., Furst, E.J., Hill, W.H., Krathwohl, D.R. (1956). Taxonomy of Educational Objectives, Handbook I: The Cognitive Domain. New York: David McKay Co Inc.
• Dreyfus, Stuart E.; Dreyfus, Hubert L. (February 1980). "A Five-Stage Model of the Mental Activities Involved in Directed Skill Acquisition"
• Ericsson, K. A., Krampe, R. Th., & Tesch-Römer, C. (1993). The role of deliberate practice in the acquisition of expert performance. Psychological Review, 100, 363–406.