Summative Assessment Training
Day
Tidworth College
16 September 2005
What are Formative and Summative Assessment?
Formative assessment continues throughout the GPR year involves feedback to help you establish your
needs and to help you improve performance
Summative assessment an end-stage assessment of competence
What is Summative Assessment for GP Training?
A test of minimal competence required for an independent practitioner in general medical practice
Looks at knowledge skills attitudes
The vast majority of GPRs and Returners should have no difficulty in passing SA
Why have Summative Assessment?
Some GPRs aren’t ready for independent practice at the end of their GPR year
SA identifies those that need extra support, or more time
So, Summative Assessment is easy
BUT it must be approached professionally
If you don’t pass SA…
You can’t work in General Practice locum, assistant, or partner money
What does SA involve?
1) M C Q
2) Written submission of practical work usually an audit
3) Assessment of consulting skills usually a video
4) Structured Trainer’s report
The National Office for Summative Assessment
http//:www.nosa.org.uk
The MCQ
Positively marked 170 True/False questions 80 Extended Matching questions 10 Single Best Answer questions
The MCQ
Not recommended until completed 3 months as GPR but SHOs in hospital do pass!
Unlimited attempts permitted 4 sittings per annum
Feb/May/Sept/Dec
The MCQ – true/false
Itching is commonly a presenting symptom in: Atopic dermatitis T/F Hodgkin’s disease T/F Lichen planus T/F
The MCQ - Extended Matching Questions
A patient has difficulty swallowing. Which of the following investigations would help most with the diagnosis in the following clinical presentation:
A 19 year old male has been unwell for 10 days with a fever, sore throat, difficulty swallowing and general malaise
A, Barium Swallow B, Bronchoscopy C, Endoscopy D, Manometry E, Monospot F, Serum Iron G, Thyroid Function Tests H, Throat swab I, Video fluoroscopy
The MCQ – Single Best Answer Questions
Meningitis A Benzyl penicillin (IV) B Erythromycin (IV) C Oxygen via a face mask D Phenoxymethylpenicillin (oral) E Prednisolone (IV) Which is the SINGLE best treatment from the above
list of options? A 4 year old boy is drowsy and shocked. He
demonstrates neck stiffness and has a purpuric rash which doesn’t blanch on pressure. He has no known allergies.
The Structured Trainer’s Report
The Structured Trainer’s Report
To be completed 1-2 months before the completion of training
The Structured Trainer’s Report
BUT should be read by Trainer and Registrar at the onset of the GPR year
AND reviewed regularly throughout the year
What is it?
Minimum standard of competence To identify the incompetent or unready
35 basic competencies Must pass on all items
Collection of Evidence
Specific Clinical Skills (12) Patient Care (12)
Making a Diagnosis Patient Management Clinical Judgement
Personal Skills (11) Organisation Skills Professional Values Personal & Professional Growth
Formative use of Trainer’s report
Start using it now!
Formative use of Trainer’s report
Identify problems early Share problems with Course Organisers and
Associate Directors early Develop a strategy to deal with areas of
difficulty
The Written Submission
The Written Submission
Completed Audit Cycle or National Project Marking Schedule
(NPMS)
The Audit – a recipe for success Must contain the following:
Title Reason for choice Criteria chosen Reasons for choice of criteria Standards set and why? Preparation and planning
The Audit – a recipe for success Must contain the following:
First data collection - include charts and graphs Conclusions drawn from data Change to be implemented Second data collection – after change made Conclusion and learning Points
The Audit – a recipe for success
K
I
S
S
EEP
T
IMPLE
TUPID!
The Audit – a recipe for success
Follow the recipe!
Audit Timetable
Month 1 Choose Topic Month 2 First Data Collection Month 3 Put in place changes Month 4 Second Data Collection Month 5 Completion + submit to
Deanery
Audit checklist
Is the audit anonymous? Layout
Double spaced Pages single-sided and stapled Pages numbered GPR Number on each page
Word Count – not more than 3000 Practice list size Appropriate references Audit declaration and consent form
Audit tips
Listen to your tutor today KISS Follow the recipe Check out my audit website
www.mharris.eurobell.co.uk/contents.htm
MRCGP/SA Single Route
Submission of a single video for theMRCGP and Summative Assessment
Pass in MRCGP Video Module = Pass in SA Consulting Skills component
Single route video
Common video logbook summary sheet consent form
Different standard - anticipate 20%+ failure at MRCGP video 5% failure at SA video
Single route video
Register with RCGP for video component of MRCGP – 7 February 2006
Submit tapes to the Deanery by 28 April 2006 MRCGP and SA Results issued separately:
SA by Deanery office on 30 June 2006 MRCGP video by RCGP on 21 July 2006
Simulated Surgery
Examined in Leicester Deanery Wednesday evenings or Saturday afternoon Must have permission from Director of
Postgraduate GP Education before application is submitted
Audit Submission
2 first level assessorsPASS
Result to GPR
One or both REFER
2 second level assessors agree
outcome
PASS REFER
Return to GPR to RESUBMIT
Resubmission New or revised
audit
2 second level assessors
PASS REFER
2 National level
assessorsFAIL