Marking Systems, Test Evaluation and Test Administration
transcript
1. Carolina Salazar 28.04.2014
2. OBJECTIVE TEST TYPES Easy to mark Only one marker is needed
High reliability E.g. multiple choice SUBJECTIVE TEST TYPES More
difficult to mark More than one marker is advisable Low reliability
E.g. oral tests, essays RIGHTWRONGRight Wrong
3. AVOID SUBJECTIVE TESTS ALTOGETHER FACE INCONSISTENCIES OF
HUMAN JUDGEMENT
6. TOO MANY COOKS SPOIL THE BROTHSOLUTION FEWER ASSESSORS
DIFFERENT ROLES AGREED SCORE SOLVED DISCREPANCIES
7. BETTER ASSESSORS MORE CONSISTENT PROGRAMS EXERCISES MORE
RELIABLE STANDARDS
8. SPECIFY APPROACH IN ADVANCE SAVE UNCERTAINTY SAVE TIME SAVE
MONEY
9. ANTICIPATE PROBLEMS AND SUGGEST HOW TO COPE WITH THEM
MAINTAIN THE AIMS OF THE TEST GIVE GENERAL GUIDELINES FOR DEALING
WITH UNCOMMON RESPONSES DESCRIBE THE PURPOSE OF EACH QUESTION
10. HOLLISTIC TEST OVERALL PROFICIENCY ATOMISTIC ASSESS
SPECIFIC SKILLS Least reliable Most reliable
11. NOT ALL CATEGORIES IN A TEST ARE EQUALLY IMPORTANT LESS
IMPORTANT MORE IMPORTANT
12. DESCRIPTION OF LEVELS LANGUAGE ABILITY TYPICAL
LEARNERBUT
13. BUT FEW LEARNERS ARE TYPICAL CREATE PROFILES AND
CATEGORIES
14. CONTINUITY!
15. OVERALL PERFORMANCE NO SYSTEM FOR COUNTING ERRORS SINGLE
SCALE FOR ENTIRE TEST QUICK PROCEDURE SUBJECTIVE JUDGEMENT
ADVISABLE TO COMBINE IT WITH OTHER MARKING SYSTEM
16. PREPARED LIST OF FEATURES 1 MARK FOR EACH FEATURE STARTS
WITH ZERO INCREMENTAL MARKING SYSTEM
17. PREPARED LIST OF FEATURES SUBSTRACTION OF 1 MARK FOR EACH
MISTAKE ENDS WITH A MINIMUM OF ZERO UNSUITABLE FOR CERTAIN
CATEGORIES (STYLE, CONTENT) ADVISABLE TO COMBINE IT WITH OTHER
TECHNIQUES