Introducing Assessment Tools
What is an assessment tool?
The instrument/s and procedures used to gather and interpret evidence of competence:
– Instrument – the specific questions or activity used to assess competence by the assessment method selected. An assessment instrument may be supported by a profile of acceptable performance and the decision making rules or guidelines to be used by assessors.
– Procedures – the information or instructions given to the candidate and the assessor about how the assessment is to be conducted and recorded. (AQTF)
What principles/rules applyto assessment tools?
Assessment processes
Assessment methods and tools
• Assessment evidence• Assessment judgements.
PRINCIPLES OF ASSESSMENT
RULES OF EVIDENCE
Principles of Assessment
VALIDITY
RELIABILITY
FLEXIBILITYFAIRNESS
• Unit of Competency• Industry Standards• AQF Level• Dimensions of Competency• LLN
• Instructions (Learner & Assessor)• Sample answers/responses• Advice to assist judgement of competence• Trials of tools during development• Review of tools after use
• Negotiate with learner / workplace
• Consider Reasonable Adjustment (to the structure of the assessment not the outcome)
• Maintain integrity of unit and industry standards (Validity/ Reliability)
Ensuring the tool reflects all the requirements of competency
Ensuring the tool achieves consistent results
Ensuring the tool does not disadvantage learners and allows the best opportunity to
provide evidence of competency
Assessment Tools
Well designed Assessment Tools will help to ensure that the evidence collected meets the requirements of the Rules of Evidence
SUFFICIENT???
VALID?
CURRENT?AUTHENTIC?
Designing assessment tools
PLAN– Clarify evidence requirements - Unpack the Unit
of Competency to identify the evidence requirements
– Select the most appropriate assessment methods– Identify the assessment tools that align with each
of the assessment methods
DEVELOP– Develop the tools identified– Check instructions and formatting– Review / trial
Good assessment instructions
Written in plain English using standard industry terminology
Clearly understood by learners and assessors (what, where, who, when, how)
Written at the correct AQF level
FAIRNESS FLEXIBILIT
Y
RELIABILITY
VALIDITY
Verbs and AQF levels
Certificate I
Certificate II
Certificate III
• Tell• List• Find
• Use• Explain• Discuss• Describe
• Analyse• Investigate• Design
Certificate IV • Justify• Recommend • Evaluate
Reviewing and Trialing Tools
Part of the tool development process– Confirms validity and reliability– Provides advice on fairness and flexibility– Encourages involvement of stakeholders– Provides evidence for continuous
improvement
Tracked through version control to ensure all assessors use the most current tool