The Why, What, Who, When and How of Assessing Competence 2012/PP Presentations/Cowan... · When and...

The Why, What, Who,

When and How of

Assessing Competence

Angela Cowan

The ‘Why’

• Compliance with regulatory boards and standards

• Licensing requirements

• Professional development planning

• Staff appraisals

• Skilling

• Up skilling

• RTO - Statement of Attainment/Qualification

The ‘What’

Evidence • Qualifications

• Workplace experience

• Portfolio – Work Samples

• Observation – Direct or Third Party

• Written and/or Oral questions

• Testimonials

The ‘Who’

• The candidate/staff/employee/learner/trainee

• Qualified Assessor

• Technical Advisor

• Workplace supervisor

• Qualified Auditor

• Supporting Personnel

The ‘When’

Formative Summative RPL Recognition of prior learning

RCC Recognition of current competency

Assessment conducted during

the learning program

Assessment conducted on

completion of the learning program

Assessment of a candidate’s

previously obtained qualification, work experience and life history

Candidate deemed as competent in the

past but needs to be reassessed to demonstrate competence has been maintained and is current

The ‘How’

• Preparing for assessment

• Gathering quality evidence

• Supporting the candidate

• Making the assessment decision

• Recording and reporting the assessment decision

• Reviewing the assessment process

What is Competency-based Assessment?

Norm-referenced V’s

Competency-based

Norm-referenced assessment Competency-based assessment

Candidates are graded against each other rather than against performance standards or benchmarks

Competency-based assessment is made against established benchmarks

This type of assessment is the opposite of competency-based assessment and has no place in a competency-based system

A person is considered either ‘competent’ or ‘not competent’ according to whether they have demonstrated that they can

meet the specified standards

Developing and

implementing recognition

strategies

• Analyse job descriptions and workplace performance measures of an organisation

• Determine the range of evidence that can contribute to recognition for current competence

• Prepare a recognition package for employees of an organisation

• Monitor recognition-based assessment for current competence

• Evaluate an organization’s recognition-based assessment procedures

Identifying Competency

standards • Compile information on job descriptions and source data on

individual’s work performance

• The Organisation’s:

- KPI’s

- Goals and objectives

- Targets for teams and individuals

- Quantitative and qualitative performance measures

-Performance appraisal processes and documentation

• Other sources may include:

- Unit of competency from a national training package or accredited course

Investigate opportunities for

evidence gathering and determine

the range of evidence

• Review the performance appraisal processes and documentation for the job role

• Appraisal processes and Documentation may include:

• Annual employee reporting documents and templates

• Employee KPI’s

• Duty statements

• Employment contracts

• Contractor statements of work

• Log books

• Employment specifications

• Job Task lists

Prepare a recognition

package

• Interpret the organisational policies and procedures for recognition

• Document the performance requirements

• Document exemplars and evidence lists to support candidate in their application for recognition

• Provide advice and support to managers to facilitate collection of workplace evidence for recognition

Recognition Package

inclusions

• Recognition policies and procedures aligned to the organisation’s goals, values and objectives

• Advice to candidates

• Advice to employers

• Advice to assessors

• Performance and evidence requirements • Evidence lists

• Observation checklists

• Supporting statement templates – Third party reports

• Written or Oral Questions

• Appeal procedures

Monitor recognition based

assessment

• Monitor the evidence collection process

• Monitor decision making in assessment against the organisational policies and procedures

• Monitor feedback provided to and from the candidate

Your role as an assessor

• Interpret an assessment plan

• Conduct assessment according to its intentions

• Comply with workplace policies and procedures

• Comply with relevant legislation and licensing requirements

• Monitor the rules of evidence and principles of assessment

• Make a judgment

• Provide and act upon feedback where necessary

Consistency in assessment

Principles of assessment

Rules of evidence

Ensure quality outcomes Provide guidance on the collection of evidence

Fair Sufficient

Flexible Valid

Valid Current

Reliable Authentic

‘The How’







Preparing for Assessment

• Interpreting the assessment plan

• Define the benchmarks for assessment

• Confirm assessment tools and methods to be used to gather evidence and record assessment outcomes

• Arrange material and physical resources for assessment

• Organise specialist support people (if required)

• Discuss and confirm the assessment plan with the candidate – identify reasonable adjustments and provisions for two-way feedback

Assessment plan

Assessment Type Recognition of current competency

Assessor Angela Cowan

Assessment location Laboratory 1

Medical Laboratory Scientist

Performance criteria to be assessed

Clinical Practice Apply increasingly independent scientific judgment in the analysis of patient specimens leading to the verification and validation of test results and the provision of advice to the clinical unit where

appropriate

Communication/Team Participation

Actively participate in a multidisciplinary team consisting of one or more technical domains providing support to the team, advice to peers, advice or reporting services to managers

Leadership/Work Unit Management

Participate in the identification, development and implementation of quality and service improvement activities in accordance with National Association of Testing Authorities and International Standardisation Organisation (NATA/ISO)

accreditation/certification that enhance the delivery of pathology services within the local service area

Brief Description of Task Portfolio of Work Samples demonstrating evidence of applied knowledge and skills in the performance of the role.

Third Party Observation of the candidate/employee performing practical tasks in a medical laboratory Written Questions assessing required knowledge which is not able to be demonstrated by submission of work samples or observation

Duration 2 weeks to complete assessment portfolio for submission

Minimum resources required Clinical and Statewide services Division Medical Laboratory and staff Haematology Unit Branch of Princess Alexandra Hospital

Instructions Candidates receive a detailed assessment portfolio including instructions on how to gather evidence and perform certain assessable tasks.

Assessors receive a detailed marking guide and necessary recording documentation which map the candidate’s evidence against the benchmarks according to the rules of evidence, principles of assessment and dimensions of competence

Assessment method Portfolio - Collection of recommended Work Samples Observation - Third Party reporting by personnel with demonstrated current vocational skill and knowledge to the level being assessed

Written Questions – Assessment of required knowledge of the role

Reasonable adjustment Where applicable, reasonable adjustment must be made to work environments to accommodate ethnicity, age, gender, demographics and disability The LLN demands of assessment should not be greater than

those required to undertake the role in the current work environment

‘The How’







Assessment Task

Assessment task Examples

Observation Observable skills documented using a checklist of benchmarks

Simulations Observable skills documented using a checklist of benchmarks

Role-play Observable skills documented using a checklist of benchmarks

Third party reporting A Third party who holds the current competence at least to the level being assessed reporting on the candidate’s observable skills

Assessment method Examples

Portfolio of work samples

Sample of benchmark portfolio items – images, diagrams, samples of standard of work required, log book entries, workplace documentation

Questioning Benchmark questions – written or oral (model

answers)

Candidate self-assessment Reflective statements and checklists that demonstrate appropriate standards

‘The How’







Supporting the candidate

Candidates may require additional information not listed in the Recognition Package such as:

• Qualifications and/or experience of assessing staff or support personnel

• Costs to the candidate (if any)

• Candidate resources required

• Protection of their private information

• Logistical arrangements (i.e. specialist travel to the assessment environment)

• OHS and use of PPE

• Language support

‘The How’







Examining the gathered

evidence

• Evaluate collected evidence to ensure it reflects what is required to demonstrate competence

• Judging whether competence has been demonstrated based on the available evidence

• Making the assessment decision in line with the agreed recognition assessment procedures and organisation’s recognition package

Rule of evidence Evaluating the candidate’s evidence

Currency Is the evidence relatively recent?

Authentic Is there evidence that verifies that the work is that of the candidate?

Sufficient Is there enough evidence to demonstrate

competence against the entire Job Role descriptor (PD), KPI’s and the organisation’s objectives and goals.

Rule of Evidence Evaluating the candidate’s evidence

Valid Does the evidence match the PD? Does it reflect workplace performance?

Dimensions of competency Have you collected evidence of all aspects of work performance as represented by task skills, task management skills, contingency management skills and job/role environment skills?

Dimensions of competence

• Four dimensions of competency relate to all aspects of work

performance and must be judged within the context of the required performance:

• Task Skills

• Task management skills

• Contingency management skills

• Job/role environment skills

Dimension What to check Example Evidence

Task Skills Check that the evidence shows that the candidate has performed the individual skills required to complete

a work activity to the required standard

Provide scientific advice to colleagues and clinical clients with respect to test procedures and interpretation

Portfolio – samples of benchmark portfolio items e.g. Session plans; attendees; workplace policy and procedural

referencing Observation (Direct or Third Party; Questions (written or oral) Documented Feedback –

Colleague and clinical client evaluation forms


Task Management skills

Check that the candidate has managed a number of different tasks to complete a whole work activity

Conducted a training session with colleagues and clinical clients regarding testing standards and procedures

Portfolio – Session plans, learning outcomes, learning aids, Attendee evaluation Observation – Direct or Third Party

Contingency management skills

Check that the candidate used problem-solving skills to resolve issues that arise when performing a work activity

Developed a contingency plan for problems with the training venue

Work sample – Session plan Portfolio – OHS report Observation – Direct or Third party


Job/Role

environment skills Check that the

candidate performed effectively in the workplace when undertaking a work activity by working well with all stakeholders and following workplace

policies and procedures

Participated in

training validation meeting

Portfolio– Validation

meeting outcomes; documented continuous improvement opportunities; Observation – Direct or Third party Self-assessment –

Review of own work

‘The How’







Assessment Tools and

Documentation

• Recognition strategies – Job role criteria and Organisational/industry standards

• Candidate Assessment Portfolio – Evidence gathering kit

• Benchmark Checklists – Sample answers, models, expectant outcomes

• Evidence Evaluation Checklists – Dimensions of evidence, rules and principles of assessment, mapping to Performance criteria

• Competency Summary Reports - Decision

Assessment and evaluation

tool inclusions • Candidate’s name

• Assessor’s name

• Date of recognition assessment

• Job Title and/or Unit title

• Candidate, Assessor and other personnel advice

• Reasonable adjustment

• Resources required and/or recognition assessment environment

• Skills and Knowledge required to demonstrate current competence

• Marking rubric/guide

• Outcomes of assessment (current competency demonstrated or current competency not demonstrated)

• Feedback

• Candidate signature and date

• Assessor signature and date

• Version control

© RTOAssess

Assessment Portfolio

Medical Laboratory Scientist – Haematoloty

Pathology Queensland

Princess Alexandra Hospital

Clinical and Statewide Services Division

Name:

Recognition Period:

© RTOAssess Version 2– September 2012

Page 2 of 20

Assessment Portolfio – Medical Laboratory Scientist

SECTIONS

Section 1 – Portfolio – Work samples 3

Section 2 – Observation - Third Party Report 7

Section 3 – Questions - Written 13

Summary Sheet 20

The assessment activities in this assessment task portfolio assess the Position Description

Range statement, performance criteria, skills, knowledge and responsibilities of the Role

Title – Medical Laboratory Scientist

Assessment Requirements

To demonstrate current competence in this role you must gather and provide evidence

according to the agreed recognition package of this Organisation.

If you do not provide satisfactory evidence to meet the standards of the recognition

package, and therefore you are deemed to be Not Competent, your assessor may ask

you supplementary questions to determine your competence.

If you feel you are not yet ready to be assessed or this assessment is unfair please contact

your assessor to discuss your options.

! Please tick this box if you understand the assessment instructions, requirements,

have been provided a copy of the recognition package and consent to being

assessed.

Candidate’s Name:

Signature: Date:

ORG

AN

ISATIO

N T

O R

ETAIN

TH

IS P

AG

E


Page 3 of 20


Section 1 – Portfolio - Work samples

Instructions to the Candidate The tasks in this section requires you to demonstrate consistency in the performance of

your role as a Medical Laboratory Scientist in the Haematology unit of Pathology

Queensland – Princess Alexandra Hospital – Clinical and Statewide Services Division.

To satisfactorily provide evidence for this section and demonstrate consistency in

managing a range of contingencies you MUST gather evidence of your ability to meet all

key responsibilities of the role as identified in the recognition package.

As a minimum develop a portfolio of work samples exemplary of your role as a Medical

Laboratory Scientist from the assessment period idenitified on the facing page of this

Assessment Portfolio. Please provide evidence from each calendar month during the

period which demonstrates the following Key Responsibilities:

Clinical Practice:

· Apply increasingly independent scientific judgement in the analysis of patient

specimens leading to the verification and validation of test results and the provision

of advice to the clinical unit where appropriate.

· Participate in 24 hr, 7 day shift and on call arrangement as required.

· Undertake diagnostic testing and related duties following Pathology Queensland

established accredited protocols and standards within a single or multidisciplinary

team in accordance with prescribed professional and ethical standards.

· Independently solve scientific problems regarding equipment, procedures, tasks,

assays and apply professional judgement to complex clinical caseload with clinical

practice supervision.

· Provide input in the development of scientific practices, procedures and protocols

within the Pathology Queensland Haematology Laboratory Princess Alexandra

Hospital work area

· Participate in quality and service improvement activities to continually improve

patient care.

Communication/Team Participation:

· Actively participate in a multidisciplinary team consisting of one or more technical

domains providing support to the team, advice to peers, advice or reporting

services to managers.

· Develop scientific knowledge and expertise through active learning within the

team and by engaging in professional development activities.

· Work cooperatively and communicate effectively within the team and with clients,

both internal and external to the laboratory.

· Provide scientific advice to colleagues and clinical clients with respect to test

procedures and interpretation.

· Communicate a) internally with supervisors, work colleagues (operational,

administrative, technical and scientific), Haematologists, and registrars b) externally

with clinical staff, administrative staff, equipment supplier representatives and other

clients.


Page 4 of 20


Leadership/Work Unit Management:

· Participate in the identification, development and implementation of quality and

service improvement activities in accordance with National Association of Testing

Authorities and International Standardisation Organisation (NATA/ISO)

accreditation/certification that enhance the delivery of pathology services within

the local service area.

· Commensurate with level of experience provide scientific education and

supervision for less experienced practitioners.

· Provide direction to assistant and support staff, including undergraduate,

operational and administrative staff.

Examples of supporting work samples for assessment may include, but are not limited to:

· Photographic, audio or video evidence

· Completed Workplace documentation

· Analysis and diagnostic testing outcomes

· Clinical case study procedures and outcomes

· Incident reports

· Authored work of participation in developing policies, procedures and protocols

including continuous improvement processes for patient care and NATA/ISO

accreditation/certification

· Lookbook entries

· Evidence of professional development such as: professional association

membership; professional association workshops; formal or informal training

· Session plans and learning outcomes providing scientific education and supervision

for less experienced practitioners

· Peer reviews such as: documented feedback and/or evaluation

· Minutes of validation meetings

Presentation of your portfolio

Your portfolio must:

· be clearly labled with your name

· have an index of work samples.

If you are uncomfortable with any aspect of this assessment section, please contact your

assessor who will try to make alterative arrangements.

This assessment is intended to fair, flexible, reliable and valid. If you feel that we should

change any aspect of this assessment to be fair, flexible, reliable and valid, immediately

contact your assessor who will attempt to make alterative arrangements according to the

organisation’s policies and recognition package.


Page 5 of 20


Feedback to candidate on their assessment


Page 6 of 20


Section 1 – Portfolio – Work Samples - Result

Candidate Comments – Specify any improvement you could recommend relating

to this assessment.

Assessment Results (circle one)

Satisfactory / Not Satisfactory

Assessors Comments about the assessment (include any details of reasonable

adjustment or other consideration)

Assessor’s Name:

Signature: Date:

Do not sign this section until after the assessment has been marked and you are

satisfied with the result.

Candidate’s Name:

Signature: Date:

OR

GAN

ISATIO

N T

O R

ETAIN

TH

IS P

AG

E


Page 7 of 20


Section 2 – Observation – Third Party Report Instructions to the Candidate

In order for you to demonstrate your skill and knowledge in the role as a Medical

Laboratory Scientist you are required to ask your supervisor/manager to comment on your

performance of the key responsibilities of your role.

You will be required to seek agreement from your supervisor and provide them with the

reporting tool on the following page and submit this to your assessor. Your assessor will

contact your workplace supervisor to verify their comments and observations.

If you have any questions regarding the assessment, ensure you speak to the assessor

PRIOR to commencing the various tasks.


Page 8 of 20


Third Party Report


Candidate’s name

Referee’s name

(Name of person providing

this evidence)

Position/title

Workplace

Workplace address

Telephone numbers

Email address

This report was completed via interview by

Assessor !

Independently by

referee !

Interview conducted by

(if applicable)

Date of interview

To whom it may concern

Re: _____________________________________ who is a ____________________________.

(insert candidate’s name) (insert industry/job

title).

I certify that the above-named person has:

worked at ________________________________ for a period of ________________________

(insert name of workplace) (insert length of time).

Yes No

I understand the evidence/tasks the candidate has performed on which I am

required to comment. ! !

I am willing to be contacted if further verification of my statements is required. ! !

ORG

AN

ISATIO

N T

O R

ETAIN

TH

IS P

AG

E


Page 9 of 20


They have regularly completed the following activities to an acceptable

workplace/industry standard within this organisation: Yes No

Applies increasingly independent scientific judgement in the analysis of patient

specimens leading to the verification and validation of test results and the

provision of advice to the clinical unit where appropriate

! !

Participate in 24 hr, 7 day shift and on call arrangement as required ! !

Undertake diagnostic testing and related duties following Pathology Queensland

established accredited protocols and standards within a single or

multidisciplinary team in accordance with prescribed professional and ethical

standards.

! !

Independently solve scientific problems regarding equipment, procedures, tasks,

assays and apply professional judgement to complex clinical caseload with

clinical practice supervision.

! !

Provide input in the development of scientific practices, procedures and

protocols within the Pathology Queensland Haematology Laboratory Princess

Alexandra Hospital work area

! !

Participate in quality and service improvement activities to continually improve

patient care ! !

Actively participate in a multidisciplinary team consisting of one or more

technical domains providing support to the team, advice to peers, advice or

reporting services to managers

! !

Develop scientific knowledge and expertise through active learning within the

team and by engaging in professional development activities ! !

Work cooperatively and communicate effectively within the team and with

clients, both internal and external to the laboratory. ! !

Provide scientific advice to colleagues and clinical clients with respect to test

procedures and interpretation. ! !

Communicate:

a) internally with supervisors, work colleagues (operational, administrative,

technical and scientific), Haematologists, and registrars

b) externally with clinical staff, administrative staff, equipment supplier

representatives and other clients.

! !

Participate in the identification, development and implementation of quality and

service improvement activities in accordance with National Association of

Testing Authorities and International Standardisation Organisation (NATA/ISO)

accreditation/certification that enhance the delivery of pathology services

within the local service area

! !

Commensurate with level of experience provide scientific education and

supervision for less experienced practitioners ! !

Provide direction to assistant and support staff, including undergraduate,

operational and administrative staff ! !

Demonstrates knowledge of laboratory transfusion, including performance and

interpretation of routine compatibility testing and complex atypical antibody

detection in transfusion samples

! !

Denonstrates knowledge of a full range of haematology testing ! !

Demonstrates interpersonal skills and the ability to work effectively as a member

of a multi-disciplinary team ! !

Demonstrates ability to work in an out of hour’s environment with little or no

supervision ! !


Page 10 of 20


Demonstrates ability to apply established principles to a

Transfusion/Haematology service with provision of results and clinical advice in a

client focused manner

! !

Demonstrated ability (or ability to rapidly acquire the skill) to identify, develop

and implement quality and service improvement activities in accordance with

NATA/ISO accreditation / certification.

! !


Page 11 of 20




Page 12 of 20


Section 2 – Observation – Third Party Report- Result


to this assessment.





Assessor’s Name:

Signature: Date:



Candidate’s Name:

Signature: Date:

ORG

AN

ISATIO

N T

O R

ETAIN

TH

IS P

AG

E


Page 13 of 20


Section 3 – Questions - Written

Instructions to the Candidate Please read all the information given to you before you start any assessment task. If you do

not understand some or all of the questions, please ask your assessor for clarification.

Please note however, your assessor is not permitted to provide you with the answer.

If you are uncomfortable with any of these questions, please contact your assessor who

will make alternative arrangements.

Attempt to answer ALL questions in your own words on the assessment paper provided.

The questions are designed to assess the required underpinning knowledge for a Medical

Laboratory Scientist.

To satisfactorily complete this assessment task you are required to complete the whole

assessment. To do this you will need to answer all questions correctly and demonstrate you

have achieved the required knowledge to fulfil the accountabilities of the role in

accordance with Queensland Health’s core values and NATA/ISO

accreditation/certification.






Page 14 of 20


Question 1

Sample Required Knowledge Question?

Question 2


Question 3


OR

GAN

ISATIO

N T

O R

ETAIN

TH

IS

PAG

E

OR

GAN

ISATIO

N T

O R

ETAIN

TH

IS

PAG

E

ORG

AN

ISATIO

N T

O R

ETAIN

TH

IS P

AG

E


Page 15 of 20


Question 4


Question 5


Question 6


OR

GAN

ISATIO

N T

O R

ETAIN

TH

IS

PAG

E

OR

GAN

ISATIO

N T

O R

ETAIN

TH

IS

PAG

E

ORG

AN

ISATIO

N T

O R

ETAIN

TH

IS P

AG

E


Page 16 of 20


Question 7


Question 8


Question 9


OR

GAN

ISATIO

N T

O R

ETAIN

TH

IS

PAG

E

OR

GAN

ISATIO

N T

O R

ETAIN

TH

IS

PAG

E

ORG

AN

ISATIO

N T

O R

ETAIN

TH

IS P

AG

E


Page 17 of 20


Question 10


ORG

AN

ISATIO

N T

O R

ETAIN

TH

IS P

AG

E


Page 18 of 20




Page 19 of 20


Section 3 – Questions – Written - Result


to this assessment.





Assessor’s Name:

Signature: Date:



Candidate’s Name:

Signature: Date:

ORG

AN

ISATIO

N T

O R

ETAIN

TH

IS P

AG

E


Page 20 of 20


Competency Summary Record Sheet

Medical Laboratory Scientist – Haematoloty




Candidate Name:

Assessment S / NS Date

1. Portfolio – Work Samples

2. Observation – Third Party report

3. Questions - Written

Overall Result (circle one)

Competent / Not Competent

Assessor’s Name:

Signature: Date:



Candidate’s Name:

Signature: Date:

OR

GAN

ISATIO

N T

O R

ETAIN

TH

IS P

AG

E

© RTOAssess

Marking Guide and

Candidate Record Sheets Medical Laboratory Scientist – Haematoloty




© RTOAssess Version 2 – Setember 2012

Page 2 of 16

Marking Guide – Medical Laboratory Scientist

Instructions to the Assessor The assessment activities in this assessment task portfolio assess the Position Description Range

statement, performance criteria, skills, knowledge and responsibilities of the Role Title –


For the Candidate to demonstrate competence in this unit they must gather evidence

according to the agreed recognition package of this Organisation.

If they do not provide satisfactory evidence to meet the standards of the recognition

package, and therefore are deemed to be Not Competent, you may ask some

supplementary questions to determine the candidate’s competence and record these in

your comments section.


Page 3 of 16


Section 1 – Portfolio – Work Samples – Criteria

Instructions to the Assessor

The tasks in this section requires the candidate to demonstrate consistency in the

performance of their role as a Medical Laboratory Scientist in the Haematology unit of

Pathology Queensland – Princess Alexandra Hospital – Clinical and Statewide Services

Division.

To satisfactorily provide evidence for this section and demonstrate consistency in managing

a range of contingencies they must gather evidence of their ability to meet all key

responsibilities of the role as identified in the recognition package.

As a minimum candidate’s are advised to develop a portfolio of work samples exemplary of

their role as a Medical Laboratory Scientist from the assesment period identified on the title

page of the Assessment Portfolio.

Recording the Result

On the following pages provided you are required to record your observations of the

material submitted by the candidate for assessment.

For an overall satisfactory result, the candidate’s evidence must satisfy the ‘rules of

evidence’.

1. Print one set of ‘Evidence Evaluation Checklist’ for each work sample and attach to

Section 1 of the Candidate’s Assessment Portfolio.

Place a ‘tick’ under the ‘Yes’ if the candidate’s evidence meets the listed criteria and place

a ‘tick’ under the ‘No’ if the candidate’s evidence does not meet the listed criteria.

Where a ‘No’ has been ticked you are required to ask the candidate to supply further

evidence meeting all the criteria

2. Print the ‘Mapping Matrix’ for each candidate and attach to Section 1 of the Candidate’s

Assessment Task Portfolio

Indicate on the matrix which work sample has satisfied the performance criteria, required skill,

required knowledge and/or dimension of competence. Where gaps are identified you must

ask the candidate to provide further evidence to satisfy the identified criteria.


Page 4 of 16


Instructions to the Candidate

The tasks in this section requires you to demonstrate consistency in the performance of your

role as a Medical Laboratory Scientist in the Haematology unit of Pathology Queensland –

Princess Alexandra Hospital – Clinical and Statewide Services Division.

To satisfactorily provide evidence for this section and demonstrate consistency in managing

a range of contingencies you MUST gather evidence of your ability to meet all key

responsibilities of the role as identified in the recognition package.

As a minimum develop a portfolio of work samples exemplary of your role as a Medical

Laboratory Scientist from the assessment period idenitified on the facing page of this

Assessment Portfolio. Please provide evidence from each calendar month during the period

which demonstrates the following Key Responsibilities:

Clinical Practice:

· Apply increasingly independent scientific judgement in the analysis of patient

specimens leading to the verification and validation of test results and the provision of

advice to the clinical unit where appropriate.

· Participate in 24 hr, 7 day shift and on call arrangement as required.

· Undertake diagnostic testing and related duties following Pathology Queensland

established accredited protocols and standards within a single or multidisciplinary

team in accordance with prescribed professional and ethical standards.

· Independently solve scientific problems regarding equipment, procedures, tasks,

assays and apply professional judgement to complex clinical caseload with clinical

practice supervision.

· Provide input in the development of scientific practices, procedures and protocols

within the Pathology Queensland Haematology Laboratory Princess Alexandra

Hospital work area

· Participate in quality and service improvement activities to continually improve

patient care.

Communication/Team Participation:

· Actively participate in a multidisciplinary team consisting of one or more technical

domains providing support to the team, advice to peers, advice or reporting services

to managers.

· Develop scientific knowledge and expertise through active learning within the team

and by engaging in professional development activities.

· Work cooperatively and communicate effectively within the team and with clients,

both internal and external to the laboratory.

· Provide scientific advice to colleagues and clinical clients with respect to test

procedures and interpretation.

· Communicate a) internally with supervisors, work colleagues (operational,

administrative, technical and scientific), Haematologists, and registrars b) externally

with clinical staff, administrative staff, equipment supplier representatives and other

clients.


Page 5 of 16


Leadership/Work Unit Management:

· Participate in the identification, development and implementation of quality and

service improvement activities in accordance with National Association of Testing

Authorities and International Standardisation Organisation (NATA/ISO)

accreditation/certification that enhance the delivery of pathology services within the

local service area.

· Commensurate with level of experience provide scientific education and supervision

for less experienced practitioners.

· Provide direction to assistant and support staff, including undergraduate, operational

and administrative staff.

Examples of supporting work samples for assessment may include, but are not limited to:

· Photographic, audio or video evidence

· Completed Workplace documentation

· Analysis and diagnostic testing outcomes

· Clinical case study procedures and outcomes

· Incident reports

· Authored work of participation in developing policies, procedures and protocols

including continuous improvement processes for patient care and NATA/ISO

accreditation/certification

· Lookbook entries

· Evidence of professional development such as: professional association membership;

professional association workshops; formal or informal training

· Session plans and learning outcomes providing scientific education and supervision

for less experienced practitioners

· Peer reviews such as: documented feedback and/or evaluation

· Minutes of validation meetings

Presentation of your portfolio

Your portfolio must:

· be clearly labled with your name

· have an index of work samples.

If you are uncomfortable with any aspect of this assessment section, please contact your

assessor who will try to make alterative arrangements.






Page 6 of 16


Evidence Evaluation Checklist Integrity and reliability in assessment decisions Yes No

The evidence accurately reflects:

- Appropriate alignment with the recognition package

- Four dimensions of competence

- Acceptable performance measures

- Employability skills

- Range statement of the Position Description

- Workplace application of required skills and knowledge

- Workplace requirements

- Licensing, industry standards, compliance requirements

Evidence has been gathered:

- In a range of work contexts on different occasions

- Using various assessment methods

- According to the critical aspects of assessment

The rules of evidence are satisfied. The evidence is:

- Valid

- Current

- Sufficient

- Authentic

The principles of assessment have been followed. The assessment is:

- Fair

- Flexible

- Reliable

- Valid

Assessment validation has been performed?

The assessment process is scheduled for review

Print one of these forms for each candidate and attach to section 1 of the candidate

assessment portfolio

ORG

AN

ISATIO

N T

O R

ETAIN

TH

IS P

AG

E


Page 7 of 16


Mapping Matrix Criteria Work Sample

Applies increasingly independent scientific judgement in the

analysis of patient specimens leading to the verification and

validation of test results and the provision of advice to the clinical

unit where appropriate

Participate in 24 hr, 7 day shift and on call arrangement as required

Undertake diagnostic testing and related duties following Pathology

Queensland established accredited protocols and standards within

a single or multidisciplinary team in accordance with prescribed

professional and ethical standards.

Independently solve scientific problems regarding equipment,

procedures, tasks, assays and apply professional judgement to

complex clinical caseload with clinical practice supervision.

Provide input in the development of scientific practices, procedures

and protocols within the Pathology Queensland Haematology

Laboratory Princess Alexandra Hospital work area

Participate in quality and service improvement activities to

continually improve patient care

Actively participate in a multidisciplinary team consisting of one or

more technical domains providing support to the team, advice to

peers, advice or reporting services to managers

Develop scientific knowledge and expertise through active learning

within the team and by engaging in professional development

activities

Work cooperatively and communicate effectively within the team

and with clients, both internal and external to the laboratory.

Provide scientific advice to colleagues and clinical clients with

respect to test procedures and interpretation.

Communicate:

a) internally with supervisors, work colleagues (operational,

administrative, technical and scientific), Haematologists, and

registrars

b) externally with clinical staff, administrative staff, equipment

supplier representatives and other clients.

Participate in the identification, development and implementation

of quality and service improvement activities in accordance with

National Association of Testing Authorities and International

Standardisation Organisation (NATA/ISO) accreditation/certification

that enhance the delivery of pathology services within the local

service area

Commensurate with level of experience provide scientific

education and supervision for less experienced practitioners

Provide direction to assistant and support staff, including

undergraduate, operational and administrative staff

Demonstrates knowledge of laboratory transfusion, including

performance and interpretation of routine compatibility testing and

complex atypical antibody detection in transfusion samples

Denonstrates knowledge of a full range of haematology testing

Demonstrates interpersonal skills and the ability to work effectively

as a member of a multi-disciplinary team

OR

GAN

ISATIO

N T

O R

ETAIN

TH

IS P

AG

E


Page 8 of 16


Demonstrates ability to work in an out of hour’s environment with

little or no supervision

Demonstrates ability to apply established principles to a

Transfusion/Haematology service with provision of results and

clinical advice in a client focused manner

Demonstrated ability (or ability to rapidly acquire the skill) to

identify, develop and implement quality and service improvement

activities in accordance with NATA/ISO accreditation / certification



ORG

AN

ISATIO

N T

O R

ETAIN

TH

IS P

AG

E


Page 9 of 16


Section 2 – Observation – Third Party – Criteria


This section of the Assessment Portfolio requires the candidate to request that their supervisor

provide a third party report on their performance within the organisation as a Medical

Laboratory Scientist according to the recognition package.

Recording the Result

The Third Party Report MUST have a tick in all ‘Yes’ boxes to award the candidate with a

satisfactory result on the ‘Result Summary sheet’ under the section ‘Third Party Report’.

You are required to make contact with the nominated supervisor and verify the Third Party

Report during a conversation. You are required to record your conversation you have with

the supervisor on the checklist of questions provided on the Third party conversation

checklist. You are not required to record word for word the conversation, however you are

required to tick each key point that is covered during the conversation for each question.

A list of questions has been provided for you to follow to ensure consistency in gathering

evidence of the candidate’s performance.

Print one set of checklist forms for each candidate and each Third Party Report submitted for

assessment and attach to Section 2 of the Candidate Assessment Portfolio.

Place a ‘S’ next to the criteria if you are satisfied the Third Party Report provides satisfactory

evidence to support the candidate’s competence recognition and write ‘NS’ if the

candidate is identified as not performing the tasks satisfactorily.


In order for you to demonstrate your skill and knowledge in the role as a Medical Laboratory

Scientist you are required to ask your supervisor/manager to comment on your performance

of the key responsibilities of your role.

You will be required to seek agreement from your supervisor and provide them with the

reporting tool on the following page and submit this to your assessor. Your assessor will

contact your workplace supervisor to verify their comments and observations.

If you have any questions regarding the assessment, ensure you speak to the assessor PRIOR

to commencing the various tasks.


Page 10 of 16


Section 2 – Third Party Conversation – Checklist

Name of Third Party Reporter:

Third party verification Questions

Key Points must be identified

S/NS

1. Sample Question?

P.C 2.1,2.2,2.3,2.4,2.5,2.7,5.1,5.2,5.3

R.S 1a,b,c,,d,e,f,2a,b,c,

! Suggested Answer

! Suggested Answer

! Suggested Answer

Other comments:

2. Sample Question?

P.C 2.7,2.8

R.S 1e,4a,b,5a

R.K 7a,b,c,d,e,f,8

! Suggested Answer

! Suggested Answer

! Suggested Answer

Other comments:

3. Sample Question?

P.C 2.6

R.S 2d

! Suggested Answer

! Suggested Answer

! Suggested Answer

Other comments:

4. Sample Question?.

P.C 3.1,3.2,4.1,4.2,4.3,4.4

R.S 5a

! Suggested Answer

! Suggested Answer

! Suggested Answer

Other comments:



OR

GAN

ISATIO

N T

O R

ETAIN

TH

IS P

AG

E


Page 11 of 16


Section 3 – Questions – Written Criteria

Instructions to the Assessor

Below, you are required to record your findings based on the responses provided by the

candidate.

Print one set of ‘Result Summary forms’ for each candidate and attach to Section 3 of the

Candidate’s Assessment Task Portfolio

For a satisfactory result, the candidate must undertake the whole task. However if a

candidate does not perform a particular aspect of the task, you do have the opportunity to

ask the candidate to orally explain the missed criteria and record this in the assessor’s

comments area.

Place a ‘S’ next to the task if the candidate performs the task as required and in a

satisfactory manner, write ‘NS’ is the candidate does not perform the tasks satisfactorily.

Where you ask the candidate to explain or perform the task after the written assessment has

been submitted, record this in the comments section after each task on the result summary

form.

Marking the Assessment

Assessors please note: The following responses (in red) are simply suggested answers taken

from the Organisation’s Policies, procedures, protocol and operational manuals.

Candidate’s answers in all tasks contained within the Assessment Portfolio may be

considerably different if they have differing work experience. Assessors must use professional

judgement when marking these assessments. If a candidate provides a different answer to

the one that is listed below, but the answer is still correct, then they should still be marked as

correct. If there is a required answer, it will specify, “the answer must include”.

During future moderation and validation sessions it is advised to add additional answers to

the marking guide that regularly appear in responses. RTOAssess welcomes all feedback for

continuous improvement and future validation and moderation of the assessment task

portfolios.


Page 12 of 16


Instructions to the Candidate Please read all the information given to you before you start any assessment task. If you do

not understand some or all of the questions, please ask your assessor for clarification. Please

note however, your assessor is not permitted to provide you with the answer.

If you are uncomfortable with any of these questions, please contact your assessor who will

make alternative arrangements.

Attempt to answer ALL questions in your own words on the assessment paper provided. The

questions are designed to assess the required underpinning knowledge for a Medical

Laboratory Scientist.

To satisfactorily complete this assessment task you are required to complete the whole

assessment. To do this you will need to answer all questions correctly and demonstrate you

have achieved the required knowledge to fulfil the accountabilities of the role in

accordance with Queensland Health’s core values and NATA/ISO

accreditation/certification.






Page 13 of 16


Marking Guide

After each question, you will see letters and number e.g. (P.C10). This number relates back to

what performance criteria, required skill, required knowledge and critical aspect of the role

title according to the recognition package.

KEY:

PC = performance criteria and the respective number

RS = required skill

RK = required knowledge

CA = critical aspect

Question 1

Role Title P.C R.S R.K



Sample Answer

Question 2




Sample Answer

Question 3




Sample Answer


Page 14 of 16


Question 4




Sample Answer

Question 5




Sample Answer

Question 6




Sample Answer

Question 7




Sample Answer

Resources

• Industry Skills Council: Innovation and Business Skills Australia – www.ibsa.com.au

• National and Accredited training packages: training.gov.au

• Assessment and competency recognition resource development:

• www.rtoassess.com.au

• Angela Cowan: [email protected]

Date post:	06-Mar-2018
Category:	Documents
Upload:	phamdang
View:	217 times
Download:	3 times

The Why, What, Who, When and How of Assessing Competence 2012/PP Presentations/Cowan... · When and...

Documents