1

Making sound teacher judgments and moderating them

Moderation for Primary TeachersOwhata School Staff meeting

26 September 2011

2

To support teachers when they are marking and moderating their judgments of a student’s learning in a writing task

To experience the moderation process

Purposes

Moderating writing

Why moderate?

Identify similarities and differences in scoring;

Celebrate similarities and resolve differences;

Achieve common scoring responses for each of the seven scores.

4

Effective moderation

Moderation is most effective when:

• It is built on a culture of professional dialogue, support and risk-taking

• It is based around an inquiry approach• The process is planned, resourced and reviewed• Learning about the process is recorded for wider application

across the school• There is a leader or co-ordinator.

5

Skills required for moderation and building a supportive learning culture

Professional respect and trust

Communication skills and

participation in decision making

Open-mindedness to new information

and perspectives

Deepening pedagogical and

curriculum knowledge

Sharing of information and

power

Shared responsibility

6

Moderation consists of six phases

1. Planning for moderation.2. Clarifying and extending teacher knowledge of curriculum

content; learning, teaching and assessment processes.3. Collecting evidence of student learning.4. Analysing the evidence. 5. Interpreting and sharing the analysis.6. Continuing and reviewing moderation processes.

7

Phase 1: Planning for moderation

Effective moderation builds on meticulous planning of process and content :

• Identifying personnel• Planning timetable• Identifying the area of learning that you wish to gather consistent

judgments on• Deciding what you will moderate - a piece of writing, a reading or

mathematics task or activity, the administration of an assessment tool , e.g. running records.

• Timeframe

8

Role of leader/coordinator

In moderation there are a number of administrative jobs that will require organising. Some of these are:

• Gathering and preparing samples for moderation e.g. making samples anonymous, photocopying multiple copies of student work (e.g. Writing)

• Communicating expectations to teachers• Establishing ground rules for discussions • Setting the agenda• Preparing annotation and marking sheets• Managing the meeting (time)• Appointing a note/minute taker.

9

Phase 2: Clarifying and extending teacher knowledge

Content of moderation How sound are teachers’:- Curriculum knowledge (key concepts, developmental progressions)- Pedagogical knowledge (learning, teaching and assessment)- Awareness of, and familiarity with, a range of assessment

tools and activities- Awareness of, and familiarity with, reference point,

framework or standards Time spent on exploring understanding of progressions of

learning, or the language used in the standards, will lead to greater shared understanding of the assessment criteria.

Tools for assessing writing

• Curriculum exemplars for Level 1 juniors• e-asTTle scoring rubrics• Glossary• High Frequency Word List• Writing task

Audience Awareness and Purpose

Relates to the writer’s ability to produce a piece that achieves its communicative purpose and takes account of the questions:

• Who am I writing this for?• Why am I writing this?• What shape or form will this take?

Content and ideas

Incorporates two main areas of the text written:

•Domain elements acknowledge that texts have some common features or elements that are accepted as part of the cultural resources for achieving a purpose.

• Content material is mainly concerned with what might be called ‘the aboutness’ of the text. Content included will be relevant to achieving the purpose.

Structure and OrganisationThe ordering or organisation that the writer demonstrates in his/her text. The focus is on the management of text through sequencing and linking of ideas:

•‘Global’ organisation of the text, dealing with sequence from start to finish.

•Linking of ideas within and across sentences (by using conjunctions, adverbials and adjectivals).

Language Resources

The language we use reflects three main considerations. • What are we writing about? (content influences vocabulary, idioms or phrases).

• What is our purpose? (language choices and grammatical structures that are associated with a desire to argue, to entertain, to instruct, etc.)

• Who are we writing for? (language choice and grammatical choices that acknowledge different ways of addressing our audience).

B - basic

Has a rudimentary control of the indicators at this level.

Examples are present that meet the criteria, but perhaps only a few are present or there may be as many unsuccessful attempts as there are successful ones.

P – Proficient

The student has satisfactory control of the characteristics defined at this level.

The writing meets the indicators and more examples of success, than not, are present, or better-quality examples are evident.

A - Advanced

The student has extensive control of the characteristics defined at this level, yet still is not best described by the progress indicators of the next level

18

Phase 3: Collecting evidence of student learning

There are a number of ways to collect evidence: • Decide on number of samples of assessments to be moderated at

session. • Decide how these samples will be selected. e.g. This could be a

sample of work assessed to be in the high range, mid range and low range in relation to the success criteria, every 5th student on class roll or could be samples of work that teachers are unsure how to assess.

What is collected?• For a piece of writing: student writing samples are mainly used

19

Phase 3: Collecting evidence of student learning

Review the writing task• Cover sheet for student’s details and marking• Attitude task• Writing task

o For juniors keep as normal as possibleo Use own books for tasko Keep a copy of their planning sheeto If spelling is an issue, encourage students to read their

narrative to you

20

Phase 4: Analysing the evidence

• Choose 3 pieces of writing – high, medium, low • Mark each one on all seven features• Record your evidence

Robyn will have two or three samples for our moderating session

21

Phase 4: Analysing the evidence

When analysing the evidence, teachers should:• identify how the student work specifically meets the success

criteria (e.g. using a highlighter pen)• use annotation sheets to record key points and judgments

made• identify next learning steps for student

22

Phase 5: Interpreting and sharing evidence

A moderation session has four goals:

1. Identify similarities and differences in judgments

2. Resolve any differences

3. Achieve consistency of judgments

4. Achieve shared understanding of consistency of criteria and language used to assess

Teachers engage in professional discussion, perhaps asking questions, such as: How typical is the sample of work for this child?

What surprised you?What are you unsure about? How well does the work show evidence of the success criteria?What will you do next to help the child’s learning?

23

Teachers will need to come to moderation meetings with open minds, with the possibilities of adjusting their opinions, expectations and their way of making judgments in the future.

Preparing for moderation sessions as a team or year level group:• Each teacher makes available the evidence from one student, according to what was decided. If moderating as a

school, the team will select one student’s work to take to whole-school moderation.

Phase 5: Interpreting and sharing the evidence

24

Preparing for moderation sessions (Cont’):• Annotated sheets are made available for teachers to identify

where work meets the standard• Team leader photocopies/photographs contents of the

moderation folder for each team member • Resources are made available, such as the Literacy Learning

progressions, Numeracy progressions and stages• Recording sheets are made available for the moderation

meeting.

Phase 5: Interpreting and sharing evidence