CREATING AND IMPLEMENTING RIGOROUS FORMATIVE ASSESSMENTS

IASP Fall Conference 2014

AGENDA

In the beginning… Find Your Constants Setting a Path Professional Development Projecting the Future

A brief history of how Duneland School Corporation came to identify the need for locally developed rigorous common assessments.

IN THE BEGINNING…

Elementary Assessments

District Wide Common Writing Prompts

Textbook Based Common Unit Assessments

School Based School Improvement Assessments

Recording of Data Use/Purpose of Data Hand Scoring &

Recording Vertical Articulation Validity & Reliability

The Items The Complexities

Intermediate/Middle School Assessments

Writing Prompts Screening Placement

Assessments Pre & Post Assessments School Improvement Pre & Post

Assessments Individual Teacher Course Finals Department Quarterly

Assessments

Inconsistencies within a course

Reliable Data No Review of Data Lack of Data Storage Multiple Buildings

The Items Complexities

High School Assessments

Algebra 1 ECA Failure Algebra 1 Common

Assessments Vocabulary Assessments Department Quarterly

Assessments

How do we score?

RISO ScanTron By Hand

In an era of change, holding on to what you control and hold important.

FIND YOUR CONSTANTS

A Climate of Change

Indiana Standards – Common Core – College & Career Readiness Standards

Textbook Change Acuity Predictive – Acuity Diagnostic mClass NWEA ISTEP IREAD3

AdvancED Visit

Train all professionals how to harvest and communicate student performance data from locally developed assessments so as to build confidence among principals and teachers to make instructional, research-based decisions based upon valid and reliable local assessment results that have been triangulated against external assessments.

Superintendents Advisory Committee

Common Concerns Across the state Danielle Shockey, Deputy Superintendent of Public

Instruction Stick to your constants to weather the storm

Our steps to the process and clarifying definitions for the future.

DEFINING A PATH

Our Path

Clearly identify any and all common assessments used within schools and across the district. Assessment evaluation.

Curriculum evaluation. Mechanism for assessment creation. Timeline for assessment creation. Formats for assessments at all levels. Professional development on writing assessments. Writing assessments.

15

Essential Assessment Questions

Gradebook Accountability

Program or curriculum Grade level or content School, division or state

I am not sure what my students know and don’t know about this

I need data to inform me about why they are not getting this concept

I need data for creating like groups for further instruction

16

Key Elements of Rigorous Instruction

Rigor

Cognitive Engagement

OngoingAssessment

Complex Content

Student Engagement

Barbara Blackburn

Rigor is creating an environment in which each student is expected to learn at high levels each student is supported so he or she can learn at high

levels each student demonstrates learning at high levels

(Blackburn, 2008)

Karin Hess

Cognitive rigor encompasses: the complexity of content the cognitive engagement with that contentthe scope of the planned learning activities

(Hess, Carlock, Jones, & Walkup, 2009)

Robyn R. Jackson

Rigor is a quality of instruction that requires students to: construct meaning for themselves impose structure on information integrate individual skills into processes operate within but at the outer edge of their abilities apply what they learn in more than one context and to

unpredictable situations

http://www.mindstepsinc.com/rigor/

A relationship with Interactive Achievement and onTRAC.

PROFESSIONAL DEVELOPMENT

General Tips and Guidelines

Items that Produce Reliable Results

Bad

Why was Jamestown a poor site for a settlement and when was it moved to Williamsburg?

Good

Why was Jamestown a poor site for a settlement?-and-

When was the capital moved to Williamsburg?

Single Idea or Problem

Good Graphic

Readable Graphics

Not so Good Graphics

Which explorer’s route is represented by A?

A ColumbusB NewportC CartierD Ponce de Leon

Avoid unnecessary information ingraphics

Garrett has cereal every morning for breakfast. He notices that the cereal box is in the shape of a rectangular prism. The cereal box that he is eating from has the volume of 1,200 square inches and a height of 20 inches. Knowing the height and volume, which of the following could be the dimensions of the length and width of the cereal box?

What can be eliminated?

A cereal box has the volume of 1,200 square inches and a height of 20 inches. Which of the following could be the dimensions of the length and width of the cereal box?

Clear, precise, simple language

These items were on the same history test:

Who led a raid on the United States arsenal (armory) at Harpers Ferry, Virginia?

-and-

Why did John Brown lead a raid on the United States arsenal (armory) at Harpers Ferry, Virginia?

Ensure items are not interdependent

If Shakayan divided a dozen eggs into three equal groups, how many groups of eggs would she have?

A 4B 3C 1D 12

If April divided a dozen eggs into three equal groups, how many groups of eggs would she have?

Do NOT use difficult or common names

Include words in the stem that would be repeated in each response option.

After the secession of Virginia –

A the capital of the Confederacy was RichmondB the capital of the Confederacy was ManassasC the capital of the Confederacy was MontgomeryD the capital of the Confederacy was Atlanta

After the secession of Virginia the capital of the Confederacy was –

A RichmondB ManassasC MontgomeryD Atlanta

Reduce redundancy

Use as little punctuation as possible.

Bad

Which number isn’t an example of an integer?

Good

Which number is NOT an example of an integer?

Do NOT use contractions

Use new language as frequently as possible.

SOL Framework

“Many settlers died of starvation…”

BadMany settlers died of –

A starvation

GoodWhich hardship caused the deaths of many settlers?

A They did not have enough food to eat.

Avoid phrases taken directly from text or lecture

Place “blanks” at the end of the statement, rather than the middle. Use a dash.

John found the solution of 13 + x = 25 in one step by —

A dividing both sides of the number sentence by 13 B adding 13 to both sides of the number sentenceC multiplying both sides of the number sentence by 13D subtracting 13 from both sides of the number sentence

Incomplete statements

Virginia’s Maggie L. Walker is known as the first African-American woman to —

A become a city officialB become a bank presidentC was a spy for the Continental ArmyD led the Underground Railroad

Distractors must be grammatically consistent with the stem

BadWhen selecting a career you should take into account all of the following EXCEPT ‒A your own talentsB what your friends are doingC things you are interested inD what you are good at

GoodWhen selecting a career people should take into account all of the following EXCEPT ‒A their own talentsB what their friends are doingC things they are interested inD what they are good at

Write items in the THIRD PERSON

Before the Civil War, the primary form of a family’s transportation was a –

A horse and buggy

B rocket

C skateboard

D canoe

Ensure distractors are equally attractive

Subject History 8.1

Question: Nat Turner led a revolt against -

Answer: plantation owners Students might select this distractor if:

Option 1: slaves they don’t attend to the word against

Option 2: Confederate troops they think the revolt took place during the civil war

Option 3: abolitionists they think he sided with slave owners

Thinking through your distractors

Bad

West Virginia separated from Virginia because of different opinions about —

A the types of materials the United States should trade with foreign countriesB slaveryC what types of religion people should practiceD whether factories should be built in the southern states

All distractors should be equivalent in length, style and structure

The colony of Virginia mainly provided England with –

A locations for English prisonsB new sources of raw materials C all of the aboveD none of the above

Avoid “all of the above” & “none of the above”

Which of the following is a reason why the southern states seceded from the Union?

A Northern and southern states disagreed about everything.B The industrial economy of the North did not support slavery.C People in the South wanted to continue farming on plantations.D The southern states did not want any of the western territories to become states.

Avoid absolute terminology

The Good the Bad and the Ugly Learning Activity I

ISTEP and ISTEP+ Formatting

Distractors are:CapitalizedNo periods

Who were members of the 1619 Virginia Assembly?

A LordsB BurgessesC Indentured servantsD American Indians (First Americans)

When distractors are incomplete sentences

A person mixed 2 teaspoons of salt into 1 cup of water that measured 70°F. What most likely happened?

A The salt did not lose any of its original chemical properties

B A new compound was formed with the water and salt

C The temperature of the water was lowered by ten degrees

D The salt molecules broke apart to form sodium and chloride

Distractors are:CapitalizedNo Periods

When distractors are complete sentences or statements

To find more information about Pocahontas, a student should use ―

A the Internet and an encyclopedia

B a dictionary and the internet

C an encyclopedia and a thesaurus

D a dictionary and a thesaurus

Distractors are:Not capitalizedNo periods

When stem is an incomplete statement

Always CAPITALIZED BEST NOT MOST LIKELY

Use of Italics

Writing Directions

Grade 8

Use of Graphics for Multiple Choice

The colony of Virginia mainly provided England with ―

A locations for English prisonsB increased influence with other countriesC American Indians (First Americans) as a labor sourceD new source of raw materials for English industry

Qualifiers are NOT italicized

PROJECTING THE FUTURE

APPROVAL & MONITORING

Determine Mechanism for Approval Who will be approving the assessments? What criteria will be used for final approval?

Set Timeline for Implementation Determine Mechanism for Modifications

How often will assessments be reviewed for modifications? Who will be making modifications to assessments? How will modifications be approved?

Determine Mechanism for Monitoring Results Determine standardized assessments used to triangulate data for validity. Determine who will review district data and how? Assessments Implemented, Recorded, & Modified – Monitoring Provided by

Curriculum Committees (K-12 representatives) Provide Professional Development as Needed

WRAP UP & QUESTIONS?

Contact Information

PrincipalBailly Elementary School Chesterton, IN(219)983-3670kevin.zeck@duneland.k12.in.us

Director of Professional DevelopmentInteractive Achievement(540) 206-2262 office(757) 535-4484 cellsally.ianson@interactiveachievement.com

www.interactiveachievement.comFollow me onTwitter @SallyIAnson1

KEVIN ZECKSALLY I’ANSON, Ed. D.