Understanding How the Ranking is Calculated

2011 TOP TO BOTTOM RANKING

The statewide top-to-bottom ranking takes into account both student achievement on state tests and graduation rates. Student achievement on state tests is included in the statewide top to bottom ranking in the following three ways:Achievement at the elementary, middle, and high school levels

Improvement in achievement over timeThe largest achievement gap between two subgroups calculated based on the top scoring 30% of students versus the bottom scoring 30% of students

TOP TO BOTTOM (TTB) RANKING

In addition to the achievement components, student graduation is included in the statewide top-to-bottom ranking for schools with a graduation rate in the two following ways:Graduation RateImprovement in graduation rate over time

TTB RANKING

Schools with 30 or more full academic year (FAY) students tested over the last two years in at least two state-tested content areas:

MathematicsReadingScienceSocial StudiesWriting

WHO RECEIVES A RANKING?

Geographic Distribution

of Top to Bottom

Rankings

Quick Reference for Z-Scores

WHAT IS A Z-SCORE?

WHY DO WE USE Z SCORES?

Z-scores are a standardized measure that helps you compare individual student (or school) data to the state average data (average scores across populations).

Z-scores allow us to “level the playing field” across grade levels and subjects

Each Z-score corresponds to a value in a normal distribution. A Z-Score will describe how much a value deviates from the mean.

Z-SCORE “CHEAT SHEET”

Student z-score = (Student Scale Score) – (Statewide average of scale scores)

Standard Deviation of Scale Score

School z-score=(School Value) – (Statewide average of that value)

Standard deviation of that value

Z Score Summary PowerPoint and Business Rules-http: / /www.mich igan.gov/mde/0,4615,7-140-37818_56562- - - ,00.html

Z-SCORE “CHEAT SHEET”

Z-scores are centered around zeroPositive numbers mean the student or school is above the state average

Negative numbers mean the student or school is below the state average

0 1 2 3-1

-2

-3

State Average Better than state

average….…Worse than state

average

Z-SCORE EXAMPLES

Your school has a z-score of 1.5. You are better than the state average.

0 1 2 3-1

-2

-3

State Average Better than state

average….…Worse than state

average

Z-score of 1.5

Z-SCORE EXAMPLESYour school has a z-score of .2. You are better than

the state average, but not by a lot.

0 1 2 3-1

-2

-3

State Average Better than state

average….…Worse than state

average

Z-score of 1.5

Z-score of 0.2

Z-SCORE EXAMPLESYour school has a z-score of -2.0. You are very far

below state average.

0 1 2 3-1

-2

-3

State Average Better than state

average….…Worse than state

average

Z-score of 1.5

Z-score of 0.2

Z-score of -2.0

For grade 3-8 reading and mathematics

HOW IS THE TOP TO BOTTOM RANKING CALCULATED

Two-Year Average

Standardized Student Scale

(Z) Score

Two-Year Average

Performance Level Change

Index

Two-Year Average Bottom 30% - Top 30%Z-Score Gap

School Achievement

Z-Score

School Performance Level Change

Z-Score

School Achievement Gap Z-Score

School Content

Area Index

1/2

1/4

1/4

Content

Index Z-

score

A weighted composite of individual student performance level change is used to calculate improvement in grades 3-8 reading and mathematics

Rewards large improvements more heavily, rewards maintenance of proficiency if a student was already proficient

WEIGHTED PERFORMANCE LEVEL CHANGE

Previous Proficiency

Significant Decline Decline Maintain Improvemen

tSignificant

Improvement

Not Previously Proficient

-2 -1 0 1 2Previously Proficient -2 -1 1 1 2

For science, social studies, writing, and grade 11 all tested subjects

HOW IS THE TOP TO BOTTOM RANKING CALCULATED

Two-Year Average

Standardized Student Scale

(Z) Score

Four-Year Achievement Trend Slope

Two-Year Average Bottom 30% - Top 30%Z-Score Gap

School Achievement

Z-Score

School Performance Achievement

TrendZ-Score

School Achievement Gap Z-Score

School Content

Area Index

1/2

1/4

1/4

Content

Index Z-

score

For graduation rate

HOW IS THE TOP TO BOTTOM RANKING CALCULATED

Two-Year Average

Graduation Rate

Four-Year Graduation Rate

Trend Slope

School Graduation Rate

Z-Score

School Graduation Rate

TrendZ-Score

School Graduatio

n Rate Index

2/3

1/3

Grad Index

Z-score

Calculating a four-year slope (e.g., graduation rate)

HOW IS THE TOP TO BOTTOM RANKING CALCULATED

1 2 3 460%

65%

70%

75%

80%

85%

90%

Year

Grad

uatio

n Ra

te

• Plot the school’s graduation rate for the last four years

• Plot a linear regression line through the points

• Calculate the slope of the line (gives the school’s annual improvement rate)

Calculating a four-year slope (e.g., graduation rate)

HOW IS THE TOP TO BOTTOM RANKING CALCULATED

1 2 3 460%

65%

70%

75%

80%

85%

90%

Year

Grad

uatio

n Ra

te

• Plot the school’s graduation rate for the last four years

• Plot a linear regression line through the points

• Calculate the slope of the line (gives the school’s annual improvement rate)

Calculating a four-year slope (e.g., graduation rate)

HOW IS THE TOP TO BOTTOM RANKING CALCULATED

1 2 3 460%

65%

70%

75%

80%

85%

90%

Year

Grad

uatio

n Ra

te

• Plot the school’s graduation rate for the last four years

• Plot a linear regression line through the points

• Calculate the slope of the line (gives the school’s annual improvement rate)

Slope = 2.3%

Calculating an overall ranking for a school with a graduation rate

HOW IS THE TOP TO BOTTOM RANKING CALCULATED

School Graduation

Rate Std Index

School Mathematics

Std IndexSchool Reading

Std Index

School Science Std Index

School Social Studies Std

IndexSchool Writing

Std Index

Overall Standardized School Index

18%

18%

18%

18%

18%

10%

Overall School Percentile Rank

Calculating an overall ranking for a school without a graduation rate

HOW IS THE TOP TO BOTTOM RANKING CALCULATED

School Mathematics

Std IndexSchool Reading

Std Index

School Science Std Index

School Social Studies Std

IndexSchool Writing

Std Index

Overall School Standardized

Index

20%

20%

20%

20%

20%

Overall School Percentile Rank

Calculating an overall ranking for a school without a graduation rate and without a writing score

HOW IS THE TOP TO BOTTOM RANKING CALCULATED

School Mathematics

IndexSchool Reading

Index

School Science Index

School Social Studies Index

Overall School Standardized

Index

25%

25%

25%

25%

Overall School Percentile Rank

WHICH YEARS OF DATA ARE IN THE

RANKING?

Michigan tests in the fall.These fall tests reflect the learning of students in the

previous school year.

FOR ELEMENTARY AND MIDDLE SCHOOLS

Fall 2011 Testing

Fall 2010 Testing

Fall 2009 Testing

Fall 2008 Testin

g

SY 2008-2009

SY 2009-2010

SY 2010-2011

Michigan tests in the springThe spring test (MME and MI-Access) measures what students have learned from grades 9, 10 and grade 11 prior to the MME testing.

FOR HIGH SCHOOLS

For elementary/middle schools:Performance on the MEAP and MI-Access tests in fall 2010 (which represents learning from school year 2009-2010) and before

For high schools:Performance on the MME and MI-Access tests in spring 2011 (which represents learning from school year 2010-2011 prior to testing) and before.

WHAT DO THE 2011 RANKINGS REFLECT?

For elementary/middle schools:Fall 2010 MEAP & MI-Access

For high schoolsSpring 2011 MME & MI-Access

WHEN IS PERFORMANCE IN 2010-2011 MEASURED?

For elementary/middle schools:Fall 2011 MEAP, MI-Access & MEAP-Access

For high schoolsSpring 2012 MME & MI-Access

WHEN IS PERFORMANCE IN 2011-2012 MEASURED?

TTB vs PLA

HOW IS THIS DIFFERENT FROM

THE PLA LIST?

This list represents a ranking of all schools in the state of Michigan, using our preferred methodology developed in collaboration with many stakeholders.

MDE also published, according to state statute, a list of Persistently Lowest Achieving schools. This is the PLA list.

The PLA list of schools was generated by a set of federally-approved and required rules that differ from our Top to Bottom ranking.

TTB VERSUS PLA

WHY ARE THE LISTS DIFFERENT?Top to Bottom PLA

Subjects included MathReadingWritingScienceSocial Studies

MathReading

Graduation rate? Yes NoComponents Achievement (1/2)

Improvement (1/4)Achievement gap (1/4)

Proficiency (2/3)Improvement (1/3)

Proficiency? Uses standardized measure of student performance (z-score)

Uses proficiency levels

High achieving schools? Calculation adjustments to avoid “ceiling effects”

No adjustment

Tiers? No tiers; all schools included

Tiers; Title I, AYP and school level considered

RESOURCES TO UNDERSTAND MY

RANKING

Complete list of all schools and their ranking Individual school look-up to see your school’s results Overview presentation with voice over FAQ Business rules by which the rankings were calculated Complete data file and validation file

You can access these resources at: http://www.michigan.gov/baa Click on “Michigan Schools Top to Bottom Ranking”

You can also request individual assistance by calling the Evaluation, Research and Accountability unit at 517-373-1342, or emailing mde-accountability@michigan.gov

RESOURCES AVAILABLE