PROGRESS&ACHIEVEMENTPennsylvania Value-Added Assessment System (PVAAS)The Power of School District
PDE Data Tools
PSSA Data Interactive by eMetricInteractive tool for analyzing PSSA data by district, school, grade, subgroup and student Reporting category information is also availablePVAASValue-added tool that reports growth of cohorts of students and projections for individual students for performance on future PSSAsPA AYPPublic site that reports all AYP related data on district, school, grade and subgroup - Reporting category information is also available4Sight Member CenterReporting site for benchmark data by grade, class, subgroup and student intended to be formative and used often throughout the school year
Stair-Step Expectations Grade Three Grade Four Grade Five Grade 3 Test Grade 4 Test Grade 5 TestIn a perfect world students would start school at about the same academic level. Proficiency levels could simply be achieved by students gaining age-appropriate knowledge and skills each year.
Differentiated Reality Grade Three Grade Four Grade FiveStudents begin school at different places; they often progress at different rates. Yet all students are expected to achieve the same level of academic proficiency each year. Grade 3 Test Grade 4 Test Grade 5 Test
The Need for Progress Measures Grade Three Grade Four Grade FiveTo measure school effectiveness in this differentiated world, we need to pay attention not only to proficiency levels, but also to how much progress students make in a given year. Grade 3 Test Grade 4 Test Grade 5 Test
PVAAS IS:Another tool for continuous school improvement A statistical analysis of existing assessment data (PSSA). A realistic measurement of a schools progress/growth over time.Not to be used in isolationProgress data to add to achievement data as schools are analyzing their work with students and making improvement plans.
PVAAS is NOT:Another Test
A measure for teacher accountability
The PVAAS MethodologiesTodayLooking Back/EvaluationValue-added Growth Reports For Cohorts of StudentsLooking Forward/PlanningPVAAS Projection Reports For Individual Students and Cohorts of Students
PVAAS Fall 2008 Reporting(math, rdg; wrtg; science: coming late fall)Value-added growth reports for grades 4 through 8, and 11 (Lasts years cohorts)
Projections to basic, proficient, advancedGrade last tested - 3 4 or 5 (future PSSAs)Grade last tested - 4 5 or 6 (future PSSAs)Grade last tested - 5 6 or 7 (future PSSAs)Grade last tested - 6 7 or 8 (future PSSAs)Grade last tested - 7 8 (future PSSAs)Grade last tested - 8 11 (future PSSAs)
Student ProjectionsWouldnt it be great to know the likelihood that a student will be proficient on afuture PSSA?
Student Projection MethodologyA separate longitudinal modeling process focused on the performance scores of individual students.
The model uses all of the available data (both math and reading) to project future PSSA performances in Math and Reading.
Projections can be calculated for an individual student or groups of students.
PVAAS Student Projection Report
Identified Students Meeting Search Requirements
Data Packets: Student Level
TimingSourceReportInitial Meeting Looking BackPSSA: eMetric/GROWIndividual Student ReportInitial Meeting Today4SightBaselineInitial Meeting Looking ForwardPVAASPVAAS ProjectionPeriodic Meetings (based on subject area and grade level)Examples:DIBELS4SightGRADEGMADECore PhonicsLocal FormativeAssessment
PVAAS Projections with Other Data:Elementary Scenario/ReadingStudent NOW in 5th Grade
PSSAGrade 4 Proficiency Range: 1255-146812104Sight BaselineGrade 5 Proficiency Range: 1275-14961200PVAAS ProjectionsTo Basic:To Proficient:To Advanced:93.6%64.8%5.5%DIBELSORFGrade 5 Low Risk104+ at beginning of year124+ at end of year89Some Risk
PVAAS Projections with Other Data:High School Scenario/MathStudent NOW in 9th Grade
PSSAGrade 8 Proficiency Range 1284-144514504Sight BaselineGrade 9 Proficiency Range 1304-15081507PVAAS Projections(11th Grade)To Basic:To Proficient:To Advanced:98.7%89.9%45.7%Grade 8 Final GradesFinal Exam: 91%Course Grade: 87%
What Does This Mean to You?
The district could provide you each with the probability of students in your classrooms (current grades 4-9)Grade level/course specific teams can collaborate to make sure adequate supports are in place for all students to reach success.
How could we use this information?For students with each level of probability of proficiency, what do we need to keep doing to keep at this level? What do we need to do to increase the level of probability?70-100% likelihood of proficiency what is our action plan?40-70% likelihood of proficiency what is our action plan? Goal date for proficiency?0-40% likelihood of proficiency what is our action plan? Goal date for proficiency?
Wouldnt it be great to know if we made one years growth with last years 4th, 5th, 6th, 7th, and 8th graders? 11th graders?Value-Added
Value-Added Measure of Cohort GrowthComparison to a State Growth Standard
The Growth Standard specifies the minimal designated academic gain from grade to grade for a cohort of students.
The use of a Growth Standard creates the possibility that ALL schools can demonstrate appropriate growth.
PVAAS Value-added CohortGrowth Descriptors
Caution IndicatorEstimated gain below growth standard but by less than one standard error.Students in this cohort have grown less than the standard.
Stronger CautionEstimated gain below growth standard by more than one but less than two standard errors.Students in this cohort have fallen behind their peers.
Strongest WarningEstimated gain well below growth standard by more than two standard errors.Students in this cohort have made little progress.
Favorable IndicatorEstimated gain at or above growth standard. Students in this cohort have made at least one year growth.All schools can achieve this rating.
PVAAS School ReportGrades 4 through 8Every grade in the school has met or exceeded a years worth of growth?
(Getting Results!, p. 12)
11th Grade Growth Descriptors
BelowObserved performance is significantly BELOW the expected performance.NDDObserved performance is NOT DETECTABLY DIFFERENT than the expected performance.AboveObserved performance is significantly ABOVE the expected performance.
Grade 11 School Report
Every performance levels (below basic, basic, proficient, advanced) in each grade has met or exceeded a years worth of growth?
(Getting Results!, p. 12)Performance Diagnostic Report
What the whiskers tell usGrowth Standard (One Years Growth)Met the Growth Standard;Made One Years Growth Yellow
Below Growth Standard;Less than One Years GrowthRoseExceeded Growth Standard;More than One Years GrowthGreen
Every performance level (below basic, basic, proficient, advanced) in each grade has met or exceeded a years worth of growth?
(Getting Results!, p. 12)Patterns: Performance Diagnostic Report
Patterns of GrowthABC
What Does This Mean to You?
The district could provide each grade level/course specific team with their growth reportsGrades 4-8, and 11 (Lasts years cohorts)Subgroup reporting
How could we use this information?At a grade level/course specific team, discuss why and how you may have gotten the growth results on the report?Which students made a years worth of growth?Which did not?Why? Why not?What is our teams plan of action as a grade level/course specific team?
Where do we go from here?How do we plan to use our PVAAS data this next month? This school year?Value-added reportsDiagnostic reportsStudent projections
How do we plan to share our PVAAS data?With other Administrators?With Teachers?With Parents?With Others?
District Goal: PVAAS will be used by teachers and administrators for annual school evaluation and planning, grade/subject level evaluation and planning, and for student level planning.
Data Packet: Annual School-Level Analysis
QuestionToolReport1) School Met AYP?PAAYPPerformance Chart2) Every Grade Met AYP?eMetric3-Year Portrait3) Every Grade Met Growth Standard?PVAASSchool Value-added Report4) Every Grade 3 Year Trend Change in Proficiency?eMetric3-Year Portrait5) Every Predicted Performance Level Met Growth Standard?PVAASPerformance Diagnostic Report6) Every Subgroup Met AYP?eMetric3-Year Portrait7) Achievement Gap Narrower?eMetric3-Year Portrait8) Every Grade Projected To Meet AYP Target?PVAASGrade Projection Summary 9) School and Subgroups Met Participation Targets?PAAYPData Table
10) Every Subgroup Met Growth Standard?PVAASPerformance Diagnostic Report11) Subgroups Performed Similarly in Reporting Categories?eMetric3-Year Portrait
Data Packets: Grade Level
TimingSourceReportInitial Meeting Looking BackeMetriceMetricPVAASPVAASeMetric/PVAASPerformance LevelsReporting CategoriesValue Added ReportPerformance Diagnostic ReportPSSA/ PVAAS ScatterplotsInitial Meeting Looking ForwardPVAAS4Sight Baseline4Sight BaselineProjection Summary ReportPerformance LevelsSubscale ReportsInitial Meeting Subgroup ComparisonsSame as aboveSame as abovePeriodic Meetings4Sight4SightLocal FormativeAssessmentPerformance LevelsSubscale Reports
Data Packets: Student Level
TimingSourceReportInitial Meeting Looking BackPSSA: eMetric/GROWIndividual
Click here to load reader