Date post: | 21-Jun-2015 |
Category: |
Education |
Upload: | evanguilder |
View: | 568 times |
Download: | 1 times |
PVAAS and PVAAS Teacher Specific Reporting
Erin Van GuilderAntietam School District
Goal of Session
By the end of the session, participants will be able to answer the following questions:
1. What is PVAAS and how is it a part of the Teacher Effectiveness Model?
2. How does PVAAS measure growth?3. What does PVAAS tell us about growth in our district and
school(s)?4. What is PVAAS Teacher Specific Reporting?5. How Specific Reporting is Determined for a Teacher?6. What and when is Roster Verification?
4
PVAAS Teacher Reporting Implementation Timeline
THE CONCEPT OF PVAAS GROWTH AND MEASURING GROWTH METHODOLOGY
F2F Overview 2013 7
PVAAS Analyses
PSSA Writing
Keystone Exams:
Algebra I, Biology,
Literature
PSSA Science
PSSA Reading
PSSA Math
2. LOOKING AHEADPlanning for
Students’ Needs:Student Projections
to Future Tests
1. LOOKING BACKEvaluating School
Effectiveness:Value Added &
Diagnostic Reports
PVAAS 2 Reporting Categories
8
LOOKING AHEADLOOKING
BACK
How much growth did groups of students make in the past school year?
PVAAS…a Growth and Projections Model
PVAAS Academic Growth does NOT…
Does NOT Does NOT
PVAAS Academic Growth is
• PVAAS Growth provides a measure of the growth of a teacher’s group of students
Where does the PVAAS Growth Measure come from?
Testing Subject-Grades
Methodologies
Measurement
Assessment in Consecutive Years
Math, 4-8Reading, 4-8
Growth Standards
Growth in Math and Reading
Assessments not in Consecutive Years
Writing, 5 & 8
Science- 4&8
Keystones- Algebra 1, Biology, Literature
Predictive Predicted scaled score based on each students’ academic assessment history across subjects
F2F Overview 2013
Prior Achievement for GroupHigher Achievement
Concept of Measuring Growth in PVAAS
Lower Achievement
13
• For grades 4-8, Math and Reading - represents the mean achievement level of the group of student
• For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students
F2F Overview 2013
Prior Achievement for GroupHigher Achievement
Concept of Measuring Growth in PVAAS
Lower Achievement
14
• For grades 4-8, Math and Reading - represents the mean achievement level of the group of student
• For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students
Most Recent School Year for Group
Higher Achievement
Lower Achievement
F2F Overview 2013
Prior Achievement for GroupHigher Achievement
Concept of Measuring Growth in PVAAS
Lower Achievement
15
• For grades 4-8, Math and Reading - represents the mean achievement level of the group of student
• For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students
Most Recent School Year for Group
Higher Achievement
Lower Achievement
F2F Overview 2013
Prior Achievement for GroupHigher Achievement
Concept of Measuring Growth in PVAAS
Lower Achievement
16
• For grades 4-8, Math and Reading - represents the mean achievement level of the group of student
• For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students
Most Recent School Year for Group
Higher Achievement
Lower Achievement
F2F Overview 2013
Prior Achievement for GroupHigher Achievement
Concept of Measuring Growth in PVAAS
Lower Achievement
17
• For grades 4-8, Math and Reading - represents the mean achievement level of the group of student
• For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students
Most Recent School Year for Group
Higher Achievement
Lower Achievement
F2F Overview 2013
Prior Achievement for GroupHigher Achievement
Concept of Measuring Growth in PVAAS
Lower Achievement
18
• For grades 4-8, Math and Reading - represents the mean achievement level of the group of student
• For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students
Most Recent School Year for Group
Higher Achievement
Lower Achievement
F2F Overview 2013
Regardless of the entering achievement level of the group…
19
F2F Overview 2013
Regardless of the entering achievement level of the group…
• Students should not lose ground academically
20
F2F Overview 2013
Regardless of the entering achievement level of the group…
• Students should not lose ground academically
• A reasonable goal would be to at least maintain the achievement level of the group
21
F2F Overview 2013
Regardless of the entering achievement level of the group…
• Students should not lose ground academically
• A reasonable goal would be to at least maintain the achievement level of the group
• All groups of students can make growth
22
PVAAS Value-AddedGrowth Measures Reading and Math 4-8
The Growth Measure is NOT reported in years and cannot
be referenced in terms of number of year’s growth.
1000 1100 1200 1300 1400 1500 Scale Score Points
0 10 20 30 40 50 60 70 80 90 100NCE Units
Growth is measured in Normal Curve Equivalent (NCE) units as scale scores cannot be compared from grade to grade and year to year.
The Growth Measure is NOT reported in percentages and cannot be referenced in terms of an increase or decrease in percentage points.
PVAAS Value-Added Growth Measures - Science, Writing and Keystones
• Growth is measured in scale score points.
• The Growth Measure is NOT reported in years and cannot be referenced in terms of number of year’s growth.
• The Growth Measure is NOT reported in percentages and cannot be referenced in terms of an increase or decrease in percentage points.
TEACHER SPECIFIC REPORTING
What is PVAAS teacher-specific reporting?
• Estimates the effect of a teacher’s performance on the academic growth of a group of students.
• Taking into account both their endpoint and their entering achievement level.
• By concentrating on growth, PVAAS puts the emphasis on what educators can influence.
26
Purpose of PVAAS Teacher Specific Reporting
• To inform teaching practice in order to guide replication, changes,
or
• adjustments of teaching practices for continual professional growth.
Who does this affect?
A PA certified educator with full or partial responsibility for content
specific instruction of the assessed eligible content as measured by a PA
state assessment
Face to Face Online Instruction28
PVAAS Teacher Reporting: Teachers in Which Tested Grades/Subjects/Courses?
• PSSA: With/Without Accommodations (Not PASA)– Grades 4-8: Reading and Math– Grades 4 & 8: Science– Grades 5 & 8: Writing
• Future: Transition into ELA Assessment• Courses Culminating in Keystone Exams:
With/Without Accommodations– Algebra I– Literature– Biology
Approximately 30-40% of your teaching staff will be eligible
for a PVAAS teacher specific
score
29
What is content-specific instruction?
• Content Specific Instruction: When a teacher(s) has the responsibility to
• plan the instruction of the assessed eligible content,• provide the instruction of the assessed eligible content,• use the assessment information to evaluate the
effectiveness of the instruction of the assessed eligible content on a PA state assessment.
Defined on the Framework for Teaching by both Domains 1 and 3
Special education teachers, intervention specialists, reading/math specialists, ESL teachers, and gifted teachers are eligible for a
PVAAS score
30
HOW DOES TSR GET COMPUTED?
An Example
Teacher Specific Reporting Example: Mrs. Smith’s Class
Students not included in Teacher Specific Reporting
New Terms: % Instructional Responsibility
% Student + Teacher Enrollmen
t
Full or Partial %
of Instructio
n• This % is your total Instructional Responsibility
for a student. • This % reflects how much the student will be
weighted in the PVAAS analyses.• The % Instructional Responsibility is
calculated by multiplying the (% Student + Teacher Enrollment) by (Full or Partial % of Instruction).
% Instructional Responsibility
34
Calculating: % Student + Teacher Enrollment
% Student + Teacher Enrollmen
t
What proportion of the
grade/subject/course are the student and teacher concurrently
enrolled?
Day 1
Day 140Last Day
Before Testing Window
Grade/Subject/Course
Student Enrolled
Teacher Enrolled
% Student + Teacher Enrollment =
Concurrent Enrollment 35
Calculating: Full or Partial % of Instruction
Full or Partial % of Instruction
Full % of Instruction = 100%
Are you the only PA certified educator responsible for the content-specific instruction (Domains 1 and 3) of the
assessed eligible content in the grade/subject/course?
YES NO
Partial % of Instruction = <100%Proportion of responsibility for the content-specific instruction of the assessed eligible content
in the grade/subject/course (Domains 1 and 3)
36
Mrs. Smith’s % Instructional Responsibility The Total % Instructional Responsibility for Each Student
New # of Students in the TSR Group
Mrs. Smith’s Class
Actual # of Students
Instructional Responsibility of the actual # of students
TEACHER VERIFICATION
Teachers, school administrators and district administrators verifying data that is used to yield PVAAS teacher specific reporting– data that will ultimately be used as part of a teacher’s evaluation.
The PVAAS rosters are prepopulated from the
PIMS Course/HQT submitted by LEAs to PIMS (Student, Staff,
Course Templates)
What is this Verification process all about?
40
SY13-14 PVAAS Roster Verification Timeline
3 New Terms
42
Access to Teacher Specific Reporting
What does my District or School Admin see?
• The same PVAAS data and reporting for an individual teacher that a teacher can see
• No additional data or reporting on any individual teacher!
School Admin. can also:• See a District/School Teacher Summary for
quick access by school/ grade/ subject/ course
• Search to locate an individual teacher’s report
• Will PVAAS teacher‐specific reporting be reported publicly?– Act 82 states that “An employee's
individual rating form shall not be subject to disclosure
– Reference: Act of February 14, 2008 (P.L. 6, No.3), known as the "Right‐to‐Know Law." PDE will follow the law on non‐disclosure.
Support and Next Steps
Next Steps- Fall TrainingTypes of Reports for Teacher• Resources and Supports
LEA DATA TO PVAAS TEACHER SPECIFICREPORTING
ROSTER VERIFICATION: