Date post: | 19-Jan-2016 |
Category: |
Documents |
Upload: | sophie-woodhull |
View: | 214 times |
Download: | 1 times |
1
Module 2
Using DIBELS Next Data: Identifying and Validating
Need for Support
Objectives
Understand how to interpret and use DIBELS data to identify and validate need for support
Systems level
School or District Overview Report
Student level
Classroom Reports
2
3
Outcomes-Driven Model
Steps 1 & 2: Identify and Validate
Need for Support
ODM Step 1. Identify Need for Support
4
ODM StepODM Step Question(s)Question(s) DataData
1. Identify Need for Support
System: Are there students who may need support? How many students may need support?
Student: Which students may need support?
School or District Overview, Box Plot, Histogram, District Norms
Classroom, Group or Grade-Level Report, Student Benchmark Assessment History
2. Validate Need for Support
System: Are we confident in the accuracy of our data overall?
Student: Are we confident that the identified students need support?
School or District Overview, Box Plot, Histogram
Classroom, Group or Grade-Level Report, Student Benchmark Assessment History
3. Plan and Implement Support
System: What is our system-wide plan for support? What changes are needed in the plan to address the identified system needs? What are our system goals?
Student: What is the plan of support for each student, including goals and progress monitoring plan?
School or District Overview, Box Plot, Histogram
Student booklets, additional diagnostic assessment, Initial Grouping Suggestions
4. Evaluate and Modify Support
System: Are the majority of students making adequate progress? Are we making progress toward system goals?
Student: Is the support effective for individual students?
School or District Overview, Box Plot, Histogram, Status Report, Effectiveness of Instructional Support Levels
Student Progress Monitoring Report
5. Review Outcomes
System: What proportion of students have met benchmark goals? Have we met our system-wide goal?
Student: Have individual students met their goals?
School or District Overview, Box Plot, Histogram
Effectiveness of Instructional Support Levels, Multi-Year Percent at Benchmark, Status Report
Student Progress Monitoring Report
Step 1: Identify Need for Support: Overview
Systems Level
Is the system of support generally effective tosupport most students to reach reading outcomes?
Determined by percent of students who reach benchmark goals
If a large proportion of students score below the benchmark, system-level support may be necessary
Student Level
Is the student likely to need more or different instruction to reach reading outcomes?
Determined by each student’s score relative to benchmark goals
5
Are There Students Who Need Instructional Support?
School or District Overview Report
Summarizes percent of students whose scores fall at/above, below, or well below the benchmark goal
Includes all of the measures used in that grade at that time of the year
6
Sample School Overview Report
7
8
Sample School Overview ReportFall of 1st Grade – Happy Valley School
Sample School Overview Report
Start with the Composite Score; it is the best overall predictor of outcomes.
In terms of overall early literacy skills, are most students on track to achieve literacy outcomes?
Approximately how many students may need additional instructional support?
9
Are There 1st Graders Who Need Support at Happy Valley School?
In terms of overall early literacy skills, 56% of students have scores at/above the benchmark on the composite score at the beginning of first grade.
Approximately 44% of students may need additional instructional support.
Of these, 15% may need strategic support; 29% may need intensive support.
10
11
On Which Basic Early Literacy Skill(s) Might Students Need Support?
On Which Basic Early Literacy Skill(s) Might Students Need Support?
40% of students may need support in acquiring phonemic awareness skills (% below and well below benchmark on PSF).
Of these, 8% of students have scores below the cut point and may need intensive support.
42% of students may need support in learning/becoming fluent in applying knowledge of letter sounds (% below and well below benchmark on NWF-CLS).
Of these, 14% of students have scores below the cut point and may need intensive support.
35% of students may need support in applying knowledge of letter sounds in fluently blending/decoding unknown words (% below and well below benchmark on NWF-WWR).
No cut point for risk at this benchmark period. 12
Are There Students Who Need Instructional Support?
Is the next step to analyze and improve core reading instruction at Tier 1 or to plan Tier 2?
13
Overall, too many 1st graders are not on track
35-42% of students are not on track, which is not a reasonable percent for which to plan Tier 2 supports
On which skills will students need support in Tier 1?
14
Sample School Overview ReportFall of 4th Grade – Happy Valley School
Sample School Overview ReportFall of 4th Grade
Composite Score is the best overall predictor of outcomes.
In terms of overall reading skills, are most students on track to achieve reading outcomes? Approximately how many students may need additional instructional support?
15
*Percents rounded to nearest whole number
*
Are There 4th Graders Who Need Support at Happy Valley School?
In terms of overall early literacy skills, 66% of students have scores at/above the benchmark on the composite score at the beginning of first grade.
Approximately 34% of students may need additional instructional support.
Of these, 13% may need strategic support; 21% may need intensive support.
16
17
On Which Basic Early Literacy Skill(s) Might Students Need Support?
On Which Basic Early Literacy Skill(s) Might Students Need Support?
Accurate, fluent, reading for meaning
36% of students may need additional instructional support in accurate reading of connected text (% below and well below benchmark on Accuracy).*
44% of students may need additional instructional support in fluent reading of connected text (% below and well below benchmark on WC).*
34-44% of students may need additional instructional support in reading comprehension (% below and well below benchmark on Composite Score, WC, Retell and/or Daze).*
18
* Note: These may not be the same students; it is important to use each student’s specific scores and pattern of scores across measures to make individual instructional decisions.
Small Group Activity: Identify Need for Support at the System Level
Divide into groups of 2-3
Use your school’s data to respond to the following questions. If you do not have your own data, select either First Grade or Fourth Grade at Sunset School.
Summarize what the data indicate about need for support at the systems level. On which basic early literacy skills might students need support?
What are the implications for curriculum and instruction for students in first and fourth grade at the beginning of the school year?
19
Small Group Activity: School OverviewSunset School – First Grade BOY
20
Small Group ActivitySunset School – First Grade BOY
In terms of overall early literacy skills, are most students at the beginning of first grade on track to achieve literacy outcomes? Approximately how many students may need additional instructional support?
In terms of overall early literacy skills, % of students have scores at or above the benchmark for the Composite Score and are on track to achieve subsequent reading outcomes.
% of the first graders may need instructional support to achieve future reading outcomes.
21
49
51
Small Group ActivitySunset School – First Grade BOY
22
On which basic early literacy skills might students need support?
50% of students may need additional instructional support in acquiring phonemic awareness skills(% below and well below benchmark on PSF).
40% of students may need support in learning/becoming fluent in applying knowledge of letter sounds (% below and well below benchmark on NWF CLS).
52% of students may need support in applying knowledge of letter sounds in fluently blending/decoding unknown words (% below Benchmark on NWF WWR).
Small Group ActivitySunset School – First Grade BOY
23
What are the implications for curriculum and instruction?
Need for strong core program in phonemic awareness/basic phonics, differentiated instruction
Small Group Activity: School OverviewSunset School – Fourth Grade BOY
24
Small Group Activity – Fourth Grade
25
In terms of overall reading skill, are most students at the beginning of fourth grade on track to achieve reading outcomes? Approximately how many students may need additional instructional support?
In terms of overall reading skill, 65% of students have scores at or above the benchmark for the Composite Score and are on track to achieve subsequent reading outcomes.
36% of the fourth grade students may need instructional support to achieve future reading outcomes.
Small Group Activity – Fourth Grade
26
On which basic early literacy skills might students need support?
37% of students may need additional instructional support in accurate reading of connected text (% below and well below benchmark on Accuracy).*
37% of students may need additional instructional support in fluent reading of connected text (% below and well below benchmark on WC).*
25-55% of students may need additional instructional support in reading comprehension (% below and well below benchmark on Composite Score, WC, Retell and/or Daze).*
* Note: These may not be the same students; it is important to use each student’s specific scores and pattern of scores across measures to make individual instructional decisions.
Small Group Activity – Fourth Grade
What are the implications for curriculum and instruction?
•Differentiated small group instruction in advanced phonics and reading comprehension
•Differentiation of text that students are asked to read for comprehension
•Daily fluency practice for all students in text that students can read accurately
27
Identify Need for Support at the System Level: Summary
The system is the context. An effective system of support is critical to effective implementation of DIBELS®.
Percent of students who need support determines next steps
If more than 20% of students may need additional support to achieve goals, an important first step is to analyze core curriculum and instruction (Tier 1).
How could core instruction be more effective and better matched to the needs of the students in each grade?
28
ODM Step 2: Validate Need for Support
29
ODM StepODM Step Question(s)Question(s) DataData
1. Identify Need for Support
System: Are there students who may need support? How many students may need support?
Student: Which students may need support?
School or District Overview, Box Plot, Histogram, District Norms
Classroom, Group or Grade-Level Report, Student Benchmark Assessment History
2. Validate Need for Support
System: Are we confident in the accuracy of our data overall?
Student: Are we confident that the identified students need support?
School or District Overview, Box Plot, Histogram
Classroom, Group or Grade-Level Report, Student Benchmark Assessment History
3. Plan and Implement Support
System: What is our system-wide plan for support? What changes are needed in the plan to address the identified system needs? What are our system goals?
Student: What is the plan of support for each student, including goals and progress monitoring plan?
School or District Overview, Box Plot, Histogram
Student booklets, additional diagnostic assessment, Initial Grouping Suggestions
4. Evaluate and Modify Support
System: Are the majority of students making adequate progress? Are we making progress toward system goals?
Student: Is the support effective for individual students?
School or District Overview, Box Plot, Histogram, Status Report, Effectiveness of Instructional Support Levels
Student Progress Monitoring Report
5. Review Outcomes
System: What proportion of students have met benchmark goals? Have we met our system-wide goal?
Student: Have individual students met their goals?
School or District Overview, Box Plot, Histogram
Effectiveness of Instructional Support Levels, Multi-Year Percent at Benchmark, Status Report
Student Progress Monitoring Report
ODM Step 2: Validate Need for SupportSystem Level
Before moving forward to plan instruction, scan the system level data:
Are we reasonably confident that the data were collected accurately?
Did all assessors receive adequate training and practice?
Did we conduct accuracy checks and/or shadow scoring?
Are there inconsistencies in the pattern of data?
What data can you use?
• Assessment Accuracy Checklists
• Shadow Scoring Documentation30
Assessment Accuracy ChecklistsDIBELS Next Assessment Manual
31
Look for Patterns in the Data
Data of one grade does not fit the pattern of other grades in the school.
Data of one classroom does not fit the pattern of other classrooms at that grade.
Data collected by one assessor does not fit the pattern of that collected by the rest of the team.
Data on a measure does not fit the pattern of data on other measures at the grade level at that time.
32
ODM Step 1. Identify Need for Support
33
ODM StepODM Step Question(s)Question(s) DataData
1. Identify Need for Support
System: Are there students who may need support? How many students may need support?
Student: Which students may need support?
School or District Overview, Box Plot, Histogram, District Norms
Classroom, Group or Grade-Level Report, Student Benchmark Assessment History
2. Validate Need for Support
System: Are we confident in the accuracy of our data overall?
Student: Are we confident that the identified students need support?
School or District Overview, Box Plot, Histogram
Classroom, Group or Grade-Level Report, Student Benchmark Assessment History
3. Plan and Implement Support
System: What is our system-wide plan for support? What changes are needed in the plan to address the identified system needs? What are our system goals?
Student: What is the plan of support for each student, including goals and progress monitoring plan?
School or District Overview, Box Plot, Histogram
Student booklets, additional diagnostic assessment, Initial Grouping Suggestions
4. Evaluate and Modify Support
System: Are the majority of students making adequate progress? Are we making progress toward system goals?
Student: Is the support effective for individual students?
School or District Overview, Box Plot, Histogram, Status Report, Effectiveness of Instructional Support Levels
Student Progress Monitoring Report
5. Review Outcomes
System: What proportion of students have met benchmark goals? Have we met our system-wide goal?
Student: Have individual students met their goals?
School or District Overview, Box Plot, Histogram
Effectiveness of Instructional Support Levels, Multi-Year Percent at Benchmark, Status Report
Student Progress Monitoring Report
Step 1: Identify Need for SupportStudent Level
Which Students May Need Support?
The Classroom or Instructional Group Report provides information on individual students at a given assessment period. The Classroom Report includes all the students from one class.
The Classroom Report shows:
The student’s score on each measure and on the DIBELS Next® composite.
The likely need for support category (i.e., Needs Core, Strategic, or Intensive Support) for the student’s score on each measure and on the composite.
Percentile ranks for the student’s score on each measure to show the student's performance in relation to all participating students in the district.
34
Sample Classroom ReportBeginning of First Grade
35
Which Students Need Support?
Which students are below or well below the benchmark goal for the DIBELS® Composite Score?
Which students are below or well below the benchmark goal on one or more of the DIBELS Next® measures given at this time of the year?
Are there any otherstudents you areconcerned about(e.g., childrenjust above thecutoff, childrenwho performinconsistentlyin class)?
36
Sample Classroom ReportLakeside School – First Grade BOY
Which students score below or well below the benchmark on the Composite?
37
Which students score below or well below the benchmark goal on one
or more of the DIBELS Next®
measures given at this time of the year?
Wireless Generation mCLASS:DIBELS Sample Classroom Report
38
ODM Step 2: Validate Need for Support
39
ODM StepODM Step Question(s)Question(s) DataData
1. Identify Need for Support
System: Are there students who may need support? How many students may need support?
Student: Which students may need support?
School or District Overview, Box Plot, Histogram, District Norms
Classroom, Group or Grade-Level Report, Student Benchmark Assessment History
2. Validate Need for Support
System: Are we confident in the accuracy of our data overall?
Student: Are we confident that the identified students need support?
School or District Overview, Box Plot, Histogram
Classroom, Group or Grade-Level Report, Student Benchmark Assessment History
3. Plan and Implement Support
System: What is our system-wide plan for support? What changes are needed in the plan to address the identified system needs? What are our system goals?
Student: What is the plan of support for each student, including goals and progress monitoring plan?
School or District Overview, Box Plot, Histogram
Student booklets, additional diagnostic assessment, Initial Grouping Suggestions
4. Evaluate and Modify Support
System: Are the majority of students making adequate progress? Are we making progress toward system goals?
Student: Is the support effective for individual students?
School or District Overview, Box Plot, Histogram, Status Report, Effectiveness of Instructional Support Levels
Student Progress Monitoring Report
5. Review Outcomes
System: What proportion of students have met benchmark goals? Have we met our system-wide goal?
Student: Have individual students met their goals?
School or District Overview, Box Plot, Histogram
Effectiveness of Instructional Support Levels, Multi-Year Percent at Benchmark, Status Report
Student Progress Monitoring Report
Validate Need for Support at theStudent Level
What do you need to know?
Are we reasonably confident the studentneeds instructional support?
Rule out easy reasons for unexpected performance: bad day, confused on directions or task, ill, shy, or error in assessment administration
What data can you use?
Any additional available assessment data
Repeat DIBELS Next®assessments using progress
monitoring booklets.
General guideline: At least 2 more times, not on the same day but within 1 week
40
Are We Confident the Student Needs Additional Instructional Support?
41
Validate Need for Support
Verify need for instructional support by retesting with alternate forms until we are reasonably confident.
42
Luke
Davis
Happy Valley
24114
Sept66
108,105
BOY Cut Point
BOY Benchmark
Validate Need for Support
Verify need for instructional support by retesting with alternate forms until we are reasonably confident.
43
Miriam
Davis
Happy Valley
24125
Sept68
65,60
BOY Cut Point
BOY Benchmark
What is the Next Step?
What decisions have we made?
Identified and validated need for support at a systems level
Identified and validated need for support for individual students
What do we do next?
44