Data for Student Success MACUL
March, 2011“It is about focusing on building a culture of quality data
through professional development and web based dynamic inquiries for school improvement.”
Session Description
• This session will support schools in understanding the inquiry tools to access data needed for the continuous school improvement process.
Outcomes
• Understand Data for Student Success• Understand the Professional Development modules and
their basic content• Connection to Continuous School Improvement Process• Understand the Inquiry Tool• Understand the data dig process
Understand Data for Student Success
Overview
• Federal Title II Part D of the NCLB Act of 2001 Enhancing Education through Technology Grant awarded through CEPI
• Awarded to Calhoun ISD in partnership with Macomb ISD and Shiawassee RESD
• Beginning date: January 1, 2007
Goals of Data for Student Success
• Build and bring to scale a program that helps schools develop cultures of quality data in which there are consistent and sustained efforts to:
• Identify critical questions whose answers would benefit school districts in decision making to inform instruction
• Provide inquiries designed around the critical questions• Provide focused professional development on data-
based decision making• Provide a scaffold of support for the CNA and High
Priority Schools
Collaboration: Why?
• “Schools that explore data and take action collaboratively provide the most fertile soil in which a culture of improvement can take root and flourish.”
"The Collaborative Advantage." Educational Leadership Dec/Jan (2009)
Who should collaborate?
• Curriculum• Technology • Special Education• Principals• Superintendent • School Improvement Team• Leadership Team
Professional Development is Critical
Using Data to Improve Student Achievement Modules
• Using State Data to Identify School Improvement Goals
• Using School Data to Clarify and Address the Problem
• Examining Student Work to Inform Instruction
• Using Classroom Data to Monitor Student Progress
For more detailed information please go to www.data4ss.org
www.data4ss.org
Understand the Professional Development modules and their basic
content
Understand the Professional Development modules and their basic content
• There are 10 Modules that are tool-independent– They can be used with local warehouses and
the Data 4SS Inquiry tool• All professional development resources
provide a scaffold – To model the data analysis process– To give districts ownership of their data
Understand the Professional Development modules and their basic content
• Each professional development module will utilize the following tools:– In depth focus questions to help determine
outcomes– PowerPoint presentations to guide the
workshop– Worksheets for participants– Facilitation guides
StudyAnalyze Data
Set Goals Set Measurable Objectives
Research Best PracticeDo
Implement Plan Monitor PlanEvaluate Plan
PlanDevelop Action
Plan
GatherGetting ReadyCollect DataBuild Profile
StudentAchievement
StudyAnalyze Data
Set Goals Measurable ObjectivesResearch Best Practice
School Improvement Planning Process
Understand the Inquiry Tool
Let’s investigate the Dynamic Inquiry tool…
• All data mining efforts must be based on inquiry – asking the right questions, and then asking more questions of the answers in order to make informed decisions.
• “Data-driven decision making does not simply require good data; it also requires good decisions.”
"The New Stupid." Educational Leadership Dec/Jan (2009)
• “The essential-questions approach provides the fuel that drives collaborative analysis.”“Answering the Questions that Count." Educational Leadership Dec/Jan (2009)
Dynamic Inquiry Tool
• Inquiries based on essential questions, aligned with the school improvement process, that allow for drill down into student data
Dynamic Inquiry Tools• MEAP
– Proficiency– Students Near Proficiency– Comparative Item Analysis– Cohort Proficiency– Admin Review
• MME– Proficiency– Students Near Proficiency– Standard Analysis
• MI-Access– Proficiency– Students Near Proficiency
• CNA Report• PA25 Report• Student History
MEAP Proficiency Inquiry
“How did students perform on MEAP tests by content area, strand, and GLCE?”
“How did students perform in relation to our school improvement goal?”
MEAP Proficiency - All Students
MEAP Proficiency - Statistical Information
MEAP Proficiency - Student Drill Down
Students Near Proficiency Inquiry
“What are the demographic characteristics of students who are close to being proficient on a specified test?”
“How well did those students perform by strand, GLCE, and comment codes?”
Cohort Proficiency Inquiry
“What is the evidence of one year’s growth for one year of instruction?”
(this is one of the tools to support the new requirements)
Comparative Item Analysis Inquiry
“How did student performance within a district or building or ISD compare to the State?”•The comparative item analysis inquiry also answers the following question: “How did we do in comparison to the state on
items/GLCE in a strand?” •Will help to identify curriculum and teaching areas that may need adjustment
Assessing Your Culture of Quality Data
Regional Data Initiative
• ISDs collaborating on the use of data tools for school improvement
How do Data4SS and local data warehousing tools work together?
• Together they provide the ability to triangulate data from multiple sources– Both provide non-negotiable state data
• Data4SS is based on enrollment at time of MEAP • Local warehouse is based on live/current enrollment
– Local warehouse provides analysis of district required assessments
– Local warehouse provides analysis of classroom performance data
– Local warehouse provides frequent systematic monitoring for growth to avoid unexpected results
How do Data4SS and local data warehousing tools work together?
• How does your data warehouse complement the Data 4SS Inquiries?– Frequently monitor student achievement
using local assessment data– Monitor groups of students to identify
trends based on state and local assessments as well as other data such as involvement in various programs
Local Warehouse Example:
8th Grade Math MEAP
compared to 9th Grade Algebra
GradeNext Question: What area of 8th
grade math curriculum
needs to be reviewed?
Data Security: Resources
• Maintaining Confidentiality Activities on Data for Student Success web site outline best practices and provide resources for addressing data security. www.data4ss.org
Why? FERPA/HIPPA
• Family Educational Records and Privacy Act (FERPA) and the Health Insurance Portability and Access Act (HIPAA)– Confidentiality and protection of student’s
data, including educational record and directory information
What about Free/Reduced Lunch?
• 2008 Memo: Reaffirmation of Policy on Limited Disclosure of Children‘s Eligibility Information to the National Assessment of Educational Progress (NAEP):– “….school food authorities may disclose children’s
names and eligibility status to persons directly connected with the administration or enforcement of State educational assessment programs to the extent that the State assessment is part of the NAEP or the assessment program is established at the State, not local level.”
– “This does not imply that these persons have routine access to participants' eligibility status. There must be a ‘need to know’”
Understand the data dig process
Activity Objectives
• This activity is designed to begin the data mining process.
• This activity enables schools to identify percent proficient in ELA and Math in a clear and concise chart.
• Using the AYP targets provides a way to compare school results to the proficiency targets.
• This activity is not to be used to determine if the school has made AYP.
Dynamic Inquiry Tool
• Inquiries based on essential questions, aligned with the school improvement process, that allow for drill down into student data
• Gather• Module: Using State Data to
Identify School Improvement Goals
MEAP Proficiency Inquiry
How did students perform on MEAP tests by content area, strand, and GLCE?
How did students perform in relation to our School Improvement Goal?
Building: Content Area Proficiency
• Building: Content Area Proficiency – Procedure
• Using the template and handouts provided, record data for math
– Determine AYP target at building and grade level– Record on template– Use MEAP Proficiency – All grades, individual– Record data on template
• Select a highlighter– Highlight those areas above the AYP target– Choose a different color highlighter – highlight those areas
below the AYP target
Data Dig
• Demo site used to complete the data dig for reading and math– www.data4ss.org
• “Dynamic Inquiries” button• “Access the Dynamic Inquiry Tool” link
– Login• Username: demo_test1• Password: fall_01
Data Dig
What would be the questions to ask based on the data?
What do we need to know more about?
Overall Building Sub-Group Level Achievement
• Overall Building Sub-Group Level Achievement– Procedure
• Using the template and handouts provided, record data for math
– Use the building AYP target– Record on template– Use MEAP Proficiency – AYP Groups and Other Groups
– all grades, individual– Record data on template
• Select a highlighter– Highlight those areas above the AYP target– Choose a different color highlighter – highlight those
areas below the AYP target
Data Dig
• Demo site data used to complete the data dig to the sub-group level for math and reading
Data Dig
What would be the questions to ask based on the data?
What do we need to know more about?
Data Dig for a School Team to Focus
• Based on data– What content area has the greatest need?– What subgroup has the greatest need?– What grade level has the greatest need?– Are we meeting our SI goals/objectives?– What interventions were put in place?– How will we know they are effective?
• Module: Creating Conditions for Professional Learning
Reading
Comparative Item Analysis
66
Comparative Item Analysis
– Procedure• Using the template provided, record Grade Level
Content Expectations – Determine strand to explore– Record strand– Determine GLCE with 10% or more below state average– Record GLCE on template
• Prioritize GLCE of challenge
– Module: Using Classroom Data to Monitor Student Progress 67
Comparative Item Analysis Reading Comprehension Across Grade Levels
Grade Level Content Expectation of Greatest Concern
• R.CM.05.01, 06.01, 07.01 - connect personal knowledge, experiences, and understanding of the world to themes and perspectives in text through oral and written responses.
• R.CM.05.02, 06.02, 07.02 - retell through concise summarization grade-level narrative and informational text.
• R.CM.05.03, 06.03, 07.03 - analyze global themes, universal truths, and principles within and across text to create a deeper understanding by drawing conclusions, making inferences, and synthesizing.
College and Career Readiness Anchor Standard for Reading
Key Ideas and Details1. Read closely to determine what the text says explicitly
and to make logical inferences from it; cite specific textual evidence when writing or speaking to support conclusions drawn from the text.
R.CM.06-08.02R.CM.06-08.03
2. Determine central ideas or themes of a text and analyze their development; summarize the key supporting details and ideas.
R.CM.06-08.02R.CM.06-08.03
Intervention and monitoring• Based on the data
– Unwrap the GLCE of greatest concern• Identify knowledge and skills
– Curriculum - Delivered with effective core instruction• All students receive – all students as learners
– Strategy• Core instruction and above and beyond – not supplant
– Intervention – Research/evidenced based• What will we do if students have already learned it?• What will we do if students have not learned it?
– Monitoring - Collect data on • Student learning• Implementation of strategy/intervention
• Module: Using Classroom Data to Monitor Student Progress
• What do you see in your district assessment plan that could be used to facilitate the monitoring process?
Assessing Your Culture of Quality Data
StudyAnalyze Data
Set Goals Set Measurable Objectives
Research Best PracticeDo
Implement Plan Monitor PlanEvaluate Plan
PlanDevelop Action
Plan
GatherGetting ReadyCollect DataBuild Profile
StudentAchievement
StudyAnalyze Data
Set Goals Measurable ObjectivesResearch Best Practice
School Improvement Planning Process
Gather
Study
Plan
Do
• What are your possible next steps?
Next Steps• What are your possible next steps?
– Who do I need to talk to?– Do I know my district assessment plan and
where it is?– How does my SI Plan relate to my GLCEs of
greatest concern?– Access to Data 4SS– Access to Data 4SS training– GLCE unwrapping – who can help?
• Evaluation
• Visit www.macul.org
Data for Student SuccessKey Contact Information
• General – www.data4ss.org
• Mary Gehrig, Assistant Superintendent, Calhoun ISD– [email protected]
• Mike Oswalt, Assistant Superintendent, Calhoun ISD– [email protected]
• Becky Rocho, Assistant Superintendent, Calhoun ISD– [email protected]
• Maureen Slamer – Data 4SS PD Director, Calhoun ISD– [email protected]
