1

DDOE Education Insight Dashboard Implementation Project

25th Annual STATS-DC 2012 Data Conference

July 13, 2012

2

Zero to Dashboard in 15 Months

•Introductions•Project Background•Going Further Faster•Next Steps•Q & A

3

Who we are

•Reese Robinsono Delaware Department of Educationo Education Insight Project Manager

•Lori Feyo Michael & Susan Dell Foundationo Director – Ed-Fi Initiative

•Eddie Parkero Otis Educational Systems (OtisEd)o Founder & CEO

4

RTTT Project Aimed at Ambitious Targets

K-12 data is increasingly important●Federal mandates●Management – Data-driven decisionmaking

DOE Targets (RT3)●90% of students will graduate by 2013-2014●100% will meet standard on state math and reading exams by 2013-2014

How do we close the gap?

5

Specific Focus on Equipping Educators with Meaningful Data to Help Students

6

Series of Education Insight Projects Required to Meet Goals

7

Project Timelines Posed Significant Challenge

8

Insight Dashboard Preparation Process

• Documentation Review

• System Inventory

• Market Review

• LEA Interviews

• Findings: Many Existing Systems, Many Potential Providers

• Request For Information: 26 Responses

• Selected Ed-Fi standard for data structure and dashboards

• Request for Proposalo Data Warehouse: ESP Solutions Group / OtisEdo Dashboard Design: Wireless Generation / Double Line Partners

July 2010 – April 2011

9

Ed-Fi Leverages Existing Data for New Uses

• Extensive documentationo Interface, Database, Metrics, Data Exchange

• Research-based• Well received• Consistent with RT3 philosophy• Public domain• Growing adoption by states and districtso States of Arkansas, Colorado, Kansas, Texaso Little Rock School District

• Adopted for the Strategic Learning Collaborative (SLC)o Piloted with Colorado, Georgia, Illinois, Massachusetts, New York,

North Carolina

Ed-Fi includes:•Open data standard•Collection of best practice metrics•Dashboard source code

Ed-Fi includes:•Open data standard•Collection of best practice metrics•Dashboard source code

10

Architecture

11

Data Flow

11

26,000,000 Records Evaluated Nightly6-7 Hours

12

Insight Dashboard Designed to Meet RTTT Goals•Collection of research-based metrics (33)o Predictive of education outcomes

•Integrated from multiple sourceso eSchool, DCAS, DIBELS…

•Focused on studentso Class, School, District rollups

•Along with student characteristicso Contacts, Program Indicators

•Designed by and for Teachers

12

13

How was it Developed?

13

• 45 Individuals• All Districts• 4 Charter Schools

• 70 Student Metrics• 200 Aggregate or Rollup Metrics

• 11 Focus Groups• 175 Participants

― 122 Teachers― 4 Principals― 49 Admin

14

Stakeholder Workshop ReviewThree stakeholder engagement workshops were conducted in June 2011.

June 20, 2011Glasgow HS

84 participants

June 22, 2011Polytech HS

55 participants

June 23, 2011Sussex Tech HS36 participants

175 people attended the stakeholder workshops•122 Classroom Teachers•4 Principals•49 Other Administration

11 Breakout Sessions with 4 stakeholder groups •Elementary Teachers•Middle School Teachers•High School Teachers•Principals, Counselors, and other Administrative personnel (sometimes as part of teacher breakout sessions)

15

Stakeholder Survey FeedbackFeedback from the Workshop participants was overwhelmingly positive.

16

Several key factors enabled DDOE to get further, faster

17

Leveraging Others’ Work Accelerated Development• Ed-Fi Toolso Data standard already createdo Metrics research already synthesized and well-documentedo Operational dashboard source code dramatically cut development time

• Stakeholder Engagement Model from Texaso Metrics prioritized by Delaware educatorso Built awareness and buy-in

• iMart Data Warehouseo OTS product with dimensional model and K12 operational processo Easily extensibleo Low cost of ownershipo Self-Sufficiency with Knowledge Transfer to DDOE staff

18

Embracing Change Eliminated Common Pitfalls• Adopting Standardso Provided common ‘language’o Minimized design confusion and unnecessary development

• Agile Managemento ‘TimeBox’ development approach was key to meeting deadlineso Executives minimized bureaucracy

• Specific Development Team Strategieso Mentoringo Pair-programmingo Code reading and reviewo Regular code walkthroughso Review of artifactso Question and answer

19

Metric Focus

20

Ed-Fi Provided Powerful, Free Accelerators

Ed-Fi Core1.2

Delaware InsightDashboard extensions

maintain compatibility with Ed-Fi Core if/as it is modified

Ed-Fi Core1.3

• Texas Student Data System dashboard code developed into publicly licensable Ed-Fi tool suite

• DDOE licensed Ed-Fi tool suite free• Implementation of Ed-Fi allows for extensibility (customization) for

Delaware presentation and unique metrics• Ed-Fi core schema will evolve over time, but will still be compatible with

Delaware implementation as long as extensibility points are only areas of customization

• Texas Student Data System dashboard code developed into publicly licensable Ed-Fi tool suite

• DDOE licensed Ed-Fi tool suite free• Implementation of Ed-Fi allows for extensibility (customization) for

Delaware presentation and unique metrics• Ed-Fi core schema will evolve over time, but will still be compatible with

Delaware implementation as long as extensibility points are only areas of customization

Future Ed-Fi Core releases

21© 2012 Michael & Susan Dell Foundation

Ed-Fi Footprint is Growing

Total US students49.4M

Total US teachers3.2M

19% of students19.5% of teachers

34% of students36% of teachers

Momentum of State Adoption Creates Further Opportunities for Leverage

22

Scope of iMart to Mapping Process

• Moving data from iMart Data Warehouse to Ed-Fi Operational Data Store

• Tableso Source Tables Used to read data: 65o Target tables loaded:

105 Type Tables (Code Tables) 84 Maps (Ed-Fi Target Tables)

• 14 packages or modules

• 95 ETL jobs

• Data pointso 600 columns loaded of 84 Ed-Fi Tableso 135,000 unique Current Year enrolled

students processedo 26,575,792 Records processed (Most of

them are only Current year records)

This does not include the source mapping to the Data Warehouse (iMart)

23

Data Mapping and Import Process

Available dataDashboard

requirements

Design

Ed-Fi Standard

24

Insight Dashboard Project Timeline

Release 1.0•Interim Teacher Dashboard Development

Stakeholder engagement

4/1/11

Release 2.0•Teacher (expansion), Principal, Administrator, DOE Dashboards

4/1

Release 3.0 and beyond•Expansion, refinement, and support for additional Stakeholders

6/30/137/1 10/1

Phased release•Pilot districts•Other districts

25

Q & A

Lori.Fey@msdf.orgwww.ed-fi.org

Zeynep@doublelinepartners.comwww.doublelinepartners.com

Eddie.Parker@OtisEd.comwww.OtisEd.com