+ All Categories
Home > Documents > SDP TOOLKIT - sdp.cepr.harvard.edu

SDP TOOLKIT - sdp.cepr.harvard.edu

Date post: 27-Feb-2022
Category:
Upload: others
View: 1 times
Download: 0 times
Share this document with a friend
35
www.gse.harvard.edu/sdp/toolkit SDP TOOLKIT FOR EFFECTIVE DATA USE Toolkit Version 1.1 Webinar | TOOLKIT FOR EFFECTIVE DATA USE A GUIDE FOR CONDUCTING DATA ANALYSIS IN EDUCATION AGENCIES Please mute your computer speakers and phone microphone.
Transcript
Page 1: SDP TOOLKIT - sdp.cepr.harvard.edu

Thursday, January 26, 2012 Webinar1 | TOOLKIT FOR EFFECTIVE DATA USE 1

www.gse.harvard.edu/sdp/toolkit

SDP TOOLKITFOR EFFECTIVE DATA USE

Toolkit Version 1.1 Webinar | TOOLKIT FOR EFFECTIVE DATA USE

A GUIDE FOR CONDUCTING DATAANALYSIS IN EDUCATION AGENCIES

Please mute your computer speakers and phone microphone.

Page 2: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 2

Todd KawakitaManager of Product Development

Patty Diaz-AndradeDirector of Education and Outreach

Page 3: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 3

SDP TOOLKITFOR EFFECTIVE DATA USE

A GUIDE FOR CONDUCTING DATAANALYSIS IN EDUCATION AGENCIES

essential data elements

check, and build variables

for your datasets

relevant datasets from

different sources

your datasets best practices to facilitate shared and

replicable data analysis

Page 4: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 4

Page 5: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 5

Data Specification Guide

Successful data analysis begins with proper identification of data elements

necessary to answer key questions of interest.

Page 6: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 6

Page 7: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 7

Page 8: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 8

Help you to:

• Take stock of the data available in your agency• Understand the data elements you will need to conduct analytics

in the areas of high school completion and college-going success

• Begin the process of establishing a common language for data elements across your agency

Upon completing, you will:

• Pull together the data you will need to successfully complete this Toolkit

• Have a good feel for your agency’s data availability and perhaps begin processes for collecting data that may be missing

Page 9: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 9

Data Building Tasks

Upon collecting essential data elements, ensure that the data can be reliably used in future

analyses.

Page 10: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 10

Data Building Tasks

Upon collecting essential data elements, ensure that the data can be reliably used in future

analyses.

Page 11: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 11

Page 12: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 12

Page 13: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 13

Page 14: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 14

Page 15: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 15

Page 16: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 16

For Clean

Page 17: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 17

Help you to:

• Understand the important of decision rules when defining data elements

• Identify data inconsistencies, including duplicate and missing records

• Develop a set of robust datasets that are accurate and reliable

Upon completing, you will:

• Have a set of datasets that include clean, reliable data to take you into the next step of the Toolkit

• Have established (or begun to establish) decision rules and shared them with others who will use the same data elements to conduct other analyses

Page 18: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 18

Data Linking Guide

Now that you have collected and cleaned your data, you will want to merge the files together to

create an analysis file.

Page 19: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 19

Page 20: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 20

For Connect

Page 21: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 21

Help you to:

• Merge your cleaned data files• Connect complex datasets through a unique student identifier

Upon completing, you will:

• Have a complete, robust, and comprehensive dataset that will allow you to conduct analyses in Analyze.

• Have a dataset you can share with other analysts in your department or agency

Page 22: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 22

College-Going Success Analysis Guide

The final step in the SDP Toolkit for Effective Data Use is to analyze the data you have identified,

cleaned, and connected.

Page 23: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 23

Page 24: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 24

Page 25: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 25

Page 26: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 26

For Analyze

Page 27: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 27

Page 28: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 28

Help you to:

• Take the robust dataset you’ve created and jump into the world of analytics

• Replicate SDP’s diagnostics• Identify trends, across your agency and across schools, in

student graduation, college enrollment, and college persistence rates

Upon completing, you will:

• Understand on-time graduation, college enrollment, and college persistence in your agency

• Understand the “school-effect” on student graduation and college enrollment rates

• Have a set of analyses (graphs) that you can share with senior leadership

• Have produces Strategic Performance Indicators (SPI’s) for your agency

• Have earned an SDP badge for Toolkit completion

Page 29: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 29

Coding Style Guide

To ensure that statistical code is easily shared across a team and is replicable

by future users, SDP and the Center for Education Policy Research (CEPR)

recommends that you follow best coding, programming, and data management

practices.

Page 30: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 30

Page 31: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 31

What makes you a prime user for the Toolkit?

• Access to large datasets with information on student achievement • Interest, in your agency, to understand and explore high school completion and

college enrollment trends• Knowledge of some statistical programming language

Page 32: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 32

What makes you a prime user for the Toolkit?

• Access to large datasets with information on student achievement • Interest, in your agency, to understand and explore high school completion and

college enrollment trends• Knowledge of some statistical programming language

Beyond the analytic questions found in ANALYZE, the Toolkit will help you to answer structural questions like:

• Are we missing key data elements that will help us better understand the high-school effect on graduation and college enrollment/persistence?

• Is there a set of decision rules that all analysts in our agency understand and embrace?

• Do datasets from disparate warehouses easily match-up, or do we find vast inconsistencies in the way that data are collected in our agency?

Page 33: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 33

What to do if you’re serious about digging into the Toolkit:

• Get into the mental mode and psych yourself out. This is a 300+ page document and no easy task. Are you up for it?

• Devote time in your calendar, perhaps 1-2 hours every other day to digging into the Toolkit. This means that you are consciously putting all of your other demands on hold for a few hours a week!

• Find a Toolkit completion buddy – either in your agency or across the SDP network.

• Decide on what program you can use – Stata, SPSS, R, perhaps Excel?• Practice with our datasets first, then start to use your own; but, create

duplicate datasets of all originals.• Keep SDP in the loop – let us know where you run into bumps or when you’ve

completed an analysis, particularly the SPI’s!

Page 34: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 34

Q A&

Page 35: SDP TOOLKIT - sdp.cepr.harvard.edu

Monday, October 15, 2012 Toolkit Version 1.1 | TOOLKIT FOR EFFECTIVE DATA USE 35

Thank You

Check www.gse.harvard.edu/sdp/toolkit for the most recent toolkit version.

Please contact us at [email protected] if you have any questions about the toolkit.


Recommended