Wayne State Center for Health and Justice of Court ... · Assessment Tool (IRAS‐PAT) and has more...

Wayne State University Center for Behavioral Health and Justice

Indiana Office of Court Services Pretrial Pilot Study ‐ October 4, 2019

Indiana Office of Court ServicesPretrial Pilot Study

Brad Ray, Ph.D.Director of the Center for Behavioral Health and Justice

Wayne State University

Spencer G. Lawson, M.S.Michigan State University



Eric Grommon, Ph.D.Associate ProfessorO’Neill School of Public and Environmental AffairsIndian University – Purdue University Indianapolis

Indiana Pretrial Pilot ProjectThe Center for Behavioral Health and Justice is a community‐engaged research group who works directly with agencies to address social problems through data‐driven decision making in the development, implementation, and evaluation of policies and initiatives

Spencer G. Lawson, M.S.School of Criminal JusticeMichigan State University

Evan Lowder, Ph.D.Assistant ProfessorCriminology, Law and Society George Mason University



Indiana Pretrial Pilot Project

• In 2014, the Indiana Supreme Court authorized the development of a pretrial release pilot project in collaboration with the Evidence Based Decision Making Initiative

• Criminal Rule 26: “In determining whether an arrestee presents a substantial risk of flight or danger to self or other persons or to the public, the court should utilize the results of an evidence‐based risk assessment…”

• Indiana Criminal Rule 26 was the foundation for the 11 pretrial pilot project counties

• Evaluation efforts started in 2015 and was initially aimed at examining the barriers and facilitators towards implementation of the Indiana Risk Assessment System – Pretrial Assessment Tool (IRAS‐PAT) and has more recently focused on validation



Indiana Pretrial Risk Assessment Tool

• Administered to determine risk of pretrial failure

• Self‐report and verification

• Low, Moderate, or High



EPIS Framework: IRAS‐PATA developmental evaluation, aimed at course corrections toward the utilization and validation of a structured risk assessment tool

2015 2019



Exploration Phase

• Every state has enacted legal reforms governing pretrial release with the goal of exploring alternatives to money bail

• Unstructured professional judgments have repeatedly been shown to be less accurate than evidence‐based risk assessment approaches

• Structured risk assessment tools are informed by more than 65 years of rigorous research into factors associated with public safety risks



Exploration Phase





Preparation Phase

Pretrial Pilot Counties• Allen• Bartholomew• Grant• Hamilton• Hendricks• Jefferson• Monroe• Porter• St. Joseph• Starke• Tipton



Preparation Phase

Facilitators

• Pretrial recommendations helpful at initial hearings

• Established local teams committed to the pretrial risk assessment process

Barriers

• Lack of integration across local data systems

• Concerns about the IRAS‐PAT instrument



Preparation Phase

Preliminary integration and analysis of linked INCite and Odyssey data: 2014 ‐ 2016



Preparation Phase

Preliminary integration and analysis of linked INCite and Odyssey data: 2014 ‐ 2016



Preparation Phase

• The IRAS‐PAT was not being used in the decision‐making process

• Counties were using the IRAS‐PAT at varying points in the criminal justice system, with different populations, and different release schedules:

• Allen County had a target population of non‐violent F5/F6 arrestees and used an additional risk tool for pre‐screening

• Bartholomew County had a target population which largely consisted of those arrestees with warrants issues or charges filed

Evaluation plan shifted to validation of the IRAS‐PAT





Implementation Phase

Pretrial Pilot Counties• Allen Mar. 2016• Bartholomew Sept. 2016• Grant Aug. 2017• Hamilton June 2016• Hendricks Jan. 2016• Jefferson Oct. 2016• Monroe Oct. 2016• Porter Mar. 2017• St. Joseph Oct. 2016• Starke Jan. 2016• Tipton Oct. 2016

Validation requires approximately one‐year of IRAS‐PAT

implementation and an additional year for

follow‐up


IRAS‐PAT Validation

• Validation is the process of demonstrating the quality of a measure, the scores obtained with the measure, or the interpretation of those scores

• Example: mental illness

• Kessler (6) screening instrument

• Distress from serious mental illness in past 30 days


Kessler (6) Example

18%

27%

0%

10%

20%

30%

2017 2019

County

A

22%25%

0%

10%

20%

30%

2017 2019

County

B

21%22%

0%

10%

20%

30%

2017 2019

County

D

18%16%

0%

10%

20%

30%

2017 2019

County

E

21% 22%

0%

10%

20%

30%

2017 2019

County

J19%

32%

0%

10%

20%

30%

40%

2017 2019

County

I

22%19%

0%

10%

20%

30%

2017 2019

County

H16%

12%

0%

10%

20%

30%

2017 2019

County

G

Data Source: K6 Collection 2017 & 2019



• The IRAS is a suite of assessments: Community Supervision and Screening Tool (CSST), Community and Screening Tool (CST), Prison Intake Tool (PIT), and Reentry Tool (RT)

The IRAS‐PAT measures the risk for failure‐to‐appear and reoffend while on pre‐trial supervision

Pretrial risk assessment tools are designed to inform not replace the exercise of judicial decision‐making and discretion

No matter how well validated in other jurisdictions, assessments should be subjected to local evaluation



• Record linkage between three systems

• We cannot validate the IRAS‐PAT without local jail data

• We need to know when a person entered the jail, left the jail, and a broad understanding of the arrest charges

• From a research standpoint nothing has proven more challenging than the collection of local jail data

Unique Individual Event

INCite

JailOdyssey


IRAS‐PAT Validation: Monroe County

• Data Sources

• Pretrial records

• Jail bookings

• Odyssey court records

• Matching

• Offense date (O)

• Arrest date (J)

• Charge filing date (O)

• Booking date (J)

Sample Flow Chart


IRAS‐PAT Validation: Monroe CountyDistribution of Risk Classifications


IRAS‐PAT Validation: Monroe CountyPredictive Validity: Any Failure‐to‐Appear


IRAS‐PAT Validation: Monroe CountyPredictive Validity: Any Arrest


IRAS‐PAT Validation: Monroe CountyPredictive Validity: Any Misconduct


IRAS‐PAT Validation: Monroe CountyPredictive Validity


IRAS‐PAT Validation: Monroe CountyPredictive Validity


IRAS‐PAT Validation: Monroe County

• Preliminary results suggest moderate to strong predictive accuracy of IRAS‐PAT assessment in Monroe County, Indiana

• IRAS‐PAT assessments predict arrest with more accuracy than FTA

• High proportions of defendants at moderate (33%) and high (52%) risk levels engage in any pretrial misconduct; should be closer to 18% and 29% respectively based on instrument design




Continue working with counties to obtain local booking data to provide a local validation of the IRAS‐PAT

Need to assure we have adequate sample size for validation

Data needed to be cleaned and linked prior to validation




Pretrial Pilot Counties• Allen Mar. 2016• Bartholomew Sept. 2016• Grant Aug. 2017• Hamilton June 2016• Hendricks Jan. 2016• Jefferson Oct. 2016• Monroe Oct. 2016• Porter Mar. 2017• St. Joseph Oct. 2016• Starke Jan. 2016• Tipton Oct. 2016

Validation requires approximately one‐year of IRAS‐PAT

implementation and an additional year for

follow‐up





Sustainment Phase

Quality Assurance and Future Research

• Determine validation within county specific practices

• Investigate pretrial supervision on court appearance and public safety outcomes

• Inform supervision practices for optimal outcomes by risk‐level

• Examine whether the implementation of pretrial risk assessments improves the fairness of pretrial release decisions for racial‐ethnic minorities (funded by the National Institute of Justice)



Questions & Discussion

Michigan Mental Health Diversion Council

Date post:	14-May-2020
Category:	Documents
Upload:	others
View:	1 times
Download:	0 times

Wayne State Center for Health and Justice of Court ... · Assessment Tool (IRAS‐PAT) and has more...

Documents