+ All Categories
Home > Documents > USING SELF-MONITORING TO INCREASE ON-TASK …

USING SELF-MONITORING TO INCREASE ON-TASK …

Date post: 06-Nov-2021
Category:
Upload: others
View: 2 times
Download: 0 times
Share this document with a friend
92
USING SELF-MONITORING TO INCREASE ON-TASK BEHAVIOR IN A JUVENILE JUSTICE FACILITY A DISSERTATION SUBMITTED IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF DOCTOR OF PHILOSOPHY IN THE GRADUATE SCHOOL OF THE TEXAS WOMAN’S UNIVERSITY DEPARTMENT OF TEACHER EDUCATION COLLEGE OF ARTS AND SCIENCES BY RACHEL LIVELY B.A., M.ED. DENTON, TEXAS AUGUST 2019 Copyright © 2019 by Rachel Lively
Transcript
Page 1: USING SELF-MONITORING TO INCREASE ON-TASK …

USING SELF-MONITORING TO INCREASE ON-TASK BEHAVIOR IN A

JUVENILE JUSTICE FACILITY

A DISSERTATION

SUBMITTED IN PARTIAL FULFILLMENT OF THE REQUIREMENTS

FOR THE DEGREE OF DOCTOR OF PHILOSOPHY

IN THE GRADUATE SCHOOL OF THE

TEXAS WOMAN’S UNIVERSITY

DEPARTMENT OF TEACHER EDUCATION

COLLEGE OF ARTS AND SCIENCES

BY

RACHEL LIVELY B.A., M.ED.

DENTON, TEXAS

AUGUST 2019

Copyright © 2019 by Rachel Lively

Page 2: USING SELF-MONITORING TO INCREASE ON-TASK …

iii

DEDICATION

To my parents, Joe and Rhonda, who instilled in me a passion for education and life.

Thank you for your endless love, sacrifice, and support.

Page 3: USING SELF-MONITORING TO INCREASE ON-TASK …

iv

ACKNOWLEDGMENTS

There are countless individuals who contributed to this dissertation. I would like

to thank my committee chair and advisor, Dr. Diane Myers, for her thorough feedback,

endless support, and for reminding me that there is always a place for humor in the world

of education. Thank you for always entertaining our seemingly endless shenanigans and

for making each of us feel like rock stars. Dr. Jane Pemberton always greeted me with a

smile and made me feel welcome. Dr. Minkowan Goo provided unique insight and

sound advice. Thank you also to Dr. Mary Donelson and Dr. Teresa Starrett for your

personal counsel, support, and encouragement throughout my academic journey.

To my parents, thank you for always believing in me when I didn’t believe in

myself. Your countless sacrifices provided me the opportunity to become a strong and

independent woman who thrives on life’s challenges. Your endless love and support

guided me on a path to the highest level of academic attainment and for this I am

eternally grateful. To my mom, thank you for never letting me quit and always pushing

me to be my best self. To my dad, thank you for the countless hours of cat sitting and

early morning coffee runs.

I would like to acknowledge the encouragement and support of my friends and

colleagues. Many adventures were missed during this journey; however, each of you

graciously understood and remained by my side. Whether it was a needed laugh or an

open ear, each was an integral part of this process. I would like to give special thanks to

Ed Steffek for being my dissertation battle-buddy. Finally, I would like to thank my cat,

Penelope, for always offering to help me type even when I didn’t need her assistance.

Page 4: USING SELF-MONITORING TO INCREASE ON-TASK …

v

ABSTRACT

RACHEL LIVELY

USING SELF-MONITORING TO INCREASE ON-TASK BEHAVIOR IN A

JUVENILE JUSTICE FACILITY

AUGUST 2019

Limited research exists on the use of self-monitoring interventions in the juvenile

justice setting. This replication study used a randomized multiple-baseline design across

participants to determine if there is a functional relationship between the self-monitoring

intervention and an increase in on-task behavior of three male students in a secure

juvenile facility in Texas. The self-monitoring intervention consisted of a student

worksheet to track behavior, a vibrating watch to remind students to record their

behavior, and individual training in how to use the worksheet and watch. Results

indicated that self-monitoring was associated with an increase in on-task behavior across

all participants. Also discussed are implications of these findings and future directions

for similar research in the juvenile justice setting.

Page 5: USING SELF-MONITORING TO INCREASE ON-TASK …

vi

TABLE OF CONTENTS

Page

DEDICATION ........................................................................................................... iii

ACKNOWLEDGMENTS .......................................................................................... iv

ABSTRACT ................................................................................................................. v

LIST OF TABLES .................................................................................................... viii

LIST OF FIGURES .................................................................................................... ix

Chapter

I. INTRODUCTION .................................................................................................... 1

Statement of the Problem .................................................................................... 3

Research Question .............................................................................................. 4

II. REVIEW OF THE LITERATURE ......................................................................... 5

Juvenile Justice System....................................................................................... 5

Emotional and Behavioral Disorders ................................................................ 10

Self-Monitoring................................................................................................. 16

Rationale for the Current Study ........................................................................ 25

III. METHODOLOGY .............................................................................................. 28

Setting ............................................................................................................... 28

Participants ........................................................................................................ 31

Independent Variable ........................................................................................ 34

Dependent Variable .......................................................................................... 34

Social Validity Measure .................................................................................... 35

Procedures ......................................................................................................... 36

IV. RESULTS ............................................................................................................ 42

Overview of Results ....................................................................................... 42

Student 1 ................................................................................................. 42

Student 2 ................................................................................................. 43

Student 3 ................................................................................................. 44

Intervention Fidelity ................................................................................ 46

Page 6: USING SELF-MONITORING TO INCREASE ON-TASK …

vii

Treatment Integrity ................................................................................. 47

Social Validity......................................................................................... 47

V. DISCUSSION ....................................................................................................... 50

Limitations ........................................................................................................ 50

Implications....................................................................................................... 51

Summary ........................................................................................................... 53

REFERENCES .......................................................................................................... 55

APPENDICES

A. Data Collection Sheet .......................................................................................... 75

B. Fidelity Checklist ................................................................................................ 77

C. Self-Monitoring Intervention Social Validity Survey: Student Version ............. 79

D. Self-Monitoring Intervention Social Validity Survey: Teacher Version ............ 81

E. Student Self-Monitoring Sheet ............................................................................ 83

Page 7: USING SELF-MONITORING TO INCREASE ON-TASK …

viii

LIST OF TABLES

Table Page

1. Demographic Characteristics of Participants ............................................................31

2. Academic and Behavioral Characteristics of Participants ........................................33

3. Academic and Behavioral Results of Participants ...................................................46

4. Social Validity Rating by Participants ......................................................................48

Page 8: USING SELF-MONITORING TO INCREASE ON-TASK …

ix

LIST OF FIGURES

Figure Page

1. Participants’ Percentage of Intervals with On-Task Behavior ..................................45

Page 9: USING SELF-MONITORING TO INCREASE ON-TASK …

CHAPTER I

INTRODUCTION

Incarcerated juveniles, who are often transient within the juvenile justice system

and arrive at facilities with varying academic and behavioral needs, present special

challenges to the delivery of a comprehensive, appropriate education (Sedlak &

McPherson, 2010). Many students in the juvenile justice system have one or more

disabilities or mental illnesses (Gagnon, Barber, Van Loan, & Leone, 2009; Krezmien,

Mulcahy, & Leone, 2008), as well as histories of intense trauma and neglect (Ford,

Chapman, Connor, & Cruise, 2012; Lampron & Gonsoulin, 2013). Research indicates

that students involved in the juvenile justice system often exhibit significant deficits in

academic achievement, placing them several years below grade level in reading and math

(Beyer, 2006; Leone & Weinberg, 2012; O'Brien, Langhinrichsen-Rohling, & Shelley-

Tremblay, 2007). For example, Beyer (2006) analyzed developmental assessment data

from 50 incarcerated juveniles and found that the juveniles had difficulty maintaining

appropriate attention, anticipating cause and effect, asking for help from adults, and

digesting information. Additionally, juvenile offenders often experience increased

academic failure, school suspension and expulsion, and are at greater risk of dropping out

of school (Pyle, Flower, Fall, & Williams, 2016).

Despite these academic and behavioral challenges, education plays a pivotal role

in recidivism rates among juvenile offenders. Blomberg, Bales, Mann, Piquero, and Berk

Page 10: USING SELF-MONITORING TO INCREASE ON-TASK …

(2011) conducted a longitudinal study involving 4,147 juveniles across 115 juvenile

facilities in Florida. Results indicated that juveniles with higher levels of academic

achievement (e.g., increase number and percentage of high school credits) while involved

in the juvenile justice system were more likely to return to school and less likely to

reoffend within 12 and 24 months after release. The researchers concluded that there is a

link between academic achievement, post-release schooling, and rearrests (Blomberg,

Bales, Mann, Piquero, & Berk, 2011).

Incarcerated juveniles and students with emotional and behavioral disorders

(EBD) often present with similar educational and behavioral characteristics (Mathur &

Schoenfeld, 2010). Students with EBD often exhibit maladaptive behaviors (e.g.,

noncompliance, impulsive behaviors, aggression, lack of attention, avoidance, and

atypical response to typical situations) that impede their academic engagement and lead

to increased risk of suspension, expulsion, and dropout (Chiu, Carrero, & Lusk, 2017;

Cook, Rao, & Collins, 2017). In addition to low academic performance, students with

EBD often lack the social skills needed to form and maintain meaningful relationships

with peers and adults (Ryan, Pierce, & Mooney, 2008).

Like many students in the juvenile justice system, students with EBD often

exhibit deficits in executive function including problem solving, attentional shift,

planning, and self-regulation (Barkley, 2006; Hummer et al., 2011; Mueller & Tomblin,

2012). These deficits in executive functioning, specifically self-regulation, affect

academic instruction. Research suggests teachers devote much of the instructional day to

managing student behaviors (Wehby, Lane, & Falk, 2003). One way to shift behavior

Page 11: USING SELF-MONITORING TO INCREASE ON-TASK …

3

management from the teacher to the student is to provide students with the skills needed

to be self-sufficient learners who can monitor their own behavior as a means of

increasing academic outcomes (Rafferty, 2010). Students may be able learn to use self-

monitoring techniques to increase or decrease the likelihood of specific target behaviors.

Self-monitoring interventions have been found to be effective at increasing desired

behaviors, social skills, and academic achievement in students with EBD (Ennis, Harris,

Lane, & Mason, 2014). Because deficits in executive functioning, specifically self-

regulation, impact behavior control and academic performance, juvenile justice facilities

should implement behavioral interventions that require students to monitor and generalize

their appropriate behaviors (Barkley, 2006).

Statement of the Problem

Research indicates that self-monitoring interventions can improve on-task

behavior for students with challenging behaviors across grade levels (i.e., elementary,

middle, and high school). While EBD is overrepresented in the juvenile justice system,

little research exists on the use of classroom-based self-monitoring within the juvenile

correctional school setting. In a pilot study, Lively, Myers, and Levin (2019) examined

the effects of self-monitoring on the on-task behavior of three male students in a secure

juvenile facility. Results indicated the self-monitoring intervention increased on-task

behavior across all participants. Despite promising results, much of the current research

regarding self-monitoring in the juvenile justice system focuses on trauma-based

interventions outside of the educational setting (e.g., Ford & Blaustein, 2013). As

previously mentioned, both students with EBD and those involved in the juvenile justice

Page 12: USING SELF-MONITORING TO INCREASE ON-TASK …

4

system often experience deficits in self-regulation (Hummer et al., 2011; Mueller &

Tomblin, 2012), which increases their risk of continued criminal behavior and recidivism

(Fine, Baglivio, Cauffman, Wolfe, & Piquero, 2018). Researchers should further

investigate the effectiveness of self-monitoring on desired behavioral and academic

outcomes of student involved in secure juvenile facilities.

Research Question

This study is a replication of Lively et al. (2019). When evaluating the pilot

study, we recommended that future studies include a formal measure of treatment

integrity during all study phases, which was done in the current study. The purpose of

this replication study was to investigate the effects of self-monitoring training on the on-

task behavior of students who are incarcerated in a juvenile justice facility. This study

contributes to the current literature base on effective practices for educating youth in the

juvenile justice system, the effectiveness of self-monitoring, and the ability of teachers to

implement an efficient intervention that is effective with students with a wide range of

behaviors and disabilities. This replication study investigated the following research

question: Is there a functional relationship between the use of self-monitoring and an

increase in the on-task behavior of adolescent males incarcerated in a juvenile justice

facility?

Page 13: USING SELF-MONITORING TO INCREASE ON-TASK …

CHAPTER II

REVIEW OF LITERATURE

Juvenile Justice System

The number of juveniles held in residential placements in the United States fell

44% between 2000 and 2015 (Office of Juvenile Justice and Delinquency Prevention

[OJJDP], 2019). However, in 2015, there were still approximately 48,000 juveniles in

residential placements (Sickmund, Sladky, Kang, & Puzzanchera, 2017). Juveniles in

residential facilities have histories of poor academic performance and school attendance

(Leone & Weinberg, 2010). Additionally, many of these juveniles have experienced

neglect, abuse, homelessness, and trauma prior to entering the juvenile justice system

(Lampron & Gonsoulin, 2013).

Data suggest that minorities are disproportionately represented in the juvenile

justice setting (Lampron & Gonsoulin, 2013). Although Black and Hispanic adolescents

comprise 13% and 17% (respectively) of the adolescent population in the United States,

Black and Hispanic adolescents comprise 39% and 23% (respectively) of juveniles in

residential placements in 2013 (Sickmund et al., 2015). Males are also more likely than

females to be committed to a juvenile facility, accounting for 86% of juvenile inmates in

2013 (Sickmund et al., 2015).

There is also disproportionate representation within the special education

population. Black students are 43% more likely and Hispanic students are 17% more

Page 14: USING SELF-MONITORING TO INCREASE ON-TASK …

likely than White students to be identified for special education (Mallett, 2014). The

number of students found eligible for special education services is higher in the juvenile

justice system than in the traditional school setting; prevalence rates range from 9-11% in

public schools and from 34-45% in the juvenile justice setting (Krezmien et al., 2008;

Quinn, Rutherford, Leone, Osher, & Poirier, 2005). Research suggests that two-thirds of

students receiving special education services in juvenile facilities are classified as having

EBD (Kessler et al., 2006; Leone & Wruble, 2015; Visser, Lesesne, & Perou, 2007). One

explanation is that students with EBD have unresolved academic and behavioral issues

with long histories of academic failure and behavior problems (Mathur, Griller Clark,

LaCroix, & Short, 2017). Without appropriate interventions, students with EBD are at

greater risk for involvement in the juvenile justice system (Mathur & Griller Clark,

2013). Students receiving special education services are more likely than peers without

disabilities to experience academic failure, school suspension, and expulsion (Krezmien

et al., 2008; Lampron & Gonsoulin, 2013; Sheldon-Sherman, 2013). Additionally,

school dropout rates are as high as 75% for young offenders (Risler & O'Rourke, 2009;

Tyler & Loftstrom, 2009).

Academic Interventions

Research indicates that students involved in the juvenile justice system exhibit

significant deficits in reading and math and are at greater risk of academic retention

(Harris, Baltodano, Jolivette, & Mulcahy, 2009; Krezmien et al., 2008; Leone &

Weinberg, 2012). Both the Office of Juvenile Justice and Delinquency Prevention and

U.S. Department of Education highlight education as a critical component of the

Page 15: USING SELF-MONITORING TO INCREASE ON-TASK …

7

rehabilitation process (National Council on Disabilities, 2003). Considering the impact

of education on recidivism, it is important to improve academic outcomes of students in

the juvenile justice system (Wexler, Pyle, Flowers, Williams, & Cole, 2014). Several

studies on reading interventions in the juvenile justice setting have yielded positive

results. For example, Houchins et al. (2008) examined the use of Corrective Reading on

students with EBD across three juvenile corrections facilities. Results indicated that a

majority of the participants made gains in all reading measures (i.e., reading

comprehension, oral reading fluency, and decoding). Wexler, Reed, Barton, Mitchell,

and Clancy (2018) found similar results when they used a multiple baseline design across

participants to determine if there was a functional relationship between a supplemental

peer-mediated reading intervention and juvenile offenders’ abilities to generate main idea

statements about informational text. Students received explicit teacher instruction on

using the Get the Gist strategy followed by peer-mediated practice. Results indicated a

moderately positive relationship between the reading intervention and main idea

generation (Wexler et al., 2018).

In a pretest-posttest control group design study, Warnick and Caldarella (2016)

found similar positive results while examining the effectiveness of a multisensory

phonics-based reading intervention program on the reading skills of students in a

residential treatment facility in the western United States. Both male and female students

between 13 and 17 years old participated in the study. Students in the treatment group

participated in an 8-week, 38-hr reading program utilizing materials from Spelling and

Reading with Riggs (McCulloch, 1995). Based on pretest and posttest data, students in

Page 16: USING SELF-MONITORING TO INCREASE ON-TASK …

8

the treatment group showed significantly larger reading gains than those in the control

group. The researchers concluded that the use of a multisensory phonics-based program

would be an effective intervention for targeting word-level difficulties on juvenile

offenders (Warnick & Caldarella, 2016).

Shippen, Morton, Flynt, Houchins, and Smitherman (2012) found similar results

after examining the effects of the Fast ForWord computer-based reading program on

reading and spelling abilities on juvenile offenders. Results indicated a slight increase in

reading level for students in a juvenile justice facility (Shippen, Morton, Flynt, Houchins,

& Smitherman, 2012). Another study of a computer-based reading program (i.e., Tune

in™ to Reading) was associated with improved instructional reading levels for students

with disabilities in a juvenile justice setting (Calderone, Bennet, Homan, Derick, &

Chatfield, 2009). Additional research is needed to determine the effectiveness of

evidence-based practices on students’ academic deficits in the juvenile justice setting

(Wexler et al., 2014).

Positive Behavior Interventions and Supports

The juvenile justice system has historically focused on a punitive approach to

behavior (Read & Lampron, 2012); however, as indicated in the Guiding Principles for

Providing High-Quality Education in Juvenile Justice Secure Care Settings (U.S.

Department of Education and U.S. Department of Justice, 2014), there has been an

increased focus on promoting a proactive approach to behavior and providing a high-

quality education that “encourages the necessary behavioral and social support services

that address the individual needs of all youths, including those with disabilities and

Page 17: USING SELF-MONITORING TO INCREASE ON-TASK …

9

English learners” (p. iv). Specifically, research indicates that positive behavioral

interventions and supports (PBIS) is an effective alternative to a punitive model (Jolivette

& Nelson, 2010). PBIS is a multi-tier framework that incorporates individual needs

assessments and data-driven interventions to increase desired student outcomes by

providing evidence-based tools for program implementation (Horner et. al., 2009; Myers

& Farrell, 2008; Simonsen & Sugai, 2013). The PBIS framework offers instructional and

intervention supports for students with and without disabilities (Algozzine et al., 2012;

Sugai & Horner, 2009). Approximately 80% of students respond positively to primary

tier (i.e., universal) interventions, 10-15% require secondary tier (small group)

interventions, and 5-7% require individualized intervention provided by tier three

supports (Lewis & Sugai, 1999; Sugai & Horner, 2002, 2006).

The research base on PBIS in the juvenile justice system continues to grow as

trends shift from punitive-based, reactive discipline to a more proactive, preventative

approach (e.g., Lampron & Gonsoulin, 2013; Lopez, Williams, & Newsom, 2015;

Simonsen, Pearsall, Sugai, & McCurdy, 2011). Johnson et al. (2015) examined the

impact of school-wide PBIS (SW-PBIS) on improvements in behavioral outcomes (i.e.,

total incidents, incident report without security referral, incident report with security

referral but without security admission, and incident report with security referral and

admission) and academic performance (i.e., average daily attendance and industry

certifications) in a secure juvenile facility in Texas by comparing data from one year

prior to SW-PBIS implementation to one year after implementation. Results indicated a

reduction in total incidents (46%), incident reports without security referral (41%),

Page 18: USING SELF-MONITORING TO INCREASE ON-TASK …

10

incident reports with security referral but without security admission (56%), and incident

reports with security referral and admission (35%). Additionally, academic performance

increased concurrently with the implementation of SW-PBIS. There was a 21% increase

in average daily attendance and an increase of 131 industry certifications earned. Results

indicated that the implementation of SW-PBIS increased desired behaviors and academic

engagement (Johnson et al., 2015).

Similar results occurred with secondary tier interventions (e.g., check-in/check-

out, self-monitoring, and social skills training) which have been associated with

improvements in target behaviors such as time on task, disruption, and aggressive

language (Bruhn, Lane, & Hirsch, 2014). Additionally, secondary tier interventions have

been found effective across various settings, including alternative education settings

(Swoszowski, Jolivette, & Fredrick, 2013), residential facilities (e.g., Ennis, Jolivette,

Swoszowski, & Johnson, 2012; Swoszowski, Jolivette, Fredrick, & Heflin 2012) and

secure juvenile facilities (e.g., Caldwell & Joseph, 2012). Because students in the

juvenile justice system often struggle with task completion, organization, and self-

regulation (Moilanen, 2007), additional research is needed to determine the effects of a

targeted secondary tier intervention, specifically self-monitoring, on increasing on-task

behavior and academic performance in the juvenile justice system.

Emotional and Behavioral Disorders

As previously mentioned, students with EBD are represented at a higher rate in

the justice system than in the traditional school setting. Students with EBD commonly

exhibit noncompliance, impulsivity, inattentiveness, disorganization, acting out, and

Page 19: USING SELF-MONITORING TO INCREASE ON-TASK …

11

aggression (Landrum & Sweigart, 2014). These externalizing behaviors often interfere

with academic performance and skills acquisition in the general education setting

(Harrison, Bunford, Evans, & Owens, 2013). Similar to students involved in the juvenile

justice system, students with EBD often have poor academic outcomes, with as many as

58% performing below grade level in reading and 93% below grade level in math

(Greenbaum et al., 1996). Nelson et al. (2004) speculated that increased deficits in math

performance in high school correlates with deficits in reasoning skills. In addition to

deficits in reading and math, students with EBD experience more disciplinary action

(e.g., suspension and expulsion) than students in other disability categories (Wagner,

Kutash, Duchnowski, Epstein, & Sumi, 2005). Because students with EBD often fail to

attain basic academic and functional skills, they experience some of the lowest

graduation rates (51.1%) and highest dropout rates (38.1%) of any disability category

(U.S. Department of Education, 2014). Additionally, students with EBD experience

increased unemployment after leaving high school (Andrews, Houchins, & Varjas, 2017).

In order to address these concerns, schools are encouraged to increase the use of

evidence-based practices and interventions for students with EBD (Seeley, Severson, &

Fixsen, 2014). Ryan et al. (2008) reviewed and summarized the literature addressing the

use of evidence-based interventions to target academic performance of students with

EBD. Results were clustered into three categories: peer-mediated (e.g., peer modeling,

peer tutoring, and cooperative learning), self-mediated (e.g., self-monitoring, self-

evaluation, and goal setting), and teacher-mediated interventions through manipulation of

antecedents (e.g., modeling, verbalization of math problems, and mnemonic instruction)

Page 20: USING SELF-MONITORING TO INCREASE ON-TASK …

12

and/or consequences (e.g., token reinforcement and written feedback). Overall, all three

intervention categories were associated with positive gains related to the academic

performance of students with EBD in the public school setting (Ryan et al., 2008).

As previously mentioned, students with EBD often experience increased rates of

suspension and expulsion (Wagner et al., 2005) and are at greater risk for involvement in

the juvenile justice system (Mathur & Griller Clark, 2013). Tobin and Sprague (2000)

reviewed and summarized literature on research-based practices for students with EBD in

alternative settings. Tobin and Sprague (2000) identified eight effective research-based

strategies: (a) small teacher-student ratio, (b) structured classroom management, (c)

positive behavior management, (d) adult mentors, (e) functional assessments, (f) social

skills training, (g) instructional strategies focusing on academic deficits, and (h) parent

training programs. Tobin and Sprague (2000) suggested that schools provide evidence-

based interventions to address the varied academic and behavioral needs of students with

EBD.

Interventions for Writing

Research indicates a direct link between language development, reading skills,

and writing ability; for example, as reading comprehension and language fluency

increase, so too does written performance (Berninger et al., 2006). When comparing

writing performance of students with EBD to their peers without disabilities, Gage et al.

(2014) determined that more than 50% of the variance in writing ability in their

participants was linked to reading performance. Because students with EBD experience

Page 21: USING SELF-MONITORING TO INCREASE ON-TASK …

13

deficits in reading, they have a diminished opportunity to demonstrate and acquire

knowledge of the writing process.

Self-regulated strategy development (SRSD) is an evidence-based intervention

designed to address deficits in writing while reinforcing self-regulation and motivation

(Harris, Graham, & Mason, 2003). Ennis (2016) used a multiple probe, multiple baseline

design across participants to examine the effectiveness of SRSD to teach summary

writing in social studies to three high school students in a residential facility for youth

with EBD. SRSD lessons were taught using TWA (Think before reading, think While

reading, think After reading) and PLANS (Pick goals, List ways to meet goals, And,

make Notes and Sequence notes). Results indicated a functional relationship between

SRSD instruction and writing performance as measured by summary elements, quality,

and total written words (Ennis, 2016).

Mason, Kubina, Valasa, and Cramer (2012) found similar results using SRSD for

persuasive quick writing on five seventh- and eighth-grade students in an alternative

school for students with EBD. Similar to the SRSD instructional approach used by Ennis

(2016), the researchers utilized SRSD instruction for POW (Pick my ideas, Organize my

notes, Write and say more) and TREE (Topic sentence, Reasons - three or more, Explain,

Ending) for improving persuasive writing skills. A graduate student provided one-on-one

SRSD instruction to each participant. All stages of SRSD strategy acquisition and self-

regulation procedures were employed during the lessons. Results indicated that the

implementation of the SRSD instruction for the POW + TREE intervention increased

persuasive writing skills across all five participants (Mason et al., 2012).

Page 22: USING SELF-MONITORING TO INCREASE ON-TASK …

14

Interventions for Reading

In addition to deficits in writing, students with EBD also struggle with grade-level

reading performance; reading deficits are likely to impact life outcomes including

academic success, dropout rate, and employment (Kostewicz & Kubina, 2008; McKenna,

Kim, Shin, & Pfannenstiel, 2017). Students with EBD are often 5 to 7 years behind grade

level in reading (Wei, Blackorby, & Schiller, 2011). In recognition of the importance of

reading as related to student success, researchers and policymakers are giving attention to

the literacy development of students with EBD. Common effective interventions include

context mapping for vocabulary and reading comprehension (Palmer, Boon, & Spencer,

2014; Stone, Boon, Fore, Bender, & Spencer, 2008), corrective reading for reading

comprehension, decoding, and oral reading fluency (Houchins et al., 2008; McDaniel,

Houchins, & Terry, 2013), and repeated reading for reading comprehension and oral

reading fluency (Vostal & Lee, 2011).

For example, Escarpio and Barbetta (2016) used an alternating treatment design to

examine the effects of three reading conditions (i.e., repeated readings, non-repeated

readings, and equivalent non-repeated readings) on the reading fluency, errors, and

comprehension of four sixth-grade students with EBD who were also identified as

struggling readers. During the first phase (i.e., repeated readings) of the study, each

participant read a 100 or 150-word passage three times. If an error occurred, the

researcher immediately read the word and the participant would repeat the word and the

sentence. At the conclusion of each reading, the participant would read aloud any words

that required correction. During non-repeated readings, participants completed a process

Page 23: USING SELF-MONITORING TO INCREASE ON-TASK …

15

identical to the previous stage except the passage was only read one time. Procedures in

the third phase were identical to the second phase except that participants read a 300- or

450-word passage one time. Researchers administered both an oral comprehension and

reading fluency assessment at the conclusion of each phase. Results indicated that across

all participants repeated reading had a greater effect on reading fluency, errors, and

comprehension than non-repeated reading and equivalent non-repeated reading (Escarpio

& Barbetta, 2016).

Interventions for Math

In addition to deficits in reading and writing, students with EBD experience

deficits in math and perform significantly below the national average (Riccomini, Witzel,

& Robbins, 2008). Research suggests a number of evidence-based interventions that

increase math outcomes in students with EBD. For example, Lee, Lylo, Vostal, and Hua

(2012) examined the effects of high-preference sequences (i.e., a series of tasks with a

high probability of completion and positive reinforcement) on both digits correct per

minute and latency to initiate nonpreferred problems for three participants in a chartered

alternative school for students with EBD. After demonstrating a preference for a specific

type of problem, as measured by worksheet selection, participants completed high-

preference problems followed by nonpreferred problems. Results indicate that latency

for attempting nonpreferred problems decreased across all participants; however, there

was no effect on accuracy (Lee et al., 2012).

Mulcahy and Krezmien (2009) also examined math accuracy in students with

EBD. Researchers examined the effects of a contextualized instructional package on

Page 24: USING SELF-MONITORING TO INCREASE ON-TASK …

16

teaching area and perimeter to four students in a self-contained classroom for middle-

school students with EBD. The instructional intervention consisted of 11 lessons focused

on procedural and conceptual knowledge of area and perimeter using problem-solving

strategies and a self-monitoring technique. Results indicated that math accuracy in both

area and perimeter increased across all participants; however, transfer and maintenance

results were mixed. Additionally, each participant completed the self-monitoring

checklist at the end of each session without the need for prompting (Mulcahy &

Krezmien, 2009).

Deficits in executive functioning, including the ability to think through and

control behavior, also affect students with EBD (Barkley, 2006). Executive functioning

skills include planning, organizing, mentally representing a task, tolerance response, task

visualization, switching strategies, and self-regulation (Hummer et al., 2011; Mueller &

Tomblin, 2012). Because difficulties in self-regulation impact behavior control, social

interactions, and academic performance, schools should implement behavioral

interventions that help students with EBD monitor, adapt, and generalize their own

behavior across multiple settings (Barkley, 2006).

Self-Monitoring

Research suggests that teachers of students with EBD spend only 30% of the

school day on academic instruction while devoting a majority of the time to managing

undesired behaviors (Wehby, Lane, & Falk, 2003). Improving academic outcomes

requires teachers to understand the behavioral process and integrate behavioral

interventions that shift behavior management from teacher to student. An important goal

Page 25: USING SELF-MONITORING TO INCREASE ON-TASK …

17

of any educational system is to provide students with the skills needed to become self-

sufficient learners who can manage their own behavior as a means of achieving academic

success (Rafferty, 2010). Therefore, students must learn to manipulate the antecedents

and consequences of their own behavior as they use self-monitoring techniques to make

target behaviors more or less likely (Skinner, 1953). Although many students master this

goal with little direct instruction, other students may struggle to meet academic and

behavioral demands (Fallon, O’Keefe, Gage, & Sugai, 2015). These struggles may be

more pronounced for students from a low socioeconomic status or a minority population

(Fallon et al., 2015).

Self-monitoring is a self-management strategy that can benefit students with and

without disabilities (Graham-Day, Gardner, & Hsin, 2010; Mathur, Griller Clark,

LaCroix, & Short, 2017; Wills & Mason, 2014). Self-monitoring is the process of

observing and self-recording one’s own behavior in order to increase more socially

appropriate behaviors and generalize those behaviors across multiple settings (Stahr,

Cushing, Lane, & Fox, 2006; Trevino-Maack, Kamp, & Wills, 2015). Self-monitoring

interventions have been associated with increases in various desired behaviors, including

on-task behavior, academic performance, task completion, and social behaviors (Amato-

Zech, Hoff, & Doepke, 2006; Holifield, Goodman, Hazelkorn, & Heflin, 2010; Legge,

DeBar, & Alber-Morgan, 2010; Wills & Mason, 2014).

Self-monitoring interventions vary in design and application. Some self-

monitoring interventions involve prerecorded tones emitted through audio devices

(Graham-Day et al., 2010; Harris, Friedlander, Saddler, Frizzelle, & Graham, 2005).

Page 26: USING SELF-MONITORING TO INCREASE ON-TASK …

18

Others involve a check-in technique where the student self-assesses and records his or her

own behavior using daily behavior cards (Lane, Capizzi, Fisher, & Ennis, 2012; Miller,

Dufrene, Olmi, Tingstrom, & Filce, 2015). Other self-monitoring interventions require

completion of a checklist or yes/no chart to self-monitor behavior (Holifield et al., 2010;

Parker & Kamps, 2011). Some interventions combine technology with pencil-and-paper

reporting systems (Amato-Zech et al., 2006; Legg et al., 2010).

Self-Monitoring to Increase On-Task Behavior

Much of the existing self-monitoring research focuses on students in a traditional

school setting (e.g., public school, elementary level, general education classroom). The

use of behavior checklists, student behavior logs, and self-graphing techniques have been

associated with increased time on-task for students with challenging behaviors at the

elementary (Amato-Zech et al., 2006; Harris et al., 2005; Reid, Trout, & Schartz, 2005;

Rock & Thread, 2007; Stahr et al., 2006; Stotz, Itoi, Konrad, & Alber-Morgan, 2008),

middle school (e.g., Gureasko-Moore, DuPaul, & White, 2007; Sutherland & Snyder,

2007), and high school (Graham-Day et al., 2010; Legge et al., 2010) levels. Since many

students with challenging behaviors are likely to be placed in alternative schools or

juvenile justice facilities, research on self-monitoring in these settings could support

evidence for its use with a wider population.

Self-monitoring with reinforcement. Self-monitoring plus reinforcement (e.g.,

tokens, candy, praise) has been shown to impact on-task behavior. Multiple studies

investigating self-monitoring interventions with reinforcement rewarded participants if

their recorded data matched the researchers’ (e.g., Freeman & Dexter-Mazza, 2004;

Page 27: USING SELF-MONITORING TO INCREASE ON-TASK …

19

Graham-Day et al., 2010), classroom teachers’ (e.g., Wolfe, Heron, & Goddard, 2000), or

peers’ recordings (e.g., Mitchem, Young, West, & Benyo, 2001). Combining accuracy-

and goal-based contingencies is another effective reinforcement technique. For example,

Barry and Messer (2003) used an ABABAB design to assess the effects of self-

monitoring with reinforcement across five sixth-grade students with attention deficit

hyperactivity disorder (ADHD). Target behaviors included on-task behavior, academic

performance, and disruptive behavior. Students created a menu of desired motivators as

a means of reinforcement for reaching pre-determined behavioral goals. Additional

reinforcements were awarded if the student was 100% accurate in response recordings

when compared to the teacher’s data. Across all five participants, on-task behavior and

academic performance were higher during intervention phases than in comparison

phases. Additionally, intervals of disruptive behaviors were lower for each participant

during intervention phases than in comparison phases (Barry & Messer, 2003).

Davis et al. (2014) conducted a similar study in which they provided participants

with reinforcement for both recording accuracy and meeting pre-determined behavioral

goals. During the course of the study, a 15-year-old male with no diagnosed disability

used a VibralLITE 3™ wristwatch to monitor his on-task behavior. The participant had a

chance to earn two tokens during each observation period. The participant earned one

token for meeting a behavioral goal and earned a second token if his recorded data and

that of the observer reached an interobserver reliability rating of at least 80%. After

earning five tokens, the participant could obtain a gift card to a local coffee shop. The

participant’s on-task behavior increased from 62% of observed intervals at baseline to

Page 28: USING SELF-MONITORING TO INCREASE ON-TASK …

20

69% during self-monitoring alone. His on-task behavior increased to 91% of observed

intervals when the self-monitoring with reinforcement was implemented (Davis et al.,

2014).

Mitchem et al. (2001) also conducted a study using reinforcement in conjunction

with self-monitoring. The researchers utilized a class-wide peer-assisted self-

management program (CWPASM) across three seventh-grade, general education classes.

Target behaviors included on-task behavior and the use of social skills (i.e., following

instructions and gaining teacher attention). The CWPASM intervention focused on the

blending of two concepts: teams of peer partners who earned and reported points and

self-management procedures. After random pair assignment, students would rate their

behavior and that of their partner according to the provided rating scale. If the ratings

matched, each pair received points for the team. At the end of each day, the pair with the

most points was declared the winner. If each team’s points exceed points from the

previous day, both teams received reinforcement. During CWPASM, the average

percentage of on-task behavior across all three classes increased from .7% during

baseline to 68.9% during the intervention phase. The on-task behavior of 10 target

students increased from approximately 35% of intervals observed during baseline to 80%

with the intervention. In addition to an increase in on-task behavior, the use of selected

social skills increased across target students (Mitchem et al., 2001).

Self-monitoring and function-based support. Functional behavioral assessment

(FBA) is used to determine the function (i.e., purpose) of a target behavior (e.g., escape

aversive stimulus, obtain pleasant stimulus). An FBA allows a behavior support team to

Page 29: USING SELF-MONITORING TO INCREASE ON-TASK …

21

effectively design and implement interventions related to the function of the problem

behavior (Hansen, Wills, Kamps, & Greenwood, 2014). Multiple studies have

incorporated FBAs as a way to (a) identify the function of the target behavior (e.g., off-

task behavior) and (b) design function-based interventions (e.g., Briere & Simonsen,

2011; Germer et al., 2011; Lo & Cartledge, 2006; Smith & Sugai, 2000; Stahr et al.,

2006). Stahr et al. (2006) examined the effects of a multicomponent, function-based

intervention packet (i.e., color-coded card communication system, self-monitoring, and

extinction) on the behavior of a 9-year-old male in an alternative educational placement

for students with emotional and behavioral problems. The results of the initial FBA

provided the behavioral support team with data indicating that the participant’s off-task

behavior served the dual functions of (a) escape from an undesired task and (b) obtaining

teacher/adult attention. After implementing the intervention, the participant’s on-task

behavior increased, on average, from 34% to 71% of observed intervals during his

language arts class and from 12% to 64% during math instruction (Stahr et al., 2006).

Using an ABAB withdrawal design, Majeika et al. (2011) found similar results

when analyzing the relationship between a functional-assessment based intervention

(FABI) and on-task behavior on a 17-year-old high school student receiving special

education services under other health impairment for ADHD. The intervention involved

three components. The first component focused on adjusting antecedents (i.e.,

developing a behavior contract, implementing a self-monitoring checklist, demonstrating

how to appropriately access teacher attention, having the student in the proper seat, and

increasing circulation around the room). The second component, adjusting the

Page 30: USING SELF-MONITORING TO INCREASE ON-TASK …

22

reinforcement, incorporated increased use of positive behavior supports techniques (i.e.,

behavior specific positive praise, daily and weekly rewards contingent on appropriate

behavior, and PBIS tickets). The final component, extinction, included ignoring off-task

behavior while increasing praise for desired behavior (i.e., withholding attention for off-

task behavior, providing specific praise to others for appropriate behavior, and using brief

if/then redirection). Data showed that on-task behavior averaged 53% of intervals

observed during the baseline phase, 80% during the intervention phase, 48% during the

withdrawal phase, 83% during reintroduction of the intervention, and 70% during the

maintenance phase. Results indicated a functional relationship between the FABI and

on-task behavior (Majeika et al., 2011).

Self-monitoring with technology. The integration of technology in self-

monitoring interventions has proven effective as (a) a prompting device to record

behavior and (b) a medium for recording behavioral data. Prompting devices include

audiotape players (e.g., Freeman & Dexter-Mazza, 2004), cellphones (e.g., Bedesem,

2012), electronic tablets (e.g., Blood et al., 2011), personal digital assistants (PDA; e.g.,

Gulchak, 2008), and a MotivAider™ (e.g., Briesch & Daniels, 2013). Researchers have

also used technology as both a prompting device and a medium for recording data

(Bedesem, 2012; Gulchak, 2008; Wills & Mason, 2014).

Gulchak (2008) used a PDA (i.e., Palm Zire 72) as a self-monitoring device to

prompt and record on-task behavior in 10 min intervals during a 1-hr reading period.

Using an auditory alarm notification, the PDA prompted the sole participant, an 8-year-

old male diagnosed with EBD, to check the on-task box on the PDA as “yes” or “no”

Page 31: USING SELF-MONITORING TO INCREASE ON-TASK …

23

every 10 min. At the end of the period, the participant would run a summary report and

graph behavioral progress by manually typing the data into a spreadsheet. After the

implementation of the self-monitoring interventions, on-task behavior increased from

64% of observed intervals to 98% (Gulchak, 2008).

Using more current technology, Bedesem (2012) studied the effect of an

intervention called “CellF-monitoring” on the on-task behavior of two middle school

students receiving inclusion services in a general education language arts classroom.

Self-monitoring prompts were sent via text messages to cellphones four times at 5 min

intervals during the observation period. The text messages prompted students to answer,

“Are you on task?” by typing “1” for “Yes” and “0” for “No”. Data indicated that on-

task behavior increased, on average, from 45% of observed intervals to 71% during the

CellF-monitoring intervention phase (Bedesem, 2012).

Similarly, Wills and Mason (2014) investigated the impact of tablet-based

prompts on the on-task behavior on two high school students receiving special education

services in a general education classroom. The I-Connect application on a Samsung

Galaxy Player 5.0 tablet prompted participants to self-monitor at 5 min fixed intervals

during the observation period. Visual cues (i.e., flashing screen) prompted students to

answer, “Are you on task?” with a yes/no option displayed on the tablet. Results

indicated that on-task behavior increased, on average, from 35% of intervals observed to

92% during the intervention phase (Wills & Mason, 2014).

Page 32: USING SELF-MONITORING TO INCREASE ON-TASK …

24

Self-Monitoring to Increase Academic Performance

Although research supports the use of self-monitoring as an effective method for

increasing desired behaviors, results are mixed when measuring the effects of self-

monitoring on academic performance. For example, Lannie and Martens (2008) used a

multiple baseline design across participants to determine the effects of self-monitoring on

on-task behavior, academic productivity, and academic accuracy during math instruction.

Study participants were four elementary students diagnosed with specific learning

disabilities. All participants had a documented history of off-task behavior and exhibited

difficulties in the area of math fluency. After implementing self-monitoring strategies,

on-task behavior increased across all participants; however, participants exhibited

differential effects with accuracy and productivity (Lannie & Martens, 2008).

Similar to Lannie and Martens (2008), Wolfe et al. (2000) examined the effects of

self-monitoring on a target behavior and academic performance. Wolfe et al. used a

reversal ABABABC experimental design with changing criterion to examine the effects

of self-monitoring on on-task behavior and written language performance of four 9-year-

old students receiving special education services in a resource room. Although results

indicated a functional relationship between self-monitoring and on-task behavior, no

functional relationship was determined between the intervention and written language

performance (Wolfe et al., 2000).

Caldwell and Joseph (2012) also examined the effects of a self-monitoring

intervention on on-task behavior, academic productivity, and academic accuracy during

math instruction. This study utilized a reversal ABABC design across participants. The

Page 33: USING SELF-MONITORING TO INCREASE ON-TASK …

25

participants were three high school females housed in a maximum-security juvenile

facility. At the time of the study, all participants received special education services and

had a documented history of behavioral problems (e.g., off-task). Results indicated that

on-task behavior increased minimally as a result of the self-monitoring intervention

(Caldwell & Joseph, 2012). Similar to results determined by Lannie and Martens (2008),

there was little evidence to support a functional relationship between self-monitoring and

academic productivity and accuracy.

In a similar study, Lively et al. (2019) used a randomized multiple-baseline design

across participants to examine the effects of a self-monitoring intervention on on-task

behavior on three male students in a secure juvenile facility. At the time of the pilot

study, two of the three students received special education services. The self-monitoring

intervention took place in a high school English class and consisted of a student

worksheet to track behavior, a vibrating watch to remind students to record their behavior

every 5 minutes, and one-on-one training on how to use the intervention tools. Results

indicated that the self-monitoring intervention was associated with an increase in on-task

behavior across all three students (Lively et al., 2019).

Rationale for the Current Study

Research indicates that the implementation of self-monitoring both alone and with

additional components (e.g., reinforcement) can be an effective intervention for

increasing on-task behavior for students with challenging and problematic behaviors

across grade levels (i.e., elementary, middle, and high school). Results from studies of

interventions combining self-monitoring with reinforcement also indicated increased on-

Page 34: USING SELF-MONITORING TO INCREASE ON-TASK …

26

task behavior for participants; however, results did not indicate a functional relationship

between self-monitoring (alone or with reinforcement) and an increase in academic

productivity, accuracy, and achievement.

While EBD is prevalent among students in juvenile justice facilities, little

research exists on the use of school-based self-monitoring with this population (Barry &

Gaines, 2008). Much of the research examining the use of self-monitoring techniques in

the juvenile justice system involve trauma-based care interventions (Ford & Blaustein,

2013; Havens, Ford, Grasso, & Marr, 2012; Steiner et al., 2011).

As previously mentioned, both students with EBD and those involved in the

juvenile justice system commonly exhibit difficulties with self-regulation (Barkley, 2006;

Hummer et al., 2011; Moilanen, 2007; Mueller & Tomblin, 2012). Students who are

unable to effectively master self-regulation are at a greater risk of engaging in antisocial

and criminal behavior (Cauffman & Steinberg, 2000; Vitacco, Neumann, Robertson, &

Durrant, 2002). Fine et al. (2018) examined the effects of students’ attitudes on self-

regulation and recidivism rates in the Florida Juvenile Justice System. Results indicated

that students with higher levels of self-regulation were less likely to recidivate than

students with lower levels of self-regulation. However, it should be noted that the effect

of self-regulation diminished as criminal attitudes increased (Fine et al., 2018).

Self-regulation skills allow students to be more actively engaged in the

educational process. Given the academic and behavioral needs of incarcerated juveniles,

instruction in self-regulation is essential. There continues to be a need to further

investigate the effectiveness of self-monitoring on desired behavior of students involved

Page 35: USING SELF-MONITORING TO INCREASE ON-TASK …

27

in the juvenile justice system. The purpose of this replication study was to investigate the

effects of a self-monitoring intervention on on-task behavior of students who are

incarcerated in a secure justice facility. This study contributes to the current literature

base on effective practices for educating students in the juvenile justice system, the

effectiveness of self-monitoring, and the ability of teachers to implement an efficient

intervention with students with a wide range of behaviors and disabilities in a secure

juvenile setting.

Page 36: USING SELF-MONITORING TO INCREASE ON-TASK …

CHAPTER III

METHODOLOGY

The current replication study used a concurrent baseline design across participants

with randomized intervention start points and order of intervention to determine if there

was a functional relationship between the self-monitoring intervention and an increase in

on-task behavior. This chapter describes the methods for implementing this study.

Specifically, this chapter provides a description on the setting, participants, independent

variable, dependent variable, interobserver agreement, social validity measures, study

design, procedures, fidelity of implementation, and data analysis.

Setting

Prior to beginning any research and recruitment, I obtained all necessary

permissions from the institutional review board and the facility where the research was

conducted. The study took place in a secure juvenile facility in Texas with an average

daily population of 116 male students in grades nine through twelve. At the time of the

study, the school’s population was 40% African American, 29% Hispanic, 20%

Caucasian, <1% Native American, and <1% other. Approximately 8% of the population

was Limited English Proficient and 31% of the population received special education

services. Students with EBD accounted for approximately 60% of the campus special

education population. Students housed in the secure facility were between 15 and 18.11

years of age.

Page 37: USING SELF-MONITORING TO INCREASE ON-TASK …

The secure juvenile facility offered educational, medical, residential, and

therapeutic services to students. In 2016, the facility completed facility-wide PBIS

implementation. The multi-tiered system of support was implemented to increase desired

behaviors and decrease undesired behaviors through the delivery of structured

reinforcement and support. Students attended school five days a week except for state

holidays and predetermined breaks (e.g., professional development days, incentive days,

and annual leave days). The school operated on a year-round, modified A/B block

schedule. Students attended three 69-min long classes per day for a total of 207

instructional minutes per day.

Classes ranged from three to eight students with one certified teacher of record

providing instruction. Enrollment fluctuated due to schedule changes and the result of

students being released and admitted to the facility. Although there were at least two

juvenile correctional officers assigned to each hallway, an officer was not specifically

assigned to the classroom used in the study. To be eligible for the study, students had to

be (a) between 14 and 18.5 years old; (b) have documentation (e.g., teacher reports,

discipline referrals, academic records) indicating a history of inattention, off-task

behavior, distraction, and low-level disruptive behavior during academic classes; and (c)

have a math class with the teacher designated for the study.

The math teacher’s classroom was chosen for this study because of the (a) number

of students seen by the math teacher each day and (b) the willingness of the math teacher

to serve as the interventionist. He had been a math teacher at the facility for five years

and was certified in mathematics (Grades 8-12). Students in his classroom were seated at

Page 38: USING SELF-MONITORING TO INCREASE ON-TASK …

30

individual desks arranged in four rows with three desks per row. The teacher provided

group instruction at the front of the room using an interactive board. While students

worked individually, the teacher circulated the room.

The math teacher reviewed the eligibility criteria (described above) and created a

list of students who met that criteria based on his own observations, office discipline

referral data, and daily behavior reports. Once students were identified by the teacher, I

gained assent from each student. Using a verbal script, I explained the study to each

student privately (i.e., one-on-one) before math class and included the expectations for

their participation, the purpose of the study, and a clear statement about the student’s

ability to withdraw from the study at any time without having to state a reason. After I

obtained student assent, the education clerk at the school sent a parental consent form to

the parents/guardians of potential participants. The letter was mailed (via US mail) in an

envelope containing (a) the consent form and (b) a self-addressed stamped envelope for

the parents to return the form if they gave permission for their child to participate.

Parental consent forms were available in Spanish, if records indicated Spanish was the

parents’ preferred language of communication. One student identified by the teacher was

over the age of 18. The education clerk at the school sent an adult student consent form

to the student’s housing unit located at the facility. The letter was in an envelope that

contained (a) the consent form and (b) an interdepartmental envelope for the student to

return the form if giving consent.

Page 39: USING SELF-MONITORING TO INCREASE ON-TASK …

31

Participants

Three of the 12 students nominated by the teachers were selected to participate in

the study. See Table 1 for demographics for each participant.

Table 1

Demographic Characteristics of Participants

Participant Age Race Grade Disability

LEP

Status

Months in

Facility

1 18 B 11 ID/ED No 5

2 17 H 11 ADHD Yes 6

3 16 W 10 ED No 6

Note. Race. B = Black, H = Hispanic, W = White. Disability. ADHD = Attention Deficit Hyperactivity

Disorder, ED = Emotional Disturbance, ID = Intellectual Disability

Student 1

Student 1 was an 18-year-old Black male classified as an eleventh grader

receiving special education; he was diagnosed with both an intellectual disability and an

emotional disturbance. According to his Individualized Education Program (IEP), he had

academic and behavioral accommodations, a modified curriculum, and inclusion support

in his math course. He had been incarcerated at the facility for 5 months at the time the

study began and had a documented history of inattention, off-task behavior, and low-level

disruptive behavior. Since arriving at the facility, he had received 25 behavior reports

(i.e., the facility’s version of office discipline referrals); 18 occurred in the math

classroom used in the study. He received seven incident reports (i.e., four major rule

violations and three minor rule violations). Of the seven incidents, one minor rule

Page 40: USING SELF-MONITORING TO INCREASE ON-TASK …

32

violation (i.e., “horse playing”) took place in the math classroom. Based on his grade

report history, his average in math at the time the study began was 72%. The Test of

Adult Basic Education (TABE) is a diagnostic tool used to assess an individual’s grasp of

the basic skills needed to be successful in both the academic arena and workplace. TABE

assessments are administered and scored using computer software. Scores range from the

0.0 grade-level to the 12.9 grade-level. According to TABE results, he scored at the 2.1

grade-level in reading and the 1.6 in math. See Table 2 for behavioral and academic

characteristics of all participants.

Student 2

Student 2 was a 17-year-old Hispanic male classified as an eleventh grader

receiving special education; he was diagnosed with ADHD and was eligible for special

education under the “other health impairment” category. According to his IEP, he

received academic and behavioral accommodations in his math course. He was also

classified as Limited English Proficient and participated in the school English as a

Second Language program. He had been incarcerated at the facility for 6 months and had

a documented history of inattention, off-task behavior, and low-level disruptive behavior.

Since arriving at the facility, he received 22 behavior reports; 10 occurred in the math

classroom used in the study. He received three incident reports for minor rule violations.

Of the three incidents, two minor rule violations (i.e., both “undesignated area”) took

place in the math classroom. Based on his grade report history, his average in math at the

time the study began was 75%. According to TABE results, he scored at the 5.6 grade-

level in reading and the 7.9 in math.

Page 41: USING SELF-MONITORING TO INCREASE ON-TASK …

33

Student 3

Student 3 was a 16-year-old White male classified as a tenth grader receiving

special education services; he was diagnosed with an emotional disturbance. According

to his IEP, he received academic and behavioral accommodations in his math course. He

had been incarcerated at the facility for 6 months and had a documented history of

inattention, off-task behavior, and low-level disruptive behavior. Since arriving at the

facility, he received 48 behavior reports (similar to office discipline referrals); 29

occurred in the math classroom used in the study. He received 20 incident reports (i.e.,

six major rule violations and 14 minor rule violations). Of the 20 incidents, four minor

rule violations (i.e., “refusal to follow staff instructions, “horse playing”, and “disruption

of scheduled activity”) took place in the math classroom. Based on his grade report

history, his average in math at the time the study began was 62%. According to TABE

results, he scored at the 10.7 grade-level in reading and the 9.9 in math.

Table 2

Academic and Behavioral Characteristics of Participants

Number of

Behavior Reports

Number of

Incident Reports

Participant

TABE

Reading

TABE

Math

Current

Math

Average Total In Math Total In Math

1 2.1 1.6 72 25 18 7 1

2 5.6 7.9 75 22 10 3 2

3 10.7 9.9 62 48 29 20 4

Note. TABE scores correlate with grade-level.

Page 42: USING SELF-MONITORING TO INCREASE ON-TASK …

34

Independent Variable

The independent variable in this study was a self-monitoring tool which consisted

of a worksheet to track behavior, a vibrating watch to remind students to record their

behavior (with a reminder set for 5-min intervals), and training in how to use the

worksheet and vibrating watch. The different phases of intervention are described in

detail in the “Procedures” section.

Dependent Variable

The dependent variable was on-task behavior. On-task behavior was defined as a

student doing all of the following: (a) sitting in his seat; (b) looking at work on his desk;

(c) directing his attention to an area or object as indicated by the teacher; (d) remaining

silent unless asking a question or responding to a question; and (e) following classroom

expectations, including keeping hands to himself, raising hand to contribute, and

following all teacher directions within 5 s of being asked. Data were collected during 15-

min direct observations using 10-s whole-interval recording to determine the percentage

of intervals per observation with on-task behavior (see Appendix A). Data collectors

calculated the percentage of intervals with on-task behavior by dividing the total number

of intervals with on-task behavior by the total number of intervals observed (i.e., 90

intervals observed in a 15-m observation) to yield a percentage.

Data collectors

Data collectors were four special education doctoral students. All data collectors

completed both the online Social and Behavioral Research – Basic/Refresher and Social

and Behavioral Responsible Conduct of Research training courses provided through the

Page 43: USING SELF-MONITORING TO INCREASE ON-TASK …

35

CITI Program. This was followed by successful completion of the IRB approval process

at Texas Woman’s University and background checks conducted by the secure facility.

Data collectors were trained prior to the study to ensure that could accurately collect data.

Training consisted of (a) an operational definition of on-task behavior, including

examples and non-examples; (b) practice collecting data on on-task behavior using the

10-s whole-interval coding sheet; and (c) practice documenting treatment fidelity using

the fidelity checklist (see Appendix B). I trained data collectors for two hours prior to the

start of the study. Training took place in a natural setting. Data collectors had to

demonstrate 90% or greater inter-observer agreement (IOA) across three consecutive

observations prior to the beginning of the study. IOA was determined by dividing the

number of agreed-upon observations by the total number of intervals observed.

For the 81 direct observations, 27 of them were done with two data collectors to

establish IOA. IOA was calculated for 33% (i.e., 27/81) of the observations. To ensure

the integrity of the reliability checks, checks were scheduled at random throughout the

duration of the study. Overall IOA for the study was 93% (range 76%-100%), calculated

by dividing the total number of intervals with agreement by the total number of intervals

observed and calculating a percentage.

Social Validity

The Self-Monitoring Intervention Social Validity Survey: Student and Teacher

Versions (Lively et al., 2019) were used to collect descriptive data on social validity of

the intervention from the students’ and teacher’s perspectives. At the conclusion of the

study, the students and the math teacher were given a corresponding social validity

Page 44: USING SELF-MONITORING TO INCREASE ON-TASK …

36

survey. The five-question surveys used a 5-point Likert scale, with 5 representing

strongly agree and 1 representing strongly disagree, to determine participant satisfaction

with the intervention. The surveys included questions about satisfaction with (a) the ease

of the intervention, (b) whether the person would recommend the intervention to others,

(c) the time commitment of the intervention, (d) the effectiveness of the intervention, and

(e) whether the person would be inclined to use the intervention in the future. A copy of

each questionnaire is included in Appendix C and D.

Procedure

This replication study was a single-subject, concurrent baseline design across

participants with randomized intervention start points and order of intervention.

Randomizing the order participants receive the intervention and the intervention start

points reduces threats to internal validity in single-subject design (Levin, Ferron, &

Gafurov, 2016). After the participants were selected and the requisite consent and assent

obtained, a member of the research team assigned each participant a number. I only had

access to the numbers and the data were only identifiable by number; I had no access to

identifiable information about each participant for this process. Participant numbers were

put into an opaque container, then three numbers were drawn and listed on a whiteboard.

After the order was randomly assigned, all participants were randomly assigned an

intervention start point. It was predetermined that each participant would have at least

five baseline data collection observations. I wrote each number from 6-20 on a piece of

paper, folded the papers, and placed the numbers in an opaque container. Then, I

selected a number for each participant number (in the order which the participants’

Page 45: USING SELF-MONITORING TO INCREASE ON-TASK …

37

numbers appeared on the whiteboard). This number determined the data point where the

intervention began. Once the start points were determined, baseline data collection

began. The baseline, intervention, and maintenance phases of the study are described

below.

Baseline

During the baseline phase, trained data collectors completed a minimum of five

15-min observations of each of the three participants using 10-s whole-interval recording

to determine levels of on-task behavior. Observations occurred during the first 15 min of

each participant’s scheduled math class to minimize possible disruption. Data collectors

conducted baseline observations over 60 calendar days (i.e., 15 days for Student 1, 31

days for Student 2, and 60 days for Student 3). Data collection for the entire study

occurred over 88 calendar days.

Intervention

After completing baseline data collection for the first participant as determined

through the random-assignment process described above, a doctoral student conducted a

1-hour training session with the math teacher. Using training methods similar to those

used by Lively et al. (2019), the doctoral student followed a training checklist and

explained the self-monitoring intervention, described the operational definition of on-task

behavior, and provided the teacher copies of all training materials, student self-

monitoring sheets, and a programmable watch set to vibrate at predetermined intervals. I

observed the teacher training and completed a procedural fidelity checklist to ensure all

components were covered in the training. The procedural fidelity checklist provided

Page 46: USING SELF-MONITORING TO INCREASE ON-TASK …

38

spaces to check off when the following were provided: (a) an explanation of the self-

monitoring intervention; (b) an operational definition of on-task behavior; and (c) copies

of all training materials, self-monitoring sheets, and tools needed (i.e., vibrating watch).

At the conclusion of each participant’s baseline phase, the math teacher scheduled

a 15-min training session with each student participant. The individual training sessions

took place in the math teacher’s classroom and consisted of the math teacher training the

student participant in the self-monitoring intervention using a script developed by me.

During the training, the math teacher demonstrated how to use the self-monitoring sheet

(see Appendix E) and provided examples and non-examples of on-task behavior. The

teacher explained to the student that when he felt the watch vibrate, he would mark a “+”

in the corresponding box on the self-monitoring sheet if he was on task and a “-” if he

was not on task based on the previously provided examples and non-examples of on-task

behavior. I observed the student training sessions and completed a procedural fidelity

checklist to ensure all components were covered in the training. The procedural fidelity

checklist provided spaces to check off when the following were provided: (a) an

explanation of how to use the self-monitoring sheet; (b) a demonstration of how to use

the vibrating watch; and (c) an operational definition of on-task behavior including

examples and non-examples of on-task behavior.

On the first day of each student’s intervention phase, the math teacher provided

the student with the self-monitoring sheet and the vibrating watch at the beginning of the

class and provided a verbal reminder that the student would be prompted by the watch

every 5 min and should mark a “+” or “-” to identify whether or not he was on-task at

Page 47: USING SELF-MONITORING TO INCREASE ON-TASK …

39

that moment. At the conclusion of the class period, the math teacher collected the

vibrating watch and the student self-monitoring sheets and filed the sheets in the

student’s work folders. These sheets were not used as data for the study. Although direct

observation occurred for the only the first 15 min of the class, students were expected to

self-monitor for the 69-min class period. There was no additional reinforcement or

prompting to accompany the self-monitoring intervention in order to investigate if self-

monitoring alone (i.e., increasing awareness of one’s own behavior) increased the

likelihood of on-task behavior. During the intervention phase, data collectors observed

each student participant until at least six data points had been collected or until the data

appeared to be stable, at which point the intervention was discontinued.

Maintenance

During the maintenance phase, students no longer had access to the vibrating

watch. The student could still request the self-monitoring sheet from the teacher when he

picked up his materials at the beginning of the math class. If this occurred, the math

teacher provided the student with the self-monitoring sheet. As in the intervention phase,

the teacher collected the self-monitoring sheet at the end of class and filed it in the

student’s work folders. During maintenance, students received no further reinforcement

or prompting from the math teacher to self-monitor.

Fidelity

Prior to the start of the study, I conducted an individual 30 min training session

with a doctoral student. During the training, I (a) explained the self-monitoring

intervention; (b) described the operational definition of on-task behavior (including

Page 48: USING SELF-MONITORING TO INCREASE ON-TASK …

40

examples and non-examples); (c) provided the doctoral student copies of all training

materials, student self-monitoring sheets, and a programmable watch, and (d)

demonstrated how to complete the teacher training. The trained doctoral student

followed a training checklist to train the math teacher. I observed the teacher training and

completed a procedural fidelity checklist to ensure that the trainer (a) explained the self-

monitoring intervention; (b) described the operational definition of on-task behavior

(including examples and non-examples); and (c) provided the teacher copies of all

training materials, student self-monitoring sheets, and a programmable watch set to

vibrate at predetermined intervals.

Prior to beginning each student’s intervention phase, the math teacher scheduled a

15-min scripted training session with each student. During the individual training

sessions, the math teacher described on-task behavior (including examples and non-

examples) and demonstrated how to use the self-monitoring sheet. Specifically, the

teacher explained to the student that when he felt the watch vibrate (5-min intervals), he

would mark a “+” on the self-monitoring sheet if he was on task and a “-” if not on task

based on the previously provided examples and non-examples of on-task behavior. I

observed each individual training sessions and completed a procedural fidelity checklist

to ensure these steps were covered in the training.

During each observation in the intervention and maintenance phases, data

collectors completed a fidelity check. The fidelity checklist included two components.

The first component corresponded with the intervention phase. During direct

observation, data collectors recorded whether the student completed the task “fully” (i.e.,

Page 49: USING SELF-MONITORING TO INCREASE ON-TASK …

41

recorded behavior on SM sheet 100% of the time when prompted), “partially” (i.e., did

not SM 100% of the time but did more than 0% of the time), or “not at all” (i.e., did not

obtain the watch or did not SM when prompted). The second fidelity checklist

component corresponded to the maintenance phase. During direct observation, data

collectors recorded whether the student completed the task “fully” (i.e., obtained the SM

sheet from the teacher and recorded behavior at least once), “partially” (i.e., obtained the

SM sheet from the teacher but did not record behavior), or “not at all” (did not obtain the

SM sheet from the teacher). Of the 81 direct observations, 48 occurred during the

intervention and maintenance phases. For the 48 direct observations taking place after

baseline, data collectors completed the fidelity check 100% (i.e., 48/48) of the

observations.

Data analysis

The data were visually analyzed to determine whether there were between-phase

changes in each student’s response level. Specifically, visual analysis was used to assess

whether increases in students’ levels of on-task behavior occurred simultaneously with

the staggered introduction of the self-monitoring intervention. If the introduction of the

intervention coincided with the students’ levels of on-task behavior, visual analysis was

used to determine whether those increases continued throughout the intervention and

maintenance phased.

Page 50: USING SELF-MONITORING TO INCREASE ON-TASK …

CHAPTER IV

RESULTS

The current replication study was designed to determine if there was a functional

relationship between self-monitoring and an increase in on-task behavior in three male

students in a secure juvenile facility. During each observation, trained data collectors

used 10-s whole-interval recording to track the student’s on-task behavior. In addition,

data collectors completed an intervention fidelity checklist during each intervention and

maintenance phase observation. Three students participated in the replication study. The

following section will discuss the results of all three students, beginning with an

overview of the data and then a detailed examination of the results for each individual

student.

Overview of the results

Figure 1 provides a graphic representation of the percentage of intervals with on-

task behavior data for each of the three students. Visual analysis of Figure 1 indicated a

functional relationship between the intervention of self-monitoring and student on-task

behavior. The introduction of the self-monitoring intervention was followed by an

immediate and sustained increase in student on-task behavior.

Student 1

Student 1 had five baseline observations and averaged 37% of intervals with on-

task behavior (range 27-46%). During the intervention phase, he was observed six times

Page 51: USING SELF-MONITORING TO INCREASE ON-TASK …

and averaged 79% of intervals with on-task behavior (range 70-91%). Student 1 had 16

maintenance observations, during which he averaged 63% of intervals with on-task

behavior (range 57-77%). Visual analysis indicated an immediate and clear separation of

level between baseline phase and the intervention phase with no overlapping data points

between the two phases.

His behavior reports (i.e., the facility’s version of office discipline referrals)

decreased from 25 to 7 overall and from 18 to 0 in the math classroom. His incident

reports decreased from seven to zero. His incident reports in the math classroom

decreased from one to zero. Based on his grade report history, his academic average in

math increased from 72% prior the intervention to 81% at the conclusion of the study.

According to TABE results, his score in reading increased from the 2.1 grade-level to the

3.2 grade-level. Similarly, his score in math increased from 1.6 to 4.5. See Table 3 for

behavioral and academic results of all participants.

Student 2

Student 2 had 11 baseline observations and averaged 45% of intervals with on-

task behavior (range 29-78%). During the intervention phase, he was observed six times

and averaged 87% of intervals with on-task behavior (range 76-100%). Student 2 had 10

maintenance observations, during which he averaged 81% of intervals with on-task

behavior (range 78-86%). Visual analysis indicated an immediate and clear separation of

level between baseline phase and the intervention phase with one datum point

(observation 1) that overlapped with the baseline phase (observation 15). It should be

Page 52: USING SELF-MONITORING TO INCREASE ON-TASK …

44

noted that during observation 1, an inclusion teacher provided one-on-one support to

Student 2 for 11 minutes of the 15-min observation.

His behavior reports decreased from 22 to 13 overall and from 10 to 0 in the math

classroom. His incident reports decreased from three to one. His incident reports in the

math classroom decreased from two to zero. Based on his grade report history, his

academic average in math increased from 75% prior the intervention to 86% at the

conclusion of the study. His TABE score in reading increased from the 5.6 grade-level

to the 6.9 grade-level. Similarly, his score in math increased from 7.9 to 9.9.

Student 3

Student 3 had 17 baseline observations and averaged 39% of intervals with on-

task behavior (range 29-50%). During the intervention phase, he was observed six times

and averaged 77% of intervals with on-task behavior (range 69-81%). Student 3 had four

maintenance observations, during which he averaged 70% of intervals with on-task

behavior (range 68-72%). Visual analysis indicated an immediate and clear separation of

level between baseline phase and the intervention phase with no overlapping data points

between the two phases.

His behavior reports decreased from 48 to 27 overall and from 29 to 0 in the math

classroom. His incident reports decreased from 20 to 12. His incident reports in the math

classroom decreased from four to zero. Based on his grade report history, his academic

average in math increased from 62% prior the intervention to 78% at the conclusion of

the study. At the conclusion of the study, Student 3 had not retaken the TABE

assessment; therefore, updated TABE results were not available.

Page 53: USING SELF-MONITORING TO INCREASE ON-TASK …

45

Figure 1. Participants’ Percentage of Intervals with On-Task Behavior

Page 54: USING SELF-MONITORING TO INCREASE ON-TASK …

46

Table 3

Academic and Behavioral Results of Participants

Number of

Behavior Reports

Number of

Incident Reports

Participant

TABE

Reading

TABE

Math

Current

Math

Average Total In Math Total In Math

1 3.2 4.5 81 7 0 0 0

2 6.9 9.9 86 13 0 1 0

3 10.7 9.9 78 27 0 12 0

Note. TABE scores correlate with grade-level. Student 3 did not have updated TABE results.

Intervention Fidelity

I observed all teacher and student training sessions. A doctoral student conducted

a 1-hour training session with the math teacher. During the training session, the doctoral

student followed a training checklist and explained the self-monitoring intervention,

described the operational definition of on-task behavior, and provided the teacher copies

of all training materials, student self-monitoring sheets, and a programmable watch set to

vibrate at predetermined intervals. I observed the teacher training and completed a

procedural fidelity checklist. The checklist provided spaces to check off when the

following occurred: (a) an explanation of the self-monitoring intervention, (b) an

operational definition of on-task behavior, and (c) provided the math teacher with copies

of all training materials, self-monitoring sheets, and tools needed (i.e., vibrating watch).

Fidelity was 100% for the teacher training session.

Page 55: USING SELF-MONITORING TO INCREASE ON-TASK …

47

Prior to the start of each student’s intervention phase, the math teacher scheduled

a 15-min scripted training session with each student. During the individual training

sessions, the math teacher described on-task behavior (including examples and non-

examples) and demonstrated how to use the self-monitoring sheet. I observed each

individual training sessions and completed a procedural fidelity checklist to ensure all

components were covered in the training. Fidelity was 100% for all three student training

sessions.

Treatment Integrity

During the intervention and maintenance phases, data collectors completed a

fidelity checklist during each observation to determine whether the student completes the

self-monitoring intervention “fully,” “partially,” or “not at all.” Of the 81 direct

observations, 48 occurred during the intervention and maintenance phases. For the 48

direct observations taking place after baseline, data collectors completed the fidelity

check 100% (i.e., 48/48) of the observations. Student 1 used the interventions “fully”

100% of the time observed (i.e., six intervention observations and 16 maintenance

observations). Student 2 used the interventions “fully” 100% of the time observed (i.e.,

six intervention observations and 10 maintenance observations). Student 3 used the

interventions “fully” 100% of the time observed (i.e., six intervention observations and

four maintenance observations).

Social Validity

To evaluate the efficiency and effectiveness of using self-monitoring to increase

on-task behavior, each student participant was asked to complete the Self-Monitoring

Page 56: USING SELF-MONITORING TO INCREASE ON-TASK …

48

Intervention Social Validity Survey: Student Version (see Appendix C). Students were

asked to complete the survey at the conclusion of the maintenance phase. The five-

question survey used a 5-point Likert scale, with 5 representing strongly agree and 1

representing strongly disagree, to determine participant satisfaction with the intervention.

The results are listed in Table 4.

Table 4

Social Validity Rating by Participants

Survey Item Mean Range

The self-monitoring intervention was easy to use. 4.7 4-5

I would recommend self-monitoring to other students. 4.7 4-5

Self-monitoring did not take up too much of my time. 4.7 4-5

Self-monitoring was effective at improving my behavior. 5.0 5

I will use self-monitoring in the future. 5.0 5

All three students chose 4 (agree) or 5 (strongly agree) for the first three items

indicating that (1) the self-monitoring intervention was easy to use, (2) they would

recommend it to other students, and (3) that it did not take up too much time. All three

students chose 5 (strongly agree) to the final two questions indicating that self-

monitoring was effective at improving behavior and that they would use it in the future.

The math teacher was asked to complete the Self-Monitoring Intervention Social

Validity Survey: Teacher Version (see Appendix D). The math teacher was asked to

Page 57: USING SELF-MONITORING TO INCREASE ON-TASK …

49

complete the survey at the conclusion of the maintenance phase. The five-question

survey used a 5-point Likert scale, with 5 representing strongly agree and 1 representing

strongly disagree, to determine the teacher’s satisfaction with the intervention. The

teacher chose 5 (strongly agree) for all survey questions: the self-monitoring intervention

was easy to use, self-monitoring recommended to other teachers, self-monitoring did not

take up too much time, self-monitoring was effective at improving student behavior, and

self-monitoring will be used in the classroom in the future.

Page 58: USING SELF-MONITORING TO INCREASE ON-TASK …

CHAPTER V

DISCUSSION

Self-monitoring interventions have been effective at increasing desired behaviors

in both students in the general education setting and those with EBD (Bruhn et al., 2014;

Wexler et al., 2014). Although EBD is prevalent among students in the juvenile justice

system, limited research exists on the use of self-monitoring to increase desired behaviors

in the school setting (Barry & Gaines, 2008). The purpose of this study was to determine

if there was a functional relationship between self-monitoring and an increase in on-task

behavior in three males in a secure juvenile facility. This study was a systematic

replication of the Lively et al. (2019) pilot study that investigated the impact of self-

monitoring on the on-task behavior of adjudicated juvenile males in an English class.

For all three students, the introduction of self-monitoring resulted in an immediate

and sustained increase in on-task behavior. When the vibrating watch was removed (i.e.,

maintenance phase), all three students continued to maintain on-task behavior at rates

above baseline. Additionally, all three students saw a decrease in behavior and incident

reports and an increase in their academic average in math.

Limitations

The current study does have limitations that should be considered when

evaluating and interpreting the findings. First, one limitation of single-case research is

the limited potential for generalization (i.e., external validity). There were no

Page 59: USING SELF-MONITORING TO INCREASE ON-TASK …

generalization probes in other classrooms in the facility. It is unclear whether improved

on-task behavior as a result of the self-monitoring intervention would generalize to the

students’ other academic classes or other students in different juvenile justice facilities or

alternative settings. Because the study was conducted in a math classroom with a range

of three to eight students, the extent to which similar results would generalize to other

settings containing a larger range of students is unknown.

Additionally, all observations were conducted in a school setting within a secure

juvenile facility, and certain environmental factors could not be controlled (e.g.,

interruptions, specialized services, and student behavior). For example, during one

observation, an inclusion teacher provided one-on-one support to a student participant.

On four occasions the math teacher was absent, and a substitute teacher covered the class.

Implications

The findings of this study support application of self-monitoring interventions on

increasing on-task behavior on students in a secure juvenile facility.

Implications for Researchers

External validity is strengthened when researchers replicate the experimental

procedures of another study and obtain similar results (Richards, Taylor, & Ramasamy,

2014). One important aim of this study was to strengthen external validity through

replication of Lively et al. (2019). Similar results were obtained in both studies. Results

of this replication study indicated a functional relationship between the self-monitoring

intervention and an increase in on-task behavior in incarcerated male students in a math

classroom. Literature documents the effectiveness of self-monitoring interventions

Page 60: USING SELF-MONITORING TO INCREASE ON-TASK …

52

across diverse groups; however, limited research exists on self-monitoring interventions

in secure juvenile facilities (Caldwell & Joseph, 2012; Lively et al., 2019). Replicating

this study would be an important next step to determine if similar results can occur with

additional dependent variables. Although this study sought to increase on-task behavior,

it should be noted that all three student participants increased their academic average in

math. Future studies should explore the use of a self-monitoring intervention to increase

both on-task behavior and academic performance. Researchers could also expand on the

findings of the current study by modifying elements of the independent variable (e.g.,

changing the watch to a timer).

Another implication for researchers is the need for replication across settings.

Lively et al. (2019) examined the use of a self-monitoring intervention in an English

classroom while this replication study took place in a math classroom. Future studies

should explore the effectiveness of self-monitoring across settings to see if students in the

juvenile justice setting can generalize behavior across multiple classrooms.

A final implication for researchers addresses the need for additional maintenance

probes. While this study included maintenance data, it is difficult to determine long-

range effects of the self-monitoring intervention on on-task behavior. Future studies

should examine longitudinal data to determine the effectiveness of the intervention across

participants.

Implications for Practitioners

Finding simple interventions is critical given the demands on teachers, especially

for those who address high rates of problematic behaviors (e.g., teachers in juvenile

Page 61: USING SELF-MONITORING TO INCREASE ON-TASK …

53

justice settings). Results from the social validity questionnaire indicated that the self-

monitoring intervention was an efficient intervention that was easy to use and required

limited resources. This study represents how a low-cost, low-resource intervention can

substantially impact student behavior, even students with a history of challenging

behaviors. Additionally, practitioners can easily adapt the self-monitoring intervention to

fit the various needs of a diverse student population. As discussed in Chapter II,

practitioners can add additional components to the self-monitoring interventions

including a reinforcement system, tactical prompts, and technology (e.g., smartphones,

timers, watches).

Summary

In this study, a multiple baseline design across participants was used to

investigate the effects of a self-monitoring intervention on increasing on-task behavior on

male students in a secure juvenile facility. Results from the study strongly suggest a

functional relationship between self-monitoring and an increase in on-task behavior. All

student participants showed immediate and sustained improvements in on-task behavior

when taught to use the self-monitoring intervention. The positive response to the self-

monitoring intervention was consistent with literature. Additionally, all three students

saw a decrease in behavior and incident reports and an increase in their academic average

in math.

Limitations to the current study include its limited potential for generalizability

(i.e., external validity) when based on a limited number of student participants. Factors

including limited participant selection, the facility, the math teacher, the classroom, and

Page 62: USING SELF-MONITORING TO INCREASE ON-TASK …

54

other characteristics unique to the juvenile justice setting may reduce generalizability.

Additionally, because there were no generalization probes in other classrooms, it is

unknown whether the self-monitoring intervention increased on-task behavior in other

academic settings.

The current replication study also has several implications for researchers and

practitioners. Future studies should examine the effects of the self-monitoring

intervention on on-task behavior (a) plus additional dependent variables (e.g., academic

performance); (b) across different settings and participates; and (c) using longitudinal

maintenance probes. Practitioners can easily adapt the self-monitoring intervention to fit

the needs of a diverse student population including students with disruptive behaviors.

Given the positive results of this study, there is an apparent benefit for implementation of

self-monitoring intervention in the juvenile justice setting.

Page 63: USING SELF-MONITORING TO INCREASE ON-TASK …

55

References

Algozzine, B., Wang, C., White, R., Cooke, N., Marr, M., Algozzine, K., . . .Duran, G.

(2012). Effects of multi-tier academic and behavior instruction on difficult to

teach students. Exceptional Children, 79(1), 45–64.

doi:10.1177/001440291207900103

Amato-Zech, N. A., Hoff, K. E., & Doepke, K. J. (2006). Increasing on-task behavior in

the classroom: Extension of self-monitoring strategies. Psychology in the

Schools, 43(2), 211–221. doi:10.1002/pits.20137

Andrews, W., Houchins, D., & Varjas, K. (2017). Student-directed check-in/check-out

for students in alternative education settings. Teaching Exceptional Children,

49(6), 380-390. doi:10.1177/0040059917701122

Barkley, R. (2006). Attention deficit-hyperactivity disorder: A handbook for diagnosis

and treatment (3rd ed.). New York, NY: Guilford.

Barry, L., & Gaines, T. (2008). Attention deficit hyperactivity disorder: Intervention as

crime prevention. The Journal of Behavior Analysis of Offender and Victim

Treatment and Prevention, 1, 154-170. doi:10.1037/h0100441

Barry, L., & Messer, J. (2003). A practical application of self-management for students

diagnosed with attention-deficit/hyperactivity disorder. Journal of Positive

Behavior Interventions, 5, 238-248. doi:10.1177/10983007030050040701

Bedesem, P. (2012). Using cell phone technology for self-monitoring procedures in

inclusive settings. Journal of Special Education Technology, 27, 33-46.

doi:10.1177/016264341202700403

Page 64: USING SELF-MONITORING TO INCREASE ON-TASK …

56

Berninger, V., Abbott, R., Jones, J., Wolf, B., Gould, L., Anderson-Youngstrom, M. …

Apel, K. (2006). Early development of language by hand: Composing, reading,

listening, and speaking connections; three letter-writing modes; and fast mapping

in spelling. Developmental Neuropsychology, 29(1), 61–92.

Beyer, M. (2006). Fifty delinquents in juvenile and adult court. American Journal of

Orthopsychiatry, 76(2), 206–214. doi:10.1037/0002-9432.76.2.206

Blomberg, T., Bales, W., Mann, K., Piquero, A., & Berk, R. (2011). Incarceration,

education and transition for delinquency. Journal of Criminal Justice, 39, 355-

365. doi:10.1016/j.jcrimjus.2011.04.003

Blood, E., Johnson, J. W., Ridenour, L., Simmons, K., & Crouch, S. (2011). Using an

iPod touch to teach social and self-management skills to an elementary student

with emotional/behavioral disorders. Education and Treatment of

Children, 34(3), 299-321. doi:10.1353/etc.2011.0019

Briere, D., & Simonsen, B. (2011). Self-monitoring interventions for at-risk middle

school students: The importance of considering function. Behavioral

Disorders, 36(2), 129-140.

Briesch, A., & Daniels, B. (2013). Using self-management interventions to address

general education behavioral needs: Assessment of effectiveness and

feasibility. Psychology in The Schools, 50(4), 366-381. doi:10.1002/pits.21679

Bruhn, A. L., Lane, K. L., & Hirsch, S. E. (2014). A review of tier 2 interventions

conducted within multi-tiered models of prevention evidencing a primary

Page 65: USING SELF-MONITORING TO INCREASE ON-TASK …

57

behavioral plan. Journal of Emotional and Behavioral Disorders, 22, 171–189.

doi:10.1177/1063426613476092

Caldwell, S., & Joseph, L. (2012). Helping female juveniles improve their on-task

behavior and academic performance using a self-management procedure in a

correctional facility. Contemporary School Psychology, 16(1)61-74.

doi:10.1007/BF03340976

Calderone, C., Bennet, S., Homan, S., Derick, R., & Chatfield, A. (2009). Reading the

hard to reach: A comparison of two reading interventions with incarcerated

youth. Middle Grades Research Journal, 4(3), 61-80.

Cauffman, E., & Steinberg, L. (2000). (Im)maturity of judgment in adolescence: Why

adolescents may be less culpable than adults. Behavioral Sciences & the Law, 18,

741-760. doi:10.1002/bsl.416

Chiu, C. L., Carrero, K. M., & Lusk, M. E. (2017). Culturally responsive writing

instruction for secondary students with emotional and behavioral disorders.

Beyond Behavior, 26(1), 28-35. doi: 10.1177/1074295617694406

Cook, S., Rao, K., & Collins, L. (2017). Self-monitoring for students with EBD:

Applying UDL to a research-based practice. Beyond Behavior, 26(1), 19-27. doi:

10.1177/1074295617694407

Davis, T., Dacus, S., Bankhead, J., Haupert, M., Fuentes, L., Zoch, T., & ... Lang, R.

(2014). A comparison of self-monitoring with and without reinforcement to

improve on-task classroom behavior. Journal of School Counseling, 12(12), 1-

23.

Page 66: USING SELF-MONITORING TO INCREASE ON-TASK …

58

Ennis, R. P. (2016). Using self-regulated strategy development to help high school

students with EBD summarize informational text in social studies. Education and

Treatment of Children, 39, 545-568. doi:10.1353/etc.2016.0024

Ennis, R. P., Harris, K. R., Lane, K. L., & Mason, L. H. (2014). Lessons learned from

implementing self-regulated strategy development with students with emotional

and behavioral disorders in alternative educational settings. Behavioral

Disorders, 40(1), 68-77. doi:1 0.17988/0198-7429-40.1.68

Ennis, R. P., Jolivette, K., Swoszowski, N. C., & Johnson, M. L. (2012). Secondary

prevention efforts at a residential facility for students with emotional and

behavioral disorders: Function-based check-in, check-out. Residential Treatment

for Children & Youth, 29, 79–102. doi:10.1080/0886571X.2012.669250

Escarpio, R., & Barbetta, P.M. (2016). Comparison of repeated and non-repeated

readings on the reading performances of students with emotional and behavioral

disorders. Journal of Emotional and Behavioral Disorders, 24(2), 111-124.

doi:10.1177/1063426615574337

Fallon, L. M., O'Keefe, B. V., Gage, N. A., & Sugai, G. (2015). Brief report: Assessing

attitudes towards culturally and contextually relevant school-wide positive

behavior support strategies. Behavioral Disorders, 40(4), 251-260.

doi:10.17988/0198-7429-40.4.251

Fine, A., Baglivio, M., Cauffman, E., Wolfe, K., & Piquero, A. (2018). Does the effect of

self-regulation on adolescent recidivism vary by youths’ attitudes? Criminal

Justice and Behavior, 45(2), 214-233. doi:10.1177/0093854817739046

Page 67: USING SELF-MONITORING TO INCREASE ON-TASK …

59

Ford, J., & Blaustein, M. (2013). Systemic self-regulation: A framework for trauma-

informed services in residential juvenile justice programs. Journal of Family

Violence, 28, 665-677. doi:10.1007/s10896-013-9538-5

Ford, J., Chapman, J., Connor, D., & Cruise, K. (2012). Complex trauma and aggression

in secure juvenile justice settings. Criminal Justice and Behavior, 39, 694–724.

doi:10.1177/0093854812436957

Freeman, K. A., & Dexter-Mazza, E. (2004). Using self-monitoring with an adolescent

with disruptive classroom behavior: Preliminary analysis of the role of adult

feedback. Behavior Modification, 28, 402-419. doi:10.1177/0145445503258982

Gage, N., Wilson, J., & MacSuga- Gage, A. (2014). Writing performance of students

with emotional and/or behavioral disabilities. Behavioral Disorders, 40, 3-14.

doi:10.17988 /0198 –7429–40.1.3

Gagnon, J., Barber, B., Van Loan, C., & Leone, P. (2009). Juvenile correctional schools:

Characteristics and approached to curriculum. Education and Treatment of

Children, 32, 673–696. doi:10.1353/etc.0.0068

Germer, K., Kaplan, L., Giroux, L., Markham, E., Ferris, G., Oakes, W., & Lane, K.

(2011). A function-based intervention to increase a second-grade student's on-

task behavior in a general education classroom. Beyond Behavior, 20, 19-30.

Graham-Day, K., Gardner, R., & Hsin, Y. (2010). Increasing on-task behaviors of high

school students with attention deficit hyperactivity disorder. Education and

Treatment of Children, 33(2), 205-221. doi:10.1353/etc.0.0096

Page 68: USING SELF-MONITORING TO INCREASE ON-TASK …

60

Greenbaum, P. E., Dedrick, R. F., Friedman, R. M., Kutash, K., Brown, E. C., Lardieri, S.

P., & Pugh, A. M. (1996). National Adolescent and Child Treatment Study

(NACTS): Outcomes for children with serious emotional and behavioral

disturbance. Journal of Emotional and Behavioral Disorders, 4(3), 130-146.

doi:10.1177/106342669600400301

Gulchak, D. J. (2008). Using a mobile handheld computer to teach a student with an

emotional and behavioral disorder to self-monitor attention. Education &

Treatment of Children, 31, 567-581. doi:10.1353/etc.0.0028

Gureasko-Moore, S., DuPaul, G., & White, G. (2007). Self-management of classroom

preparedness and homework: Effects on school functioning of adolescents with

attention deficit hyperactivity disorder. School Psychology Review, 36(4), 647-

664.

Hansen, B., Wills, H., Kamps, D., & Greenwood, C. (2014). The effects of function-

based self-management interventions on student behavior. Journal of Emotional

and Behavioral Disorders, 22(3), 149 –159. doi:10.1177/1063426613476345

Harris, K., Friedlander, B., Saddler, B., Frizzelle, R., & Graham, S. (2005). Self-

monitoring of attention versus self-monitoring of academic performance: Effects

among students with ADHD in the general education classroom. The Journal of

Special Education, 39, 145-156. doi:10.1177/00224669050390030201

Harris, K., Graham, S., & Mason, L. (2003). Self-regulated strategy development in the

classroom: Part of a balanced approach to writing instruction for students with

disabilities. Focus on Exceptional Children, 35, 1-17.

Page 69: USING SELF-MONITORING TO INCREASE ON-TASK …

61

Harris P. J., Baltodano H. M., Jolivette K., & Mulcahy C. (2009). Reading achievement

of incarcerated youth in three regions. Journal of Correctional Education, 60,

120-145.

Harrison, J., Bunford, N., Evans, S., & Owens, J. (2013). Educational accommodations

for students with behavioral challenges: A systematic review of the literature.

Review of Educational Research, 83(4), 551-597.

doi:10.3102/0034654313497517

Havens, J., Ford, J., Grasso, D., & Marr, M. (2012). Opening Pandora's box: The

importance of trauma identification and intervention in hospitalized and

incarcerated adolescent populations. Adolescent Psychiatry, 2, 309-312.

doi:10.2174/2210676611202040309

Holifield, C., Goodman, J., Hazelkorn, M., & Heflin, L. (2010). Using self-monitoring to

increase attending to task and academic accuracy in children with autism. Focus

on Autism and Other Developmental Disabilities, 25(4), 230–238.

doi:10.1177/1088357610380137

Horner, R. H., Sugai, G., Smolkowski, K., Eber, L., Nakasato, J., Todd, A. W., &

Esperanza, J. (2009). A randomized, wait-list controlled effectiveness trial

assessing school-wide positive behavior support in elementary schools. Journal of

Positive Behavior, 11(3), 133–144. doi:10.1177/1098300709332067

Houchins, D. E., Jolivette, K., Krezmien, M. P., & Baltodano, H. M. (2008). A multi-

state study examining the impact of explicit reading instruction with incarcerated

students. The Journal of Correctional Education, 59, 65–85.

Page 70: USING SELF-MONITORING TO INCREASE ON-TASK …

62

Hummer, T., Kronenberger, W., Wang, Y., Dunn, D., Mosier, K., Kalnin, A., &

Mathews, V. (2011). Executive functioning characteristics associated with ADHD

comorbidity in adolescents with disruptive behavior disorders. Journal of

Abnormal Child Psychology, 39(1), 11-19. doi:10.1007/s10802-010-9449-3

Johnson, L., Wang, E., Gilinsky, N., He, Z., Carpenter, C., Nelson, C. M., &

Scheuermann, B. (2015). Youth outcomes following implementation of universal

SW-PBIS strategies in a Texas secure juvenile facility. Education and Treatment

of Children, 36(3), 135-145. doi:10.1353/etc.2013.0019

Jolivette, K., & Nelson, C. M. (2010). Adapting positive behavioral interventions and

supports for secure juvenile justices settings: Improving facility-wide behavior.

Behavioral Disorder, 36(1), 28-42. doi:10.1177/019874291003600104

Kessler, R., Adler, L., Barkley, R., Biederman, J., Conners, C., Demler, O., … Zaslavsky,

A. (2006). The prevalence and correlates of adult ADHD in the United States:

Results from the national comorbidity survey replication. American Journal of

Psychiatry, 163(4), 716-723. doi:10.1176/ajp.2006.163.4.716

Kostewicz, D., & Kubina, R. (2008). The national reading panel guidepost: A review of

reading outcome measures for students with emotional and behavioral disorders.

Behavioral Disorders, 33(2), 62–74.

Krezmien, M., Mulcahy, C., & Leone, P. (2008). Detained and committed youth:

Examining differences in achievement, mental health needs, and special education

status. Education & Treatment of Children, 31(4), 445-464.

Page 71: USING SELF-MONITORING TO INCREASE ON-TASK …

63

Lampron, S., & Gonsoulin, S. (2013). PBIS in restrictive settings: The time is now.

Education & Treatment of Children, 36(3), 161-174. doi:10.1353/etc.2013.0023

Landrum, T., & Sweigart, C. (2014). Simple, evidence-based interventions for classic

problems of emotional and behavioral disorders. Beyond Behavior, 23(3), 3-9.

doi:10.1177/107429561402300302

Lane, K., Capizzi, A., Fisher, M., & Ennis, R. (2012). Secondary prevention efforts at the

middle school level: An application of the behavior education program. Education

and Treatment of Children, 35(1), 51–90.

Lannie, A., & Martens, B. (2008). Targeting performance dimensions in sequence

according to the instructional hierarchy: Effects on children's math work within a

self-monitoring program. Journal of Behavioral Education, 17(4), 356-375.

doi:10.1007/s10864-008-9073-2

Lee, D., Lylo, B., Vostal, B., & Hua, Y. (2012). The effects of high-preference problems

on the completion of nonpreferred mathematics problems. Journal of Applied

Behavior Analysis, 45, 223-228.

Legge, D., DeBar, R., & Alber-Morgan, S. (2010). The effects of self-monitoring with a

MotivAider ® on the on-task behavior of fifth and sixth graders with autism and

other disabilities. Journal of Behavior Assessment and Intervention in Children,

1(1), 43–52. doi:10.1037/h0100359

Leone, P., & Weinberg, L. (2010). Addressing the unmet educational needs of children

and youth in the juvenile justice and child welfare systems. Washington, DC:

Page 72: USING SELF-MONITORING TO INCREASE ON-TASK …

64

Center for Juvenile Justice Reform, Georgetown University Public Policy

Institute.

Leone, P., & Weinberg, L. (2012). Addressing the unmet educational needs of children

and youth in the juvenile justice and child welfare systems. Washington, DC:

Center for Juvenile Justice Reform, Georgetown University Public Policy

Institute.

Leone, P., & Wruble, P. (2015). Education services in juvenile corrections: 40 years of

litigation and reform. Education & Treatment of Children, 38(4), 587-604.

doi:10.1353/etc.2015.0026

Lewis, T. J., & Sugai, G. (1999). Effective behavior support: A systems approach to

proactive school-wide management. Effective School Practices, 17, 47-53.

Levin, J. R., Ferron, J. M., & Gafurov, B. S. (2016). Comparison of randomization-test

procedures for single-case multiple-baseline designs. Developmental

Neurorehabilitation, 21(5), 290-311. doi:10.1080/17518423.2016.1197708

Lively, R., Myers, D., & Levin, J. R. (2019). Using self-monitoring to support student

behavior in a juvenile justice facility. The Journal of Correctional Education,

70(1), 36-52.

Lo, Y. & Cartledge, G. (2006). FBA and BIP: Increasing the behavior adjustment of

african american boys in schools. Behavioral Disorders, 31, 147-161.

doi:10.1177/019874290603100204

Lopez, A., Williams, J., & Newsom, K. (2015). PBIS in Texas juvenile justice

department’s division of education and state programs: Integrating programs and

Page 73: USING SELF-MONITORING TO INCREASE ON-TASK …

65

developing systems for sustained implementation. Residential Treatment for

Children & Youth, 32(4), 344-353. doi:10.1080/0886571X.2015.1113460

Majeika, C., Walder, J., Hubbard, J., Steeb, K., Ferris, G., Oakes, W., &

Lane, K. (2011). Improving on-task behavior using a functional assessment-based

intervention in an inclusive high school setting. Beyond Behavior, 3, 55-66.

Mallett, C. A. (2014). The 'learning disabilities to juvenile detention' pipeline: A case

study. Children & Schools, 36(3), 147-154. doi:10.1093/cs/cdu010

Mason, L., Kubina, R., Valasa, L., & Cramer, A. (2012). Evaluating effective writing

instruction for adolescent students in an emotional and behavior support setting.

Behavioral Disorders, 35(2), 140-156.

Mathur S. R., & Griller Clark, H. (2013). Prerelease planning and practices for youth

with disabilities in juvenile detention. The Journal of Special Education

Leadership, 26, 82–92.

Mathur, S. R., Griller Clark, H., LaCroix, L., & Short, J. (2017). Research-based

practices for reintegrating students with emotional and behavioral disorders from

the juvenile justice system. Beyond Behavior, 27(1), 28-36

doi:10.1177/1074295617728508

Mathur, S. R. & Schoenfeld, N. (2010). Effective instructional practices in juvenile

justice. Behavioral Disorders, 36(1), 20-27. doi:10.1177/019874291003600103

McCulloch, M. (1995). Spelling and Reading With Riggs: Daily/weekly lesson plans,

study guide and syllabus. Portland, OR: The Riggs Institute Press.

Page 74: USING SELF-MONITORING TO INCREASE ON-TASK …

66

McDaniel, S. C., Houchins, D. E., & Terry, N. P. (2013). Corrective Reading as a

supplementary curriculum for students with emotional and behavioral disorders.

Journal of Emotional and Behavioral Disorders, 21, 240–249.

McKenna, J. W., Kim, M. K., Shin, M., & Pfannenstiel, K. (2017). An evaluation of

single-case reading intervention study quality for students with and at risk for

emotional and behavioral disorders. Behavior Modification, 41(6), 868-906.

doi:10.1177/0145445517701896

Miller, L., Dufrene, B., Olmi, J., Tingstrom, D., & Filce, H. (2015). Self-monitoring as a

viable fading option in check-in/check-out. Journal of School Psychology, 53(2),

121-135. doi:10.1016/j.jsp.2014.12.004

Mitchem, K., Young, K., West, R., & Benyo, J. (2001). CWPASM: A classwide peer-

assisted self-management program for general education classrooms. Education

and Treatment of Children, 24, 111-140.

Moilanen K. L. (2007). The adolescent self-regulatory inventory: The development and

validation of a questionnaire of short-term and long-term self-regulation. Journal

of Youth and Adolescence, 36, 835–848. doi:10.1007/s10964-006-9107-9

Mueller, K. & Tomblin, B. (2012). Diagnosis of attention-deficit/hyperactivity disorder

and its behavioral, neurological, and genetic roots. Topics in Language Disorders,

32(3), 207-227. doi:10.1097/TLD.0b013e318261ffdd

Mulcahy, C., & Krezmien, M. P. (2009). Effects of a contextualized instructional

package on the mathematics performance of secondary students with EBD.

Behavioral Disorders, 34(3), 136– 150. doi:10.1177/0741932515579275

Page 75: USING SELF-MONITORING TO INCREASE ON-TASK …

67

Myers, D. & Farrell, A. (2008). Reclaiming lost opportunities: Applying public health

models in juvenile justice. Children and Youth Services Review, 30, 1159–1177.

doi:10.1016/j.childyouth.2008.03.002

National Council on Disability. (2003). Addressing the needs of youth with disabilities

in the juvenile justice system: The current status of evidence-based research.

Retrieved from http://www.ncd.gov/publications/2003/May12003

Nelson, J. R., Benner, G. J., Lane, K., & Smith, B. W. (2004). Academic achievement of

K-12 students with emotional and behavioral disorders. Exceptional Children, 71,

59-73. doi:10.1177/001440290407100104

O’Brien, N., Langhinrichsen-Rohling, J., & Shelley-Tremblay, J. (2007). Reading

problems, attentional deficits, and current mental health status in adjudicated

adolescent males. The Journal of Correctional Education, 58, 293–315.

Office of Juvenile Justice and Delinquency Prevention. (2019). OJJDP statistical briefing

book. Retrieved from https://www.ojjdp.gov/ojstatbb/corrections/qa08201.asp

Palmer, J., Boon, R. T., & Spencer, V. G. (2014). Effect of concept mapping instruction

on the vocabulary acquisition skills of seventh-graders with mild disabilities: A

replication study. Reading & Writing Quarterly, 30, 165–182.

Parker, D., & Kamps, D. (2011). Effects of task analysis and self-monitoring for children

with autism in multiple social settings. Focus on Autism and Other

Developmental Disabilities, 26, 131–142. doi:10.1177/1088357610376945

Page 76: USING SELF-MONITORING TO INCREASE ON-TASK …

68

Pyle, N., Flower, A., Fall, A., & Williams, J. (2016). Individual-level risk factors of

incarcerated youth. Remedial and Special Education, 37(3), 172–186.

doi:10.1177/0741932515593383

Quinn, M. M., Rutherford, R. B., Leone, P. E., Osher, D. M., & Poirier, J. M. (2005).

Youth with disabilities in juvenile corrections: A national survey. Exceptional

Children, 71(3), 339. doi:10.1177/001440290507100308

Rafferty, L. A. (2010). Step-by step: Teaching students to self-monitor. Teaching

Exceptional children, 43(2), 50-58. doi:10.1177/004005991004300205

Read, N. W. & Lampron, S. (2012). Supporting student achievement through sound

behavior management practices in schools and juvenile justice facilities: A

spotlight on Positive Behavior Interventions and Supports (PBIS). Washington,

DC: National Evaluation and Technical Assistance Center for Children and Youth

Who Are Neglected, Delinquent, or At-Risk (NDTAC).

Reid, R., Trout, A., & Schartz, M. (2005). Self-regulation interventions for children with

attention deficit hyperactivity disorder. Council for Exceptional Children, 71,

361-377.

Riccomini, P., Witzel, B., & Robbins, K. (2008). Improving the mathematics

instruction for students with emotional and behavioral disorders: Two evidenced-

based instructional approaches. Beyond Behavior, 2(17), 24–30.

Richards, S. B., Taylor, R. L., & Ramasamy, R. (2014). Single subject research:

Applications in educational and clinical settings (2nd ed.). Belmont, CA:

Wadsworth, Cengage Learning.

Page 77: USING SELF-MONITORING TO INCREASE ON-TASK …

69

Risler, E., & O'Rourke, T. (2009). Thinking exit at entry: Exploring outcomes of

Georgia's juvenile justice educational programs. Journal of Correctional

Education, 60(3), 225-239.

Rock, M., & Thead, B. (2007). The effects of fading a strategic self-monitoring

intervention on students’ academic engagement, accuracy, and productivity.

Journal of Behavioral Education, 16, 389-412. doi:10.1007/s10864-007-9049-7

Ryan, J., Pierce, C., & Mooney, P. (2008). Evidence-based teaching strategies for

students with EBD. Beyond Behavior, 17, 22-29.

Sedlak, A., & McPherson, K. (2010). Youth’s needs and services: Findings from the

survey of youth in residential placement. Juvenile Justice Bulletin. Washington,

DC: Office of Juvenile Justice and Delinquency Prevention, Office of Justice

Programs, U.S. Department of Justice.

Seeley, J., Severson, H., & Fixsen, A. (2014). Empirically based target prevention

approaches for addressing externalizing and internalizing behavior disorders

within school contexts. In H. M. Walker & F. M. Gresham (Ed.), Handbook of

evidence-based practices for emotional and behavioral disorders (pp. 307-323).

New York, NY: The Guilford Press.

Sheldon-Sherman, J. (2013). The IDEA of an adequate education for all: Ensuring

success for incarcerated youth with disabilities. Journal of Law & Education,

42(2), 227-274.

Page 78: USING SELF-MONITORING TO INCREASE ON-TASK …

70

Shippen, M., Morton, R., Flynt, S., Houchins, D., & Smitherman, T. (2012). Efficacy of a

computer-based program on acquisition of reading skills of incarcerated youth.

Remedial and Special Education, 33, 14-22. doi:10.1177/0741932510362512

Sickmund, M., Sladky, T., Kang, W., & Puzzanchera, C. (2015). Easy Access to the

Census of Juveniles in Residential Placement. Retrieved from

http://www.ojjdp.gov/ojstatbb/ezacjrp/

Sickmund, M., Sladky, T., Kang, W., & Puzzanchera, C. (2017). Easy Access to the

Census of Juveniles in Residential Placement. Retrieved from

http://www.ojjdp.gov/ojstatbb/ezacjrp/

Simonsen, B., Pearsall, J. J., Sugai, G., & McCurdy, B. (2011). Alternative setting-wide

positive behavior supports. Behavioral Disorders, 36, 213-224.

doi:10.1177/019874291103600402

Simonsen, B., & Sugai, G. (2013). PBIS in alternative education settings: Positive

support for youth with high-risk behavior. Education and Treatment of Children,

36, 3–14.

Skinner, B. F. (1953). Science and human behavior. New York, NY: MacMillan.

Smith, B., & Sugai, G. (2000). A self-management functional assessment-based behavior

support plan for a middle school student with EBD. Journal of Positive Behavior

Interventions, 2, 208-217. doi:10.1177/109830070000200405

Stahr, B., Cushing, D., Lane, K., & Fox, J. (2006). Efficacy of a function-based

intervention in decreasing off-task behavior exhibited by a student with ADHD.

Page 79: USING SELF-MONITORING TO INCREASE ON-TASK …

71

Journal of Positive Behavior Interventions, 8(4), 201-211.

doi:10.1177/10983007060080040301

Steiner, H., Silverman, M., Karnik, N., Huemer, J., Plattner, B., Clark, C., … Haapanen,

R. (2011). Psychopathology, trauma and delinquency: Subtypes of aggression and

their relevance for understanding young offenders. Child and Adolescent

Psychiatry and Mental Health, 5, 1-11. doi:10.1186/1753-2000-5-21

Stone, R. H., Boon, R. T., Fore, C., Bender, W. N., & Spencer, V. G. (2008). Use of text

maps to improve the reading comprehension skills among students in high school

with emotional and behavioral disorders. Behavioral Disorders, 33, 87–98.

Stotz, K., Itoi, M., Konrad, M., & Alber-Morgan, S. (2008). Effects of self-graphing on

written expression of fourth grade students with high-incidence disabilities.

Journal of Behavioral Education, 17(2), 172-186. doi:10.1007/s10864-007-9055-

9

Sugai, G., & Horner, R. H. (2002). The evolution of discipline practices: School-wide

positive behavior supports. Child & Family Behavior Therapy, 24, 23-50.

Sugai, G., & Horner, R. (2006). A promising approach for expanding and sustaining the

implementation of school-wide positive behavior support. School Psychology

Review, 35, 245–259.

Sugai, G., & Horner, R. H. (2009). Responsiveness-to-intervention and school-wide

positive behavior supports: Integration of multi-tiered system approaches.

Exceptionality, 17, 223–237. doi:10.1080/09362830903235375

Page 80: USING SELF-MONITORING TO INCREASE ON-TASK …

72

Sutherland, K. S., & Snyder, A. (2007). Effects of reciprocal peer tutoring and self-

graphing on reading fluency of classroom behavior of middle school students with

emotional or behavioral disorders. Journal of Emotional and Behavioral

Disorders, 15(2), 103-118. doi:10.1177/10634266070150020101

Swoszowski, N. C., Jolivette, K., & Fredrick, L. D. (2013). Addressing the social and

academic behavior of a student with emotional and behavioral disorders in an

alternative setting. Journal of Classroom Interaction, 47, 28-36.

Swoszowski, N. C., Jolivette, K., Fredrick, L. D., & Heflin, L. J. (2012). Check in/check

out: Effects on students with emotional and behavioral disorders with attention-or

escape-maintained behavior in a residential facility. Exceptionality, 20, 163–178.

doi:10.1080/09362835.2012.694613

Tobin, T., & Sprague, J. (2000). Alternative education strategies: Reducing violence in

school and community. Journal of Emotional and Behavioral Disorders, 8, 177–

186. doi:10.1177/106342660000800305

Trevino-Maack, S. I., Kamps, D., & Wills, H. (2015). A group contingency plus self-

management intervention targeting at-risk secondary students’ class-work and

active engagement. Remedial Special Education, 36(6), 347-360.

doi:10.1177/0741932514561865

Tyler, J. H., & Lofstrom, M. (2009). Finishing high school: Alternative pathways and

dropout recovery. The Future of Children, 19(1), 77-103. doi:10.1353/foc.0.0019

U.S. Department of Education. (2014). Thirty-sixth annual report to Congress on the

implementation of the Individuals with Disabilities Education Act, 2014.

Page 81: USING SELF-MONITORING TO INCREASE ON-TASK …

73

Washington, DG: Author. Retrieved from

https://www2.ed.gov/about/reports/annual/osep/2014/parts-b-c/36th-idea-arc.pdf

U.S. Department of Education and U.S. Department of Justice. (2014). Guiding

principles for providing high quality education in juvenile justice secure care

settings. Washington, DC: Author. Retrieved from http://www2.ed.gov/policy/

gen/guid/correctional-education/guiding-principles.pdf

Visser, S., Lesesne, C., & Perou, R. (2007). National estimates and factors associated

with medication treatment for childhood attention-deficit/hyperactivity disorder.

Pediatrics, 119, 99–106. doi:10.1542/peds.2006-2089O

Vitacco, M. J., Neumann, C. S., Robertson, A. A., & Durrant, S. L. (2002). Contributions

of impulsivity and callousness in the assessment of adjudicated male adolescents:

A prospective study. Journal of Personality Assessment, 78, 87-103.

doi:10.1207/S15327752JPA7801_06

Vostal, B. R., & Lee, D. L. (2011). Behavioral momentum during a continuous reading

task: An exploratory study. Journal of Behavioral Education, 20, 163–181.

Wagner, M., Kutash, K., Duchnowski, A. J., Epstein, M. H., & Sumi, W. C. (2005). The

children and youth we serve: A national picture of the characteristics of students

with emotional disturbances receiving special education. Journal of Emotional

and Behavioral Disorders, 13, 79–96. doi:10.1177/10634266050130020201

Warnick, K., & Caldarella, P. (2016). Using multisensory phonics to foster reading skills

of adolescent delinquents. Reading & Writing Quarterly, 32, 317–33.

doi:10.1080/10573569.2014.962199

Page 82: USING SELF-MONITORING TO INCREASE ON-TASK …

74

Wehby, J., Lane, K., & Falk, K. (2003). Academic instruction for students with emotional

and behavioral disorders. Journal of Emotional and Behavioral Disorders, 11,

194-197. doi:10.1177/10634266030110040101

Wei, X., Blackorby, J., & Schiller, E. (2011). Growth in reading achievement of students

with disabilities, ages 7 to 17. Exceptional Children, 78, 89-106.

doi:10.1177/001440291107800106

Wexler, J., Pyle, N., Flowers, A., Williams, J., & Cole H. (2014). A synthesis of

academic interventions for incarcerated adolescents. Review of Educational

Research, 84(1), 3-46. doi:10.3102/0034654313499410

Wexler, J., Reed, D., Barton, E., Mitchell, M., & Clancy, E. (2018). The effects of a peer-

mediated reading intervention on juvenile offenders’ main idea statements about

informational text. Behavioral Disorders, 43(2), 290-301.

doi:10.1177/0198742917703359

Wills, H., & Mason, B. (2014). Implementation of a self-monitoring application to

improve on-task behavior: A high-school pilot study. Journal of Behavioral

Education, 23(4), 421-434. doi:10.1007/s10864-014-9204-x

Wolfe, L., Heron, T., & Goddard, Y. (2000). Effects of self-monitoring on the on-task

behavior and written language performance on elementary students with learning

disabilities. Journal of Behavioral Education, 10, 49-73.

doi:10.1023/A:1016695806663

Page 83: USING SELF-MONITORING TO INCREASE ON-TASK …

75

APPENDIX A

Data Collection Sheet

Page 84: USING SELF-MONITORING TO INCREASE ON-TASK …

76

Data Collection Sheet

Student:

Data collector:

Date:

Time (15 min):

Indicate if student is on-task for the entire 10 s interval by marking a “+” in the designated space.

Indicate if student is off-task at any point during the 10 s interval by marking a “-” in the

designated space. Remember, on-task behavior looks like a student doing any or all of the

following: (a) sitting in his seat, (b) facing the teacher if the teacher is speaking, (c) directing his

attention to an area or object as indicated by the teacher, (d) looking at work on his desk, (e)

remaining silent unless asking a question or responding to a question, and (f) following classroom

expectations, including keeping hands to himself, raising hand to contribute, and following all

teacher directions within 5 s of being asked. Non-examples of on-task behavior include sleeping,

talking to peers (unless in teacher-directed group work), looking at the clock or other unrelated

materials for more than 10 s, and talking to himself.

Minute Interval

:10 :20 :30 :40 :50 :60

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

Total +

Add up bottom row. What is the total number of intervals with on-task behavior?

_____________

Divide the number above by 90 (i.e., total number of intervals). What is that number? _______

Multiply the number above by 100. What is the percentage of intervals with on-task behavior?

_________

Page 85: USING SELF-MONITORING TO INCREASE ON-TASK …

77

APPENDIX B

Fidelity Checklist

Page 86: USING SELF-MONITORING TO INCREASE ON-TASK …

78

Fidelity Checklist

Instructions

For this component, record whether the participant complete the task:

a) Fully (recorded behavior on SM sheet 100% of the time when prompted)

b) Partially (did not SM 100% of the time)

c) Not at all (did not obtain the watch or did not SM when prompted)

Component One: Watch plus SM sheet

The participant obtained the watch from the teacher, wore it on his wrist throughout the

entire observation period, and self-monitored each time the watch prompted (i.e.,

vibrated and signaled in writing the words “pay attention”).

Fully ⃞

Partially ⃞ If partially, provide a

brief description.

Not at all ⃞ If not at all, provide a

brief description.

Instructions

For this component, record whether student complete it:

a) Fully (obtained the SM sheet from the teacher and recorded behavior at least

once)

b) Partially (obtained the SM sheet from the teacher but did not record behavior)

c) Not at all (did not obtain the SM sheet from the teacher)

Component Two: SM sheet only (watch was removed)

The participant obtained the SM sheet from the teacher and recorded behavior on the

SM sheet at least once during the observation period.

Fully ⃞

Partially ⃞ If partially, provide a

brief description.

Not at all ⃞ If not at all, provide a

brief description.

Page 87: USING SELF-MONITORING TO INCREASE ON-TASK …

79

APPENDIX C

Self-Monitoring Intervention Social Validity Survey: Student Version

Page 88: USING SELF-MONITORING TO INCREASE ON-TASK …

80

Self-Monitoring Intervention Social Validity Survey: Student Version

Please fill out the survey below based on the self-monitoring that you were asked to do as a

participant in our recent research study. Indicate whether you strongly disagree, disagree,

neither agree nor disagree, agree, or strongly agree with the statements. Thank you for

your time.

1. The self-monitoring intervention was easy to use.

1

Strongly

Disagree

2

Disagree

3

Neither agree

nor disagree

4

Agree

5

Strongly

Agree

2. I would recommend self-monitoring to other students.

1

Strongly

Disagree

2

Disagree

3

Neither agree

nor disagree

4

Agree

5

Strongly

Agree

3. Self-monitoring did not take up too much of my time.

1

Strongly

Disagree

2

Disagree

3

Neither agree

nor disagree

4

Agree

5

Strongly

Agree

4. Self-monitoring was effective at improving my behavior.

1

Strongly

Disagree

2

Disagree

3

Neither agree

nor disagree

4

Agree

5

Strongly

Agree

5. I will use self-monitoring in the future.

1

Strongly

Disagree

2

Disagree

3

Neither agree

nor disagree

4

Agree

5

Strongly

Agree

Page 89: USING SELF-MONITORING TO INCREASE ON-TASK …

81

APPENDIX D

Self-Monitoring Intervention Social Validity Survey: Teacher Version

Page 90: USING SELF-MONITORING TO INCREASE ON-TASK …

82

Self-Monitoring Intervention Social Validity Survey: Teacher Version

Please fill out the survey below based on the self-monitoring that you were asked to do as

a participant in our recent research study. Indicate whether you strongly disagree, disagree,

neither agree nor disagree, agree, or strongly agree with the statements. Thank you for

your time.

1. The self-monitoring intervention was easy to use.

1

Strongly

Disagree

2

Disagree

3

Neither agree

nor disagree

4

Agree

5

Strongly

Agree

2. I would recommend self-monitoring to other teachers.

1

Strongly

Disagree

2

Disagree

3

Neither agree

nor disagree

4

Agree

5

Strongly

Agree

3. Self-monitoring did not take up too much of my time.

1

Strongly

Disagree

2

Disagree

3

Neither agree

nor disagree

4

Agree

5

Strongly

Agree

4. Self-monitoring was effective at improving student behavior.

1

Strongly

Disagree

2

Disagree

3

Neither agree

nor disagree

4

Agree

5

Strongly

Agree

5. I will use self-monitoring in my classroom in the future.

1

Strongly

Disagree

2

Disagree

3

Neither agree

nor disagree

4

Agree

5

Strongly

Agree

Page 91: USING SELF-MONITORING TO INCREASE ON-TASK …

83

APPENDIX E

Student Self-Monitoring Sheet

Page 92: USING SELF-MONITORING TO INCREASE ON-TASK …

84

Student Self-Monitoring Sheet

Name:

Date and time:

Every five minutes (or each time the watch vibrates), indicate whether you are on-task

(+) or off-task (-). Remember, on-task looks like you’re doing your work, paying

attention to the teacher, following directions, and meeting all of the behavior expectations

for the class.

Interval On-task (+) or off-task (-)? Interval On-task (+) or off-task (-)?

1 19

2 20

3 21

4 22

5 23

6 24

7 25

8 26

9 27

10 28

11 29

12 30

13 31

14 32

15 33

16 34

17 35

18 36


Recommended