EPISCenter’s PM Reporting Guidelines: Olweus Bullying Prevention ... Reporting Guideli… ·...

EPISCenter’s PM Reporting Guidelines: Olweus Bullying Prevention Program (OBPP)

1 | P a g e Updated as of 11-5-10

This guide provides detailed information about how to calculate PCCD’s required Performance Measures (PMs) for the OBPP program. Below is

information that will help orient you to this guide.

PERFORMANCE MEASURES CATEGORIES:

1) Process Measures: PMs that assess implementation quality

2) Outcome Measures: PMs that assess the impact of the program on its participants

Note: The order of the PMs in the chart may not match the order in EGrants.

HOW TO READ THE REPORTING GUIDELINES CHART:

1) The first column lists the title and description of the PMs

2) The second column, “PM Calculation Instructions,” outlines three things:

a. Data: Survey instrument or strategy that should be used to collect the necessary data

b. Scoring (if necessary): Data manipulations that must occur prior to calculating the PM (e.g., creating a summary score)

c. Number for the PM: Detailed steps for calculating the actual number that will be entered into EGrants for that PM

3) The fourth column, “Data Checks,” provides guidance for double-checking your data to assure the information you enter into EGrants is

valid and accurate. Data checks should be used as you calculate your PMs to determine if the number you calculated for the PM makes

sense. If your numbers are not consistent with the data check column, you should revisit the calculation instructions and recalculate

your number for the PM.

CALCULATION GUIDANCE:

Detailed information and examples of PM calculations can be found on the EPISCenter website in a document entitled ‘Sample Calculations.’

Note: The EPISCenter is the process of developing a tool that will automate the calculation of the PMs for you. We will keep you updated on its

progress.



To ask questions regarding calculation of the PMs, contact Brittany Rhoades at the EPISCenter. Email address: [email protected]

Phone: 814-863-2280

mailto:[email protected]



OBPP Performance Measure Index Please use the links below to find the calculation information for a specific PM (hold down the CTRL key and click on link).

OBPP Process Measures

Number of School Buildings in Continued Implementation Phase of OBPP

Number of School Buildings that Began First Year of OBPP Implementation

Number of Youth Participating in OBPP

Year 1 Number of Youth that Completed the OBPP Bullying Questionnaire




Number of Teachers and Staff that Completed the EPISCenter Bullying Prevention Program Staff Survey

Number of New Trained Teachers

Number of Teachers that Held Weekly Classroom Meetings

Number of New Administrative and Support Staff in the Buildings that Implemented OBPP

Number of New Support Staff or Administrators Trained in OBPP

Number of New Bullying Prevention Committee Members

Number of School Buildings with Assigned Bullying Prevention Coordinators

Number of New Bullying Prevention Committee Members Trained

Number of School Buildings with a Bullying Prevention Committee

Number of Bullying Prevention Committees that Met Monthly

Number of Schools with Bullying Prevention Coordinators that had Regular Consultations with their Certified OBPP Trainer

Number of School Buildings that Completed the OBPP Schoolwide Implementation Checklist for the First Year of Implementation

Number of School Buildings that Completed the OBPP Implementation Checklist for Continued Program

Number of School Buildings that Held an Annual Kickoff Event

Number of Hazelden Standard School Reports Submitted

Number of Hazelden District Trend Reports Submitted

Number of Reports to the Collaborative Board

OBPP Outcome Measures

Number of Staff that Reported Positive Safety Effect

Number of Staff that Reported that School Rules were an Effective Bullying Prevention Strategy



Number of Staff that Reported OBPP had a Positive Effect on Youths’ Self Esteem

Total Number of Disciplinary Referrals

Total Number of Bullying Disciplinary Referrals

OBPP Year 1 Outcome Measures

Year 1 Number of Youth that Reported Being Bullied 2-3 Times a Month or More

Year 1 Number of Youth that Reported Being Bullied in the Past Couple of Months

Year 1 Number of Bullied Youth that Told Someone About the Bullying

Year 1 Number of Youth that Reported Expressing Empathy Towards Seeing a Student Being Bullied at School

Year 1 Number of Youth that Reported Teachers and Other Adults Intervening in Bullying Incidents

Year 1 Number of Youth that Reported Other Students Intervening in Bullying Incidents


























PM Title & Description PM Calculation Instructions Data Checks

Process Measures

Number of School Buildings in Continued

Implementation Phase of OBPP: Number of school

buildings in the continued phase of OBPP.

Data: This information should be collected by internal tracking systems. Report on this measure only during the first reporting period the school begins their second year of implementation. (2nd school year of implementation following the year in which classroom meetings began) Number for PM: Count each school building that are holding weekly classroom meetings and began their 2nd year of implementation of OBPP during this reporting period and report this number for the PM.

Number of School Buildings in Continued Implementation Phase of OBPP should be greater than or equal to: -Number of School Buildings that Completed the OBPP Implementation Checklist for Continued Program - Number of School Buildings that had Regular Staff Discussion Groups Related to OBPP - Number of Standard School Reports Submitted - Number of District Trend Reports Submitted

Number of School Buildings that Began First Year of OBPP Implementation: Number of school buildings that began their first year of OBPP implementation during this reporting period.

Data: This information should be collected by internal tracking systems. Report on this measure only during the reporting period the school begins the first year of implementation. Number for PM: Count each school building that began their 1st year of implementation of OBPP during this reporting period and report this number for the PM. School buildings must be currently holding weekly classroom meetings to be included in this count.

Number of School Buildings that Began First Year of OBPP Implementation should be greater than or equal to Number of School Buildings that Completed the OBPP Schoolwide Implementation Checklist for the First Year of Implementation




Number of Youth Participating in OBPP: Total number of youth in targeted classrooms that are participating in weekly classroom meetings.

Data: This information should be collected by internal tracking systems. Report on this measure only at the end of each school year (4th quarter).

Number for PM: Count the number of youth in classrooms targeted by OBPP and report this number for the PM.

Year 1 Number of Youth that Completed the OBPP Bullying Questionnaire: Number of youth that completed the OBPP Bullying Questionnaire.

Data: This data can be collected from the OBPP Bullying Questionnaire (OBQ) Standard School Report. Report on this measure once each year during the reporting period that the OBQ School Standard Report was received. Number for PM: In Section 1, identify the table that reports the percentage (and number) of surveys completed by grade and gender. Report the total number of boys and girls that completed the survey for the PM.

Year 1 Number of Youth that Completed the OBPP Bullying Questionnaire should be greater than or equal to: - Year 1 Number of Youth that Reported Being Bullied 2-3 Times a Month or More - Year 1 Number of Youth that Reported Being Bullied in the Past Couple of Months - Year 1 Number of Bullied Youth that Told Someone About the Bullying - Year 1 Number of Youth that Reported Expressing Empathy Towards Seeing a Student Being Bullied at School - Year 1 Number of Youth that Reported Teachers and Other Adults Intervening in Bullying Incidents - Year 1 Number of Youth that Reported Other Students Intervening in Bullying Incidents






















Number of Teachers and Staff that Completed the EPISCenter Bullying Prevention Program Staff Survey: Number of teachers and staff who completed the EPISCenter Bullying Prevention Program Staff Survey.

Data: This data can be collected from the EPISCenter Bullying Prevention Program Staff Survey, which should be administered during the fourth quarter of the final year of your grant. Report on this measure only during the reporting period that the survey is administered. Number for PM: Count the number of teachers and staff who completed the EPISCenter Bullying Prevention Program Staff Survey and report this number for the PM.

Number of Teachers and Staff that Completed the EPISCenter Bullying Prevention Program Staff Survey should be greater than or equal to: - Number of Staff that Reported Positive Safety Effect - Number of Staff that Reported that School Rules were an Effective Bullying Prevention Strategy - Number of Staff that Reported OBPP had a Positive Effect on Youths’ Self Esteem

Number of New Trained Teachers: Total number of new teachers trained in OBPP during this reporting period.

Data: This information should be collected by internal tracking systems. Number for the PM: Count each new teacher that received their initial 1-day or 2 half-day trainings (do not count booster trainings) by their school’s Bullying Prevention Committee during this reporting period and report this number for the PM.

Number of Teachers that Held Weekly Classroom Meetings: Number of OBPP trained teachers that held weekly OBPP classroom meetings.

Data: This information should be collected by weekly classroom meeting logs. Report on this measure only at the end of the school year during the first year of implementation (4th quarter). Number for PM: Count the number of OBPP trained teachers that held weekly OBPP classroom meetings and report this number for the PM.

Number of Teachers that Held Weekly Classroom Meetings should be less than or equal to Number of New Trained Teachers




Number of New Administrative and Support Staff in the Buildings that Implemented OBPP: The number of administrative and support staff in the buildings that implemented OBPP during this year.

Data: This information should be collected by internal tracking systems. Report on this measure only at the end of each school year (4th quarter). Number for PM: Count the number of administrative and support staff in the buildings that implemented OBPP during this year and report this number for the PM. Count each individual only once and do not include teachers in the count.

Number of New Administrative and Support Staff in the School Buildings that Implemented OBPP should be greater than or equal to Number of New Support Staff or Administrators Trained in OBPP

Number of New Support Staff or Administrators Trained in OBPP: Number of new support staff, administrators or other school employees that were trained in the OBPP model.

Data: This information should be collected by internal tracking systems. Report on this measure only at the end of each school year (4th quarter). Number for PM: Count each new support staff and new administrators that received their initial training (do not count booster trainings) by their school’s Bullying Prevention Committee during this school year and report this number for the PM. Count each individual only once and do not include teachers in the count.

Number of New Support Staff or Administrators Trained in OBPP should be less than or equal to Number of Administrative and Support Staff in the School Buildings that Implemented OBPP

Number of New Bullying Prevention Committee Members: Number of new members that joined the Bullying Prevention Committee during this reporting period.

Data: This information should be collected by internal tracking systems. Report on this measure only during the reporting period that members initially joined the Bullying Prevention Committee. Number for PM: Count the total number of new members that joined the Bullying Prevention Committee during this reporting period and report this number for the PM. Count each member only once.

Number of New Bullying Prevention Committee Members should be greater than or equal to Number of New Bullying Prevention Committee Members Trained




Number of School Buildings with Assigned Bullying Prevention Coordinators: Number of school buildings that have an assigned Bullying Prevention Coordinator.

Data: This information should be collected by internal tracking systems. Report on this measure only during the reporting period that the school was initially assigned a Bullying Prevention Coordinator. Number for PM: Count the number of new Bullying Prevention Coordinators that joined the committee during this reporting period and report this number for the PM. Count each coordinator only once.

Number of New Bullying Prevention Committee Members Trained: Number of new Bullying Prevention Committee members that completed the 2-day OBPP training during this reporting period.

Data: This information should be collected by internal tracking systems. Number for PM: Of those reported in ‘Number of New Bullying Prevention Committee Members’, count the number that completed the 2-day OBPP training and report this number for the PM. Count each member only once.

Number of New Bullying Prevention Committee Members Trained should be less than or equal to Number of New Bullying Prevention Committee Members

Number of School Buildings with a Bullying Prevention Committee: Number of school buildings with a Bullying Prevention Committee.

Data: This information should be collected by internal tracking systems. Report on this measure only during the reporting period that the Bullying Prevention Committee was initially formed. Number for PM: Count the number of school buildings where a Bullying Prevention Committee was formed during this reporting period and report this number for the PM.

Number of School Buildings with a Bullying Prevention Committee should be greater than or equal to Number of Bullying Prevention Committees that Met Monthly




Number of Bullying Prevention Committees that Met Monthly: The number of Bullying Prevention Committees that met at least once every month during the school year.

Data: This information should be collected by internal tracking systems. Report on this measure only at the end of each school year (4th quarter). Number for PM: Count the number of Bullying Prevention Committees that met at least once every month during the school year and report this number for the PM. Count each Bullying Prevention Committee only once.

Number of Bullying Prevention Committees that Met Monthly should be less than or equal to Number of School Buildings with a Bullying Prevention Committee

Number of Schools with Bullying Prevention

Coordinators that had Regular Consultations with

their Certified OBPP Trainer: Number of Schools

with Bullying Prevention Coordinators that had at

least 4 consultations with their certified OBPP

trainer during this school year.

Data: This information should be collected by internal tracking systems. Report on this measure only at the end of each school year (4th quarter). Number for PM: Count the number of schools with Bullying Prevention Coordinators that had at least 4 telephone and/or face-to-face consultations with their Certified OBPP trainer during this school year and report this number for the PM.

Number of Schools with Bullying Prevention Coordinators that had Regular Consultations with their Certified OBPP Trainer less than or equal to Number of School Buildings with Assigned Bullying Prevention Coordinators

Number of School Buildings that Completed the OBPP Schoolwide Implementation Checklist for the First Year of Implementation: Number of school buildings that completed the OBPP Schoolwide Implementation Checklist for the First Year of Implementation.

Data: This information should be collected by internal tracking systems. Report on this measure only at the end of the first year of OBPP implementation. Number for PM: Count the number of school buildings that completed all categories on the OBPP Schoolwide Implementation Checklist for the First Year of Implementation by the end of this school year and report this number for the PM.

Number of School Buildings that Completed the OBPP Schoolwide Implementation Checklist for the First Year of Implementation should be less than or equal to Number of School Buildings that Began First Year of OBPP Implementation




Number of School Buildings that Completed the OBPP Implementation Checklist for Continued Program: Number of school buildings that completed the OBPP Implementation Checklist for Continued Program Implementation.

Data: This information should be collected by internal tracking systems. Report on this measure at the end of each year following the first year of OBPP implementation (e.g., the 2nd, 3rd, 4th year of program implementation) Number for PM: Count the number of school buildings that completed all categories on the OBPP Implementation Checklist for Continued Program Implementation by the end of this school year and report this number for the PM.

Number of School Buildings that Completed the OBPP Implementation Checklist for Continued Program should be less than or equal to Number of School Buildings Implementing OBPP minus Number of School Buildings that Began First Year of OBPP Implementation

Number of School Buildings that Held an Annual

Kickoff Event: Number of school buildings that

held one kickoff event during this school year.

Data: This information should be collected by internal tracking systems. Report on this measure only at the end of each school year (4th quarter). Number for PM: Count the number of school buildings that held at least one kickoff event during this school year and report this number for the PM. At least one kickoff event per year is recommended by the developer.

Number of School Buildings that Held an Annual Kickoff Event should be less than or equal to Number of School Buildings Implementing OBPP

Number of Hazelden Standard School Reports Submitted: Number of Hazelden Standard School Reports submitted as part of the quarterly program report.

Data: This information should be collected by internal tracking systems. Number for PM: Count the number of Hazelden Standard School Reports submitted as part of the quarterly program report during this reporting period and report this number for the PM. The school reports are received from Hazelden and are an analysis of the Olweus Bullying Questionnaire. They should be submitted with the quarterly report during the reporting period in which they were received.

Number of Hazelden Standard School Reports Submitted should be less than or equal to Number of School Buildings Implementing OBPP




Number of Hazelden District Trend Reports Submitted: Number of Hazelden District Trend Reports submitted as part of the quarterly program report.

Data: This information should be collected by internal tracking systems. Number for PM: Count the number of Hazelden District Trend Reports submitted as part of the quarterly program report during this reporting period and report this number for the PM. The district reports are received from Hazelden and are an analysis of the Olweus Bullying Questionnaire. They should be submitted with the quarterly report during the quarter in which they were received.

Number of Hazelden District Trend Reports Submitted should be less than or equal to Number of School Buildings Implementing OBPP

Number of Reports to the Collaborative Board: Number of data/outcome reports presented to the collaborative board that supported the project and/or number of written or oral presentations made during this reporting period to the collaborative board that supported the project.

Data: Grantees are required to report to the collaborative board that supported the grant proposal at least quarterly and to provide a written data report highlighting program outcomes at least annually. The annual written data report must be submitted to the collaborative board prior to the end of each fiscal year. The written data report must also be attached in E-grants. Meeting minutes or other documentation may also be attached. This information should be collected using internal tracking systems.

Number for PM: Count each report only once. Only report this for reports/presentations given during this reporting period.

Outcome Measures




Number of Staff that Reported Positive Safety Effect: Number of teachers and staff trained in OBPP that reported that OBPP positively affected youths’ feelings of safety at school.

Data: This data can be collected from the EPISCenter Bullying Prevention Program Staff Survey. Report on this measure as part of your Quarterly Program Report for the fourth quarter of the last year of your grant for all staff with a completed survey. Number for PM: Count the number of staff that answered ‘agree’ (4) or ‘strongly agree’ (5) for Question 1 and report this number for the PM.

Number of Staff that Reported Positive Safety Effect should be less than or equal to Number of Teachers and Staff that Completed the EPISCenter Bullying Prevention Program Staff Survey

Number of Staff that Reported that School Rules were an Effective Bullying Prevention Strategy: Number of teachers and staff trained in OBPP that reported that establishing school-wide rules was an effective bullying prevention strategy.


Number of Staff that Reported that School Rules were an Effective Bullying Prevention Strategy should be less than or equal to Number of Teachers and Staff that Completed the EPISCenter Bullying Prevention Program Staff Survey

Number of Staff that Reported OBPP had a Positive Effect on Youths’ Self Esteem: Number of teachers and staff trained in OBPP that reported that OBPP had a positive effect on youths’ self esteem.


Number of Staff that Reported OBPP had a Positive Effect on Youths’ Self Esteem should be less than or equal to Number of Teachers and Staff that Completed the EPISCenter Bullying Prevention Program Staff Survey




Total Number of Disciplinary Referrals: Total number of disciplinary referrals reported at the school during this reporting period.

Data: This information should be collected by internal tracking systems. Number for PM: Count the total number of disciplinary referrals reported at the school during this reporting period and report this number for the PM.

Total Number of Disciplinary Referrals should be greater than or equal to Total Number of Bullying Disciplinary Referrals

Total Number of Bullying Disciplinary Referrals: Total number of bullying disciplinary referrals reported at the school during this reporting period.

Data: This information should be collected by internal tracking systems. Number for PM: Of the total number of disciplinary referrals reported at the school during this reporting period, count how many were referrals related to bullying incidents and report this number for the PM.

Total Number of Bullying Disciplinary Referrals should be less than or equal to Total Number of Disciplinary Referrals

Year 1 Outcomes Measures

Year 1 Number of Youth that Reported Being Bullied 2-3 Times a Month or More: Number of youth that reported being bullied 2-3 times a month or more.

Data: This data can be collected from the OBPP Bullying Questionnaire (OBQ) Standard School Report. Report on this measure once each year during the reporting period that the OBQ School Standard Report was received. Scoring: In Section 2 of the report, identify the table that reports the percentage (and number) of girls and boys who have been bullied “2-3 times per month” or more in the past couple of months. Report the total number of boys and girls reported in this table for the PM. Number for PM: Report the number from the calculation above for the PM.

Year 1 Number of Youth that Reported Being Bullied 2-3 Times a Month or More should be less than or equal to Year 1 Number of Youth that Completed the OBPP Bullying Questionnaire




Year 1 Number of Youth that Reported Being Bullied in the Past Couple of Months: Number of youth that reported being bullied in the past couple of months and responded to the questions regarding who they told about the bullying.

Data: This data can be collected from the OBPP Bullying Questionnaire (OBQ) Standard School Report. Report on this measure once each year during the reporting period that the OBQ School Standard Report was received. Number for PM: In Section 2 of the report, identify the series of tables that report a) bullied students who have told a teacher or another adult, b) bullied students who have told a parent/guardian, c) bullied students who have told a brother, sister or friend and d) bullied students who haven’t told anyone at school about the bullying. Sum the total number of boys and girls included in these tables and report this number for the PM.

Year 1 Number of Youth that Reported Being Bullied in the Past Couple of Months should be less than or equal to Year 1 Number of Youth that Completed the OBPP Bullying Questionnaire

Year 1 Number of Bullied Youth that Told Someone About the Bullying: Number of bullied youth that reported that they had told someone about the bullying.

Data: This data can be collected from the OBPP Bullying Questionnaire (OBQ) Standard School Report. Report on this measure once each year during the reporting period that the OBQ School Standard Report was received. Number for PM: In Section 2 of the report, identify the two tables that report a) bullied students who have told a teacher or another adult, and b) bullied students who have told a parent/guardian, and c) bullied students who have told a brother, sister or friend about the bullying. Sum the total number of boys and girls that reported an answer to each of these questions (19a, 19b, 19c, 19d, 19e) and report this number for the PM.

Year 1 Number of Bullied Youth that Told Someone About the Bullying should be less than or equal to Year 1 Number of Youth that Completed the OBPP Bullying Questionnaire




Year 1 Number of Youth that Reported Expressing Empathy Towards Seeing a Student Being Bullied at School: Number of youth that reported expressing empathy towards seeing a student being bullied at school.

Data: This data can be collected from the OBPP Bullying Questionnaire (OBQ) Standard School Report. Report on this measure once each year during the reporting period that the OBQ School Standard Report was received. Number for PM: In Section 3, identify the table that reports the percentage (and number) of students who responded "feel a bit sorry" or "feel sorry and want to help" to Q23: When you see a student your age being bullied at school, what do you feel or think?. Report the total number of boys and girls reported in this table for the PM.

Year 1 Number of Youth that Reported Expressing Empathy Towards Seeing a Student Being Bullied at School should be less than or equal to Year 1 Number of Youth that Completed the OBPP Bullying Questionnaire

Year 1 Number of Youth that Reported Teachers

and Other Adults Intervening in Bullying Incidents:

Number of youth that reported that teachers and

other adults intervene in bullying incidents at their

school.

Data: This data can be collected from the OBPP Bullying Questionnaire (OBQ) Standard School Report. Report on this measure once each year during the reporting period that the OBQ School Standard Report was received. Number for PM: In Section 4, identify the table that reports percentage (and number) of students who responded "often" or "almost always" to Q20: How often do the teachers or other adults at school try to put a stop to it when a student is being bullied at school? Report the total number of boys and girls reported in this table for the PM.

Year 1 Number of Youth that Reported Teachers and Other Adults Intervening in Bullying Incidents should be less than or equal to Year 1 Number of Youth that Completed the OBPP Bullying Questionnaire




Year 1 Number of Youth that Reported Other

Students Intervening in Bullying Incidents:

Number of youth that reported that other students

intervene in bullying incidents at their school.

Data: This data can be collected from the OBPP Bullying Questionnaire (OBQ) Standard School Report. Report on this measure once each year during the reporting period that the OBQ School Standard Report was received. Number for PM: In Section 4, identify the table that reports percentage (and number) of students who responded "often" or "almost always" to Q21: How often do other students try to put a stop to it when a student is being bullied at school? Report the total number of boys and girls reported in this table for the PM.

Year 1 Number of Youth that Reported Other Students Intervening in Bullying Incidents should be less than or equal to Year 1 Number of Youth that Completed the OBPP Bullying Questionnaire

Year 2 Outcome Measures























school.












Year 3 Outcomes Measures























school.












Year 4 Outcome Measures























school.












Date post:	23-May-2020
Category:	Documents
Upload:	others
View:	3 times
Download:	0 times

EPISCenter’s PM Reporting Guidelines: Olweus Bullying Prevention ... Reporting Guideli… ·...

Documents