Megan Cave
Celeste Rossetto Dickey
University of Oregon
�Current: PBS Surveys
� Future: PBIS Assessment
�PBIS Evaluation
�Questions
www.pbssurveys.org
� TIC 3.0
� Classroom Self Assessment
� School Information Guide
� Respondent Cheatsheet
� Troubleshooting
� Coordinator Manual
� Self Assessment (items 6 & 8):
� Classroom Behavior Support System (items 15-17)
� Three new questions designed to include the classroom setting in the school wide planning.
� Classroom Assessment – Question 15
�One Example: Classroom Assessment
(Sugai, Horner, Lewis Palmer)
� Establish Information System (items 18-19)
� Build Capacity for Function-Based Support (items 21-23)
– These questions provide greater detail on the needs of the school to support tier 3 students.
� Two-page information sheet containing:
� Overview of PBS Surveys application
� Basic access and login procedures
� Information about available survey instruments
� Space available for coordinator’s contact information.
� Back-to-Back instructions for completing (multi-respondent) surveys.
� Side 1: Self Assessment Survey� Side 2: School Safety Survey� Instructions contain detailed steps and screen shots of the data entry process.
� Space provided for school name and account ID as well as coordinator contact information.
� Survey windows:
� The survey window can be updated as long as edits are made BEFORE the window closes.
� Examples:
� Everyone at Demo School Exemplar has completed the School Safety but they can’t view reports but the survey closes next week.
� Demo School Challenged needs one more week to get the rest of the staff responses. The survey closed yesterday.
� Several faculty members at Test School 1 forgot to enter data and the window closes tomorrow.
� Adding a School:
�What is your current “scope” access? (school, district, or state?)
� Check the “Add School” feature in Account Management?
� Complete “School Information Form” (page 37 of the PBS Surveys User Manual) and return to PBS Surveys account manager.
�Where are my Self-Assessment reports?
� Check the close date.
� The data will be merged at midnight and available the next morning.
�What’s my school’s account code?
� Check the Account Management section of your coordinator account.
� If it’s a new school, click the Create Account button for that school in Account Management.
Demo School
555 Demo Street
Demo, State 12345
� Since February, I haven’t been able to login to PBS Surveys to coordinate my accounts.
� If you are a SWIS facilitator, your SAMI login information is now your PBS Surveys login information.
Projected Timeline:
August, 2010: Beta site
June, 2011: Release
�Overview of the website design
� Action Planning
� Individual Surveys/Checklists
� Evaluation Planning Template
� PBIS Assessment will take the place of PBS Surveys
� PBIS Assessment will include information on:
� Developing an Evaluation Plan
� Choosing Surveys/Checklists
� Creating of a single Action Plan from the Surveys/Checklists
� Home Page
� Surveys/Checklists Tab
� Reports Tab
� Action Planning Tab
� Management Tab
� Support/Training Tab
Website
PBIS AssessmentLogin
Home Support & TrainingAbout Surveys &
Checklists
•About
Us/Contact
•Login/ Demo
•Purpose
•Process
•How to Access
•Survey Information
•Link to version/ history
•Action Planning
•Evaluation Blueprint
•Start-up wizard
•Help topics
•Resources/ Links
•Videos
•Coordinator search
•Contact info.
Surveys/
Checklists
Action
Plan
Reports Support/
TrainingManage
Login/
Authentication
Account Home
My coordinator
Application
�Reliable & Evidence-Based
�Consistent use across states
�Addresses a need not duplicated by measures currently offered
Research Tool Annual
Assessment
Tool
Progress
Monitoring Tool
Universal
System
System-wide
Evaluation Tool
(SET)
Benchmarks of Quality
(BoQ)
Self Assessment
Survey (SAS)
Team Implementation
Checklist (TIC 3.0)
Secondary &
Tertiary
Systems
Self Assessment
Survey (SAS)
Outcome Measure: School Safety Survey
Research Tool Annual
Assessment
Tool
Progress
Monitoring Tool
Universal
System
System-wide
Evaluation Tool
(SET)
Pre-SET
Benchmarks of Quality
(BoQ)
Self Assessment
Survey (SAS)
Teaching Pyramid
Observation Tool
(TPOT)
Team Implementation
Checklist (TIC 3.0)
Pre-School Tool TBD
Secondary &
Tertiary
Systems
Individual Student
Systems Evaluation
Tool (ISSET)
Benchmarks of
Advanced Tiers (BAT)
Self Assessment
Survey (SAS)
(MATT)
Monitoring Advanced
Tiers Tool
Outcome Measure: School Safety Survey
� ISSET- Currently in use, will be available on the website for data entry
� BAT (Benchmarks of Advanced Tiers) – copy for preview
� PreSET & TPOT –Early Education instruments
� MATT (Monitoring Advanced Tools Tiers) –in progress
Saturday, March 278:30 am – 12:30 pmTools for Developing A Comprehensive Evaluation Template --- BAT
�Overall Report
�Subscale Report
�Individual Item Report
TIC Action Plan
SAS
Action Plan
BoQ Action Plan
SET
Action Plan
� School-wide Action Planning form
� Questions from TIC, BoQ, SET, and/or SAS will be included
� Secondary and Tertiary (Tier 2/3) Action Planning form
� Questions from ISSET, BAT and MATT will be included
� Action Planning Forms based on Research-based features
Measure Year One Year Two Year Three
Fall Winter Spring Sum Fall Winter Spring Sum Fall Winter Spring Sum
SAS Survey
Team
Checklist
(TIC)
BoQ
SET
Or PreSET
BAT
MATT
ISSET
School
Safety
Survey
TPOT
Measure Year One Year Two Year Three
Fall Winter Spring Sum Fall Winter Spring Sum Fall Winter Spring Sum
SAS Survey X X X
Team
Checklist
(TIC)
X X X X X X X X X
SET
Or PreSET
X X X
Measure Year One Year Two Year Three
Fall Winter Spring Sum Fall Winter Spring Sum Fall Winter Spring Sum
BoQ X X X
BAT X X X
MATT X X X X X X X X X
EXAMPLES
Measure Year One Year Two Year Three
Fall Winter Spring Sum Fall Winter Spring Sum Fall Winter Spring Sum
www.pbseval.org
� Site for Evaluators at the State or District Level
� Includes data from SWIS & PBS Surveys
� Schools are included in the reports if data sharing has been signed
� Cost: $1000 – State Access; $500 – District Access per year
� State or District Leadership Team
� 90 minute training on PBIS Evaluation
� Agreement by State or District to not show school level data without the school’s permission
� Signed license agreement
� Annual fee
� PBIS Evaluation
�www.pbseval.org
� Contact:
� Rob Horner [email protected]
� Celeste Rossetto Dickey [email protected]
� Application to assist with:
� Are we doing what we said we would do?
� PBS Surveys/PBIS Assessment:
� Surveys/Checklists to assess fidelity of implementation
� PBIS Evaluation
� Combines student outcome data with fidelity of implementation data
� Reporting/Evaluation purposes