ADMS Recommendation_Board of Education_030111 1
2010-2011 Assessment Data Management System (ADMS) Review & EvaluationConducted by the Assessment Data Management System Committee in collaboration with the Assessment, Research and Evaluation Department and Curriculum Council 1
ADMS Recommendation_Board of Education_030111
22
After a thorough review of our current provider and four potential replacement vendors, the ADMS committee strongly recommends the adoption of Illuminate Education as the provider of our district’s ADMS.
ADMS Committee Recommendation
Illuminate Education Data Wise
Performance Matters
eSchool PLUS (Performance
Plus)DataDirector New Interface Total
Weighted Points Received 1005 360 51 48 18 1482
Percent of Weighted Points Received
68% 24% 3% 3% 1% 100%
Number of Ballots Ranked Number One
18 2 1 1 22
Percent of Ballots Ranked Number One
82% 9% 5% 5% 0% 100%
ADMS Recommendation_Board of Education_030111
3
Why Have an ADMS?
Facilitates teaching and learning by making student-centered information available to teachers and staff …. easily … and when it is needed. Classroom Assessments Demographic Lists Online K-6 Report Cards Placement and Intervention Eligibility Lists English Proficiency Identification and Fluency Reports California Standardized Test Reports Program Evaluation Reports District Assessments
ADMS Recommendation_Board of Education_030111
4
Our JourneyLUSD has been using DataDirector, our current ADMS
provider since March 2008.
DataDirector is scheduled to undergo a significant user interface change in the late summer that would require significant training of our district’s users.
Under DataDirector’s new management, customer service and system reliability quality has declined significantly.
Frequent down times for the system’s servers, especially at the end of each quarter, and programming errors have become the norm.
4
ADMS Recommendation_Board of Education_030111
5
Our JourneyOur current contract for DataDirector
expires on June 30, 2011.
In response to several wide-spread concerns regarding DataDirector, the Assessment, Research, and Evaluation (ARE) Department facilitated a review and evaluation of the district’s ADMS needs in collaboration with teachers, site instructional leaders, and district leadership teams
5
ADMS Recommendation_Board of Education_030111 6
ADMS Review Timeline / ProcessDate Action
September 2010Vendor customer service issues, site concerns discussed at Instructional Leadership Team
October 2010 DataDirector survey developed in collaboration with LEA
November 2010 District ADMS review process formulated at Cabinet
District ADMS review process shared at Curriculum Council
ADMS Committee members, including teachers, administrators, technology, and ARE staff, recruited to make a recommendation regarding the replacement or extension of the contract with our current provider (see ADMS Committee Membership in Appendix)
Potential replacement vendor demonstration by PERFORMANCE MATTERS*
December 2010 Potential replacement vendor demonstration by DATA WISE*
Potential replacement vendor demonstration by ILLUMINATE EDUCATION*
Potential replacement vendor demonstration by SUNGARD (a.k.a. eSchoolPLUS)*
January 2011Riverside Publishing cancels January 27 demonstration of new interface for DataDirector; demonstration postponed until March 1 (at the earliest)
ADMS Committee members electronically polled and unanimously agree to continue on without DataDirector new interface demonstration
ADMS meeting to discuss and rank vendors; recommendation received*
6*Each of these five meetings were scheduled for 2 hours from 3:30-5:30 PM.
ADMS Recommendation_Board of Education_030111 7
ADMS Review Timeline / Process(continued)
Date Action
February 2011Recommendation shared with Cabinet and Curriculum CouncilIlluminate Education demonstrations at selected LUSD sites
March 2011 Recommendation to LUSD Board of Education
April 2011 Implementation process meetings held with vendorBegin data conversion scheduling
May 2011 Data conversion and data import schedule finalized
June 2011 Illuminate Education available in Lodi USD
July 2011 Teachers receive initial training
7
ADMS Recommendation_Board of Education_030111
8
Significant Features of Illuminate Education ADMSCamera-based scanning resulting in cheaper printing costs,
easier data entry, and increased student engagement.
Promotes student-centered assessments by allowing students to scan their own assessments and receive instant feedback
Provides more flexibility over the annual k-6 report card revision process
Facilitates nightly upload to ESP Grade book
Includes similar, but more user-friendly user interface over DataDirector
8
ADMS Recommendation_Board of Education_030111
9
Related TasksBased on ADMS Committee recommendation,
ARE staff has been conducting the following tasks:Facilitate resale of Fujitsu fi-6130 scanners in
collaboration with Purchasing Department Verify web / document camera scanning options for
short (20 question), medium (40 question), and long (100 question) assessments.
Determine proposed budget impacts
9
ADMS Recommendation_Board of Education_030111
10
Related TasksSale of Existing Scanners
Conservative estimate provided by Purchasing is that LUSD could receive $500 per existing Fujitsu fi-6130 scanner
This amounts to $31,000 based on the 62 verified units at school sites
Scanners to be sold at end of 2010-11 or in early 2011-12; the projected amount will be deposited into the district’s General Fund
10
ADMS Recommendation_Board of Education_030111
11
Results of ARE Follow-Up TasksVerify web / document camera scanning ability for assessments
Short, medium and long assessments could be scanned simply by placing them on a GradeCam camera.
This process has been successfully tested in classrooms at the following sites:
11
Elementary Middle High
Clairmont (Grade 3)
Heritage(Grade 6)
Julia Morgan(Grade 6)
Larson (Grade 3)
Christa McAuliffe(Grade 8)
Lodi High(Grade 11)
ADMS Recommendation_Board of Education_030111
12
Related TasksProposed Budget Impacts
AssumptionsGr K-1 teachers continue to hand-enter
assessment data; cameras not providedCameras provided for:
446 Gr 2-6 classroom teachers179 Gr 7-12 ELA teachers124 Gr 7-12 Math teachers104 Gr 7-12 Science teachers113 Gr 7-12 Social Science teachers
12
ADMS Recommendation_Board of Education_030111
1313
2011-2012 Costs Related to
DataDirector
2011-2012 Costs Related to
Illuminate Education
Annual Contract $115,050 $111,203
Net One-Time $15,000
(Est. for Report Card revisions)
$28,600 (Net costs after scanner sales
and Camera purchases)
2011-2012 Costs $130,050 $139,803
2012-2013 Costs $115,050 $111,203
2013-2014 Costs $115,050 $111,203
Related Tasks Proposed Budget Impacts
Funding Source: District Program Improvement Funds
ADMS Recommendation_Board of Education_030111
14
AppendixADMS Committee Membership
ADMS Recommendation_Board of Education_030111
15
ADMS Committee: Classroom TeachersSite Name (First - Last) Position Grade Level
Bear Creek High Cindy Mettler Classroom 9-12
Beckman Elementary Lisa Fromm Classroom 6
Christa McAuliffe Middle Charles Taylor Classroom 7-8
Christa McAuliffe Middle Martha Snider Classroom 7-8
Ellerth E. Larson Elementary Chris Funge Classroom 3
Julia Morgan Elementary Shelley Liechty Classroom 3
Live Oak Elementary Nancy Gonzalez Classroom 1
Lodi High George Krukis Classroom 9-12
Lois E. Borchardt Elementary Joe Velasquez Classroom 6
Manlio Silva Elementary Vanessa Eddy Classroom 2
Morada Middle Adriano Dobrescu Classroom 7-8
Oakwood Elementary Nichelle Bartlett Classroom 5
Podesta Ranch Elementary Tammie Rich Classroom 3
Ronald E. McNair High Amy Lundeberg Classroom 9-12
Tokay High Jamie Anaforian Classroom 9-12
Tokay High Mark Hughes Classroom 9-12
ADMS Recommendation_Board of Education_030111
16
ADMS Committee: Coaches / Intervention / LEA President
Site Name (First - Last) Position Grade Level
Beckman Elementary Christina Dunn Coach k-6
Creekside Elementary Jennifer Plaster Intervention k-6
Oakwood Matt Hummel Intervention K-6
District Kathryn Odell Coach k-12
District Luann Casey Coach k-6
District Nanci Webber-Johnston Coach k-6
District Jeff Johnston LEA President 7-12
ADMS Recommendation_Board of Education_030111
17ADMS Committee: Site Administrators / ARE / Technology
Site Name (First - Last) Position Grade Level
Christa McAuliffe Middle Randy Malandro Admin 7-8
Clairmont Elementary Susan Hitchcock Admin k-6
Erma B. Reese Elementary Matthew Ray Admin k-6
Lois E. Borchardt Elementary Janis Morehead Admin k-6
Millswood Middle Sheree Flemmer Admin 7-8
Tokay High Martha Dent Admin 9-12
District Debra Ladwig ARE k-12
District Ed Eldridge ARE k-12
District Jim Sherblon ARE k-12
District Susan Martin Technology k-12