JULY 11 - 13

JULY 11 - 13THE SARATOGA HILTON | SARATOGA SPRINGS, NY

2 | Leading With Data: DATAG Summer Conference 2018

OUR MISSIONTo provide a leadership role in identifying, cataloging, and modeling best practices in the analysis and use of data for New York schools.

To assist schools in understanding performance assessments in order to effect changes in curriculum and instruction to meet New York educational standards.

To support the use of data to inform and improve curriculum, instruction, and assessment, as well as to guide professional development and district comprehensive or strategic planning.

Leading With Data: DATAG Summer Conference 2018 | 3

WELCOME!Welcome to our DATAG Summer Conference. We are excited to return to Saratoga, New York for what promises to be

another informative and helpful time together. As we vetted the proposals, we wanted to be sure we were meeting your

needs. Our members represent many aspects of diversity ... jobs, roles, responsibilities, experience and interests. We

hope our offerings support your work in the interest of student success across New York State.

Our keynote speaker and pre - session invitation went to Bradley Geise. Bradley will be focusing on using data in the

school improvement process. Ira Schwartz will help us close the conference on Friday for a School Report Card review

based on ESSA and the new guidelines.

Thank you for joining us. We value your participation and your enthusiasm for collegiality and collaboration.

Barbara Battaglia and Sean Fahey

Summer Conference co-chairs

CHAIRRobert MeliaSchenendehowa CSD

PROGRAM DIRECTORSean FaheyWest Genesee CSD

RECORDING SECRETARYDonna Marie NortonNorth Syracuse CSD

PAST CHAIRMarcia CaponeNiagara Falls CSD

ASSOCIATE PROGRAM DIRECTORJodie Pillius Mackrell

TREASURERJoseph SternEastern Suffolk BOCES

BOARD MEMBERS

Rose Baum

Barbara Battaglia

Carol Eckl

Jeffrey Luks

Shannon Mattice

Marti Mauro

Peter McCarthy

Brenda Roof

Randy Simmons

DATAG BOARD OF DIRECTORS 2018 - 2019


CO-CHAIRBarbara Battaglia

CO-CHAIRSean Fahey

GERALD E. DEMAURO AWARDRose Baum

PROGRAMSummer Conference Committee

VOLUNTEERSCarol Eckl

TECHNOLOGYMarti Mauro Stacy Karpinski

VENDORSSean Fahey

ACKNOWLEDGEMENTS:

Registration and Purchase Orders - Roz Harris

SUMMER CONFERENCE COMMITTEE ‘18

KEY CONFERENCE SESSIONSWEDNESDAY, JULY 11, 2018

12:00pm - 1:00pm Registration (Registration is also open for the full conference during the pre-conference.)

1:00pm - 4:00pm Pre-Conference Session - Saratoga 1 and 2Bradley Geiss

THURSDAY, JULY 12, 2018

7:00am - 8:00am Registration, Coffee, and Continental Breakfast

8:00am - 8:10am Welcome, Introduction of the Board of Directors, AcknowledgementsBradley Geiss

8:15am - 9:00am Keynote AddressBradley Geiss

9:00am - 9:15am Q&A and Updates

FRIDAY, JULY 13, 2018

9:00am - 10:00am Breakfast

10:00am - 10:45am Ira Schwartz, Associate Commissioner - Office of Accountability - NYSED

11:15am - 12:00pm Regional Data Verification Session Help


SCHEDULE AT A GLANCE

KEY:

Data Analysis and Decision Making Chief Info NYS Assessment and Data Usage

Leadership All of the Above

SESSION 19:30am - 10:20am

TIME

SESSION 210:30am - 11:20am

SESSION 311:30am - 12:20pm

LUNCH12:30pm - 1:20pm

SESSION 41:30pm - 2:20pm

SESSION 52:30pm - 3:20pm

3:20pm - 4:00pm

4:00pm - 5:30pm

Using DataMate to Help Students with

Nextera Online TestsEducational Vistas

A Framework to Unlock the Potential

of District-Conducted Efficiacy Research in

New York StateCurriculum Associates

Managing RTI Data with RTI Edge

Broom-Tioga BOCES

Lunch and Vendor Time, Lunch in Saratoga 1 & 2

Vendor Visits

eScholar Reception in Gallery

CIO 101Charlie King

Data Visualization in RPaul de Barros

Alan B. Thorne, Jr.

Using the Data Warehouse for More Than Accountability

ReportingeScholar

ESSA Update “Overview”

Barb BattagliaMarcia Capone

Educational Information is About to

ChangeMonica De Tuya

Paul Zachos

A Focus on Goals - Leveraging the Data

from Your DistrictSchoolzilla

ESSA Update “Measures of Interim

Progress/State Goals & 95% Participation”

Joe SternRobert Melia

The Journey Through Digital Conversion

Jean SharlowMichelle Brantner

Presenting K-12 Data VisuallySteve Liu

Mark Samis

Better Online Assessments with

eSchooldata and IO Assessment

eSD

The Trusted Learning Environment and the Future of Data

SecurityInfinite Campus

Next Generation API Integration (RIC

Personnel Only)eScholar

The Chicken or The Egg...Does Data Come First or the Problem?

Lisa Cala Ruud

Struggle is BeautifulJanet SteinbergMandy Ehrlich

Day One Access for Students and Staff to All Their Teaching, Learning and Productivity Tools Begins with ClassLink!

Classlink

Western Suffolk BOCES Assessment Service:

Assessment Literacy and Collaborative Design of Regional Assessments

Randy SimmonsRenee Allen

ESSA Update “Graduation Rate & Career and College

ReadinessCarol Eckl

Brenda Roof

ESSA Update “School Identification In

The Every Student Succeeds Act (ESSA)”

Betsy ConnersDan Carroll

Discovering Analytics That Inspire Student

SuccessEidex

Strategies for Ensuring Data Quality

Whitney McHenry

When Less is More: How to Win the Battle

with Data Management and Interoperability

Otus

Data Deadlines and Resources to Use with

ThemAndrea Tamarazio

Using Regression and Other Statistical Methods to Analyze

Educational DataMichael Kumrow

“Can High School Instructional Programs

Affect College Success?”

Fredric Cohen

Data Driven DialoguePeter McCarthy

What’s Next - Hoonuit Data Analytics with

Actionable Next StepsHoonuit

The Times They Are a Changing! PII? API?

DPSS? What Does This All Mean?RIC One

Using Microsoft Access to Import, Link,

and Query DataCheri Pettus

Twenty Questions (or so): Driving Data

Discussions and Inquiry

Dennis AtkinsonJill Schottman

Real Time Data Analysis with Shared

Google SheetsCheryl Covell

Who is Ready to Graduate? Regents

Exam Maximum Scores Download and

DashboardMeador Pratt

Jeff Davis

LUNCH12:30pm - 1:20pm

BROADWAY 1 BROADWAY 2 BROADWAY 3 BROADWAY 4 TRAVERS ALABAMA WHITNEY

8:15am - 9:00am: Keynote: Bradley Geiss


CONFERENCE SCHEDULE

Location/Title/Presenter(s) Session Description

SESSION 1 9:30am - 10:20amThursday, July 12, 2018

SESSION 1A - Broadway 1Using DataMate to Help Students with Nextera Online TestsEducational Vistas

SESSION 1B - Broadway 2CIO 101 Charlie KingDouble Session: 9:30am - 11:20am

SESSION 1C - Broadway 3Data Visualization in RPaul de Barros, Alan B. Thorne Jr.

SESSION 1D - Broadway 4Using the Data Warehouse for More Than Accountability ReportingeScholar

SESSION 1E - TraversESSA Update “Overview”Barb Battaglia, Marcia Capone

SESSION 1F - AlabamaEducational Information is About to ChangeMonica De Tuya, Paul Zach

SESSION 1G - WhitneyDay One Access for Students and Staff to All Their Teaching, Learning and Productivity Tools Begins with ClassLink!Classlink

Students struggle using math tool bars and just getting familiar with an online platform. DataMate can be used to help students with these challenges. It uses the WIRIS toolbar just as NEXTERA does, and the questions can be laid out, so they look as if they are being done in NEXTERA. The big benefit is that after students take the assessment in DataMate, the teachers receive immediate results, unlike taking the practice tests in NEXTERA, where they just learn the platform with no feedback.

The task of accurately reporting the mountainous amounts of data that is required can be daunting for even the most seasoned District Data Coordinator. This session will review the roles and responsibilities of a District Data Coordinator. The presentation will include information on how to load data, the flow of data from local systems to SED, and required SED deadlines. This session is appropriate for all administrators or other data team members who need a “big picture” understanding of the state data repository system, accountability, and data available to help improve instruction. This session will also offer tools and guides to help make the year long process of data reporting and verification more manageable.

Data Visualization is essential to communicating information in a clear and engaging way. Learn about the “grammar of graphics” and how to use some of the most popular and powerful visualization tools for R including ggplot2 and googlevis, the Google Charts API package.

How can your RIC or district leverage the power of the eScholar Complete Data Warehouse? Don’t limit your use of the data warehouse to only accountability data for SIRS. Learn how districts and RICS are leveraging the power of the data warehouse to put data back in the hands of administrators and educators.

This ESSA overview session will provide you with the TEN big ideas from ESSA along with a vocabulary review.

The educational measurement community is working to develop theory and methods for assessment and evaluation that will be more relevant to classroom teaching. Recent breakthroughs have led to the identification of a critical unit of educational data that can accomplish this purpose — the practical learning outcome (PLO). The PLO is a natural unit of thinking and action for standards based education. It supports the realization of standards at the performance indicator level, the critical level of specificity for planning, evaluating and refining instruction. The PLO permits meaningful and efficient aggregation of educational data from individual students, through school and school district, to state and national levels. It also provides a basis for replacing the traditional psychometric interpretations of validity and reliability with purely educational counterparts. The session opens with a report on a STEM based performance assessment that shows how conventional testing and grading differ from educational assessment and evaluation. It concludes with a demonstration of an information technology that provides teachers with precisely the information needed to support practical every day decision-making.

ClassLink provides student and staff with access to all their online tools and material on day one with Single Sign On, Rostering and Account Creation Come see how! Classlink empowers students and teachers with instant access to 5,000+ single sign-on (SSO) apps and files at school and on Google, Office 365, and Dropbox cloud drives. ClassLink’s OneRoster easily delivers class rosters to any publisher using open standards. ClassLink Analytics gives decision makers essential utilization data. With the addition of ClassLink’s OneSync account creation the circle is complete.



SESSION 2A - Broadway 1Who is Ready to Graduate? Regents Exam Maximum Scores Download and DashboardMeador Pratt, Jeff Davis

SESSION 2B - Broadway 2CIO 101 Charlie KingDouble Session: 9:30am - 11:20am

SESSION 2C - Broadway 3Discovering Analytics That Inspire Student SuccessEidex

SESSION 2D - Broadway 4ESSA Update “Measures of Interim Progress/State Goals & 95% Participation”Joe Stern, Robert Melia

SESSION 2E - TraversThe Journey Through Digital ConversionJean Sharlow, Michelle Brantner

SESSION 2F - AlabamaPresenting K-12 Data VisuallySteve Liu, Mark Samis

SESSION 2G - WhitneyBetter Online Assessments with eSchooldata and IO AssessmenteSD

High schools are presented with a challenge each year to identify students who qualify for different diploma types and graduation appeals. Through a partnership with a focus group of school district administrators from across the region, the Nassau BOCES Instructional Data Warehouse Team developed new reporting tools to assist with this challenge. These reports allow the user to sort and filter students based upon their highest Regents scores, ELL status, disability status, cohort, grade level, and several other categories.

The task of accurately reporting the mountainous amounts of data that is required can be daunting for even the most seasoned District Data Coordinator. This session will review the roles and responsibilities of a District Data Coordinator. The presentation will include information on how to load data, the flow of data from local systems to SED, and required SED deadlines. This session is appropriate for all administrators or other data team members who need a “big picture” understanding of the state data repository system, accountability, and data available to help improve instruction. This session will also offer tools and guides to help make the year long process of data reporting and verification more manageable.

These are challenging times to run a school district. School leaders are expected to perform major feats - often with limited resources. You’re faced with increased accountability for student outcomes, difficult financial decisions, the need to correlate expenditures with achievement, and more. You may be swimming in a sea of data, but are you using it to your advantage? Learn how to tell your district’s story and show how data can work efficiently for you - whether at the district-, building-, or student-level.

This session will review the 95% participation state assessment requirement including the implications on determining school and district accountability under ESSA.

Over the course of the past year, with the inspiration of the East Irondequoit School District, we have begun a district-wide digital transformation. This digital conversion, although focused on using technology more effectively and creatively, has also drawn our focus to what makes for powerful teaching and learning experiences in general. Our exploration has lead us to examine the SAMR and TPACK models more effectively as we seek the best methodologies and strategies to empower our students as learners in a 1:1 environment. Join Jean and Michelle as they share the steps, processes, challenges, and excitement of a digital conversion in the Marcellus School District and walk away with tips that may help you ignite a spark in your own district. The session is targeted at people in the earlier stages of implementing a 1:1 environment for those farther along that need some tips and tricks to amplify their learning experiences.

The introduction of enhancements in browser capabilities and well as a demand for more visual and interactive representation of K-12 data has led this and other RICs to explore new methods of display that can improve an educator’s understanding and allow them to take immediate action to improve student learning. We are presenting a number of methods to display K-12 data including those constructed from R, Python, Excel and Cognos Analytics.

Join us to learn more about the IO Assessment solution that now incorporates the Virtual Data Wall. Although our IO Assessment and VDW tools can be used in conjunction with any SIS, our eSD integration allows teachers to create, deliver, score, and analyze a wide variety of assessments directly from Teacher Connect. Results are automatically published to the Teacher Connect Gradebook, eliminating the need for double entry. Join us for a full demonstration of these exciting tools designed to empower educators with data to improve student outcomes.

SESSION 2 10:30am - 11:20amThursday, July 12, 2018



CONFERENCE SCHEDULE

SESSION 3 11:30am - 12:20pmThursday, July 12, 2018

SESSION 3A - Broadway 1When Less is More: How to Win the Battle with Data Management and InteroperabilityOtus

SESSION 3B - Broadway 2The Times They Are a Changing! PII? API? DPSS? What Does This All Mean?RIC One

SESSION 3C - Broadway 3Strategies for Ensuring Data QualityWhitney McHenry

SESSION 3D - Broadway 4The Trusted Learning Environment and the Future of Data SecurityInfinite Campus

SESSION 3E - TraversNext Generation API Integration (RIC Personnel Only)eScholar

SESSION 3F - AlabamaThe Chicken or The Egg...Does Data Come First or the Problem?Lisa Cala Ruud

Does your staff ever feel like their drowning in an oversaturated ocean of edtech tools? Worse yet, do they dread trying to aggregate data from these disparate platforms to tell a coherent story about their students? They’re not alone. Attendees will learn about the importance of interoperability and how to consolidate the number of different (and disconnected) edtech tools used in their school or district into a common platform while integrating data from 3rd party assessments that typically sits in a lonely data warehouse.

Education Law 2d was enacted in 2014 and the Chief Privacy Officer of NYSED is bringing changes to the way districts manage their student and teacher data. During this session you will learn how the RIC One Team is responding to these changes to address the needs of data privacy and integration for school districts in New York.

Imagine this: A charter school neglects to report their June graduates. An elementary school leaves out a class of UPK students, affecting allocations. A high school reports zero Algebra Regents one year for their freshmen, and the error doesn’t come to light until that cohort graduates four years later.These errors are the stuff of nightmares for a District Data Coordinator, and yet they each have happened. Every year, districts, even those with experienced DDCs, make serious, preventable errors in data reporting. One of the most powerful tools to avoid preventable errors is the simple checklist. This session will explore the benefits of checklists as well as the principles of creating effective checklists. We will explore how the WNYRIC uses checklists to assist schools and districts with data quality, and how we’re using technology to help.

The Trusted Learning Environment (TLE) Seal is a mark of distinction for school systems, signaling that they have taken measurable steps to implement practices to help ensure the privacy of student data.“Data show that a large majority of parents are concerned about the privacy and security of their students and student data. Earning the TLE Seal indicates that a school system has taken measurable steps to implement strong practices to ensure the privacy of student data.”Come learn about the Trusted Learning Environment, and how to have the courageous conversations that are necessary to ensure the safety of your district’s data. The first step to earning the TLE seal. Learning Objectives & Key Takeaways: Learn about the TLE framework and take away some practical questions to ask your technology team, as well as your district’s vendors. · How to have speak to your technology team and your district’s vendors · Key questions to ask your edtech vendors · How to get this process started · Expected outcomes from earning the TLE seal

Next Generation API Integration (RIC Personnel Only)

Do we start with the data or the problem? How do your educators, leaders and staff work together make sense of data? This session explores the results of a qualitative, multiple case study aimed to understand how educators within a typical high school and an odds beating high school work together to make data-based decisions in order to close the opportunity and outcome gap faced by educationally disadvantaged populations.


Location/Title/Presenter(s)


SESSION 4A - Broadway 1A Framework to Unlock the Potential of District-Conducted Efficiacy Research in New York StateCurriculum Associates

SESSION 4B - Broadway 2Data Deadlines and Resources to Use with ThemAndrea Tamarazio

SESSION 4C - Broadway 3Using Regression and Other Statistical Methods to Analyze Educational DataMichael Kumrow

The Every Student Succeeds Act (ESSA) provides guidance to educators as they strategically select the best educational programs and implement them successfully for struggling students and schools. This change shifts the focus toward programs with proven results, and helps districts evaluate the rigor of the research supporting these results. This session seeks to provide an overview of what ESSA considers to be “evidence-based” at each of the four levels, as well as present different research frameworks districts in New York State can leverage with their own data. Data sources including the State’s data.nysed.gov site, BOCES, NCES, and vendors will be discussed. During this session, we will define the four categories of evidence and will also describe the process Curriculum Associates has taken to evaluate our products’ effectiveness. We will also remind districts that their studies can be conducted on a handful of classrooms or a few schools, if designed appropriately. By conducting their own efficacy research, districts can unlock federal dollars for their programs, and make informed decisions about whether to continue implementing a specific intervention should the results prove inefficacious.

Have you ever read the SIRS Deadlines for Verification & Certification Document or the ePMF / SIRS Staff Collection Timeline and said to yourself ... I know I need to complete these items but I wish I had a collection of resources to assist me with these tasks.This workshop is designed to highlight the most recent communication related to the upcoming ePMF and SIRS deadlines that have been sent out to CIOs and administrators. During this workshop, participants will get to discuss the upcoming deadlines, see resources that have been created to assist with the collection of information related to those deadlines and discuss questions or concerns related to the ePMF and SIRS Verification and Collection items that are due during the beginning of the school year.

This session will focus on the use of multivariate and logistic regression to model various data scenarios within school districts. By using these methods along with helpful visualizations that provide context to the intended audience, districts can avoid falling for various data fallacies and gain insightful knowledge that can be used to make decisions that are more informed. The session will include a summary of four different implementations of advanced statistical analysis: Analyzing the Impact of a 2-Year Algebra I Course, Student with Disability Performance on State Assessments, Curriculum Analysis, and Refusal Rates.

SESSION 4 1:30pm - 2:20pmThursday, July 12, 2018

Western Suffolk BOCES Assessment Service brings districts together for assessment literacy training and collaborative design of shared regional assessments. Eight Suffolk County districts have participated in the Assessment Service workshops in the last year. Districts that joined the consortium had access to 50 workshop day seats for twelve workshops ranging from second grade assessment workshops to high school assessment workshops. Renee Allen and Randy Simmons will describe the basic elements in Western Suffolk BOCES’ model of collaborative assessment design and the primary accomplishments of the multi-district consortium for the first two year. Several factors, including the opt-out movement, have motivated districts toward collaboration on regional assessments. Once teachers understand how to design assessment with rigor and good depth of measurement, the value of instructionally useful assessments is clear. The vision for assessment development is that it should be an on-going process that includes shared data reviews to improve assessments over time.

SESSION 3G - WhitneyWestern Suffolk BOCES Assessment Service: Assessment Literacy and Collaborative Design of Regional AssessmentsRandy Simmons, Renee Allen




CONFERENCE SCHEDULE

SESSION 5A - Broadway 1Managing RTI Data with RTI EdgeBroome-Tioga BOCES

SESSION 5B - Broadway 2Using Microsoft Access to Import, Link, and Query DataCheri Pettus

SESSION 5C - Broadway 3Twenty Questions (or so): Driving Data Discussions and InquiryDennis Atkinson, Jill Schottman

Come see this easy to use, yet comprehensive tracking system. Districts can track Universal Screenings, create student Interventions, Progress Monitor, work on RTI meetings, and much more. The product produces easy to read graphs, letters, and reports that give districts one RTI solution.

We will be using sample files exported out of an SIS, Special Education system, and test data. We will import these files into Microsoft Access. We will link these files together and query them. We will copy and paste the query results into Word and/or Excel. We will design a simple report in Access. Basic Microsoft Access knowledge is helpful but not required.

State assessment performance information can provide a wealth of information about student learning and teacher effectiveness, but how? Making a binder and dropping it on a teacher’s desk isn’t the most effective way to facilitate data inquiry. This session will provide questions to encourage data inquiry...we’ll even offer some ways to answer the questions. Techniques to use in your next data discussion will be modeled and sources available to answer the questions will be shared. We’ll close the session by stealing your ideas. We’d like your suggestions for more ways to keep data inquiry alive...and we know the rest of the group would as well.

SESSION 5 2:30pm - 3:20pmThursday, July 12, 2018

SESSION 4D - Broadway 4“Can High School Instructional Programs Affect College Success?”Fredric Cohen

SESSION 4E - TraversData Driven DialoguePeter McCarthy

SESSION 4FA Focus on Goals - Leveraging the Data from Your DistrictSchoolzilla

SESSION 4GESSA Update “School Identification In The Every Student Succeeds Act (ESSA)”Betsy Conners, Dan Carroll

School districts have always recognized their obligation to improve student success rates during students’ years of attendance. But schools generally see their obligations end after students graduate. In most districts, however, elementary schools do get feedback from middle schools, and middle schools do get feedback from high schools. This helps ensure that students are best prepared for success as they move on to their next level of education. Historically, though, high schools have received little feedback from colleges, and high school graduates can not be relied upon to report their level of success back to their high schools. Fortunately, in recent years, the National Student Clearinghouse has provided a data framework enabling districts to track student success after high school. Nassau BOCES and other BOCES have now produced effective data reports allowing districts to see how high school instructional programs seem to affect college success. This presentation will examine the effect of two current high school initiatives—the emphasis on obtaining Advanced Regents diplomas and on taking Advanced Placement courses.

Groups often jump to action without understanding data or its underlying causes. This process is designed to structure the steps of understanding data before engaging in planning. Participants will learn structures, tools, and techniques needed to work effectively with groups using data.

Join NERIC & Schoolzilla for a collaborative session where you’ll learn how to turn existing data into insights and more effectively track progress toward your most important goals. Attendees will learn best practices for establishing cultures of continuous improvement and leave with actionable take-aways on incorporating strategic plans into the day-to-day, meeting the needs of multiple stakeholders, and building consistent practices around regular progress monitoring.

Betsy and Dan, administrators from the Fulton City School District, will be your tour guides through the ins and outs of the school identification process under the Every Student Succeeds Act. Learn more about how schools will soon be identified as “Reward Schools,” “Schools in Good Standing,” “Targeted Support and Improvement Schools (TSI),” or “Comprehensive Improvement Schools (CSI) “ under the state’s new accountability rules.



Friday, July 13, 2018

9:00am - 10:00am Breakfast

10:00am - 10:45am ESSA Update

Ira Schwartz, Associate Commissioner - Office of Accountability- NYSED

10:45am - 11:00am Q & A

11:15am - 12:00pm Regional Verification Assistance

12:00pm - 12:30pm Drawings

SESSION 5D - Broadway 4Real Time Data Analysis with Shared Google SheetsCheryl Covell

SESSION 5E - TraversWhat’s Next - Hoonuit Data Analytics with Actionable Next StepsHoonuit Data Analysis

SESSION 5F - AlabamaStruggle is BeautifulJanet Steinberg, Mandy Ehrlich

SESSION 5G - WhitneySESSION 3B - Broadway 2ESSA Update “Graduation Rate & Career and College ReadinessCarol Eckl, Brenda Roof

During this lesson you will see an example of a district wide initiative to collect, share and analyze common assessment data using google sheets. Learn how to create your own system of shared sheets using a few new formulas and how to make charts that update in real time. No coding required!

Learn about how districts are using Hoonuit to build a data-driven culture that fosters data-based decision-making across their organization. Come and explore how you can easily see where your students are at, and if they are on track to success. We will highlight how to take your data to the next level to support and drive your key initiatives forward.

When I suggest that we need to teach with a sense of urgency, I’m not talking about teaching prompted by anxiety but rather about making every moment in the classroom count, about ensuring that our instruction engages students and moves them ahead, about using daily evaluation and reflection to make wise teaching decisions.” Reggie Routman Reggie’s perspective represents what we believe in the teaching of reading. That it is based on reflection and analysis, coupled with the belief that every student can learn. The New Generation Standards expect students to practice comprehension at very high levels. The demand on students is huge and we understand that. In this interactive presentation, Mandy Ehrlich and Janet Steinberg, from TCWRP, will coach participants in using assessments to help our students in reading/writing/content area. They will also think about next steps and ways that all assessments yield important information.

How will New York State establish long-term goals and interim measures of progress for graduation rates? New York State’s end goal is that 95% of students graduate from high school in four years, 96% in five-years, and 97% in six years. Similar to achievement goals, New York State has set a long-term goal, to be achieved by the 2021-22 school year, to close the gap by 20% between each subgroup’s graduation rates and the subgroup’s performance in the 2015- NEW YORK STATE’S FINAL ESSA PLAN SUMMARY – JANUARY 2018 25 16 school year. Each year, as with achievement goals, New York State will establish a new long-term goal for the next year beyond that for which the current long-term goal is established. We will look at how that rate is established and what happens. We will also review the College, Career, and Civic Readiness index calculations.


RENEE ALLEN, Program Administrator

Renee Allen is currently the Program Administrator for Curriculum and Instruction at Western Suffolk BOCES. She has over 20 years of experience in education and has worked with Long Island districts to provide customized curriculum services and instructional support to help districts meet the needs of administrators, teachers and students.

DENNIS ATKINSON, Manager, Data Warehouse and Test Scoring

Denny Atkinson has managed the WNYRIC Data Warehouse and Test Scoring departments for the past five years. Prior to that he served as a staff development specialist and as a high school English teacher. At the dawn of time, he worked as a medical/scientific photographer for the University of Buffalo Medical School, then did multi-media presentations for his own company. Denny’s undergraduate degree in psychology and master’s degrees in education were from the University at Buffalo. His masters in Educational Administration is from Canisius College.

PAUL DE BARROS, Chief Statistician

Paul de Barros has worked at Green Tech High Charter School in Albany since 2009, first as a mathematics teacher and department chair, and later as the chief statistician. He holds graduate degrees in educational psychology, school psychology, mathematics instruction, and biostatistics. He is a proponent of the RRTT (Rapid Return To Teacher) model of data-driven instruction, and of the R Project for Statistical Computing.

BARBARA BATTAGLIA, Director of the Office of Accountability and CIO

Has been a general education and special education teacher at elementary, middle, and secondary levels as well as a school administrator at all levels. She is currently the Director of the Office of Accountability and the CIO for the Kenmore Town of Tonawanda School District. Barbara has extensive experience in Professional Development and has been an adjunct professor since 1981 in the Western New York area. Ms. Battaglia has been a regular contributor to DATAG presentations.

MICHELLE BRANTNER, Superintendent

Michelle is finishing her second her as Superintendent of the Marcellus Central School District. Prior to that, she spent seven years as the Superintendent of Moravia Schools in Moravia, New York. She began her administrative career as an Assistant Principal before transitioning after three years to become Principal of Lansing High School outside of Ithaca, NY. Michelle also spent nearly ten years teaching Spanish at Norwood-Norfolk School District in St. Lawrence County prior to transitioning into administration. In recent years her focus has been on innovation and bringing learning and schools into a new and enlightened age.

MARCIA CAPONE, Administrator for Assessment and CIO

Immediate past Chair of DATAG is the Administrator for Assessment and CIO of the Niagara Falls City School District. In addition to overseeing the assessment program in the District, she supervises the English as New Language (ENL) program. She has recently been appointed to a second three year term on the Niagara University College of Education Advisory Board. Ms. Capone began her educational career as a music teacher at the middle school level. She holds two Master’s degrees as well as a Specialist certificate in Educational Administration from the University of Buffalo.

DAN CARROLL, Director of Instructional Support Services (Fulton City School District)

Dan Carroll has been an administrator in the Fulton City school District for the past 4 years, after having served as an elementary principal in the Johnstown and Central Square School Districts. As Fulton’s Director of Instructional Support Services, Dan plays a leadership role in the district’s school improvement process and its navigation through the New York State’s accountability system.

FREDRIC COHEN, Data Warehouse Consultant, Nassau BOCES

Fred has worked as a Data Warehouse consultant at Nassau BOCES for the past 16 years after retiring from his position as Deputy Superintendent at the Bellmore-Merrick CHSD. He also taught English and Reading at several schools in NYC. He has published articles in Ed

BIOGRAPHIES


Leadership and Phi Delta Kappan, and written Op Ed pieces for Newsday and The New York Times. Fred has presented at Adelphi and Hofstra Universities and is a regular presenter for the New York State School Boards Association. Finally, Fred is also a proud recipient of DATAG’s Gerry DeMauro Excellence in Education award.

BETSY CONNERS, Executive Director

Betsy Conners has been an administrator in the Fulton City school District for the past 18 years. She has served over the past 18 months on the ESSA Think Tank. In her current role as Executive Director of Instruction and Assessment she has served as both the Title 1 Coordinator and School Improvement Coordinator. She is currently an instructor in the Central New York Leadership Development Program and an adjunct professor for LeMoyne College.

CHERYL COVELL, Director of Curriculum and Instruction

Cheryl Covell is the Director of Curriculum and Instruction for Dryden Central School District. She has also worked as an elementary teacher in Washington DC and Ithaca NY, Associate Principal at Geneva High School, and Data Analyst for Tompkins-Seneca-Tioga BOCES. She holds a Masters Degree in Learning, Teaching and Social Policy from Cornell University and has been a member of DATAG since 2006.

JEFF DAVIS, Data Warehousing Manager

Jeff Davis is the Data Warehousing Manager at Nassau BOCES and an alumnus of the Harvard Strategic Data Project fellowship. He joined the Nassau BOCES team in 2002 during the inception of the Nassau BOCES Instructional DataWarehouse (IDW). Jeff has designed numerous tools and reports that help Nassau County school districts analyze student assessment results and improve instruction.

CAROL ECKL, Data Coordinator

Carol is the Data Coordinator for the Ravena Coeymans Selkirk Central School District. She has held the same role at South Glens Falls CSD and with CNYRIC. Prior to working as a Data Coordinator, she was an Instructional

Specialist, middle school Assistant Principal, and science teacher at Mexico Central Schools.

MANDY EHRLICH

Mandy Ehrlich worked for many years as an elementary classroom teacher in NYC and Westchester. Before joining the Project, she was the Literacy Coach supporting implementation of balanced literacy and Units of Study at a Middle School in the Bronx. Her work extended to support reading and writing in science and social studies. She holds an MSEd. in Early Childhood Education from Bank Street Graduate College of Education and her School Building Leadership Certification.

CHARLES KING, Program Administrator for Student Data Services

Charlie King is currently a Program Administrator for Student Data Services at Eastern Suffolk BOCES, where he supervises the data warehouse and test scanning teams. Previously, Charlie served concurrently as the CIO/District Data Administrator for the Kings Park CSD, as well as Assistant Principal for RJO Intermediate School. Prior to working in the Kings Park School District, Charlie spent three years as a Staff Developer/Shared Data Expert at Eastern Suffolk BOCES helping districts use data to effectively drive instruction. In addition, Charlie spent time as a fourth and fifth grade teacher.

MICHAEL KUMROW, Data Specialist

Michael Kumrow is currently working as a professional development coordinator and data specialist at Erie 1 BOCES. Before this, he was a high school math teacher in an urban school district. In his role as a data specialist, he has been able to use his knowledge of statistics to complete special projects for various school districts. These projects have included using statistical methods (t-tests, multivariate and logistic regression, and exponential smoothing) to analyze school data from the local to state level. He has a bachelor’s degree in mathematics and a master’s degree in professional, applied, and computational mathematics.


STEVE LIU, Director of Operations

Steve directs the operations of the LHRIC Data Warehouse and created the initial data warehouse for LHRIC and a few districts when the state started testing students in 1999. Steve and his team now maintain hundreds of reports that allow administrators, teachers and counselors to take action to help their students. Steve also developed Teacher Level Reporting that allows teachers to see the strengths and weaknesses of their students based on the learning standards all through the Level 1 Data Warehouse.

PETER MCCARTHY, Consultant

Peter McCarthy offers training and consulting in team building and facilitation, data analysis, action research, and comprehensive district planning. He is a former District Data Coordinator at Central New York Regional Information Center, where he provided support for data analysis and reporting for school districts. His former administrative positions include central office administrator for data and planning, and staff development specialist for OCM BOCES. He is a Board member and former Chair of the New York Data Analysis Technical Assistance Group (DATAG).

WHITNEY MCHENRY, Coordinator of Data Support Services

Whitney McHenry is the Coordinator of Data Support Services at the Western New York Regional Information Center. She has worked in data warehouse programming and student management system support for fourteen years. Whitney has a Master’s degree in Educational Communication and Technology from New York University.

ROBERT MELIA, Assistant Superintendent

Robert Melia is currently an assistant superintendent at Shenendehowa Central Schools since 2006. Prior to that, he was a teacher, coach, class and club advisor, assistant principal and high school principal in four school systems. He has taught every grade 5 through 12 and worked in urban, rural and suburban schools across the state ranging in size from 500 to 10,000 students. He has over 40 years of experience as a professional educator and has led several

statewide educational organizations including the School Administrators Association of New York State – SAANYS and the New York State Council of Educational Associations – NYSCEA. Mr. Melia has been a member of DATAG since 2006 and a Board Member since 2014. Presently he serves as the Chairperson for DATAG for 2018-2019.

CHERI PETTUS, Data Coordinator

Cheri has been at the New Paltz Central School District in the Hudson Valley for 16 years as the data coordinator. She also taught Microsoft Office as an adjunct at SUNY New Paltz and various community colleges. In a former life, Cheri worked as a computer programmer for an HMO, using Microsoft Access to link to databases, run queries, and export data. Cheri is currently studying for her Ph.D. at University at Buffalo, where she is not bothered by the fact that she is older than her professors.

MEADOR PRATT, Supervisor

Dr. Meador Pratt, Ed.D. is the Supervisor for the Instructional Data Warehouse and Test Scoring Departments at the Nassau BOCES Regional Information Center. After earning his B.A. from Colgate University (1990), he began his career as a Math and Science Teacher in the North Syracuse School District during which time he completed his M.S. in Science Education at Syracuse University as well as his C.A.S. degree in Educational Leadership. He then became a high school assistant principal in the Central Square School District. Upon completing his doctoral work at Syracuse in 2004, he moved to Long Island with his family where he assumed new roles including Curriculum Director and Middle School Principal before joining Nassau BOCES in 2014.

BRENDA ROOF, Executive Board Member

Brenda Roof has worked for the Webster Central School District for the past 28 years and has been a member of DATAG since 2006. She currently serves on the Executive Board for DATAG. Her current role in Webster is the District Information Manager and she oversees the Data Management Office along with all State and Federal Reporting for Webster. She previously worked at one of the Middle Schools in Webster, where she

BIOGRAPHIES


helped to develop and administer perceptual data surveys, along with other data collection projects for the District. Her Team has implemented a scanning and software system district wide to help collect data and information for analysis and informing instruction. She continues to work with Administration, Staff and others to help them better inform instruction and use their data to help students learn. She also consults with neighboring districts on the use of the scanning software and analysis.

LISA CALA RUUD, Director of Technology Integration

Lisa Cala Ruud is part of the district level leadership team at Berne Knox Westerlo Central School District where she is responsible for directing the integration of technology, innovation and design. Lisa holds a Master of Science in Curriculum Development and Instructional Technology and Advanced Graduate Certificate(AGC) in School Building Leadership from State University of New York at Albany. Lisa is currently a doctoral candidate in Education, Policy and Leadership Studies at the State University of Albany.

MARK SAMIS, Manager - Data Services

Mark manages Data Services which includes the Data Warehouse, Testing Services and State Reporting Services. Mark taught science, health and physical education for 12 years and then started working for LHRIC as a network technician and a curriculum trainer. He then worked with Steve Liu to create the first Data Warehouse in the region. It was one of the first implementations of connecting an educational data warehouse with Web technology.

JILL SCHOTTMAN, Data Warehouse Support Specialist

Jill Schottman is a Data Warehouse Support Specialist at WNYRIC where her focus is Level 1 support, Data Warehouse training, and documentation. She is a former High School Social Studies teacher and Staff Development and Curriculum Coordinator for Erie 1 BOCES with extensive experience in data analysis with teachers and administrators. She also was an item writer and Final-Eyes committee member for the Global History and Geography Regents exam. Jill also has expertise in instructional design and technical writing. She has a BA in History from University at Buffalo and a MS Ed from Canisius College.

JEAN SHARLOW, Assistant Principal/District Data Coordinator

Jean Currently serves as the Assistant Principal at the middle school level in the Marcellus School District while also responsible for the district’s data coordination. She began her administrative career at the CNYRIC in Syracuse as a Data Coordinator spending some of her time working in the Marcellus District in that capacity. Prior to becoming an administrator, Jean worked for the Syracuse City School District first as a high school English teacher for nine years and then spent senve years as a literacy coach working throughout the city. Jean’s passion centers arouns data collection, analysis and its effective use to drive instruction. In addition, she has worked closely with her administrative teammates to explore innovation and modern approaches to teaching and learning.

RANDY SIMMONS, Executive Director

Randy is the Executive Director of Bridges Data and Professional Development, partnering with Long Island districts as a data professional developer. He has been a data analyst on Long Island for thirty years and was involved in DATAG’s development while serving as a board-member for 12 years. Randy’s current focus is understanding the Common Core curriculum and helping teachers and schools use Common Core aligned data to inform instruction.

JANET STEINBERG, Data and Curriculum Specialist

Janet Steinberg, Research and Data Manager for the TCRWP, was a literacy coach in the Bronx, NY before joining the Project. Janet has special expertise in standards based instruction and analyzing student achievement data, which she brings to her work in New York City and across the country. She is a coauthor of Reading History: The American Revolution.

JOSEPH STERN, Divisional Administrator

Joseph P. Stern is Divisional Administrator for Student Data Services at Eastern Suffolk BOCES. His responsibilities include the supervision of the data warehouse, test scoring, and programming teams. He serves as the primary point of contact for SIRS data reporting and accountability questions for the District Data Coordinators in Suffolk County. His prior experience includes serving


as a District Data Coordinator/CIO since the role was initiated by SED, 25 years of teaching mathematics on the secondary level, as well as serving as mathematics department chair, Director of Mathematics K-12, and Assistant Superintendent for Curriculum and Instruction.

ANDREA TAMARAZIO, Coordinator, Data and Staff Development

Andrea Tamarazio is currently working at Erie 1 BOCES as a District Data & Curriculum Coordinator and has been in her currently position since 2009. Prior to working at Erie 1 BOCES, Ms. Tamarazio worked as an elementary teacher and a math instructional coach in Virginia. Ms. Tamarazio is a graduate of The Pennsylvania State University and recently received her administrative degree from Canisius College.

ALAN THOME, Network Data Coordinator

Alan Thorne is the Network Data Coordinator for Uncommon Schools Troy and Rochester. He works on the Special Projects team and the Home Office Data and IT teams on projects related to State and Federal reporting, Data Governance, training, and process automation.

MONICA DE TUYA, Director of Programs and Operations

Monica De Tuya spent over 10 years in the classroom at the elementary, middle, and high school levels. She is certified in both special education and biology, and served as a consultant and resource room teacher. She has taught Earth Science, Living Environment, and General Science at the Neil Hellman School of Parsons Child and Family Center, in Albany NY. She has also worked as a Technical Training Specialist in the biotechnology sector. Currently, she serves as Director of Programs and Operations at The Association for the Cooperative Advancement of Science and Education in Saratoga Springs, NY. She holds an M.S. in Secondary Education and is currently a Doctoral student in Information Studies at the University at Albany.

PAUL ZACHOS, Director, Research and Evaluation

Paul Zachos has taught in elementary, junior high, and high schools in both the public and independent sectors. He served for 12 years as a researcher and planner for the New York State SED. Since 1999 he has been an independent researcher and educational product developer, providing services and workshops in educational assessment and evaluation to schools, school districts, professional organizations and businesses. He is currently Director of Research and Evaluation for The Association for the Cooperative Advancement of Science and Education located in Saratoga Springs, New York. He holds a Master of Science in Curriculum and Instruction and a PhD in Educational Psychology and Statistics from the University at Albany.

BIOGRAPHIES


BILL BOUCHARD (EDUCATIONAL VISTAS)

Bill works with EVI’s Programming team to address the needs of school districts and oversees the Product Support team, Data Capture, and the Data Entry staff. Moreover, he works with school districts to process their data to be loaded into various EVI products. Bill brings 25+ years of IT and technical experience in the design, implementation, delivery, and training related to software solutions. His experience includes business management, data and data center management, IT Staff management, staff training, and design of custom software applications. Bill has an extensive background in data scrubbing and reporting across multiple hardware platforms and operating systems. He has provided consultation and managed implementations for such companies as Omnicare, Cardinal Health, Ecolab, VWR Scientifics, McKesson, Corporate Express and many others. He enjoys evaluating school district requirements, creating detailed project plans, and managing implementation to meet district needs.

JANELLE CACH (SCHOOLZILLA)

Jannelle is passionate about helping schools more effectively use their data to positively impact students. As a former teacher, I know the importance of using data to best adjust instruction and provide intervention and support for students. I also worked at Portland Public Schools in the Instruction, Curriculum and Assessment department where I had the opportunity to work on multiple projects where I saw the power of data-driven decision making and how key it is to have data easily accessible for district wide transformation.

PATRICK DEVANNEY (CLASSLINK)

As VP of Interoperability Services at ClassLink, Patrick is passionate about facilitating positive change in education, with a focus on easy access to technology and the benefits made available with secure, controlled data exchange between systems. Patrick’s diverse background includes time with numerous Ed Tech companies including Edgenuity Education Elements and inBloom with efforts spanning large and varied roles and territories in the US over nearly 18 years. Prior to joining the Ed Tech world Patrick worked for 20 years in the Technology and Telecommunications industries in

a wide variety of leadership roles with large international companies and start-ups.

BILL DWYER (INFINITE CAMPUS)

Bill brings 25+ years of IT and technical experience in the design, implementation, delivery, and training related to software solutions. His experience includes business management, data and data center management, IT Staff management, staff training, and design of custom software applications. Bill has an extensive background in data scrubbing and reporting across multiple hardware platforms and operating systems. He has provided consultation and managed implementations for such companies as Omnicare, Cardinal Health, Ecolab, VWR Scientifics, McKesson, Corporate Express and many others. He enjoys evaluating school district requirements, creating detailed project plans, and managing implementation to meet district needs.

DOUG LA FLEUR (EIDEX)

Doug LaFleur, PhD, is the Founder and President of Eidex LLC. Eidex provides data analytic software and services to K-12 schools located across the United States. Eidex currently serves over 1000 districts, providing a web based, software platform for district leaders that is easy to use, provides instant, compelling graphics, and offers data at the strategic, operational, and student/teacher levels of performance. This includes financial, academic, and demographic data. Doug is also a school board member of his local suburban district, currently serving as board president. His educational background includes a Ph.D. in Applied Behavior Analysis and Masters Degree in Industrial/Organization Psychology from Western Michigan University as well as Masters in Business Administration from Grand Valley State University.

MARIE HATALA (BROOME-TIOGA BOCES)

Over the last 10 years, Marie has been instrumental in the design and development of RTI Edge. She has also worked directly with many districts implementing RTI Edge based on their RTI process.

VENDOR BIOGRAPHIES


BRIAN HUSSEY (ESD)

Brian Hussey is from eSchool Data working in marketing, sales and all aspects of customer and client communication and success.

RACHEL MAY (ESD)

Rachel May is an Implementation and Training Specialist with 6 years of experience on the eSchoolData team. She draws on her time spent at the help desk and providing onsite support to compile comprehensive trainings. Rachel delivers the valuable feedback she collects from our customers directly to the product team. Her background in education and firsthand experience in the classroom has been a huge asset to clients and the eSchoolData team.

ERIC PATNOUDES (OTUS)

Eric Patnoudes is the Director of Strategic Initiatives at Otus. He is responsible for developing education partnerships as well as keeping pace with the ever-changing trends of tech, innovation, and digital learning. Eric joined Otus in 2018 from CDW-G, the largest reseller of devices in the United States. As an education strategist, he worked with schools to ensure they effectively adopted technology and implemented a strategy to maximize student performance. Before that, he served as an instructional technologist and a special education teacher.

NEAL ROBBINS (ESD)

Neal Robbins is Senior Account Executive and Director for Partnerships for IO Education with 10 years experience in K-12 public schools. He has consulted with districts as varied as Los Angeles Unified to the most intimate charter school. Neal combines his love of data with a keen understanding of formative assessment to help educators discover knowledge gaps.

MADALYN ROMANO (RIC ONE)

Dr. Madalyn Romano is the Manger of Customer Relations for the RIC One Initiative. Her role is to coordinate activities for districts and educational software vendors. Prior to joining the RIC One Team, she was the Coordinator of Instructional Technology for the LHRIC. Madalyn has her Doctorate in Technology and Education from Pace University and holds a Master’s Degree from Hofstra University.

STEVE SCHMITT (HOONUIT)

Steve, a consultative expert in the Hoonuit analytics solution, is passionate about helping school districts utilize their data to identify and solve critical issues that improve student outcomes. He has over 15 years’ experience in Ed-tech software sales.

ELISSA SETO (ESCHOLAR)

Elissa Seto is the eScholar Senior Manager of Marketing and Sales. She began her career in education as a middle school science teacher in New York City Public Schools. She has an A.B in Biology from Bryn Mawr College and an MBA in Marketing and Public and Nonprofit Management from Boston University.

PETER SWERDZEWSKI (CURRICULUM ASSOCIATES)

Prior to overseeing Curriculum Associates’ evaluation and research initiatives, Peter was the Assistant Commissioner of Assessment, Standards, and Curriculum for New York State, where he was responsible for the state’s K-12 assessments, including school federal accountability exams. He also served as a Fellow at the Regents Research Fund of the University of the State of New York, where he specialized in assessment development and policy. Peter earned his Ph.D. in Assessment and Measurement from James Madison University.


WE’VE MOVED!

518-694-5508136 Everett Road. • Albany, NY 12205


Vend

or Lo

catio

ns

DATA

G Su

mm

er C

onfe

renc

e 20

18

se

rvice

x x

food

/bev

fo

od/b

ev

serv

ice

VENDOR MAP


Representatives from the following companies are here! Please visit them to learn more about their products and services.

The following events have been underwritten by:

Reception on Thursday: Coffee on Thursday:

Afternoon Snack Thursday

Alla Breve Educational Consulting

Schooltool

Educational Vistas, Inc.

eDoctrina Corporation

Infinite Campus

LinkIt!

Broome-Tioga BOCES

eSD (eSchooldata)

RIC One

Eidex LLC

Panorama Education

Schoolzilla

Otus

Harris School Solutions

Renaissance

eScholar

Curriculum Associates

Strategic Measurement and Evaluation

ClassLink

THANK YOU TO OUR CORPORATE SPONSORS


We’re always interested in sharing methods, findings, or practices with our membership and attendees and we’d like you to consider contributing something from your own work to our future meetings. Presentations are generally scheduled for durations of approximately 60 minutes. We may offer them in various formats (such as smaller breakout sessions or panel discussions) as our programs permit. If you would like to participate in this important work of DATAG, please be looking for an email after summer conference from our Program Driector, Sean Fahey. He will supply you with a link to submit your applications.

Please include the following information to help us plan the best way to present your contributions:

1. Name of the presenter(s) and complete contact information, including email(s) and telephone number(s)

2. School district, BOCES, or other educational affiliation and a short biography for all presenters (50 words each)

3. Presentation topic: please include a preferred title and brief (75 word) description

4. Meeting date(s) when you could present

5. Audience type: please tell us if your presentation is most suited for a Beginner, Intermediate or Advanced audience

6. Presentation support needs: projector, laptop computer, tables, flip charts, wireless Internet access, etc.

7. Special requests

8. Questions for the Program Committee

Thank you for your interest in sharing your expertise and your work!

CALL FOR DATAG PRESENTERS ‘18 - ‘19

GERALD E. DEMAURO DATAG EXCELLENCE IN EDUCATION AWARD

THIS YEAR’S DR. GERALD DEMAURO AWARD WILL BE PRESENTED TOMARIA J. MCIVERThe awards will be presented by DATAG Board Members at Thursday afternoon’s eScholar reception at 4:00pm - 5:30pm in the Gallery.

This award recognizes individuals who have made a significant contribution to the educational performance of students by promoting data-driven policies

Date post:	12-Jan-2022
Category:	Documents
Upload:	others
View:	0 times
Download:	0 times

JULY 11 - 13

Documents