ACCESS for ELLs Reporting Workshop

ACCESS for ELLs Reporting WorkshopSeptember 2021

Student Assessment Services

Melanie Manares, English Proficiency Assessment Coordinator

Shannon Cullen, MCAS and ACCESS Assessment Specialist

Dan Wiener, Administrator of Inclusive Assessment

Massachusetts Department of Elementary and Secondary Education

Questions During Today’s Presentation

• Audience members are muted to avoid distractions.

• Please type your question in the Q&A below and we will

respond in writing as we are able.

• Also, feel free to reach out to us after the presentation with

questions about specific circumstances or students.

o by email at [email protected] or [email protected], or

o by phone at 781-338-3625.

Thank You!2

mailto:[email protected]



Welcome – Reminders – Q and A

• Proficiency (i.e., Attainment) = Level 4.2 overall, plus Level 3.9

literacy composite score (in effect since 2016)

oDistricts may NOT exit students who do not attain this ACCESS score.

• Reporting Elements #1−5 (LOOK; ESSA−Title III)

• Post-Reporting Data Validation: September 8-16o This was your last chance to unite your students’ records

oA complete student record = 4 domain tests combined for a student

oAny differences may prevent receiving an overall score (e.g., different

or incorrect spelling of name, mismatched SASID, etc.).

oCorrected records will be available in WIDA AMS on September 30.

3


Results for the WIDA Consortium and Massachusetts

• Participation

o How many students took ACCESS and Alternate

ACCESS in 2021?

o How does this compare with 2020?

• Proficiency

o Overall and in each Domain

• ACCESS Participation and Growth SGPA) will

not be included for Accountability in 2021.

• What are the implications?

o Many students will not have Progress indicators.

o Students may only be exited from EL status if they

have taken ACCESS and scored Overall Level 4.2

and Literacy 3.9.4


Participation: Total MA Students Tested on ACCESS 2018-2021

5

82%of ELs

reported

in Oct.

2020


Overall Proficiency Levels in 2020 and 2021

6

• Scores reflect ALL students who

tested in 2020 and 2021.

• Many fewer students tested in

2021. Scores might have differed

if more students had tested.

• There is much to learn about

which students did/didn't test.

• Testing conditions were

very different in 2021.

• Data is "reliable," but be

cautious drawing conclusions

and making inferences, esp. if

fewer than 80% tested in a

school/district.


2021 ACCESS: Urban vs. Non-Urban (Average Overall Scaled Scores)

7


Change in Domain

Scores (2020 to 2021): Listening

• Average scale

scores on the

Listening test

decreased or

remained about the

same in all grades

except grade 9,

which gained 7

points.

• The largest declines

were in grades 3, 5,

and 12.

8


Change in Domain Scores

(2020 to 2021):

Reading

• Average scale scores on the Reading test increased in grades 1, 2, and 9−12.

• Scores decreased 1−7 points in all other grades, with the largest declines in grades 4 and 5.

9



(2020 to 2021):

Speaking

• Average scale scores

on the Speaking test

decreased in every

grade except grade 9,

which gained 7

points.

• Grades 4−6 and

10−12 decreased

significantly, with

largest declines in

grades 4 and 5

(-10 and -14

respectively).

10



(2020 to 2021):

Writing

• Average scale scores

on the Writing test

showed largest

declines, except in

grade 9 which

gained 7 points.

• Grade K−6 showed

significant declines.

11


WIDA Consortium: Number of students tested

12


WIDA Consortium: Changes in Domain Scores from 2020 to 2021

13



14



15



16



17


Accessing YourACCESS for ELLs Results

•2021 ACCESS ResultsoAvailable August 5 in WIDA AMS

▪ Individual Student Reports (ISRs)

▪ School and District Frequency Reports

▪ Student Roster Reports

oPaper results mailed to schools on

September 8

o In DropBox Central (mid-October)

o In Edwin Analytics (mid-October)

18


Accessing YourACCESS for ELLs Results

•2021 ACCESS ResultsoAvailable August 5 in WIDA AMS

▪ Individual Student Reports (ISRs)

▪ School and District Frequency Reports

▪ Student Roster Reports

oPaper results mailed to schools on

September 8

o In DropBox Central (mid-October)

o In Edwin Analytics (mid-October)

19

20

Accessing Your Results in WIDA AMS

• ACCESS for ELLs

• Alternate ACCESS for ELLs


WIDA AMS Reports

21


District Frequency Report – ACCESS for ELLs

22


District Frequency Report – Alternate ACCESS

23


Student Roster Report – ACCESS

24

• School level report by grade shows individual students’ scale scores and

proficiency levels for each domain, plus composite and overall scores.

• Also shows the test tier taken by the student.


Student Roster Report – Alternate ACCESS

• Same as the ACCESS Student Roster Report, minus a “tier”

column.

25


WIDA AMS On-Demand Reports

• “On-demand”

reports are

Individual Student

Reports (ISRs) that

can be downloaded

for individual

students or a group

of students in

English and in other

languages.

• Reports download as

a single pdf in each

language selected.


WIDA AMS On-Demand Reports

27


Individual Student Report (ISR) – ACCESS

28

• Proficiency Level and Scale Score

for each domain and composites

• Brief description of what student

can do at that proficiency level

• Available for download by school

and grade in Spanish and English

• On-Demand Report in other

languages

• Can download a single pdf by

selected individual, by school-

level or by grade-level


ISR: Top section

provides

- student

information

- proficiency level

in each domain and

composite

- scale score for the

domain and

composite29


Individual Student Report − ACCESS

30

• Bottom section of ISR provides brief description of what a

student at that level generally can do.


Individual Student Report (ISR) – Alternate ACCESS

31

• Proficiency Level and Scale Score for each domain and composites

• Student’s performance in Listening and Reading domains

• Test Administration Information

• Brief description of what student can do at each proficiency level

• Available for download by school and grade in Spanish and English

• On-Demand Report in other languages

• Can download a single pdf by selected individual, by school-level or by grade-level



• Describes the kinds of skills

that students at each level

(A1-P3) are able to

demonstrate.

• Described in terms of the

Productive domains

(Speaking and Writing) and

Receptive domains (Listening

and Reading)

32



• Provides Test Administration

information such as:

o Test Environment

oAreas of the test where

accommodations were used

o Test Administrator Title

o Test Administrator's Knowledge

of the student’s abilities

33


WIDA AMS Reports

34

35

Report Delivery and

Parent Notification


Report Delivery

• Reports are available electronically in WIDA AMS now.

• Printed reports arrived in schools on September 8:

o School Frequency Report

o Student Roster Report

o Individual Student Reports (English)

o District Frequency Report (the only report mailed to the district office)

• In WIDA AMS, District ACCESS Test Coordinators can view both district-

level and school-level reports. School ACCESS Test Coordinators can view

school-level reports. Test Administrators cannot view reports unless they

have the assigned permission.

36


• All Applications>User

Management

• Select Administration

2020-2021 and “Test

Administrator” under

User Role

• Find User>Profiles

37

Giving Test Administrators Access to Individual Student Reports

District Test Coordinator can give access to ISRs to Test Administrators.



38

• Check the users you want to give access to ISRs, and click

“Assign Permissions”



39

• Scroll through the list of

available permissions in

the left-hand box

• Select View Dynamic Reports

• Click the single arrow

• Save



40

• Test Administrators will be able to view ISRs under

All Applications>Report Delivery>On-Demand Reports


Options for Parent Notification

• Schools may provide results to parents electronically by:

▪ Secure email (password-protected)

▪ Parent portal (if available)

▪Other secure method used by the district

• Schools may text or use an app to notify parents that results are

available to discuss

• Mail English-language ISRs to parents that were sent to schools.

• Schools can print ISRs locally in languages other than English

and mail to parents.41


Additional Parent Resources (Optional)

To be mailed or sent electronically:

• Sample letters – can place school or district letterhead on

the sample letter and send with the student’s results

• Parent Handouts - answers basic questions about ACCESS

or Alternate ACCESS

• Parent Guide for Score Reports – explains the Individual

Student Report in a two-page document (ACCESS or

Alternate ACCESS)

• NOTE: ISRs are confidential, but the resources above are not.42


Resources linked on the DESE ACCESS web page

43bottom of the page

44

Reporting Elements


Reporting Elements

• Reporting Element 1 – # and % making progress, disaggregated for

EL SWD

• Reporting Element 2 – # and % attaining proficiency (i.e., meeting

exit criteria – Level 4.2 overall and 3.9 literacy)

• Reporting Element 3 – # and % exited based on attaining proficiency

• Reporting Element 4 – # and % FELs meeting or exceeding

expectations on MCAS ELA, Math, and STE, disaggregated for FEL

SWD

• Reporting Element 5 - # and % not-yet-proficient after six years

Guide to Understanding the Title III Reporting Elements for English Learners in Massachusetts for

2017 and Beyond available on DESE ACCESS webpage: http://www.doe.mass.edu/mcas/access/default.html

45

http://www.doe.mass.edu/mcas/access/default.html


ACCESS Results

on DESE web page:

http://www.doe.mass.edu/mcas/access/results.html

• ACCESS for ELLs Results by

District/School (not just Title III

districts)

oReporting Element 1

(Progress)


(Progress/Attainment)

• State, Title III Districts, and

Consortia


oReporting Elements 1, 2, 3,

and 5 46

http://www.doe.mass.edu/mcas/access/results.html


DESE ACCESS web page (www.doe.mass.edu/mcas/access)

47

Reporting Elements

•Under “ACCESS for

ELLs” on the left-hand

side

•Click “Results”

http://www.doe.mass.edu/mcas/access

Massachusetts Department of Elementary and Secondary Education 48

2021 Reporting Elements 1 and 2 available in October


ACCESS for ELLs Results by District/School

49

• Participation rate (ACCESS and Alternate ACCESS)

• # and % at each ACCESS level by grade span and all grades

• Reporting Element 1- Progress (those meeting benchmarks, or

scoring one proficiency level higher in any domain on Alt ACCESS)

• Reporting Element 2 - Attainment (those scoring 4.2 overall and

3.9 literacy on ACCESS)


Reporting Element 4 – District by FEL/FEL SWD and Year FEL

50

• Reporting Element 4 – # and % FELs meeting or exceeding

expectations on MCAS ELA, Math, and STE, disaggregated for FEL

SWD (by year FEL)

• State, Title III Districts and Consortia


Reporting Elements 1, 2, 3, and 5: State, Title III Districts, and Consortia

• Reporting Element 1 = Progress by district (not grade span) for Grades K-8 and High

School

o Participation

o Progress (total)

o Mean SGPA (current year and previous year)

o Difficulty Index, # and % making progress, progress target and yes/no indicator for Grades K-8 and

High School

o # and % making progress EL SWD for K-8 and High School

51


Reporting Elements 1, 2, 3, and 5: State, Title III Districts, and Consortia

• Reporting Element 2 = Attaining proficiency

o # and % attaining proficiency (by district, not grade span)

• Reporting Element 3 = # and % exited based on proficiency

• Reporting Element 5 = # and % not yet proficient after six years

•

52

53

Targets and Indicators in

Security Portal DropBox and

Edwin


Progress Indicators and Progress Targets for Students

•Security Portal DropBox

o“ACCESS2021_student_level_R1_and_R2_” (early-mid

October)

•Edwin Analytics

oACCESS for ELLs District and School Summary (EL327)

(mid-October)

▪Participation for schools and district

▪# and % making progress for schools and districts

oACCESS for ELLs Student Roster (EL627) – individual

students (mid-October) 54


DropBox Files and Edwin Reports in the Security Portal

55


DropBox Files

56


DropBox Files – Available in October

57


DropBox Files - Your District’s Data (available in October)

58


DropBox Files – Your District’s Data

59

• 2021 ACCESS files available in October• ACCESS2021_student_level_R1_and_R2_

• ACCESS2021_with_reporting_elements - later in the fall (December)


ACCESS 2021 Files – Available in October

60

• Student level results• Progress targets 2021 and 2022

• Progress indicator

• ACCESS overall scores 2021 and 2022

• SGPA, etc.


ACCESS 2021 Files – Available in October

• Student level results • Attainment, future targets and difficulty index (2022)

• RE3 not included in October

61


Edwin Reports – available mid-October

62


Edwin Analytics – available mid-October

63


ACCESS for ELLs District and School Summary (EL327)

64


ACCESS for ELLs Student Roster (EL627)

65

…

can select claimed students

can select certain students

to go to PR600

66

Assigning Scores for Missing

Test Domains (SPD)


Assigned Scores for Missing Test Domains

• Since 2020, DESE has assigned scores to missing ACCESS test domains

for students for whom there were unavailable accommodations.

• Overall scores and proficiency levels are provided for these students so

reclassification determinations and growth-to-proficiency (benchmark)

calculations can occur.

• Will be reported this fall in the Security Portal DropBox in file

“ACCESS2021_student_level_R1_and_R2_”.

• Will not be included on ISRs or any other reports found in WIDA AMS.

• See the Guide to Assigning Scores for Missing Domains on ACCESS for

ELLs Tests for English Learners with Disabilities posted on DESE ACCESS

web page. 67

http://www.doe.mass.edu/mcas/access/default.html


QUESTIONS?

DESE: [email protected]

781-338-3625

WIDA: [email protected]

1-866-276-7735

DRC: [email protected]

1-855-787-9615

68




Date post:	23-Oct-2021
Category:	Documents
Upload:	others
View:	7 times
Download:	0 times

ACCESS for ELLs Reporting Workshop

Documents