Date post: | 04-Jan-2016 |
Category: |
Documents |
Upload: | preston-lester |
View: | 218 times |
Download: | 1 times |
1
ELLOPA 2001 and 2002Early Language Listening & Oral Proficiency Assessment
Spanish & Japanese Partial Immersion Program
Compiled by Michele Anciaux Aoki, Ph.D.
John Stanford International School Seattle, WA
John Stanford International School 2
Overview of the Evaluation 2001 ELLOPA was conducted by team from
Center for Applied Linguistics over 4 days in May with K and 1st grade students (completing first year of immersion)
2002 Evaluation was completed by JSIS staff and UW graduate students over 3 weeks in May-June with K, 1st, and 2nd grade students (1st and 2nd graders completing second year of immersion)
2002 Evaluators received training in ELLOPA interviewing and rating at UW in April, 2002, as well as on-site training and coaching with Beverly Boyson of CAL in May, 2002
John Stanford International School 3
About the ELLOPA
Language Areas:
Oral Fluency Grammar Vocabulary Listening
Comprehension
Proficiency Levels: Junior Novice Low (1) Junior Novice Mid (2) Junior Novice High (3) Junior Intermediate Low (4)
Notes: All ratings above 4 were categorized
as 4 for the purposes of the ELLOPA statistics.
Teachers used the same Rating Profile to rate students based on classroom experience.
John Stanford International School 4
What do we want the data to tell us?
How well are our students learning Spanish or Japanese? (Can we see growth across years?)
Do students learn Japanese at the same rate as Spanish?
How well did we do in assessing our students’ language proficiency? (How do ELLOPA ratings compare to Teacher Ratings?)
John Stanford International School 5
ELLOPA – Kindergarten
Jr Nov Low Jr Nov Mid Jr Nov High Jr Int LowOral Fluency 15.4% 53.8% 15.4% 15.4%Grammar 15.4% 53.8% 15.4% 15.4%Vocabulary 15.4% 53.8% 19.3% 11.5%Listening Comp 3.8% 13.5% 50.0% 32.7%
Jr Nov Low Jr Nov Mid Jr Nov High Jr Int LowOral Fluency 46.2% 26.9% 7.7% 19.2%Grammar 50.0% 23.1% 7.7% 19.2%Vocabulary 50.0% 23.1% 7.7% 19.2%Listening Comp 3.8% 42.3% 23.1% 30.8%
ELLOPA Spanish 2001 - K
ELLOPA Spanish 2002 - K
ELLOPA Japanese 2002 - KJr Nov Low Jr Nov Mid Jr Nov High Jr Int Low
Oral Fluency 67.9% 17.9% 0.0% 14.3%Grammar 67.9% 17.9% 0.0% 14.3%Vocabulary 75.0% 10.7% 0.0% 14.3%Listening Comp 17.9% 53.6% 7.1% 21.4%
John Stanford International School 6
Teacher Ratings – KindergartenTeacher Ratings Spanish 2001 - K
Teacher Ratings Spanish 2002 - K
Teacher Ratings Japanese 2002 - K
Jr Nov Low Jr Nov Mid Jr Nov High Jr Int LowOral Fluency 38.5% 42.3% 19.2%Grammar 34.6% 46.2% 19.2%Vocabulary 34.6% 46.2% 19.2%Listening Comp 46.2% 34.6% 19.2%
Jr Nov Low Jr Nov Mid Jr Nov High Jr Int LowOral Fluency 17.9% 67.9% 14.3%Grammar 17.9% 67.9% 14.3%Vocabulary 21.4% 57.1% 7.1% 14.3%Listening Comp 17.9% 67.9% 14.3%
John Stanford International School 7
ELLOPA Spanish 2001 - K
0.0%
10.0%
20.0%
30.0%
40.0%
50.0%
60.0%
Jr NovLow
Jr NovMid
Jr NovHigh
Jr IntLow
Oral FluencyGrammarVocabularyListening Comp
John Stanford International School 8
ELLOPA Spanish 2002 - K
0.0%5.0%
10.0%15.0%20.0%25.0%30.0%35.0%40.0%45.0%50.0%
Jr NovLow
Jr NovMid
Jr NovHigh
Jr IntLow
Oral FluencyGrammarVocabularyListening Comp
John Stanford International School 9
Teacher Ratings Spanish 2002 - K
0.0%5.0%
10.0%15.0%20.0%25.0%30.0%35.0%40.0%45.0%50.0%
Jr NovLow
Jr NovMid
Jr NovHigh
Jr IntLow
Oral FluencyGrammarVocabularyListening Comp
John Stanford International School 10
ELLOPA Japanese 2002 - K
0.0%
10.0%
20.0%
30.0%
40.0%
50.0%
60.0%
70.0%
80.0%
Jr NovLow
Jr NovMid
Jr NovHigh
Jr IntLow
Oral FluencyGrammarVocabularyListening Comp
John Stanford International School 11
Teacher Ratings Japanese 2002 - K
0.0%
10.0%
20.0%
30.0%
40.0%
50.0%
60.0%
70.0%
Jr NovLow
Jr NovMid
Jr NovHigh
Jr IntLow
Oral FluencyGrammarVocabularyListening Comp
John Stanford International School 12
ELLOPA Spanish/Japanese KMean or Average of Scores in 2001 and 2002
Oral Fluency Grammar Vocabulary Listening CompSpanish 2001 2.31 2.31 2.27 3.11Spanish 2002 2.00 1.96 1.96 2.81Japanese 2002 1.61 1.61 1.54 2.32
John Stanford International School 13
ELLOPA Spanish/Japanese 2001 - 2002 - K
0.00
0.50
1.00
1.50
2.00
2.50
3.00
3.50
Spanish2001
Spanish2002
Japanese2002
Oral FluencyGrammarVocabularyListening Comp
Mean or Average
John Stanford International School 14
ELLOPA 1st Grade
ELLOPA Spanish 2001 – 1st (after first year of language)
ELLOPA Spanish 2002 – 1st (after second year of language)
Jr Nov Low Jr Nov Mid Jr Nov High Jr Int LowOral Fluency 8.7% 69.6% 13.0% 8.7%Grammar 8.7% 69.6% 13.0% 8.7%Vocabulary 8.7% 71.7% 10.9% 8.7%Listening Comp 2.2% 8.7% 65.2% 23.9%
Jr Nov Low Jr Nov Mid Jr Nov High Jr Int LowOral Fluency 5.0% 22.5% 32.5% 40.0%Grammar 5.0% 27.5% 32.5% 35.0%Vocabulary 5.0% 27.5% 30.0% 37.5%Listening Comp 0.0% 10.0% 32.5% 57.5%
John Stanford International School 15
ELLOPA Spanish 2001 – 1st
0.0%
10.0%
20.0%
30.0%
40.0%
50.0%
60.0%
70.0%
80.0%
Jr NovLow
Jr NovMid
Jr NovHigh
Jr IntLow
Oral FluencyGrammarVocabularyListening Comp
(first year in the program)
John Stanford International School 16
ELLOPA Spanish 2002 – 1st
0.0%
10.0%
20.0%
30.0%
40.0%
50.0%
60.0%
Jr NovLow
Jr NovMid
Jr NovHigh
Jr IntLow
Oral FluencyGrammarVocabularyListening Comp
(second year in the
program)
John Stanford International School 17
Teacher Ratings Spanish 2002 – 1st
0.0%
10.0%
20.0%
30.0%
40.0%
50.0%
60.0%
70.0%
Jr NovLow
Jr NovMid
Jr NovHigh
Jr IntLow
Oral FluencyGrammarVocabularyListening Comp
(second year in the
program)
John Stanford International School 18
ELLOPA & Teacher Ratings 2nd Grade
ELLOPA Spanish 2002 – 2nd (after second year of language) Jr Nov Low Jr Nov Mid Jr Nov High Jr Int LowOral Fluency 16.7% 16.7% 22.2% 44.4%Grammar 16.7% 16.7% 16.7% 50.0%Vocabulary 11.1% 27.8% 27.8% 33.3%Listening Comp 5.6% 22.2% 16.7% 55.6%
Teacher Ratings Spanish 2002 – 2nd (after second year of language) Jr Nov Low Jr Nov Mid Jr Nov High Jr Int LowOral Fluency 2.7% 29.7% 21.6% 45.9%Grammar 10.8% 29.7% 24.3% 35.1%Vocabulary 2.7% 24.3% 35.1% 37.8%Listening Comp 0.0% 2.7% 37.8% 59.5%
John Stanford International School 19
ELLOPA Spanish 2002 – 2nd
0.0%
10.0%
20.0%
30.0%
40.0%
50.0%
60.0%
Jr NovLow
Jr NovMid
Jr NovHigh
Jr IntLow
Oral FluencyGrammarVocabularyListening Comp
(second year in the
program)
John Stanford International School 20
Teacher Ratings Spanish 2002 – 2nd
0.0%
10.0%
20.0%
30.0%
40.0%
50.0%
60.0%
Jr NovLow
Jr NovMid
Jr NovHigh
Jr IntLow
Oral FluencyGrammarVocabularyListening Comp
(second year in the
program)
John Stanford International School 21
ELLOPA/Teacher Rating – K
ELLOPA/Teacher Rating Spanish 2001 vs. 2002 – KOral Fluency Grammar Vocabulary Listening Comp
ELLOPA 2001 2.31 2.31 2.27 3.11Teacher 2001 2.56 2.67 3.02 3.17ELLOPA 2002 2.00 1.96 1.96 2.81Teacher 2002 2.00 2.04 2.04 2.73
John Stanford International School 22
ELLOPA/Teacher Rating Spanish 2001, 2002 - K
0.00
0.50
1.00
1.50
2.00
2.50
3.00
3.50
ELLOPA2001
Teacher2001
ELLOPA2002
Teacher2002
Oral FluencyGrammarVocabularyListening Comp
Mean or Average
John Stanford International School 23
ELLOPA/Teacher Rating 1st – 2nd
ELLOPA/Teacher Rating Spanish 2001 – 1st, 2002 – 1st
ELLOPA/Teacher Rating Spanish 2002 – 2nd
Oral Fluency Grammar Vocabulary Listening CompELLOPA 2001 2.22 2.22 2.20 3.11Teacher 2001 2.41 2.46 2.89 3.43ELLOPA 2002 3.08 2.98 3.00 3.48Teacher 2002 2.93 2.93 3.02 3.61
John Stanford International School 24
ELLOPA/Teacher Rating Spanish 2001, 2002 – 1st
0.00
0.50
1.00
1.50
2.00
2.50
3.00
3.50
4.00
ELLOPA2001
Teacher2001
ELLOPA2002
Teacher2002
Oral FluencyGrammarVocabularyListening Comp
Mean or Average
(2001 – one year of study;
2002 – two years of study)
John Stanford International School 25
ELLOPA/Teacher Rating Spanish 2001, 2002 – 2nd
0.00
0.50
1.00
1.50
2.00
2.50
3.00
3.50
4.00
ELLOPA 2002 Teacher 2002
Oral FluencyGrammarVocabularyListening Comp
Mean or Average
John Stanford International School 26
ELLOPA/Teacher Rating Growth
ELLOPA/Teacher Rating Spanish 2001 – K, 2002 – 1st
ELLOPA/Teacher Rating Spanish 2001 – 1st, 2002 – 2nd
Oral Fluency Grammar Vocabulary Listening CompELLOPA 2001 2.31 2.31 2.27 3.11Teacher 2001 2.56 2.67 3.02 3.17ELLOPA 2002 3.08 2.98 3.00 3.48Teacher 2002 2.93 2.93 3.02 3.61
Oral Fluency Grammar Vocabulary Listening CompELLOPA 2001 2.22 2.22 2.20 3.11Teacher 2001 2.41 2.46 2.89 3.43ELLOPA 2002 2.94 3.00 2.83 3.22Teacher 2002 3.11 2.84 3.08 3.57
John Stanford International School 27
ELLOPA/Teacher Rating Spanish 2001, 2002 – K-1 growth
0.00
0.50
1.00
1.50
2.00
2.50
3.00
3.50
4.00
ELLOPA2001
Teacher2001
ELLOPA2002
Teacher2002
Oral FluencyGrammarVocabularyListening Comp
Mean or Average
(growth over 2 years)
John Stanford International School 28
ELLOPA/Teacher Rating Spanish 2001, 2002 – 1-2 growth
0.00
0.50
1.00
1.50
2.00
2.50
3.00
3.50
4.00
ELLOPA2001
Teacher2001
ELLOPA2002
Teacher2002
Oral FluencyGrammarVocabularyListening Comp
Mean or Average
(growth over 2 years)
John Stanford International School 29
Paired ELLOPA Ratings 2001, 2002 – K-1 and 1-2 growth
0.00
0.50
1.00
1.50
2.00
2.50
3.00
3.50
2001(K)
2002(1st)
2001(1st)
2002(2nd)
Oral FluencyGrammarVocabularyListening Comp
Mean or Average
This is the most accurate representation of growth because it compares only students who were in the
program both years.
According to CAL, the rate of growth is
statistically significant.
John Stanford International School 30
How did JSIS raters compare to CAL?
020406080
100120140160180200
K 1st 2nd
Total RatingsSame as CALHigher than CALLower than CAL
Number of Ratings of Oral Fluency, Grammar,
Vocabulary, and Listening Comprehension
Beverly Boyson of CAL reviewed ELLOPA note sheets from JSIS raters and modified ratings where appropriate