Date post: | 28-Dec-2015 |
Category: |
Documents |
Upload: | norma-stephens |
View: | 213 times |
Download: | 0 times |
Lynn Thompson
Center for Applied Linguistics
Startalk Network for Program ExcellenceChicago, IllinoisOctober 16-18, 2009
Formative and Summative Assessment
Overview
I. CONTEXT – STARTALK Assessment Workshop
II. What is Assessment?
III. Key concepts
IV.Formative and Summative Assessment
V. Suggestions for evaluating assessment data
2
STARTALK Proficiency Assessment Training Program
CAL Proficiency Assessment Training Program
Blended Course Online introduction to assessment principles 2-3 day workshop allowing for networking and test item
development Online follow-up modules addressing specific needs for
instructors and administrators
Further online training options: Assessment Training Online (ATOL) Grades 9-16 Student Oral Proficiency Assessment (SOPA) Grades K-8
STAR Workshop
Purpose: Help participants learn about and plan for assessment in STARTALK summer programs
Audience: Instructors and Program Directors who work with STARTALK programs in Arabic, Chinese, Hindi, Persian, Turkish, and Urdu.
4
Language Summer 2008 Summer 2009
Arabic 3 8
Chinese 16 9
Hindi/Urdu 1 7
Persian 2 0
Turkish 0 1
Multiple 0 4
Total: 22 29
2008 STAR Workshop Content
Online Modules 1-4 (May 2-May 30)
Live Workshop (June 8-19)
Online Modules 5-8 (June 13-
December 2008)
5
Module Topics coveredModule 1 Introduction to workshop and online technology
Module 2 Key assessment conceptsNeeds assessment
Module 3 ACTFL Proficiency GuidelinesAssessing the four skills
Module 4 Formative assessmentSummative assessment
Module Topics covered
Live workshop Needs assessmentNational StandardsLinguaFolioLangnetDeveloping assessment tasksPlanning for assessment
Module Topics covered
Module 5 Review live workshopShare materialsSample assessment tasks
Module 6 Interpretive listening Interpretive reading
Module 7 Computer-based assessmentStudent self-assessmentAssessing culturePlanning for assessment
Module 8 Rating and rubricsInterpreting resultsTeacher certification
Star Workshop 2009
Online modules Choice between 2 live workshops (one in July
and one in August) Follow up modules Training courses
What is Assessment?
As instructors, we need to be able to track our students' language growth. Assessment is how we do this.
Assessment = to sit beside Assessment = the opportunity to enhance, empower, and
celebrate students’ learning while giving guidance to instructors. Assessment = a collaboration between the student and the
instructor:– monitor students' daily progress using formative
assessment,– check in on student progress at key points in the school year
using summative assessment.
Key Testing Concepts
Validity refers to the suitability of a test for your purposes. – What do you want to measure?– What will the results be used for?– Who is being tested?
9
Key Testing Concepts
Reliability is the consistency of test results. – Consistent results when tested on two
separate occasions– Consistent scoring by different instructors
Reliability is closely tied to validity. A test can be reliable without being valid. However, a test cannot be valid unless it is reliable.
10
Impact
Who will be affected by the assessment results: parents, students, teachers, administrators, funders, and more. These people are all stakeholders.
Tests can have positive or negative effects (washback)
11
Stakeholders
12
Assessment and LCTLs
Assessing Less Commonly Taught Languages can be more difficult due to a smaller pool of assessment resources from which to draw.
When ready-made assessments are not available, instructors must develop their own assessment materials, making it even more important that they understand the principles of assessment.
Challenges in Language Assessment
Instructors must understand language assessment in order to participate in the language learning culture (Shepard, 2000).
High-stakes tests, like those that the government may use in hiring and assigning language specialists, must be valid and reliable. However, in many cases, such tests have not been developed for critical languages.
14
Discussion (1)
What challenges have you faced in finding and using assessments in your language?
How have you addressed them?
15
Types of Assessment
Formative assessment is used during the course of instruction to provide feedback to the teacher, learner, or both about the learner's progress toward desired educational outcomes.
The results of formative assessments are often used in planning subsequent instruction.
Examples of Formative Assessment
Formative assessments may take many forms, such as:– Quizzes and tests, – class presentations, – projects, – portfolios and – self assessments.
17
Formative Assessment
When you plan formative assessments, think about how you will relate the assessment to your instruction.
Assessment should reflect classroom activities and provide useful information to you and your students.
It is also important to consider how you will communicate results to your students. You may want to plan for time to explain results.
Summative Assessment
Summative assessment refers to assessments that are generally conducted at the end of a unit or at the end of a sequence of units to provide feedback to the teacher, learner, or both about the learner's achievement of course goals or proficiency.
Summative Assessment
The information gathered from summative assessments is often used to make decisions about:
grading, program evaluation, tracking or accountability.
20
Summative Assessment
Summative assessment should reflect classroom instruction.
Summative assessment may have higher stakes attached to the results.
The stakes will determine what type of assessment is appropriate for the decisions you need to make.
21
Student Self Assessment
Student self-assessment is useful formative assessment, but may not be sufficient to assign grades for the semester or to determine if students have mastered an instructional unit.
A comprehensive test of all the material covered in a semester would provide a better basis for making grading decisions.
22
Evaluating Assessment Results
Classroom assessment activities allow you to collect information about what students are able to do.
In order to track student progress and inform instruction, it is necessary to have a way to evaluate the information that you have collected.
Examples of how to evaluate student progress
1) Checklists– Checklists can be used to record task
completion in the classroom or if a student has learned particular language forms and functions.
24
Rating Scales
A rating scale provides a range of measures that can be selected for a student's performance.
One of the most common rating scales that we see in schools is the A-F grading scale.
Some schools also use rating scales to measure consistency or frequency
25
Never Seldom Sometimes Always
Rubrics
Like rating scales, rubrics allow you to rate student performance and help you track their progress over time.
Rubrics define different levels of student performance and can also allow you to evaluate different aspects of a student's performance.
26
Rubric Power Move
Sharing the rubric you are developing with your students allows them to see what aspects they will be evaluated on and what each of the levels of performance require.
27
Discussion
What are your language assessment needs?
How do you go about finding language assessments when you need them?
28
Assessment Resources
Assessment Resources– Understanding Assessment: A Guide for Foreign
Language Educators is a tutorial on language testing for foreign language educators.
It is also an excellent resource for anyone who want
to learn more about language testinghttp://www.cal.org/flad/tutorial/
– Foreign Language Assessment Directory isa searchable annotated database of K-16 foreign language assessments
http://www.cal.org/CALWebDB/FLAD/
29
30
Shepard, L. (2000). The role of assessment in learning culture. Educational Researcher, 29.7, 4-17.
Stiggins, G. (1997). Student Centered Classroom Assessment. Upper Saddle River, NJ: Prentice Hall.
Stoynoff, S., & Chapelle, C. A. (2005). ESOL tests and testing: A resource for teachers and programadministrators. Alexandria, VA: TESOL Publications.
References