Designing Assessments
Teaching Seminar, Bacolod City CollegeJune 6, 2011
Topics to Cover
1. What is the best format for test questions?2. Tests take time to grade. Is there a more
efficient way to assess learning?3. What kind of learning should a test really
assess?
1. Test Question Format
What types of test questions do you use?
Why? • Multiple choice• True-false• Matching• Word problems• Short response• Essay• Fill in the blank
Case Study: Vocabulary Questions
B. Instructions: Read each incomplete statement carefully. Identify the most appropriate term from the word box to complete each statement.
1. We need to understand each _____________ of life in order for us to live it well.2. Parents have the responsibility to ___________ positive values in their children.3. The museum is an excellent place to let children ___________ their curiosity about
dinosaurs.4. Carlos has a good handwriting. It is very easy to ___________ what he has written.5. The media keep us ___________ of the news and current events.6. I’m sorry about spilling your wine. That was very ___________ of me.7. The man was very careful in carrying the box of ___________ decorative ornaments.8. Sarah Geronimo is an artist of ___________ talent.9. The researcher noticed a slight ___________ between the responses of catholic
individuals regarding their opinion on Reproductive Health Bill.
Test Version #1
immense variance facetindulge decipher fragileabreast clumsy overwhelminculcate oblivion vista
Test Version #2Instructions: Identify whether each sentence uses the underlined word “CORRECTLY” or “INCORRECTLY.”
1. In the internet age it is much easier to keep abreast of the latest current events occurring worldwide.
2. For a long time scientists have tried to variance a comprehensive, unified theory of the physical universe but without success.
3. As destruction of the natural environment continues due to deforestation and over-fishing, a greater number of plant and animal species are passing into oblivion.
4. If you want to become a proficient reader, even 15 minutes of reading a day can expose you to over one million words in a year.
5. He went to wash his face only to discover that the facet of his sink was broken.6. If you are clumsy in your actions or speaking you may risk embarrassing yourself or worse,
offending others.7. Many believe that the best way to indulge a child discipline and respect is to motivate the child
through positive reinforcement, or, in other words, rewards.8. Effective organization and time management will ensure that you are often overwhelmed.9. Please take time to inculcate this document carefully before signing your approval.10. Love is a fragile gift: it can easily wither if neglected and can easily shatter if given carelessly.
Test Version #3
1. In the internet age it is much easier to keep abreast of the latest current events occurring worldwide.
2. For a long time scientists have tried to variance a comprehensive, unified theory of the physical universe but without success.
3. As destruction of the natural environment continues due to deforestation and over-fishing, a greater number of plant and animal species are passing into oblivion.
4. If you want to become a proficient reader, even 15 minutes of reading a day can expose you to over one million words in a year.
5. He went to wash his face only to discover that the facet of his sink was broken.
6. If you are clumsy in your actions or speaking you may risk embarrassing yourself or worse, offending others.
7. Many believe that the best way to indulge a child discipline and respect is to motivate the child through positive reinforcement, or, in other words, rewards.
1. If you don’t abreast children, they may soon become disobedient.
2. Even in the same family, there is always some slight variance between the personality of children.
3. Perhaps the most important oblivion of learning is having an internal desire to gain new information.
4. The proficient child broke two plates and one glass cup in a single month.
5. According to her professor, Janine’s strongest facet of her personality was her determination.
6. For a long time I wanted to clumsy my room but I continuously found more urgent matters to occupy my time.
7. My aunt has been known to indulge in lechon too frequently, which has caused her to develop diabetes.
Instructions: Compare column A and B. Circle which sentence uses the underlined word correctly.
The ResultsTest #3: 73% Correct
Test Version #139% correct
abreast 93%
variance 47%
oblivion 87%
proficient 73%
facet 37%
clumsy 97%
indulge 17%
overwhelmed 30%
inculcate 10%
fragile 73%
cognitive 10%
cues 97%
abreast 92%variance 85%oblivion 73%proficient 88%facet 81%clumsy 96%Indulge 27%
overwhelmed 42%inculcate 65%fragile 96%cognitive 35%cues 88%
Indulge 27%
immense 27%
variance 30%
Facet 36%
decipher 39%
abreast 39%
overwhelm 39%
Inculcate 42%
clumsy 55%
fragile 58%
Test #2: 59% Correct
What were the differences?What were the problems?
Test #1• Took too long to answer• Multiple possible correct answers• Did not directly measure students’ knowledge of the words• Made students guess at what could possibly be rightTest #2• Required students to evaluate whether correct or incorrect• Defined the task more clearly (mark “CORRECT”)
Test #3• Allowed students to compare two sentences, knowing one
was correct• Indirectly taught proper vocabulary usage
What can we learn?
Test questions should:• Measure a specific skill• Be time-appropriate• Have only 1 clear, logical answer• Be instructive, not just evaluative
Now you try it…
Is this a GOOD or BAD test question?
Tests take time. Is there a more efficient way to assess learning?
Formal Assessments Informal AssessmentsMidterm/Final Exams End-of-class questionsQuizzes Beginning-of-class reviewsHomework assignments Asking questionsEssays “Playing card” monitoringReports Quiz GamesProjects Personal EvaluationsPresentations/Demonstrations Group Discussions
Informal AssessmentsAdvantages Disadvantages
Quick Not comprehensiveLow Pressure Not recordableIndividualized Not uniform
Adjustable Not standardizedSubjective Subjective
What kind of learning should a test really assess?
Question 1
1. List 3 ways a map that show the distribution of landforms and waterforms can be used by scientists: ______________________________________________________
Question 2
1. The map that shows the distribution of landforms and waterforms on the Earth surfaceA. Ethnic mapB. Physical mapC. Climate mapD. Economic map
Authentic Learning
Which of the following qualities of family members is needed when doing housekeeping, cleaning, home repair, and maintenance task?A. KnowledgeableB. CooperativeC. SmartD. Physically strong
Make a better test question….
Now You Try…
1.Design 5 test questions for your subject that uses an effective test question format.
2.Develop 1 informal assessment activity (beginning of class review, end-of class questions, quiz game, etc)
3.Change an “inauthentic” test question into an “authentic” test question.