Jump to first page

TTest ing,

Kanchana Prapphal

for Quality Assurance in Teaching

MMeasurement

and EEvaluation

Jump to first page

TTests, ests, MMeasurement and easurement and EEvaluationvaluation

Test: 1. Measurement instrument 2. Designed to elicit specific sample

of behaviorMeasurement: 1. Quantification: assigning numbers 2. Characteristics: abilities, traits,

attributes, constructs 3. Rules and procedures: must be

replicable

Jump to first page

Evaluation 1: . Systematic

2 . Gathering of information

3 . :Making decisions value judgments

Measurement ssssssssssss ssss= +

Evaluation = Testing + Quantitative Data +sssssssssss ssss

ssssssss+

19(Bachman,90

TTests, ests, MMeasurement and easurement and EEvaluationvaluation

Jump to first page

Uses of tests in Uses of tests in educational educational programsprograms Individuals

a. studentsb. teachersc. administrators

Programsa. effectiveness

b. appropriateness

c. efficiencyd. revision

Jump to first page

Assumptions Assumptions necessary for using necessary for using teststests

1. Information regarding educational outcoooo oo ooooooooo oo ooooooooo oooooo ooooo.

2. .Educational outcomes are measurable

1990(Bachman, )

Jump to first page

Learning Learning OutcomesOutcomes

Learning outcomes are statements of what is expected that a student will be able to DO as a result of a learning activity.

Quality Assurance:

INPUT

INPUT

PROCESS

PROCESS

OUTCOMES

OUTCOMES

Descriptors

Descriptors

Jump to first page

Bloom’s Bloom’s TaxonomyTaxonomy

Three domains of educational activities:

Cognitive Domain : involves knowl edge and the development of intelle ctual attitudes and skills

Affective Domain Psychomotor Domain (Bloom, 1956)

Jump to first page

Cognitive Cognitive ObjectivesObjectives

Knowledge Comprehensi

on

Application

Analysis Synthesis Evaluation

SimpleSimple

Complex

Complex

Jump to first page

KnowledgeKnowledge

The remembering of previously learned material

Examples of learning objectives:-know common terms-know specific facts-know methods and procedures-know basic concepts-know principles

Jump to first page

Knowledge Knowledge (Example)(Example) Who wrote Brave New Wo

rld?

A. D.H. Lawrence

B. Aldous Huxley

C. Hemmingway

D. Shakespeare

Jump to first page

ComprehensionComprehensionThe ability to grasp the meaning of

material

Examples of learning objectives:

-understand facts and principles-interpret verbal materials-interpret charts and graphs-translate verbal material to

mathematical formulaejustify methods and procedures

Jump to first page

Comprehension Comprehension (Example)(Example)

What is the main idea of this paragraph?

A. Nitrous oxide can cause an environmental

problem.

B. Nitrous oxide is a potent greenhouse gas.

C. Nitrous oxide destroys the earth’s ozone

layer.

D. Nitrous oxide’s concentration appears to be

rising.

Jump to first page

ApplicaApplicationtion

The ability to use learned material in new and concrete situations

Examples of learning objectives: -apply concepts and principles to new

situations apply laws and theories to practical

situations solve mathematical problems construct graphs and charts demonstrate the correct usage of a

method or procedure

Jump to first page

Application Application (Example)(Example)

Which one of the following values a pproximates best to the

volume of a sphere with radius 5m? 2000 3A. m 1000 3B. m 500 3C. m 250 3D. m 125 3E. m (MCQ)

Jump to first page

AnalyAnalysissis

The ability to break down material into its component parts

Examples of learning objectives: - recognize unstated assumptions -recognize logical fallacies in reasoning distinguish between facts and inferences evaluate the relevancy of data analyze the organizational structure of a

work

Jump to first page

Analysis Analysis (Example)(Example)

Hereare the fi ve Basi c Needs determi ned byMasl ow:

1. Comfort and survival

2. Safety

3. Belongingness and love

- 4. Self esteem and the esteem of others

-5. Self actualization

Jump to first page

Analysis Analysis (Example(Example)) Determine in what way the Germans me

et these needs and to what extent the German pattern differs

from the American pattern. Give examples.

(Valette)

Jump to first page

SyntSynthesishesis

The ability to put parts together to form a new whole

Examples of learning objectives: -write a well organized theme -give a well organize speech write a creative short story propose a plan for an experiment integrate learning from different areas

into a plan for solving a problem

Jump to first page

Synthesis Synthesis (Example)(Example)

Write a paragraph summarizing the text you have read. Your

summary should have a topic sentence defining the problem,

some of the causes, some of the effects, and a conclusion.

Jump to first page

EvaluationEvaluationThe ability to judge the value of material for a

given purpose based on definite criteria

Examples of learning objectives:

- judge the logical consistency of written material

-judge the adequacy with which conclusions are supported by data

judge the value of a work by the use of internal criteria (organization) or external standards of excellence

Jump to first page

Evaluation Evaluation (Example)(Example)

“ The United States took part in the Gu lf War against Irag BECAUSE of the la ck of civil liberties imposed on the K

urds by Saddam Hussein’s regime.” A.Theasserti onandthe reasonare bothcorr ectandthe reasoni s val i d.

B.Theasserti onandthe reasonare bothcorr ectbut the reasoni s i nval i d.

Jump to first page

Evaluation Evaluation (Example)(Example)

C. The assertion is correct but the reason is incorrect.

D. The assertion is incorrect but the reason is correct.

E. Both the assertion and the reason are incorrect.

(MCQ)

Jump to first page

Verbs specifying Verbs specifying different sorts of different sorts of outcome outcome (Knowledge)(Knowledge)arrange order define recognize duplicate

label recall list repeat memorize

state relate reproduce

Jump to first page

ComprehensionComprehension

classify locate describe recognize discuss

report explain restate express review

identify select indicate translate

Jump to first page

ApplicationApplication

apply operate choose practice demonstrate

schedule dramatize sketch employ solve

illustrate use interpret write

Jump to first page

AnalyAnalysissis

analyze differentiate appraise discriminate calculate

distinguish categorize examine compare experiment

contrast question criticize test

Jump to first page

SyntheSynthesissis

arrange formulate assemble manage collect

organize compose plan construct prepare

create propose design write

Jump to first page

EvaluaEvaluationtion

appraise judge argue predict assess

rate attach score choose select

compare support estimate evaluate

Jump to first page

Advantages of Advantages of specifying specifying learning learning outcomesoutcomes Help students learn more effectively.

Make it clear what students can hope to gain from a course.

Help instructors to design their materials more effectively.

Help instructors select the appropriate teaching strategy.

Assist in setting examinations based on the materials delivered.

Ensure that appropriate assessment strategies are employed.

Jump to first page

Behavioral Behavioral ObjectivesObjectivesBehavioral Behavioral ObjectivesObjectives

Process Process DescriptDescript

orsors

Process Process DescriptDescript

orsors

Product Product DescripDescrip

torstors

Product Product DescripDescrip

torstors

Quality Quality AssuraAssura

ncencein in

TeachinTeachingg

Quality Quality AssuraAssura

ncencein in

TeachinTeachingg

Jump to first page

References

1990Bachman, L.F. . sssssssssss ssssssssssssss ss Languag

e Testing ssssssssss ssssss. : . , .. (.) 1956. Taxonomy of Education

ss Objectives: The Classification of Educational Goals : ss sssssssss s,

sssss . ..; : , . , .. 1989. Essentials of Psychological

Testing . Fourth Edition. N.Y.: Harp s sss &

Jump to first page

References (continued)

19Gronlund, N. and Linn, R.L. 90. sssssssssss sss ssssss

ssss ss ssssssss (6 .). ..: . Thorndike, R. L. andHagen, E. (1969). Measurement and E

valuation in Psychology and Edussssss 3( rd ed.). N.Y. :Wiley.

://.... http://www. reach.ucf.edu http://www.uct.ac.za

Jump to first page

Chulalongkorn UniversityChulalongkorn University -- Academic Testing Center Academic Testing Center (CU-ATC)(CU-ATC)Http://www.cuatc.chula.ac.th