Competency 007: E

SorryThat was the wrong answerCorrect !CongratulationsDemonstrates knowledge of fundamental assessment-related issues, such as those related to bias, reliability and validity.Competency 007: EBias: prejudice in favor of or against one thing, person, or group compared with another, usually in a way considered to be unfair.

Bias4Assessment bias: present whenever one or more items on a test offend or unfairly penalize students because of personal characteristics including but not limited to:RaceGenderSocioeconomic statusReligion

Does the test over/under estimate a groups true ability?Assessment Related BiasIt todays politically correct world, the main concern with testing bias relates to penalizing students who belong to a particular group. A tests bias can be determined by answering a simple question. Does the test over or under estimate a groups true ability? If it does 5Reliability: consistency of a measureReliabilityAssessment reliability: assesses the degree to which test scores are consistent from one test administration to the next

The tests reliability is determined by three factorsReliability of student performanceReliability of scoringReliability between different forms of the same testAssessment ReliabilityCenter for applied linguistics. (2009). Module 3: Reliability. Retrieved October 7, 2012, from: http://www.cal.org/flad/tutorial/reliability/3andtestselection.htmlStudent performance: one student should be able to take a test on any given day of the week and get similar results each day.Scoring-the tests should be the same no matter who scores the testDifferent Forms-the order or slightly different questions should have very little effect on student performance.7Validity: the state or quality of being validValid: producing the desired resultValidityAssessment validity: the extent to which a test accurately measures the intended purpose

The validity of a test can be separated into three major categoriesContent validityCriterion-related validityConstruct validity

Assessment ValidityDuquesne University. Test construction: Introduction and overview. Retrieved October 7, 2012, from: http://www.mathcs.duq.edu/~packer/Courses/Psy624/test.htmlContent validity-the adequacy of measuring the chosen content areaCriterion-related validity: the usefulness in predicting a persons performance on a separate measure such as a students G.P.A. predicting success on the SAT or a students SAT score serving as a predictor for a freshmans G.P.A.Construct-defines how well a test measures a non-observable trait.

9

Reliability vs Validity Image: Nevit Dilmen found at Wikimedia commonsReliability and validity are oftentimes misused. The goal of any assessment is to have a test that is both reliable and valid. 10Competency 007: EQuizVincent BrisenoEDTC 6343

If performance on a given test results in low performance for only English language learners, then this may be a case of Assessment biasAssessment reliability Assessment validity Which of the following is the best definition for test reliability?A test that provides a fresh perspective when given multiple times to the same group of students.A test that can be scored differently depending on the test administrator.A test that provides consistent scores regardless of date, time, or test administrator.15A test can be reliable without being valid.TrueFalseWhich statement best describes test validity?A test is valid if it accurately measures the intended objective.A test is valid if a specific subset of students score low regardless of abilityA test is valid if a change in the order of test questions results in significantly different scores.A middle school math test that accurately predicts the grade of 8th grade students in Algebra I is an example ofA bias testA reliable testA valid testA classroom scale used in health class that always measures a students weight to be 25 pounds over the actual weight isA bias assessmentA reliable assessmentA valid assessmentAccording to Competency 007: E, the MTT will demonstrateKnowledge of fundamental assessment-related issuesKnowledge of the benefits and limitations of technologyKnowledge of effective methods for incorporating technology into various instructional strategies Which of the following is not an assessment related issue?BiasNumber of answer choicesValidityReliabilityOne way an MTT could assess the reliability of a test would be to Give the test to the same group of students on consecutive days.Allow multiple teachers to grade the same tests.Rearrange the test questions and ask students to take the test againAll of the aboveNone of the aboveThe EndPowerpoint template provided by Wendy Russellhttp://presentationsoft.about.com/od/templates/qt/quiz_template.htmReliability vs ValidityVideo