High-Tech High-Tech AssessmentAssessmentHigh-Tech High-Tech

AssessmentAssessment

The tools to useThe tools to use

Objectives• Recognize some high-tech

assessment technologies.• Understand how they can be used

effectively.• Know where to go for more

information.

Traditional Pedagogy and Traditional

Assessment• Class lectures• Assigned reading• Individual

projects• Papers and

presentations

• Tests, tests, tests• Class

participation• Portfolios

Pedagogy and Assessment 2.0

• Online courses– Online quizzes– Online discussion

forums• Group projects

– ePortfolios– Online Discussion

Forums• On-demand online

training– Online quizzes– Response times for

online tests

• Course management systems– Online quizzes– ePortfolios– Online discussion forums– Audience response

systems• Podcasted lectures

– Download rates– Online discussion forums

• Gaming/Simulation– Game scores– Response Times

On-Demand Online Tutorials

• “Screencasts”• Recorded demonstrations of using

computer programs.• Camtasia

– Leading screencasting system.– Allows audio, video, highlights, mouse-

clicks, etc.– Includes quiz function to assess learning.

Examples of tutorial w/quiz in Libraries

• TILT • Park Library Online Tutorial • Colorado State

Online Quizzes• Course Management

Systems (CMS)– Blackboard– Moodle

• Online survey systems– SurveyMonkey (base

version is free)• Online Tutorials

– Camtasia• Provides instant

summaries of results.

• Can track respondents’:– Answers– When started/completed– Time on quiz– Time on question (some,

not all)

• Assessment Uses– Pre-test/Post-tests– Knowledge retained– Longitudinal

assessment

Online Quiz/Test Example

Learning Assessment

Audience Response Systems

• “Clickers”• Enable anonymous or non-anonymous

responses to ad-hoc questions during a lecture.• Can be used to assess learning and direct

course of lecture.• Often integrated with MS Office programs

– PowerPoint for presentation– Excel for reporting

• …and Class Management Systems

Demo of ARS and ARS in Libraries

• Quizdom Remotes Demo• Lehigh University Library• Dickinson College

Learning Assessment

ePortfolios• Digital repository of work completed by

student.• Meant to assess progress “as a whole.”• Often included with CMS

– Blackboard• Other tools:

– Wikis (PBWiki – cheap and easy to use)– Blogs (MovableType)– Digital Archives (DSpace – campus-wide

implementation)

Examples of ePortfolios• Polaris (UT)• ePortfolio at LaGuardia• Valdosta State

– Assessment of instruction services– Article in Reference Services Review

• UNISA– Research Information Skills in distance ed

class– Article in Education for Information

Gaming/Simulation• Simulation of real-world experiences• Good for assessing higher-ordered

thinking skills• Formative assessment is better.

– Based on choices made.– Can be used to compare with others.

• Other measures– Completion time– Self-correction rates

Examples of Gaming in Libraries

• UNC Greensboro (a Web-based board game)

• Ohio State – set of games to assess learning.

• Arizona State University – developing a simulation game– Quarantined

Learning Assessment

Tool Summary• Online Quizzes/Tests

– Similar to paper-based.– CMS or SurveyMonkey– Good for “open-book” tests. No checks for

“cheating”.– Better at assessing lower-ordered thinking skills

• Recorded Demonstrations– Good for short segments of training.– Better for demonstrations.– Include a quiz for assessment.– Not good for difficult topics.

More Tools Summary• ARS

– Useful for continuous feedback from students to guide lecture.

– Good for assessing the class/course.• Gaming/Simulation

– Better at assessing higher-order thinking skills.

– Complex to create.

References• Wikipedia

– ePortfolio

• EDUCAUSE– E-Portfolios (a bit old,

but still has some good background)

– Gaming– Screencasting– ARS

• E-Portfolios for Learning blog

• Proof of learning: Assessment in Serious Games

• ePortfolios: Hi-Octane Assessment

• Bibliographic Gaming

• Game on: Games in Libraries

More References• Leach, Guy J and Tammy S. Sugarman. 2006. Play to wi

n! Using games in library instruction to enhance student learning. Research Strategies, v. 20(3):191-203.

• Fourie, I. and van Niekerk, D. (1999). Using portfolio assessment in a module in research information skills. Education for Information, 17(4), pp. 333-352.

• Chapman, J. M., Perrway, C., and White, M. (2001) The portfolio: an instruction program assessment tool . Reference Services Review, 29, 294-300 .[CrossRef]

Vendor List• Online Testing

– Blackboard– SurveyMonkey

• Screencasting/Online Tutorials– Camtasia– Adobe Captivate

• ePortfolios– Blackboard– Dspace– OpenSource Portf

olios (OSP)

• Audience Response Systems– TurningPoint– Quizdom