Quality Matters
Quality MattersTM:
Introduction to QM and to the Rubric
The Quality Matters™ Rubric 2008 – 2010 Edition Updated July 08
About About Quality Matters Quality Matters
Quality MattersQuality does matter to …• students• faculty• administrators• institutions• consortia• accrediting agencies• legislators• tax-payers
How do we …• identify & recognize it?• motivate & instill it?• assess & measure it?• insure it?• assure it?
Peer Course Peer Course ReviewReview
FeedbackFeedback
CourseCourse
Course Meets Course Meets Quality ExpectationsQuality Expectations
Course Course RevisionRevision
Instructional Designers
InstitutionsFaculty Course Developers National Standards &
Research LiteratureRubric
Faculty ReviewersTraining
Quality Matters:Quality Matters: Peer Course Peer Course
Review ProcessReview Process
Factors Affecting Course Quality
• Course design QM REVIEWS THIS
• Course delivery (i.e. teaching, faculty performance)
• Course content• Course management system• Institutional infrastructure• Faculty training and readiness• Student engagement and readiness
For Our Purposes, Quality Is…
• More than average; more than “good enough”
• An attempt to capture what’s expected in an effective online course at about an 85% level
• Based on research and widely accepted standards
85 %
The Rubric The Rubric
The Rubric Eight General Standards:
1. Course Overview and Introduction2. Learning Objectives 3. Assessment and Measurement4. Resources and Materials5. Learner Interaction6. Course Technology7. Learner Support8. Accessibility
Key components must align.
Alignment: Critical course elements work together to ensure that students achieve the desired learning outcomes. (Stated Course Objectives – Activities – Assessments – are consistent with one another.)
Course Learning Objectives (2)
Resources, Materials (4) & Technology (6)
Assessment and Measurement (3)
Learner Interactions & Activities (5)
Key sections that must align…
Rubric Scoring
Standards Points Relative Value
17 3 Essential
11 2 Very Important
12 1 Important
TOTALS
40 85
Team of 3 reviewers initially score individually One score per standard based on team majority Pre-assigned point value Yes/No decision; All/None points Consensus is NOT required
To Meet Expectations…
A course must achieve:
• “Yes” on all 17 of the 3-point “essential” standards.
• A minimum of 72 out of 85 points
72/85 = 85%
Underlying Principles of QM…
1. Based in national standards of best practice, the research literature & instructional design principles
2. The course under review does not have to be “perfect” but better than just “good enough” (Standards met at about 85% level or better.)
3. Integral to a continuous quality improvement process
4. Valued as part of a faculty-driven, peer review process
5. Designed to promote student learning
Underlying Principles of QM (cont)….
6. Designed to ensure all reviewed courses will eventually meet expectations
7. QM is a collegial review process, not an evaluation process
8. A review team must include an external peer reviewer
9. Set up so that the course faculty or instructor considered part of the review team