Transcript Quality Matters: Peer Review of Online Courses

Quality MattersTM:
Introduction to QM
and to the Rubric
The Quality Matters™ Rubric 2008 – 2010 Edition
Updated July 08
About
Quality Matters
Quality Matters
Quality does matter to …
• students
• faculty
• administrators
• institutions
• consortia
• accrediting agencies
• legislators
• tax-payers
How do we …
• identify & recognize it?
• motivate & instill it?
• assess & measure it?
• insure it?
• assure it?
Quality Matters:
Peer Course
Review Process
Institutions
Faculty Course
Developers
Course
Course Meets
Quality Expectations
National Standards &
Research Literature
Rubric
Faculty Reviewers
Training
Peer Course
Review
Feedback
Course
Revision
Instructional Designers
Factors Affecting Course Quality
• Course design
QM REVIEWS THIS
• Course delivery (i.e. teaching, faculty
performance)
• Course content
• Course management system
• Institutional infrastructure
• Faculty training and readiness
• Student engagement and readiness
For Our Purposes, Quality Is…
• More than average;
more than “good
enough”
• An attempt to capture
what’s expected in an
effective online course
at about an 85% level
• Based on research and
widely accepted
standards
85 %
The Rubric
The Rubric
Eight General Standards:
1.
2.
3.
4.
5.
6.
7.
8.
Course Overview and Introduction
Learning Objectives
Assessment and Measurement
Key components
Resources and Materials
must align.
Learner Interaction
Course Technology
Learner Support
Accessibility
Alignment: Critical course elements work together
to ensure that students achieve the desired learning
outcomes.
Key sections that must align…
Course Learning Objectives (2)
Learner Interactions & Activities (5)
Resources, Materials (4) & Technology (6)
Assessment and Measurement (3)
Rubric Scoring
Standards
Points
Relative Value
17
3
Essential
11
2
Very Important
12
1
Important
TOTALS
40





85
Team of 3 reviewers initially score individually
One score per standard based on team majority
Pre-assigned point value
Yes/No decision; All/None points
Consensus is NOT required
To Meet Expectations…
A course must achieve:
• “Yes” on all 17 of the 3-point
“essential” standards.
• A minimum of 72 out of 85 points
72/85 = 85%
Underlying Principles of QM…
1. Based in national standards of best practice, the
research literature & instructional design principles
2. The course under review does not have to be
“perfect” but better than just “good enough”
(Standards met at about 85% level or better.)
3. Integral to a continuous quality
improvement process
4. Valued as part of a faculty-driven, peer review
process
5. Designed to promote student learning
Underlying Principles of QM (cont)….
6. Designed to ensure all reviewed courses
will eventually meet expectations
7. QM is a collegial review process, not an
evaluation process
8. A review team must include an external
peer reviewer
9. Set up so that the course faculty or
instructor considered part of the review
team