Transcript Assessing Online COURSES - Johnson County Community College

ASSESSING ONLINE
COURSES
Regena Aye
Dean for Online Learning
Allen Community College
10 April 2015
WHY DO WE NEED TO TALK ABOUT
ASSESSMENT AND ONLINE COURSES?

Improvement

Accountability
COURSE ASSESSMENTS

What formal programs are being used to evaluate the
effectiveness of assignments in your online courses?

What methods are being used?

When?

How?

Analytics?

What are the results?
KEY CONSIDERATIONS

Alignment

Clarity

Feedback

Reflection

Integrity

Technology
THE CHALLENGES OF ONLINE
ASSESSMENTS

What are some challenges commonly faced when developing
online assessments?

What lessons learned would you like to share with colleagues?

What are some best practices in assessment for online classes?
RESOURCES-ASSESSING ASSIGNMENTS

Course Assessment Practices and Student Learning Strategies in Online Courses
http://www.bucks.edu/media/bcccmedialibrary/documents/academics/facultywebresources/Ass
essment_design_sloan.pdf

Creating Authentic and Engaging Assessments in Your Online Course
https://www.nl.edu/media/nlu/downloadable/provost/otlofficeteachinglearning/wiley/assessment/
62612/1349215994-palloff-prattpre-eventslides.pdf

Designing Online Course Assignments for Student Engagement: Strategies and Best Practices
http://www.worcester.edu/Currents/Archives/Volume_4_Number_2/CURRENTSV4N2McCarthyP31.p
df

Online Assessment Strategies: A Primer
http://jolt.merlot.org/vol6no1/sewell_0310.pdf
EVALUATING COURSES

What process and instrument are you using to evaluate courses?

What are the challenges of evaluate courses?

What successes have you had?
RESOURCES-COURSE EVALUATION

Quality Online Course Initiative Rubric and Checklist
http://www.ion.uillinois.edu/initiatives/qoci/rubric.asp

Quality Matters
https://www.qualitymatters.org/qm-standards-with-point-values-fifthedition/download/QM%20Standards%20with%20Point%20Values%20Fifth%20Edition.pdf

Blackboard Exemplary Course Rubric
http://kb.blackboard.com/display/EXEMPLARY/Exemplary+Course+Program

Central Michigan University Quality Assurance Checklist
http://global.cmich.edu/cid/quality-checklist.aspx
RESOURCES-COURSE EVALUATION

Online Course Evaluation Project (OCEP)
http://www.montereyinstitute.org/pdf/OCEP%20Evaluation%20Categories.pdf

Online Course Development Guide and Rubric
http://ablendedmaricopa.pbworks.com/f/LEC_Online_course+rubric.pdf

Online Course Development Guidelines and Rubric
http://www.mccvlc.org/~staff/content.cfm?ID=108

Criteria for Evaluating the Quality of Online Courses
http://elearning.typepad.com/thelearnedman/ID/evaluatingcourses.pdf
RESOURCES-COURSE EVALUATION

California State University, Chico’s Rubric for Online Instruction.
http://www.csuchico.edu/roi/the_rubric.shtml

Evaluation of Online Course based on Principles of Online Design
http://www.fgcu.edu/onlinedesign

Online Course Assessment Tool (OCAT) and Peer Assessment Process
http://www.wcu.edu/WebFiles/PDFs/facultycenter_OCAT_v2.0_25apr07.pdf
FACULTY EVALUATION

How are you conducting faculty evaluation at your institution?

What process was used to develop faculty evaluations?

What challenges did you face?

What best practices can you share?
RESOURCES-ADMINISTRATIVE EVALUATION

Best Practices for Administrative Evaluation of Online Faculty
http://www.westga.edu/~distance/ojdla/summer72/tobin72.html

Online course evaluations: faculty perspective and strategies for improved response
rates
http://www.tandfonline.com/doi/abs/10.1080/02602938.2010.493970#preview
RESOURCES-SELF AND PEER EVALUATION

Teaching Squares
http://tlp.excellencegateway.org.uk/tlp/cpd/assets/documents/teaching_squares.pdf

Quality Matters
https://www.qualitymatters.org/qm-standards-with-point-values-fifthedition/download/QM%20Standards%20with%20Point%20Values%20Fifth%20Edition.pdf

Blackboard Exemplary Course Rubric
http://kb.blackboard.com/display/EXEMPLARY/Exemplary+Course+Program
PROGRAM REVIEW

Who is using a program review process to evaluate the
effectiveness of online programs or online learning?

Are you evaluating services and decision making?

Is it working?

What challenges did have you faced?

What best practices would you share with others?
RESOURCES-PROGRAM REVIEW

Program Review Templates, Queensboro Community College
www.qcc.cuny.edu/assessment/templates.htm

Program Review Templates, Wright State University
http://www.wright.edu/academic-affairs/academic-program-review/program-reviewinstructions-timeline-and-template

Assessing Student Services for Online Learners
http://wcet.wiche.edu/wcet/docs/beyond/overview.pdf
RESOURCES-OTHER

Michigan State University Virtual University Design and Technology (VuDAT)
http://learndat.tech.msu.edu/

Illinois Online Network
http://www.ion.uillinois.edu/resources/tutorials/

10 Principles of Effective Online Teaching: Best Practices in Distance Education
http://www.facultyfocus.com/free-reports/principles-of-effective-online-teaching-bestpractices-in-distance-education/
RESOURCES-OTHER

“Seven Principles for Good Practice in Undergraduate Education,” AAHE Bulletin,
March 1987.
http://teaching.uncc.edu/learning-resources/articles-books/bestpractice/education-philosophy/seven-principles

“Implementing the Seven Principles: Technology as Lever,” AAHE Bulletin, October
1996.
http://www.tltgroup.org/programs/seven

“Seven Principles of Effective Teaching: A Practical Lens for Evaluating Online
Courses,” by Charles Graham, Kursat Cagiltay, Byung-Ro Lim, Joni Craner, and
Thomas M. Duffy (Indiana University).
http://technologysource.org/article/seven_principles_of_effective_teaching/
RESOURCES-RESEARCH

Virtual Center for Online Learning Research.
http://www.ncolr.org/#
RESOURCES-BOOKS

Rovai, Alfred P., and Michael K. Ponton. Distance Learning in Higher Education: A
Programmatic Approach to Planning, Design, Instruction, Evaluation, and Accreditation.
New York: Teachers College Press, 2008.

Comeaux, Patricia. Assessing Online Learning. Bolton, Mass.: Anker Pub., 2005.

Ruhe, Valerie, and Bruno D. Zumbo. Evaluation in Distance Education and E-learning: The
Unfolding Model. New York: Guilford Press, 2009.

Suskie, Linda A. Assessing Student Learning: A Common Sense Guide. 2nd ed. San
Francisco, CA: Jossey-Bass, 2009.
Questions?
Regena Aye, Dean for Online Learning
Allen Community College
[email protected]