Transcript D2L for Outcome Assessment - Southern Illinois University

USING D2L TO ASSESS
STUDENT LEARNING OUTCOMES
Bruce DeRuntz & Mohamad Ali
Department of Technology, Southern Illinois University
Competencies - Overview
Competencies are the measurable or observable knowledge,
skills, abilities, and behaviors.
Competencies validate information about the knowledge, skills
and abilities of students through the assessment of learning
objectives.
D2L Competencies Tool enables us to assess:
 Program Competencies

Course Learning Objectives

Evaluation Activities
Why?
•
•
•
Continuous improvement – curriculum,
pedagogy
Student success and retention
Program Accreditation (Compulsory)
Why?
Evaluation
Analyze
Retention
Growth
Implementation
Student
Retention
Analyze
Evaluation
Implementation
Analyze
Evaluation
Implementation
Retention
Growth
Develop
Retention
Growth
Design
Develop
Design
Course Repetition
Develop
Design
D2L Competencies Structure
A competency structure is a hierarchy composed of
three basic elements:



“Program” Competencies
“Course” Learning Objectives
“Assessment” Activities
D2L Terminology: Parent-child relationships
between competency structure elements
Element
Parents
Children
“Program” Competency
Other higher-order
competencies
Learning objectives.
Other lower-order
competencies
“Course” Learning Objective
Competencies
Activities
“Assessment” Activity
Learning objectives
How it looks like in D2L
“Program” Competency
“Course” Learning
Objective
“Assessment” Activities
Work flow of Competencies Mapping
5 Step Process
Program Outcomes/Competencies:
IT001
AKA “a”
Knowledge of Fundamentals: An understanding of the fundamentals of management,
quality, production, and automation.
IT002
Interpreting Data: An ability to interpret graphical, numerical, and textual data.
IT003
Problem Solving: An ability to apply relevant scientific and technology principles to solve real
world, open-ended industrial problems.
IT004
Design: An ability to design an industrial process to meet customer needs.
IT004
Communication: An ability to communicate effectively in oral, written and visual forms.
IT005
Teamwork: An ability to work in teams and understand the effective team dynamics and
characteristics.
IT006
Contemporary issues, non-technical issues, global awareness: An awareness of contemporary and
non-technical issues in technology profession and the role of professionals in an interdependent
global society.
IT007
Professional Ethics: An awareness and understanding of professional ethics.
Step #1

D2L administrator (JP Dunn) enters department level
“program” competencies in D2L database
Step #2


Instructor enters course learning objectives in D2L
database
From D2L menu - (Track/Competencies/New/Competencies or Learning
Objectives)
Step #3

Mapping process – Instructor links course learning
objectives to “program” competencies
After the linking
“Program” Competency
“Course” Learning
Objectives
Step #4

Link Activities – Instructor select the method to assess
the course learning objectives with identified activities
(quiz items, rubrics, assignments, discussions)
Step #5

Set assessment criteria – Instructor sets the threshold
to assess the learning objectives (e.g ≥ 60% of
overall quiz score)
Competencies Reports
Reports – by learning objectives
Individual student report by objective
Overall Individual report for one competency
“Define Key Terms”
D2L Insights Reports – JP generates course
and department reports


https://documentation.desire2learn.com/en/Standard
%20reports
Other D2L Insights reports include:
Standard Report
 Accreditation report
 Competencies report
 Grade report
 Enrollment report

IT-208 – Fundamental of Manufacturing Process, Fall 2014
Important considerations


Use standard conventions in D2L to avoid confusions,
including university-wide common assessment
terminology.
Use measurable verbs in learning objectives, so that
they can be assessed using learning activities.
http://www.marshall.edu/assessment/Resources/BloomsTaxonomyVerbs.pdf

A learning objective can be assessed with more
than one activities, and vice versa.
D2L demonstration
Thank You