Transcript Dimensions and parameters for the evaluation of e

Dimensions and parameters
for the evaluation of e-learning
Dr. Bernhard Ertl
Why evaluation?
• To ensure the quality of the learning
environment
• To ensure acceptance of the learning
environment
• To learn about learners´ needs
• To prove the value and benefits of the
environment to financers and participants
Results of an Evaluation
• Increased knowledge of learning
processes
• Knowledge of the effectiveness of the
learning environment
Target-group-specific improvements
Evaluation Forms
• Formative Evaluation
– Takes place during the course
• Summative Evaluation
– Takes place at the end of the course
Formative evaluation
Analysis of the learning process:
– Discovering problems
– Optimisation of the learning environment
Summative Evaluation
Analysis of the outcomes:
– Knowledge gain
– Acceptance
Evaluators
• Learners
• Teachers
• Experts
– Internal
– External
Dimensions of evaluation
• Cognitive dimension
– do the learners have the necessary strategies to work
in the learning environment?
• Epistemological dimension
– the structure and implementation of the content
• Social dimension
– available facilitation, tutoring and sociability
• Technical dimension
– usability and technical support offered
Cognitive Dimension
• Learning prerequisites
- Does the learning environment allow learners
to activate existing knowledge?
- Do the learners have required prior
knowledge?
• Learning strategies
- Which strategies are encouraged in the
environment?
- Are the learners supported in their use of
strategies?
Epistemological Dimension
• Appropriateness of content
- Who is the target group?
- Is the content up-to-date?
• Didactical design
- Based on a particular education theory?
- Which concrete learning goals?
• Acceptance
- Would participants recommend the course?
- Did it meet their expectations?
Social Dimension
• Facilitation
- To what extent do the users receive support in
collaborative learning?
- Do tutors and pupils have set roles and
tasks?
• Sociability
- Are the face-to-face and online elements well
integrated?
- Is there a positive social environment within
the groups?
Technical Dimension
• Usability
- Are the tools appropriate and adequate?
- Usability and design of the environment?
• Support
- Is the technical support offered to the users
adequate?
Evaluation Model during Implementation
•
•
Learning
processes
Learning
strategies
•
Learning
strategies
•
•
•
Aims
•
Appropriateness
•
Appropriateness
•
Sociability
•
Didactical
Design
•
Didactical
Design
•
Technical
Support
Learning
prerequisites
•
Learning
prerequisites
•
•
•
Learning
prerequisites
formative
Planning phase
Implementation
Learning
results
Fulfillment
of aims
Acceptance
summative
Pilot
Evaluation during productive Use
Learners in learning environment
formative:
learning process
Addition of
necessary
changes
summative:
outcomes
acceptance
Analysis of
test results
Summary
• Evaluation is key to any e-learning project
• Evaluation may take place continuously
throughout a project
• A number of parameters must be
considered in order to evaluate a learning
environment as a whole
Thank you for your
attention