Transcript Needs Assessment, the importance of M&E - INASP

Needs Assessment, the
importance of M&E
Session 2: Pedagogy Skills
Workshop
Monitoring and evaluation
Assess
Design
Develop
Implement
Evaluate
Assessment
Kevin Chen2003, Wikimedia
Learning Objectives
• By the end of this session, you will:
– Know why undertaking M&E (assessment
for learning) is important
– Know the difference between formative and
summative assessment techniques
– Recognise that training is an iterative
process and be able to adjust your
approach based on participant feedback
What is Assessment?
What is Assessment?
• “all those activities undertaken by trainers -- and
by their participants in assessing themselves -that provide information to be used as feedback to
modify teaching and learning activities.”
This is a general definition that applies to trainers,
but the emphasis on the iterative element can
apply, in a broader sense, to other activities and
professions.
Black, P. & Wiliam, D. 1998. Inside the Black Box: Raising standards through classroom assessment, King’s College, London
Formative
Summative
Assessment
L.Miguel Bugallo Sánchez, Wikimedia
When to assess learning?
• Two primary categories:
– Formative: Occurs while the training is
being designed, developed, and delivered.
– Summative: Usually completed
immediately after training is finished
• Can also be conducted over the course of weeks or
months after training.
M&E cycle
Pre-training
assessment
During training
Formative assessment
Post-training
Summative
assessment
Pre-Assessment?
Needs Assessment
“a window of opportunity”
Pre-assessment methods
•
•
•
•
Needs analysis questionnaire or survey
Pre-diagnostic surveys
Pre-training tasks
Scoping exercises
– Context analysis
– Audience analysis
– Attitude analysis
• Focus groups
• One on One interviews
Assessment during training
• There are several ways to evaluate the
effectiveness of training while it is taking
place
• ... For example...
Questions
Closed
Open
Clarifying
Solomon203, Wikimedia
Instant response tool
Traffic light system
Don’t understand, I
need help!
I partially
understood, but
require some points
clarifying
I’m confident, and
ready to try independently
During training delivery
methods
•
•
•
•
•
•
•
•
Quizzes / mini questionnaires
Participant demonstrations / presentations
Mood / confidence indicators
Practicals / group activities
Games
Probing questions
Focused discussions
Reflective exercises
Summative assessment
• There are several ways to evaluate the
effectiveness of training after training is
conducted.
– Post training questionnaires
– Post training debrief
– Post training task / activity
– Interviews
– Reflective journals
– Recorded observations
Task
What training
assessments do you
make?
Discuss in groups - 30 minutes
Assessment = Monitoring & Evaluation
Task
• List your approaches & cluster into formative /
summative groups:
Example 1
The M&E I undertake
are….
Example 2
Example 4
Example 3
Task
Discuss & write examples under appropriate heading
Task
Task
What outcomes will these
assessment methods achieve
at:
trainer level
 individual level
 institutional / organisational level
 societal level
Importance of M&E
• M&E should be woven into the course design,
development and delivery
• Summative assessment provides evidence of
impact, training quality and learning
• Evidence can bring about positive changes
– in institution (leverage more resources,
support…)
– in individuals (better grasp of concepts)
– in society (accountability, employability)
http://opendocs.ids.ac.uk/opendocs/bitstream/handle/123456789/2893/6758_IDS_
toolkit_Interactive.pdf?sequence=1
Learning Outcomes
By the end of this session, you will:
• Be able to identify formative and summative
assessment methods
• Understand why you use a range of techniques to
assess knowledge and fill learning gaps
• Begin to be more focused on assessment in your
training
Course materials developed by
Siobhan Duvigneau
Information Literacy manager, IDS
[email protected]
This work is licensed under a Creative Commons AttributionShareAlike 3.0 Unported License.
21/07/2015
24