Pestalozzi Children‘s Foundation emPower 2012 Monitoring & Evaluation

Lecturers: Beatrice Schulter

   

Objectives

You understand what monitoring and evaluation are and their purpose in successful project management.

You know a variety of monitoring tools and you reflect their use.

You have an insight in different forms of evaluation and you reflect their use.

You are prepared to plan the monitoring and evaluation of projects.

2



Why?

What do we need monitoring and evaluation for?



What?

What is monitoring and what is evaluation?



How?

What are possible monitoring and evaluation tools?

3

Why?

     Monitoring helps us to check, whether we are effective and efficient during implementation Evaluation helps us to check, whether we have been relevant, effective and efficient This is important to improve the quality of our work through learning monitoring → adjust working plans (action plan, budget) evaluation → improve other projects / future project phases etc.

4

Monitoring is…

 A continuing observation that uses systematic collection of relevant and selected data to provide the management and the main stakeholders of a programme/project with indications of the progress and achievement of inputs, outputs, outcome as well as the process.

5

Evaluation is…

 An assessment of a project with regard to its planning, implementation, results  Evaluation makes statements about the relevance of planned outputs/outcome the achievement of the outputs/outcome (effectiveness) the efficiency of the project the sustainability (the impact)  Evaluation makes recommendations on the further development of the projects 6

Monitoring is a process which is…  Focused  Repetitive   in time (periodic, regular) in content    Monitoring is a process which asks...

Do we do the right thing (effectiveness)?

Do we do it the right way (efficiency)?

7

Monitoring scheme

What have we achieved?

(qualitative) Why and how have we (not) implemented something?

Process Monitoring (Inputs)

How much have we achieved?

(quantitative)

Monitoring

What output & outcome has our work?

Results monitoring What strengthens or hinders our work?

Context monitoring 8

Outputs Outcomes Processes Context Monitoring matrix Desired outputs Desired effects Furthering Furthering Undesired outputs Undesired effects Hindering Hindering

9

How to use monitoring results?

   Project learning / Organisational learning Adapting plans (action plan, budget) Controlling 10

Monitoring tools / methods / approaches

   Group work: What kind of monitoring tools/methods/approaches do you know?

Which monitoring tools/methods/approaches are used in your organisation?

11

Monitoring tools

          Work plans Field visit Spot-check visit (Lessons) Observations Participants meetings Stakeholder meetings PLR Surveys Questionnaires Interviews      Tests Official data bases Steering committees All sort of reports - Annual Project Report - Quarterly Project Reports - Reports of the Partner Organisation - School Reports etc.

12



Evaluation is…

An assessment of a project with regard to its planning, implementation, results  Evaluation makes statements about the relevance of planned outputs/outcome the achievement of the outputs/outcome (effectiveness) the efficiency of the project the sustainability (the impact)  Evaluation makes recommendations on the further development of the projects 13

PCF Evaluations

  Mid-term evaluations after project phases I & II Final evaluation after project phase III   Country programme evaluations every 4-6 years PCF international programme evaluation 2007/2008 14

15

16 other axis: e.g. driver donor led, partner led, jointly led, participatory

Role Play: Project Evaluation

    Role play in groups of 5 persons Choose one of your projects in the working group Plan the evaluation of this project advocating for your specific interests Write the most important results in terms of evaluation results, evaluation team, area and people considered and evaluation methods on a flip chart 17