Module 9 – Specific Aspects of the Evaluation of a Project

Download Report

Transcript Module 9 – Specific Aspects of the Evaluation of a Project

Module 2 – Monitoring and Evaluation Definitions

Overview

• Monitoring and evaluation are tools that

make it possible to identify and measure the results of projects, programs or policies

2020-04-29 2

Why the Concern?

• To evaluate and adjust strategies and

activities

• To report on progress to interested

parties, clients, taxpayers and the general public

• To identify and share with others best

practices and lessons learned

• To improve the programming of new

interventions and strategies

2020-04-29 3

Monitoring

• Provides regular information on how

things are working

2020-04-29 4

Monitoring: Definition

• A continuous data collection and analysis

process is implemented to assess a project ( a program or a policy) and compare it with the expected performance

2020-04-29 5

Evaluation

• Evaluation can only be done after a certain

time and requires more thorough investigations

2020-04-29 6

Evaluation: Definition

• A systematic and objective measurement

of the results achieved by a project, a program or a policy, in order to assess its relevance, its coherence, the efficiency of its implementation, its effectiveness and its impact, as well as the sustainability

2020-04-29 7

Monitoring and Evaluation

• Monitoring assesses progress in

implementation of ongoing programs

• Evaluation provides a snapshot against

some benchmarks at a point in time of programs that may or may not be continuing

2020-04-29 8

Monitoring and Evaluation Rationale

• Monitoring – Holds implementers accountable for

delivery of inputs

– Provides basis for corrective action – Provides assessment of continued

relevance

• Evaluation – Accountability - was money well spent? – Learning - what could we do better next

time?

2020-04-29 9

Monitoring and Evaluation - Focus

• Monitoring – Was delivery according to plan? – What were the deviations? • Were they justifiable?Evaluation – Relevance – Appropriateness – Success – Cost effectiveness – Lessons learned – Effectiveness – Impact – Sustainability – Efficiency 2020-04-29 10

Monitoring and Evaluation Timing

• Monitoring – Ongoing or periodic throughout the life of

the program

• Evaluation – Typically at mid-point in a funding cycle, a

year before the end

– Impact evaluation - 3 to 5 years afterwards • Delay depends on the nature of the project 2020-04-29 11

Focus of the Module

• The design and implementation of a

monitoring system will not be addressed here

• There are many documents that you can

review on this topic outside this workshop. Specific training is also available.

2020-04-29 12

Reminder: The Four Basic Components of Any Project, Program or Policy Objectives Program of activities (a strategy) Budget

Basic triangular pyramid 2020-04-29

Calendar

13

Monitoring and Evaluation, and the Chain of Project Results … to undertake activities...

… the direct results of which...

… must have effects...

Resources are mobilized… This chain is based on a series of logical relationships (if… then) called "causal relationships" … and an impact on development Monitoring Evaluation

2020-04-29 14

Logical Structure of a Project or Program Resources are mobilised … to undertake activities...

… the direct results of which...

… must have effects… … and an impact on development Human material and financial resources Activities: building, training, organising, treating, writing ...

Built buildings, trained staff, implemented processes, written legislations… Harvests rescued, higher performing public service, more effective justice system Improved food supply, higher level of education, longer life expectancy, better constitutional State Resources inputs outputs outcomes Impact

2020-04-29 15

Evaluation can be Approached at Three Levels What is the world dynamics ?

General issue of project, program and policy evaluation What is my organization doing in this movement ?

Who leads this movement ?

Are there national specificities ?

Evaluation within the organization Individual practice What is this organization’s (this client) evaluation culture? Its evaluation practices?

Where is research at ?

What do I know how to do ?

What should I know how to do ?

How can I enrich my experience ?

What definitions, vocabulary, practices?

2020-04-29 16