Transcript Document

INTRODUCTION TO
MONITORING AND EVALUATION
Monitoring and Evaluation
The National Democratic Institute
INTRODUCTIONS/
GROUND RULES
• Introductions
• Ground Rules
• Ice Breaker Exercise
INTRODUCTION TO
MONITORING AND EVALUATION
OBJECTIVES
• To understand the importance of
monitoring and evaluation, key
concepts and frameworks
• To consider how gender can be
incorporated into M&E
TOPICS
•
•
•
•
•
•
•
What is M&E?
Why engage in M&E?
Gender and M&E
Logical framework approach
Project lifecycle
Data collection and analysis
Evaluation design
KEY TERMS
•
•
•
•
•
•
Indicator
Input
Output
Intermediate result
Outcome
Objective
•
•
•
•
•
Goal
Target
Baseline
Impact
Gender
EXERCISE: WHAT IS MONITORING
AND EVALUATION (M&E)?
Image: www.pixabay.com
MONITORING
• Continuous internal management
activity
• Ensures that project is on track
• Measures progress towards objectives
• Identifies problems
EVALUATION
• Assessing whether a project is achieving
its intended objectives
• Conducted periodically
• Internal or external
• Focuses on outcomes and impacts
WHY IS M&E IMPORTANT?
•
•
•
•
•
•
•
Tracking resources
Feedback on progress
Improving project effectiveness
Informing decisions
Promoting accountability
Demonstrating impact
Identifying lessons learned
GENDER AND M&E
• Gendered priorities, constraints and
impact
• Failure to address gender leads to
inefficient and unsustainable results
and exacerbates inequities
GENDER ANALYSIS
• Can be undertaken at any stage but
most effective if included in design
• Systematic way of analyzing different
roles and impacts
• Asks the “who” questions
• How this will affect women and men?
MEASURING WOMEN’S
PARTICIPATION AND IMPACT
• Lack of reliable data on basic facts
• Keeps us from getting the most out of
investments
• “What gets measured gets done”
• Not enough invested in collecting data
nor in quantifying how equality yields
benefits
Photo: Getty Images
EXAMPLE: MEASURING IMPACT
Women’s representation/leadership on
Indian local councils:
• Better access to drinking water and
immunizations
• Higher career aspirations and
educational attainment for girls
Photo: Keith Bedford, International Herald Tribune
LOGICAL FRAMEWORK
Goal
Strategic
Objectives
Intermediate
Results
Outputs
Activities
Processes
Monitor
Outcomes
Evaluate
LOGICAL FRAMEWORK
Goal (impacts)
Long-term, widespread
beyond the life of the project
Objective
Change: Effect of intermediate results on
target or beneficiaries by the end of the
project
Intermediate
results
Benefits: Intermediate effects of outputs
on target or beneficiaries
Outputs
Deliverables: Products/services produced
Activities
Services: Tasks needed to reach outputs
Inputs
Resources: Financial, human and material
LOGICAL FRAMEWORK
EXAMPLE
Goal: More participatory, inclusive political processes
IF
IF
IF
IF
IF
Objective: Political parties more inclusive,
representative of member concerns
THEN
Intermediate result: Parties implement reforms to
increase participation in platform development
THEN
Output: Parties develop action plans to increase
participation in platform development
THEN
Activities: Multi-party workshops on participatory
platform development; party consultations
THEN
Inputs: Staff, consultants, grant budget,
training guides
EXERCISE: LOGFRAME RACE
Put the logframe components in the right order
Photo: David Mark, www.pixabay.com
INDICATORS
• Outcome versus process indicators
• Qualitative versus quantitative
• SMART
– Specific
– Measurable
– Achievable
– Relevant
– Time-bound
Photo: www.pixabay.com
BASELINES AND BENCHMARKS
• Baseline
– Situation before project
– Demonstrates change
over time
• Benchmarks
– What you hope to
achieve by the end
• Targets
– Intermediate
benchmarks
Photo: www.pixabay.com
SEX-DISAGGREGATED
INDICATORS
• Sex-disaggregated indicator measures
change for men and women separately
• Gender indicator measures genderrelated changes
GENDER AND THE LOGFRAME
Evaluation
Monitoring
Empowerment;
overall well-being
Goal
Closing gender
gaps
Objective
Benefits for
women and men
Intermediate
results
Integration of
gender
Activities
Gender equity in
allocation of
resources
Inputs
PROJECT LIFE CYCLE
Phase 4: Project Evaluation
-Collect and analyze data
-Produce reports
-Identify lessons learned
Phase 1: Project Design
-Identify problem
-Develop logframe
-Develop M&E plan
M&E Life
Cycle
Phase 3: Project Management
-Analyze data and produce
reports
-Manage activities
Phase 2: Project Start-up
-Conduct baseline
-Establish targets
-Establish M&E systems
GENDER MAINSTREAMING AND
THE PROJECT LIFE CYCLE
Knowledge sharing
1. Design
Gender-sensitive
M&E
4. M&E
Gender analysis/needs
assessment
Gender expertise
Adequate
resources
Gender-specific
action/capacity building
3. Implementation
2. Start-up
Gender planning
GENDER MAINSTREAMING
STRATEGIES/TOOLS
• Involve women and men in
consultations
• Include sex-disaggregated data
• Strive for gender balance in
staff/experts
• Enable women and men to participate
and benefit equally
PROJECT DESIGN QUESTIONS
•
•
•
•
•
Goals and objectives gender-sensitive?
Input from men and women?
Baseline incorporates gender analysis?
Consultations on targets?
Activities reflect gender sensitivity?
PROJECT IMPLEMENTATION
QUESTIONS
•
•
•
•
•
•
•
•
Gender and sex-disaggregated data?
Comparing data to baseline?
M&E data used to adjust project?
Women’s groups monitoring progress?
Findings disseminated?
References to gender in reports?
Women involved in activities?
Women accessing services?
PROJECT EVALUATION
QUESTIONS
•
•
•
•
•
•
Differences in access? Why?
Differences in impact? Why?
How can differentials be addressed?
How do results compare to targets?
How did beneficiaries respond?
Are results sustainable?
Photo: Sanja Gjenero, RGBstock.com
DATA COLLECTION AND
ANALYSIS
• Forms and procedures for data
collection
• Data collection plan by indicator
• Trained staff with clear roles and
responsibilities
• Database
• Regular reflection sessions
SECONDARY DATA SOURCES
•
•
•
•
•
•
Regional or country MDG reports
UNDP Human Development reports
State Department Human Rights reports
World Bank reports
World Economic Forum
Donor and NGO reports
EXERCISE: INTEGRATING GENDER
• Are the indicators gender aware?
• Are they input, output, outcome or impact
indicators?
• Are they quantitative or qualitative?
• How would you make them more genderaware?
• Identify 3 additional indicators and how data
would be collected.
Photo: World Bank
EVALUATION DESIGN
• Identify research questions
• Identify methods for data collection
• Develop and test data collection
instruments and protocols
EVALUATION CRITERIA
•
•
•
•
•
Relevance
Effectiveness
Efficiency
Impact
Sustainability
Photo: Sanja Gjenero, RGBstock.com
INTRO TO M&E REVIEW
• Improve project effectiveness,
demonstrate impact, and identify lessons
learned
• Must address and mainstream gender
• Logframe with sex-disaggregated and/or
gender-specific indicators
• System for data collection and analysis
• Evaluate relevance, effectiveness,
efficiency, impact, and sustainability