Transcript Indicator Performance Tracking Table

Indicator Performance
Tracking Table
(adapted from FANTA II)
M&E Capacity Strengthening
Workshop Addis Ababa
4 to 8 June 2012
Arif Rashid, TOPS
What is IPTT?
“The indicator performance tracking table
(IPTT) …includes performance indicators (at the
impact, outcome and output levels) linked to
the food aid program proposal’s objectives, and
baseline and target values for each indicator
(estimated)”
Source: http://www.usaid.gov/our_work/humanitarian_assistance/ffp/ffpib_09.06.pdf
Slide # 1
Purpose of IPTT
Criteria for reviewing an IPTT to help ensure
that it
• helps you to improve your program
• helps you to meet your reporting
requirements and
• helps you conduct M&E in ways that are
not too costly or burdensome.
Slide # 2
How will you use your IPTT?
Slide # 3
How will you use IPTT? – 15 minutes
• Identify two volunteers in your group.
• The first volunteer: take a copy of your IPTT and do the
following:
• Choose one indicator and explain to your group how you will
use it to report to Food for Peace.
• Choose a different indicator and explain how you will use it to
improve your program.
• Choose a different indicator and explain how you will use it to
“tell your story” (to tell other organizations, other funders,
communities or beneficiaries about your project).
• The second volunteer should repeat the same.
Slide # 4
How will you use IPTT? – 15 minutes
As a group, please select one section of your IPTT.
Then look over each indicator in that section and LABEL
each indicator as helping you to:
• Fulfill reporting requirements
• Improve your program
• Tell your story.
• NONE OF THE ABOVE.
JUST LABEL, DON’T MAKE REVISIONS YET
Please take 15 minutes for this exercise.
Slide # 5
How will you use IPTT? – 15 minutes
Tell your group members:
• One thing that you found out about indicators
or your IPTT that you didn’t know before.
• One thing you plan to do differently as a result
of what you’ve learned.
Slide # 6
How are RF and Indicator levels related?
Overarching
Goal
Impact Indicators/
Higher Outcome Indicators
Medium/ Immediate
Outcome Indicators
Strategic
Objective 1
Intermediate
Result 1.1
Intermediate
Result 1.2
Strategic
Objective 2
Intermediate
Result 2.1
Outputs
Processes
Inputs
Activities:
a)
b)
c)
Activities:
a)
b)
c)
Activities:
a)
b)
c)
Slide # 7
Need indicator at every level
Goal
SO


IR

Activities

Farm incomes
increased
Production of non-traditional crops
increased
20 Farmers planted the new crop and followed the
intercultural practices learned from the project
Project trained 50 farmers on non
traditional crops, and distributed seeds
and fertilizer
Slide # 8
Linking Indicators to RF
• In small groups take the activity assigned to you and
create 3 indicators to measure the causal chain the
activity is part of, one at each level, output, outcome,
impact:
– Activity 1: Training on proper hand washing techniques
– Activity 2: Training farmers on improved crop
management techniques
– Activity 3: Training on crop storage systems
• You have 15 minutes- 5 minutes per indicator! Use the
worksheet in the binder
• Be prepared to share your indicators with the rest of the
participants
Slide # 9
Develop Indicators at Each Level
Activity assigned to your working group:
Level of the
Indicator (result)
General Guideline
Impact (SO level)
The change in the condition or situation of the
population
Measures the highest level of change your project
is responsible for bringing about
Outcome (IR level)
Very often this is a behavior (acting,
practicing) or knowledge change, but not
always. There are higher and lower level
outcomes, i.e. the higher level outcome
could be increases in production while a
lower level outcome would be the practices
that a beneficiary uses.
Output (activity
level)
Direct product of the implementer’s activities
Your Proposed
Indicator
Slide # 10
IPTT Checklist Criteria
What to ask yourself when
developing or assessing your IPTT
Slide # 11
What jobs can your indicator do?
Does each indicator serve at least one of the following purposes:
• reporting,
• telling your story or
• improving your program?
• For example: does it provide other interesting
information– i.e. information that indicates whether the
food security situation is improving? whether communities
and beneficiaries are making progress? how well we are
doing in implementing?
Slide # 12
Does each indicator measure a specific
result?
Overarching
Goal
Impact Indicators/
Higher Outcome Indicators
Medium/ Immediate
Outcome Indicators
Strategic
Objective 1
Intermediate
Result 1.1
Intermediate
Result 1.2
Strategic
Objective 2
Intermediate
Result 2.1
Outputs
Processes
Inputs
Activities:
a)
b)
c)
Activities:
a)
b)
c)
Activities:
a)
b)
c)
Slide # 13
IPTT Checklist Criteria
Is each indicator precise and well
defined enough to give the reader
a clear idea of what is being
measured?
Which is more precise?
1. “% of children malnourished”
OR
2. “% of children 6-59 months in the target
population who are underweight (weightfor-age Z score < -2)”
Slide # 14
IPTT Checklist Criteria
Is it FEASIBLE to collect and analyze the
data for each indicator?
Slide # 15
IPTT Checklist Criteria
Is it FEASIBLE to collect and analyze the
data for each indicator?
Some suggested questions to ask about each
indicator:
• Can you collect its data through either a populationbased household survey, annual survey of
beneficiaries or from program records?
• Does your program have the expertise, resources and
the staff needed to measure this indicator?
• Does it make sense to collect data for this indicator at
the time of year you plan to do so (e.g. baseline,
annual and final surveys)?
• Can you get a big enough sample size to produce
reliable data?
Slide # 16
IPTT Checklist Criteria
Is it FEASIBLE to collect and analyze the
data for each indicator?
• An IPTT should not have too MANY or too FEW
indicators. A BALANCED set of indicators that
captures all three aspects – reporting, telling your
story and improving program management is
expected.
Slide # 17
IPTT Checklist Criteria
Does the IPTT include gendersensitive indicators appropriate to
your RF?
•
Your IPTT should include gender sensitive indicators that:
– Go beyond disaggregation by sex and are not just about women
– Are based on the social context and gender relations (i.e. What
role does gender play in the results the MYAP wants to achieve;
Do mean and women get equal benefits from the project
activities; Who put more labor to carryout activities promoted by
the project?
•
Examples:
– Men’s knowledge about exclusive breastfeeding
– Men’s participation in helping woman get to pre-natal visits
– Ratio of women’s to men’s use of inputs OR increased yields
Slide # 18
IPTT Checklist
Are indicators numbered clearly? Each indicator should have a unique
identifying number so they are easy to refer to
Is each required indicator labeled as such? Required indicators must be
included in the IPTT and it’s helpful if the group requiring the indicator is
mentioned, i.e. (Mission), (FFP), (Government)
Is the wording for each indicator neutral? (E.g. “% of children
exclusively breastfed until 6 months” NOT “increase in the “% of children
exclusively breastfed until 6 months)
PROGRAM GOAL: Reduce Food Insecurity of Vulnerable Populations in
Western Province
SO 1: Improved livelihood capacities of vulnerable households
Impact
1.1 Average Household Dietary
Diversity Score (FFP)
(+)
Outcome
1.2 Percent of trained beneficiaries
(+)
scoring 70% or above on post-test
scores
Slide # 19
IPTT Checklist
•
Are all the targets in the right place (“Annual” vs. “Baseline,
Mid-term Evaluation and Final Evaluation”)
PROGRAM GOAL: Reduce Food Insecurity of Vulnerable Populations in Western
Province
SO 1: Improved livelihood capacities of vulnerable households
Impact
1.1 Average Household Dietary Diversity
Score (FFP)
Outcome 1.2 Percentage of households with
access to an improved sanitation
facility
(+)
(+)
Slide # 20
IPTT Checklist Criteria
Is each target
reasonable?
• Can you reasonably expect to reach the target? Is it
ambitious enough to make a difference to your
beneficiaries?
• Can you justify your targets? For example is the
target based on your organization’s past experience
with a Title II program or another similar program?
Slide # 21
IPTT Checklist
• Are targets clearly defined as
cumulative or not?
• Do all targets match their indicator in
units? Targets are in same format as the indicator (i.e. indicator says
“Number of …” but target says “50%”)
Slide # 22
This presentation was made
possible by the generous
support of the American people
through the United States
Agency for International
Development (USAID). The
contents are the responsibility
of Save the Children and do not
necessarily reflect the views of
USAID or the United States
Government.