Transcript Slide 1
Developing SEA Change’s Evaluation Plan Annual Members’ Meeting Track A November 10, 2011 Purpose of the Session • To develop parts of an evaluation plan for the second year of SEA Change • To provide participants with a participatory M&E planning experience Agenda • Review the stages of M&E and the steps for M&E planning • Conduct a stakeholders’ analysis • Define the purpose of the evaluation • Develop key evaluation questions • Identify data sources and collection methods • Discuss next steps Stages of M&E Plan the Evaluation Report & Use the Results Engage Stakeholders Analyze & Interpret Information Collect Information Reasons for Participatory Evaluation • Obtain better quality data • Because the evaluation will be more relevant, more likely to have the results used • Foster greater ownership • Develop evaluation capacity An evaluation plan is your roadmap (University of Wisconsin-Extension, Program Development & Evaluation) Steps to M&E Planning 1. Describe the project 2. Identify major stakeholders and their information needs and uses 3. Define the M&E purpose(s) 4. Formulate M&E questions and indicators 5. Identify sources of information and data collection methods 6. Determine ways to analyze the M&E data 7. Decide how to report and facilitate the use of the M&E results Step 2: Evaluation Stakeholder Analysis Major Stakeholder Groups What information do they need from the evaluation? How will they use the results of the evaluation? Step 3: Define the Purpose(s) of the Evaluation How will the information be used? Underlying purpose = Common Purposes for M&E To be accountable and report to: • Donors • Program participants and community members • Government To improve program (re)design, planning and implementation To obtain additional resources To advocate for particular issues To acknowledge and celebrate our successes Other ??? Step 3: Define Our Evaluation Purposes In your work groups, write a purpose statement: “We are conducting an evaluation of SEA Change in order to obtain information that will be used to: – – – – Steps to M&E Planning Describe the project Identify major stakeholders and their information needs and uses Define the M&E purpose(s) 1. Formulate M&E questions and indicators 2. Identify sources of information and data collection methods 3. Determine ways to analyze the M&E data 4. Decide how to report and facilitate the use of the M&E results Step 4: Formulate Evaluation Questions What are Evaluation questions? • Information needs stated as questions • State what aspects or topic of the project will be addressed in the evaluation Provide: Focus Clarity Time to focus, focus, focus . . . (University of Wisconsin-Extension, Program Development & Evaluation) Step 4: Formulate Evaluation Questions What are typical types of evaluation questions? Use the Logic Model • What project activities have been implemented? Have they been implemented as planned? If not, why not? • To what extent have expected outcomes been achieved? Step 4: Formulate Evaluation Questions Other types of evaluation questions: • • • • • Efficient use of resources? Effective in achieving project objectives? Is the project relevant? Are the activities and/or outcomes sustainable? To what extent has the project achieved its expected impact? Step 5: Decide Sources of Information and Data Collection Methods Where will the information come from to answer the evaluation questions? What methods will be used to collect that information? Data Collection Plan Project Element or Topic Evaluation Question Data Source and Collection Method Next Steps • Sign up for the Evaluation Committee, if you’re interested • How should be share this with the rest of the CoP? • How should we share this with Track B?