“Learning from Existing Evaluation Practices on the Impacts and Effects of Intellectual Property on Development” Evaluation Section Internal Audit and Oversight Division (IAOD) World.
Download ReportTranscript “Learning from Existing Evaluation Practices on the Impacts and Effects of Intellectual Property on Development” Evaluation Section Internal Audit and Oversight Division (IAOD) World.
“Learning from Existing Evaluation Practices on the Impacts and Effects of Intellectual Property on Development” Evaluation Section Internal Audit and Oversight Division (IAOD) World Intellectual Property Organization (WIPO) Geneva 6th/7th October 2011 2 Why do we need evaluation? It contributes towards a UN system evaluation policy that promotes learning, accountability and transparency Provides the Organization and MS with valuable analysis and information that can be used for: Decision-making processes concerning the improvement of present and future activities; Policy formulation and review by Member States; and, Evaluation is an organizational function focusing on institutional learning and accountability towards constituencies. 3 Is the Evaluation Section Independent? Director General WIPO General Assembly Director IAOD PBC IAOC Audit Section Evaluation Section Investigation Section 4 IAOD Organigram Nick Treen Director IAOD S. Nunez Secretary T. Efendioglu Head Internal Audit Senior Internal Auditor (Vacant) S. Woess (Consultant Senior internal Auditor) P. Mehta (Intern) Head Evaluation C. Hilfiker J. Flores Senior Evaluator S. Winter Intern J. Van Hecke Head Investigation (Temp. Assignment) S. Wiggins Investigation Assistant 5 How was the Evaluation Section created? Evaluation Section functioning only intermittently due to lack of staff Evaluation was non existent in WIPO Previous 2001 First evaluation intents 2002 Second evaluation intents 2004 Evaluation is an ad-hoc activity First evaluation policy 2007 Evaluation Section is created with 2 post. 1 post filled and 1 vacant 2008 Evaluation Guidelines, and An Evaluation Framework is put in place through: •Revised evaluation policy, •Evaluation Section Strategy, Evaluation Section consist of 1 Head of Evaluation, 1 Senior Staff and 1 intern Evaluation Focus on core business Section Work Plans 2009 2010 Process of institutionalizing the Evaluation Function 2011 Evaluation becomes effective! 2011 6 What has been done since 2007? up to 2007: Monitoring and Independent Evaluation: Program Performance Report (PPR) Providing support to the development of indicators Training staff in the development of Frameworks Developping Program and Budget Narratives Support RBM From 2008: ES starts defining its core function: Independent review of the PPR process Self Evaluation Guidelines for Managers Revision of first WIPO Evaluation Policy Evaluation Guidelines Evaluation Work Plans Evaluation Strategy Creation of an Evaluation Section Website Dissemination of evaluative information First country portfolio evaluation First evaluation seminar 7 By which framework is the Evaluation Section’s work guided? Internal Audit and Oversight Charter UN Norms and Standards for Evaluation WIPO Evaluation Policy and Evaluation Guidelines Evaluation Section Strategy Evaluation Section Biennial Work Plans Topics, Objectives, Program Performance and Country Evaluations Evaluation Section Annual Reporting 8 Current work underway: Country Portfolio Evaluation (CPE) Kenya HOW DO WE SELECT A COUNTRY? 1. Consultation of Director General and Managers 2. Data analysis using specific criteria looking at 184 countries • • • • • Level of WIPO activity by country Baseline information International Context like UN Security Rating System, Economy Level, availability of a national IP strategy, etc. IP Statistics at national and international level IP Index 3. Geographical and strategic priority using evaluability and feasibility assessment 9 Current work underway: CPE Kenya Main Characteristics of CPEs 1. CPEs focus on the entire WIPO assistance to a country 2. CPEs address issues of strategic alignment, choices as well as performance and results 3. CPEs are utilization focused evaluations. They are designed to benefit WIPO management and IP offices and partners in the countries How is a CPE process being rolled out? 1. The Kenya CPE process started beginning 2010 with the planning and scoping of the evaluation including consultation of WIPO staff 2. An Evaluability Assessment was undertaken 3. Strengthening the evaluation process by selecting an evaluators team, setting up an LRG, undertaking an inception report 4. Report preparation 5. Dissemination 6. Preliminary findings reported to the DG 7. Evaluation includes management response Where do we want to go Evaluation Policy and Strategy: Continue to implement the current policy and strategy Institutionalize evaluation Deliver more evaluation findings and information Revise strategy as needed 1 UNDERTAKING OF INDEPENDENT EVALUATIONS To deliver independent, credible and high quality evaluations that identify what works to developing a balanced and accessible international IP system and what can be replicated and scaled up. Creating a Common Understanding 2 CREATE COMMON UNDERSTANDING OF WIPO’S INDEPENDENT EVALUATION FUNCTION To contribute to strengthen and enhance the independent evaluation function and evaluation capacities for the benefit of WIPO and its stakeholders 12 Types of Evaluations Pursue Validation of Program Performance Reports Accuracy and verifiability of the performance data Sufficiency and comprehensive of reported data Accessibility of data and the efficiency of its collection Accuracy of the self-assessment of achievement Clarity of reporting Nearly two-thirds of the results validated, related to the relevance and value of the indicators Performance measures are primarily utilized for purposes of accountability to Member States Ongoing Kenya Country Portfolio Evaluation Inception Mission Completed (September 2011) Main Mission in October 2011 Results available in December 2011 Initial findings suggest that Kenya has received successful support and Consequently is reaching the « critical mass » in terms of the sustainability of it’s IP system Stakeholders have shown a keen interest in this evaluation Pursue the Enhancement of the Evaluation Function (e.g. Evaluation Seminars) If rated successful, we will repeat this type of seminars your opinion at the end of the seminar will be much appreciated ( a feedback form is being distributed)