We have been asked by the Executive Board of the International Monetary Fund to undertake an external review of the activities of its Independent Evaluation Office (IEO). This is the second such evaluation in the IEO’s twelve year history. The first review, led by Karin Lissakers (the “Lissakers Report”), was presented to the Board in 2006. That report considered the extent to which the Office had succeeded during its first five years of operation in fulfilling its mandates and made recommendations to enhance its role within the IMF’s institutional architecture. Our report thus focuses on IEO activities since 2006. As set out in the terms of reference of our Panel (see Appendix I), the central objective of this report is to evaluate how well the IEO has met its institutional mandates. The terms of reference, while not constraining the range of issues we could consider, also asks that we “assess the IEO’s effectiveness along several dimensions, including: (i) the appropriateness of evaluation topics; (ii) the independence of the IEO; (iii) the cost-effectiveness of the IEO and its operations; and (iv) the appropriateness and adequacy of the evaluation process including, but not limited to, how IEO recommendations are endorsed by the Board and implemented.”

The IEO of the IMF was created in 2000 to enhance the learning culture of the IMF, to build the IMF’s external credibility by undertaking objective evaluations in a transparent manner, to provide independent feedback to the Executive Board in its governance and oversight responsibilities, and to promote greater understanding of the work of the IMF among its members and the broader public. In the period October 2005-February 2006, the Evaluation Panel assessed how well the IEO meets these objectives, asking at the outset whether the IMF needs an IEO and whether the existing office is adequately independent. The Panel concludes that the IEO has served the IMF well but identifies certain weaknesses and makes recommendations to the IEO and the IMF to address them.

The second edition of the Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policy makers and development practitioners. First published in 2011, it has been used widely across the development and academic communities. The book incorporates real-world examples to present practical guidelines for designing and implementing impact evaluations. Readers will gain an understanding of impact evaluations and the best ways to use them to design evidence-based policies and programs. The updated version covers the newest techniques for evaluating programs and includes state-of-the-art implementation advice, as well as an expanded set of examples and case studies that draw on recent development challenges. It also includes new material on research ethics and partnerships to conduct impact evaluation. The handbook is divided into four sections: Part One discusses what to evaluate and why; Part Two presents the main impact evaluation methods; Part Three addresses how to manage impact evaluations; Part Four reviews impact evaluation sampling and data collection. Case studies illustrate different applications of impact evaluations. The book links to complementary instructional material available online, including an applied case as well as questions and answers. The updated second edition will be a valuable resource for the international development community, universities, and policy makers looking to build better evidence around what works in development.

Since October 2012, the Executive Board has discussed two IEO evaluation reports, International Reserves—IMF Concerns and Country Perspectives on December 7, 2012, and The Role of the IMF as Trusted Advisor on February 1, 2013. The Board also discussed the External Evaluation of the IEO on March 21, 2013. In addition, the IEO advanced work on the ongoing “Assessment of Self-Evaluation in the IMF,” which will go forward to the Executive Board in coming months. Following consultations on possible topics, the IEO has also initiated evaluations on IMF forecasting, country statistics, and the IMF’s response to the global financial crisis.

This book provides a rigorous application of international legal rules governing the proper interpretation of the institutions' mandates.

This volume examines how independent evaluation contributes to the legitimacy and effectiveness of the IMF. It describes the evolution and impact of the Independent Evaluation Office ten years after its creation as well as the challenges it has faced. It also incorporates feedback from a wide range of internal and external actors and offers useful insights for international organizations, academics, and other global stakeholders.