The second edition of the Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policy makers and development practitioners. First published in 2011, it has been used widely across the development and academic communities. The book incorporates real-world examples to present practical guidelines for designing and implementing impact evaluations. Readers will gain an understanding of impact evaluations and the best ways to use them to design evidence-based policies and programs. The updated version covers the newest techniques for evaluating programs and includes state-of-the-art implementation advice, as well as an expanded set of examples and case studies that draw on recent development challenges. It also includes new material on research ethics and partnerships to conduct impact evaluation. The handbook is divided into four sections: Part One discusses what to evaluate and why; Part Two presents the main impact evaluation methods; Part Three addresses how to manage impact evaluations; Part Four reviews impact evaluation sampling and data collection. Case studies illustrate different applications of impact evaluations. The book links to complementary instructional material available online, including an applied case as well as questions and answers. The updated second edition will be a valuable resource for the international development community, universities, and policy makers looking to build better evidence around what works in development.

Public programs are designed to reach certain goals and beneficiaries. Methods to understand whether such programs actually work, as well as the level and nature of impacts on intended beneficiaries, are main themes of this book.

State aid impact evaluation is new in Romania. Given its novelty, the ex post evaluation seeks to provide evidence on how effective state aid has been, on whether state aid distorted competition, and on the implications for state aid design and implementation. These aspects are fundamental to improving the efficiency of public spending and minimizing market distortions. The ex post evaluation focuses on three state aid schemes to assess whether and to what extent the aid objectives have been fulfilled, and it measures their spillover effects as well as the effects on competition outcomes. Selected based on the their importance in supporting key policy objectives, their design and complexity, and the instruments used, the three schemes include de minimis aid implemented by the Romanian Counter-Guarantee Fund and designed to incentivize access to finance for micro, small, and medium enterprises (MSMEs); state aid granted by the Ministry of Public Finance to support regional development and job creation; and state aid provided by the Ministry of European Funds to support the upgrade and modernization of research, development, and innovation. The analysis finds evidence that the state aid schemes met their objectives without distorting competition significantly. The results for the de minimis scheme to incentivize access to finance for micro, small, and medium enterprises showed that the scheme increased employment and turnover of beneficiary firms and reduced the probability of aided firms closing. The state aid scheme to support regional development and job creation fulfilled its main objectives, with robust evidence of a positive direct effect on employment creation and, to some extent, on investment. Regarding the state aid scheme to support the upgrade and modernization of research, development, and innovation, the analysis found evidence that the scheme helped promote research and development efforts.

Development Research in Practice leads the reader through a complete empirical research project, providing links to continuously updated resources on the DIME Wiki as well as illustrative examples from the Demand for Safe Spaces study. The handbook is intended to train users of development data how to handle data effectively, efficiently, and ethically. “In the DIME Analytics Data Handbook, the DIME team has produced an extraordinary public good: a detailed, comprehensive, yet easy-to-read manual for how to manage a data-oriented research project from beginning to end. It offers everything from big-picture guidance on the determinants of high-quality empirical research, to specific practical guidance on how to implement specific workflows—and includes computer code! I think it will prove durably useful to a broad range of researchers in international development and beyond, and I learned new practices that I plan on adopting in my own research group.†? —Marshall Burke, Associate Professor, Department of Earth System Science, and Deputy Director, Center on Food Security and the Environment, Stanford University “Data are the essential ingredient in any research or evaluation project, yet there has been too little attention to standardized practices to ensure high-quality data collection, handling, documentation, and exchange. Development Research in Practice: The DIME Analytics Data Handbook seeks to fill that gap with practical guidance and tools, grounded in ethics and efficiency, for data management at every stage in a research project. This excellent resource sets a new standard for the field and is an essential reference for all empirical researchers.†? —Ruth E. Levine, PhD, CEO, IDinsight “Development Research in Practice: The DIME Analytics Data Handbook is an important resource and a must-read for all development economists, empirical social scientists, and public policy analysts. Based on decades of pioneering work at the World Bank on data collection, measurement, and analysis, the handbook provides valuable tools to allow research teams to more efficiently and transparently manage their work flows—yielding more credible analytical conclusions as a result.†? —Edward Miguel, Oxfam Professor in Environmental and Resource Economics and Faculty Director of the Center for Effective Global Action, University of California, Berkeley “The DIME Analytics Data Handbook is a must-read for any data-driven researcher looking to create credible research outcomes and policy advice. By meticulously describing detailed steps, from project planning via ethical and responsible code and data practices to the publication of research papers and associated replication packages, the DIME handbook makes the complexities of transparent and credible research easier.†? —Lars Vilhuber, Data Editor, American Economic Association, and Executive Director, Labor Dynamics Institute, Cornell University

An effective state is essential to achieving socio-economic and sustainable development. With the advent of globalization, there are growing pressures on governments and organizations around the world to be more responsive to the demands of internal and external stakeholders for good governance, accountability and transparency, greater development effectiveness, and delivery of tangible results. Governments, parliaments, citizens, the private sector, NGOs, civil society, international organizations and donors are among the stakeholders interested in better performance. As demands for greater accountability and real results have increased, there is an attendant need for enhanced results-based monitoring and evaluation of policies, programs, and projects. This Handbook provides a comprehensive ten-step model that will help guide development practitioners through the process of designing and building a results-based monitoring and evaluation system. These steps begin with a OC Readiness AssessmentOCO and take the practitioner through the design, management, and importantly, the sustainability of such systems. The Handbook describes each step in detail, the tasks needed to complete each one, and the tools available to help along the way."

'The Road to Results: Designing and Conducting Effective Development Evaluations' presents concepts and procedures for evaluation in a development context. It provides procedures and examples on how to set up a monitoring and evaluation system, how to conduct participatory evaluations and do social mapping, and how to construct a "rigorous" quasi-experimental design to answer an impact question. The text begins with the context of development evaluation and how it arrived where it is today. It then discusses current issues driving development evaluation, such as the Millennium Development Goals and the move from simple project evaluations to the broader understandings of complex evaluations. The topics of implementing 'Results-based Measurement and Evaluation' and constructing a 'Theory of Change' are emphasized throughout the text. Next, the authors take the reader down 'the road to results, ' presenting procedures for evaluating projects, programs, and policies by using a 'Design Matrix' to help map the process. This road includes: determining the overall approach, formulating questions, selecting designs, developing data collection instruments, choosing a sampling strategy, and planning data analysis for qualitative, quantitative, and mixed method evaluations. The book also includes discussions on conducting complex evaluations, how to manage evaluations, how to present results, and ethical behavior--including principles, standards, and guidelines. The final chapter discusses the future of development evaluation. This comprehensive text is an essential tool for those involved in development evaluation.

Small and medium enterprise (SME) support programs are a common feature of industrial policy in developing countries, but one whose effectiveness is not well known. Governments are motivated to support SMEs both because they make up the majority of industrial enterprises and contribute substantially to GDP, employment and earnings, and because SMEs are thought to be weaker than their larger counterparts. Few governments, however, have evaluated their SME programs rigorously so there is little empirical basis for rational allocation of resources to the well performing programs. The paucity of empirical evidence from rigorous impact evaluations also presents problems for multi-lateral and bilateral donors in deciding whether or not to provide lending or aid for such policy interventions to promote SME development. This study rigorously evaluate SME programs in four Latin American countries to gain insights into which programs perform better than others, and just as important, why. These countries Mexico, Chile, Colombia and Peru cover a wide range of enterprise support programs, including training, innovation and technology upgrading, quality control, market development, export promotion and network formation. Broadly comparable panel data on enterprises is used to investigate the net impacts of these SME interventions.