Public programs are designed to reach certain goals and beneficiaries. Methods to understand whether such programs actually work, as well as the level and nature of impacts on intended beneficiaries, are main themes of this book.

The second edition of the Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policy makers and development practitioners. First published in 2011, it has been used widely across the development and academic communities. The book incorporates real-world examples to present practical guidelines for designing and implementing impact evaluations. Readers will gain an understanding of impact evaluations and the best ways to use them to design evidence-based policies and programs. The updated version covers the newest techniques for evaluating programs and includes state-of-the-art implementation advice, as well as an expanded set of examples and case studies that draw on recent development challenges. It also includes new material on research ethics and partnerships to conduct impact evaluation. The handbook is divided into four sections: Part One discusses what to evaluate and why; Part Two presents the main impact evaluation methods; Part Three addresses how to manage impact evaluations; Part Four reviews impact evaluation sampling and data collection. Case studies illustrate different applications of impact evaluations. The book links to complementary instructional material available online, including an applied case as well as questions and answers. The updated second edition will be a valuable resource for the international development community, universities, and policy makers looking to build better evidence around what works in development.

There are many reasons why strategic intelligence is required to support policy decisions. These primarily stem from the nature of today's kno- edge society with two contrasting trends. On the one hand, there is a trend of increasing human intelligence in the economic, social and political s- tems. On the other hand, there is a trend towards dissolving certainties about the problems and solutions of today's society. Clearly, more inf- mation does not necessary imply more certainties on how to act. What is more, the same facts are often interpreted in markedly different ways: the same policy relevant information can – and often does – results in confli- ing framing of a problem by different stakeholders. This is mainly due to competing assumptions, rather then because of inconsistent facts. The- fore, it is not surprising that policy-makers are calling for strategic intel- gence to support their understanding of today's challenges, including the relevant aspects of science and technology, their impact and their possible future developments. Over the last 15 years, Europe has rapidly adopted the practice of dev- oping and using Impact Assessment (IA) tools to support decision-making. Formal procedures and guidance for IA are well established within the European Commission and in most EU Member States. The adoption of IA procedures alone, however, does not guarantee that every policy domain is actually using the full potential of these assessment tools in the preparation of policies and legislation.

‘Represents the culmination of an 18-month-long project that aims to be the definitive review of this important topic. Accompanied by a scholarly literature review, some new analysis, and a wealth of evidence and insight... the report is a tour de force; a once-in-a-generation opportunity to take stock.’ – Dr Steven Hill, Head of Policy, HEFCE, LSE Impact of Social Sciences Blog ‘A must-read if you are interested in having a deeper understanding of research culture, management issues and the range of information we have on this field. It should be disseminated and discussed within institutions, disciplines and other sites of research collaboration.’ – Dr Meera Sabaratnam, Lecturer in International Relations at the School of Oriental and African Studies, University of London, LSE Impact of Social Sciences Blog Metrics evoke a mixed reaction from the research community. A commitment to using data and evidence to inform decisions makes many of us sympathetic, even enthusiastic, about the prospect of granular, real-time analysis of our own activities. Yet we only have to look around us at the blunt use of metrics to be reminded of the pitfalls. Metrics hold real power: they are constitutive of values, identities and livelihoods. How to exercise that power to positive ends is the focus of this book. Using extensive evidence-gathering, analysis and consultation, the authors take a thorough look at potential uses and limitations of research metrics and indicators. They explore the use of metrics across different disciplines, assess their potential contribution to the development of research excellence and impact and consider the changing ways in which universities are using quantitative indicators in their management systems. Finally, they consider the negative or unintended effects of metrics on various aspects of research culture. Including an updated introduction from James Wilsdon, the book proposes a framework for responsible metrics and makes a series of targeted recommendations to show how responsible metrics can be applied in research management, by funders, and in the next cycle of the Research Excellence Framework. The metric tide is certainly rising. Unlike King Canute, we have the agency and opportunity – and in this book, a serious body of evidence – to influence how it washes through higher education and research.

Impact evaluation aims to answer whether and to what extent a development intervention has delivered its intended effects, thus enabling evidence-based policy making. The desire for more hard evidence of the effectiveness of development interventions has fueled a growing interest in rigorous impact evaluation in the international development community. This report discusses the fundamental challenge of impact evaluation, which is to credibly attribute the impact, if any, to the intervention concerned. It then discusses the merits and limitations of various impact evaluation methods. It also presents a survey of recent applications of impact evaluation, focusing on the typical evaluation problems looked at, methods used, and key findings. The report includes six case studies and outlines practical steps in implementing an impact evaluation.

Competition authorities are increasingly interested in understanding the impact of their activities on markets and consumers. The goal is to improve competition policy rules and decision-making practices and to get robust evidence on the benefits of competition and competition policy for society as a whole. Discussions with competition authorities, practitioners and academics have shown the need to take stock of the experience gained in this field by the European Commission and to present it in an easily accessible way. The studies collected in this volume – prepared by senior Commission officials and competition policy experts – range from the ex post evaluation of specific policy interventions to the assessment of the broader impact of competition policy. The issues and topics examined include the following: objectives and scope of evaluations by the European Commission; description of counterfactual evaluation techniques used; conditions for a successful ex post evaluation of a competition policy intervention; a wide selection of individual cases covering a variety of economic sectors; applications in merger control, antitrust and State aid; direct benefits of competition policy interventions for consumers; deterrent effects of such interventions on market participants; and macroeconomic outcomes in terms of job creation, productivity and GDP growth. This matchless book assembles within a single volume all that is needed for competition policy analysts and practitioners to undertake ex post economic evaluations. While its collection of state-of-the-art ex post evaluation studies has a clear value for competition authorities, it is sure to be welcomed as well by competition law practitioners in the private sector, who will greatly appreciate the effort made to cast a critical eye on decisions taken in the past. Moreover, it allows for addressing some of the new challenges facing competition policymakers. Fabienne Ilzkovitz is Principal Advisor responsible for the economic evaluation of competition policy within the Directorate-General for Competition of the European Commission, and since 2014, she has coordinated various ex post evaluation projects in the Directorate-General. She is also Associate Professor of Economics in the Solvay Brussels School of Economics and Management at the Université Libre de Bruxelles, Belgium. Adriaan Dierx is Senior Expert on ex post economic evaluation within the Directorate-General for Competition of the European Commission. He has managed a number of studies aimed at assessing the economic impact of the European Commission’s competition policy interventions.