To improve their education systems, countries around the world have increasingly initiated national largescale assessment programs or participated in international or regional large-scale assessment studies for the first time. Well-constructed large-scale assessments can provide credible information on student achievement levels, which, in turn, can promote better resource allocation to schools, stronger education service delivery, and improved learning outcomes. The World Bank developed this Primer on Large-Scale Assessments of Educational Achievement as a firststop resource for those wanting to understand how to design, administer, analyze, and use the results from these assessments of student achievement. The book addresses frequently asked questions from people working on large-scale assessment projects and those interested in making informed decisions about them. Each chapter introduces a stage in the assessment process and offers advice, guidelines, and country examples. This book also reports on emerging trends in large-scale assessment and provides updated information on regional and international large-scale assessment programs. DIRK HASTEDT, Executive Director of the International Association for the Evaluation of Educational Achievement (IEA) “A special feature of the publication is that it not only gives an overview of technical specifications, but also includes examples from around the world on how countries are conducting large-scale assessments, what they found, and how the results were used. With this perspective, the Primer on Large-Scale Assessments of Educational Achievement is an excellent and easy-to-read publication to get a comprehensive overview of large-scale assessments and how and why they are conducted.†? SILVIA MONTOYA, Director of UNESCO Institute for Statistics (UNESCO UIS) “If you are responsible for learning assessment in a country and are searching for a comprehensive, yet readable, guide on large-scale assessment, this is your book. Extremely well structured and written, this primer is easy to follow, and makes points clearly and concisely. It is an excellent resource that explores the steps for a good large-scale assessment with examples from all international large-scale assessment programs.†? ANDREAS SCHLEICHER, Director for the Directorate of Education and Skills and Special Advisor on Education Policy to the Organization for Economic Cooperation and Development’s (OECD) Secretary- General “Many countries have joined international educational assessments to benchmark quality, equity, and efficiency in their education systems. But what does it take to design and implement those efforts well and to draw value from this to help students learn better, teachers teach better, and schools to work more effectively? This Primer on Large-Scale Assessments of Educational Achievement helps policy makers and their technical teams to find answers to these questions.†? ANDREI VOLKOV, Director of the Institute for Public Strategy, Moscow School of Management SKOLKOVO “In 2008, when the Russia Education Aid for Development (READ) Program was launched, we determined its main goal as the improvement of the quality of basic education. Today, the READ Program keeps setting trends as the largest Russian initiative promoting educational assessment. Approaches developed within the READ Program, from building institutional and expert capacity to influencing educational reforms, have proven their efficacy in many countries. The Primer on Large-Scale Assessments of Educational Achievement brings together in a practical format the best experience and case studies in conducting assessments under the READ Program. An especially important feature of the book is an integrated capacity building component, which makes it a practical tutorial ready for use in different cultural contexts. Through this book, we hope that our collective experience gathered during READ will be widely shared, bringing us closer to achievement of the Sustainable Development Goal on education.†? evelopment Goal on Education.†?

This book focuses on central issues that are key components of successful planning, development and implementation of LSAs. The book's main distinction is its focus on practice- based, cutting-edge research. This is achieved by having chapters co-authored by world-class researchers in collaboration with measurement practitioners.

Presents a comprehensive treatment of issues related to the inception, design, implementation and reporting of large-scale education assessments. In recent years many countries have decided to become involved in international educational assessments to allow them to ascertain the strengths and weaknesses of their student populations. Assessments such as the OECD's Programme for International Student Assessment (PISA), the IEA's Trends in Mathematics and Science Study (TIMSS) and Progress in International Reading Literacy (PIRLS) have provided opportunities for comparison between students of different countries on a common international scale. This book is designed to give researchers, policy makers and practitioners a well-grounded knowledge in the design, implementation, analysis and reporting of international assessments. Readers will be able to gain a more detailed insight into the scientific principles employed in such studies allowing them to make better use of the results. The book will also give readers an understanding of the resources needed to undertake and improve the design of educational assessments in their own countries and regions. Implementation of Large-Scale Education Assessments: Brings together the editors’ extensive experience in creating, designing, implementing, analysing and reporting results on a wide range of assessments. Emphasizes methods for implementing international studies of student achievement and obtaining highquality data from cognitive tests and contextual questionnaires. Discusses the methods of sampling, weighting, and variance estimation that are commonly encountered in international large-scale assessments. Provides direction and stimulus for improving global educational assessment and student learning Is written by experts in the field, with an international perspective. Survey researchers, market researchers and practitioners engaged in comparative projects will all benefit from the unparalleled breadth of knowledge and experience in large-scale educational assessments gathered in this one volume.

This book addresses the important assessment themes, provides a perspective from which to view large-scale assessments, and lays the foundation for plausible interpretations of their results.

Implementation of a National Assessment of Educational Achievement focuses on the practical tasks involved in running a large-scale national assessment program. It has four parts. Part I provides an overview of the tasks involved - how the essential activities of an assessment are organized and implemented, the personnel and resources that are required, and the tasks that follow the collection of data. In Part II, a methodology for selecting a sample of students that will be representative of students in the education system is presented. Principles underlying sampling are described, as well as step-by-step procedures that can be implemented in nearly any national assessment. An accompanying CD contains supporting data files. Part III describes procedures for cleaning and managing data collected in a national assessment, essential elements of a quality assurance process. It also describes how to export and import data, that is, make data available in a format that is appropriate for users of statistical software such as Access, SPSS, WesVar, and Excel. The primary objective of this section is to enable the national assessment team develop and implement a systematic set of procedures to help ensure that the assessment data are accurate and reliable. Following sampling, test administration, data entry, and cleaning, the next step is to prepare data for analysis. In Part IV, a series of important pre-analysis steps, including producing estimates, computing and using survey weights, and computing estimates are described. The section dealing with the computation of estimates describes how they and their sampling errors are computed from simple and complex samples. Finally, a range of special topics, including nonresponse and issues relating to over-and under-size schools, is addressed.

This volume provides step-by-step details on how to analyze data collected in a national assessment, with an introduction to statistical analyses normally carried out in these large-scale assessments, item and test analysis, and a CD contains with analysis software (IATA), exercises and supporting data files.