This volume provides step-by-step details on how to analyze data collected in a national assessment, with an introduction to statistical analyses normally carried out in these large-scale assessments, item and test analysis, and a CD contains with analysis software (IATA), exercises and supporting data files.

Implementing a National Assessment of Educational Achievement, the third volume in the five-part National Assessments of Educational Achievement series, focuses on practical issues in the implementation of a national assessment. These include the representation of key educational stakeholders, required personnel and facilities, and the sequence of administrative activities in implementing an assessment. Particular attention is focused on sampling, such as defining the population to be assessed, elements of sampling theory, and the selection of schools and students to take part in an assessment. Readers are guided through the selection of a sample by working on a set of concrete tasks presented in the text, using data files in an accompanying CD. One section of Volume 3 is devoted to typical tasks involved in preparing, validating and managing data. Users are expected to develop competence in data preparation skills by carrying out the practical exercises in the CD. They are also shown how to complete important pre-analysis steps such as compute survey weights, calculate means and their sampling errors, and how to deal with non-responses and oversize and undersize schools. This volume is intended primarily for teams who are responsible for conducting national assessments and graduate students interested in technical aspects of large-scale surveys.

Implementation of a National Assessment of Educational Achievement focuses on the practical tasks involved in running a large-scale national assessment program. It has four parts. Part I provides an overview of the tasks involved - how the essential activities of an assessment are organized and implemented, the personnel and resources that are required, and the tasks that follow the collection of data. In Part II, a methodology for selecting a sample of students that will be representative of students in the education system is presented. Principles underlying sampling are described, as well as step-by-step procedures that can be implemented in nearly any national assessment. An accompanying CD contains supporting data files. Part III describes procedures for cleaning and managing data collected in a national assessment, essential elements of a quality assurance process. It also describes how to export and import data, that is, make data available in a format that is appropriate for users of statistical software such as Access, SPSS, WesVar, and Excel. The primary objective of this section is to enable the national assessment team develop and implement a systematic set of procedures to help ensure that the assessment data are accurate and reliable. Following sampling, test administration, data entry, and cleaning, the next step is to prepare data for analysis. In Part IV, a series of important pre-analysis steps, including producing estimates, computing and using survey weights, and computing estimates are described. The section dealing with the computation of estimates describes how they and their sampling errors are computed from simple and complex samples. Finally, a range of special topics, including nonresponse and issues relating to over-and under-size schools, is addressed.

Data from 20 years (1970-90) of the National Assessment of Educational Progress (NAEP) are summarized. The NAEP represents the nation's only ongoing assessment of the academic achievement of American students. Its assessments of educational achievement of students in grades 4, 8, and 12 are presented as "The Nation's Report Card". Chapter 1 of this report contains information about the students' competency in subject matter across the curriculum and their ability to use their minds well. Chapters 2 and 3 include information about the trends across time related to the performance of elementary school, middle school, and secondary school students in higher-order reasoning, problem solving, and communication skills as well as information about the academic achievement of minority students. Chapter 4 summarizes information about background variables related to education. In general, the data indicate that the educational performance of U.S. students is low and not improving. It is estimated that more than half of the nation's elementary through high school students are unable to demonstrate competency in challenging subject matter in English, mathematics, science, history, and geography. Fewer than half of all U.S. students appear to be able to use their minds well. Although considerable progress has been made in closing the performance gaps among different racial/ethnic and gender groups, the gaps still remain too large to meet the nation's objective of close parallels between the performance of minority students and the student population as a whole. Much that research has identified as effective in improving education is still not being implemented in the nation's schools. Nineteen tables and five figures summarize NAEP data. (SLD)