This paper offers recommendations to the National Center for Education Statistics (NCES) on the development of the background questionnaire for the National Assessment of Adult Literacy (NAAL). The recommendations are from the viewpoint of a researcher interested in applying sophisticated statistical models to address important issues in adult literacy. The paper focuses on five issues, each of which is the subject of a section of the paper: sampling; selection bias; measurement; policy modeling; and gauging cohort effects. Each section considers the scope of the issue and then makes recommendations to NCES. These recommendations include providing all appropriate sampling weights in NAAL data; examining contextual effects on the distribution of literacy ability in the population; considering relevant auxiliary variables that would constitute the selection equation; considering the hypothesized number of factors and including at least four variables measuring each factor in the questionnaire; obtaining retrospective data on general and job-specific literacy-related activities; and exploring the possibility of linking NAAL with existing longitudinal surveys. (Contains 21 references.) (YLB)

A study focused on researchers' use of the English-Language Background Questionnaire (EBQ) portion of the National Adult Literacy Survey (NALS), the results of which were released in 1993. Data were gathered by surveying NALS data users about how they have used the EBQ data, their perspectives on the strengths and weaknesses of the EBQ, and their recommendations for changes to the EBQ. A content analysis was also conducted of published research papers that have involved analyses of the EBQ data to determine how the data were used in these research analyses. The study also drew upon recommendations garnered by a series of focus groups conducted by the American Institutes for Research in 1998. These sources were integrated with the study's own analysis of the NALS data. The following changes to the EBQ for future adult literacy assessments were recommended: expand the questions pertaining to educational experiences; expand the section on social and political participation or move the current items to other areas and delete this section; add an item on voter registration; acquire more detailed information regarding work history, wages, and parents' occupations; expand the section pertaining to literacy practices; and gather information on technological literacy practices. (Appendixes include 34 references; instruments; and studies examined for content review.) (YLB)

In December 1995, the Organisation for Economic Co-Operation and Development (OECD) and Statistics Canada jointly published the results of the first International Adult Literacy Survey (IALS). For this survey, representative samples of adults aged 16 to 65 were interviewed and tested in their homes in Canada, France, Germany, the Netherlands, Poland, Sweden, Switzerland, and the United States. This report describes how the survey was conducted in each country and presents all available evidence on the extent of bias in each country's data. Potential sources of bias, including sampling error, non-sampling error, and the cultural appropriateness and construct validity of the assessment instruments, are discussed. The chapters are; (1) "Introduction" (Irwin S. Kirsch and T. Scott Murray); (2) "Sample Design" (Nancy Darcovich); (3) "Survey Response and Weighting" (Nancy Darcovich); (4) "Non-Response Bias" (Nancy Darcovich, Marilyn Binkley, Jon Cohen, Mats Myrberg, and Stefan Persson); (5) "Data Collection and Processing" (Nancy Darcovich and T. Scott Murray); (6) "Incentives and the Motivation To Perform Well" (Stan Jones); (7) "The Measurement of Adult Literacy" (Irwin S. Kirsch, Ann Jungeblut, and Peter B. Mosenthal); (8) "Validity Generalization of the Assessment across Countries" (Don Rock); (9) "An Analysis of Items with Different Parameters across Countries" (Marilyn R. Binkley and Jean R. Pignal); (10) "Scaling and Scale Linking" (Kentaro Yamamoto); (11) "Proficiency Estimation" (Kentaro Yamamoto and Irwin S. Kirsch); (12) "Plausibility of Proficiency Estimates" (Richard Shillington); and (13) "Nested-Factor Models for the Swedish IALS Data" (Bo Palaszewski). Fourteen appendixes contain supplemental information, some survey questionnaires, and additional documentation for various chapters. (Contains 94 tables, 12 figures, and 74 references.) (SLD)