This volume presents a comprehensive collection of the latest research findings supporting the current and future implementations and applications of computerized multistage testing (MST). As a sequel to the widely acclaimed "Computerized Multistage Testing: Theory and Applications" (2014) by Yan, von Davier, and Lewis, this volume delves into the experiences, considerations, challenges, and lessons learned over the past years. It also offers practical approaches and solutions to the issues encountered. The topics covered include: purposeful MST designs, practical approaches for optimal design, assembly strategies for accuracy and efficiency, Hybrid designs, MST with natural language processing, practical routing considerations and methodologies, item calibration and proficiency estimation methods, routing and classification accuracy, added value of process data, prediction and evaluation of MST performance, cognitive diagnostic MST, differential item functioning, robustness of statistical methods, simulations, test security, the new digital large-scale SAT, software for practical assessment and simulations, AI impact, and the future of adaptive multistage testing. This volume is intended for students, faculty, researchers, practitioners, and education officers in the fields of educational measurement and evaluation, both in the United States and internationally.

This book introduces computer-based testing, addressing both nontechnical and technical considerations. The material is oriented toward practitioners and graduate students. The practical emphasis will be useful to measurement professionals who are or will be responsible for implementing a computerized testing program. The instructional information is also designed to be suitable for a one-semester graduate course in computerized testing in an educational measurement or quantitative methods program. While certain theoretical concepts are addressed, the focus of the book is on the applied nature of computerized testing. For this reason, the materials include such features as example applications, figures, and plots to illustrate critical points in the discussions. A wide range ofnontechnical issues need to be considered in implementing a computer-based testing program. Separate chapters are provided on test administration and development issues, examinee issues, software issues, and innovative item types. Test administration and delivery issues include the location of exam administration, selection of hardware and software, security considerations, scheduling of administration frequency and time limits, cost implications, and program support as well as approaches for addressing reliability, validity, comparability, and data analysis. Examinee issues include the influence ofexaminees' reactions to adaptive testing, the effect ofcomputer based task constraints, and the impact of examinees' prior computer experience. Software issues include usability studies and software evaluation as tools in selecting and developing appropriate software, based on the test program needs.

"The computer-adaptive multistage testing (ca-MST) has been developed as an alternative to computerized adaptive testing (CAT), and been increasingly adopted in large-scale assessments. Current research and practice only focus on ca-MST panels for credentialing purposes. The ca-MST test mode, therefore, is designed to gauge a single scale. The present study is the first step to investigate ca-MST panels for diagnostic purposes, which involve the assessment of multiple attributes in the same test. This study employed computer simulation to compare multidimensional ca-MST panels and their unidimensional counterparts, and to explore the factors that affect the accuracy and efficiency of multidimensional ca-MST. Nine multidimensional ca-MST panel designs - which differed in configuration and test length - were simulated under varied attribute correlation scenarios. In addition, item pools with different qualities were studied to suggest appropriate item bank design. The comparison between the multidimensional ca-MST and a sequential of unidimensional ca-MST suggested that when attributes correlated moderate to high, employing a multidimensional ca-MST provided more accurate and efficient scoring decisions than several unidimensional ca-MST with IRT scoring. However, a multidimensional ca-MST did not perform better than its unidimensional counterpart with MIRT scoring. Nevertheless, multidimensional panels are still promising for diagnostic purposes given practical considerations. The investigation on multidimensional ca-MST design indicated the following: Higher attribute correlation was associated with better scoring decision because more information carried by a correlation matrix was available for estimation. This held true across all item pool conditions. An optimal item pool would be the one that was discriminative, appropriately located and specifically designed for a configuration. The accuracy and efficiency of a multidimensional ca-MST panel would be diminished if its item pool was too easy, or not informative. According to the results, the 1-2-3 configuration design was most promising. In terms of test length, an appropriate decision would largely depend on the attribute correlation and the item pool characteristics."--Abstract from author supplied metadata.

Unlike other forms of adaptive testing, multistage testing (MST) is highly suitable for testing educational achievement because it can be adapted to educational surveys and student testing. This volume provides the first unified source of information on the design, psychometrics, implementation, and operational use of MST. It shows how to apply theoretical statistical tools to testing in novel and useful ways. It also explains how to explicitly tie the assumptions made by each model to observable (or at least inferable) data conditions.

No topic is more central to innovation and current practice in testing and assessment today than computers and the Internet. This timely publication highlights four main themes that define current issues, technical advances and applications of computer-based testing: Advances in computer-based testing -- new test designs, item selection algorithms, exposure control issues and methods, and new tests that capitalize on the power of computer technology. Operational issues -- systems design, test security, and legal and ethical matters. New and improved uses -- for tests in employment and credentialing. The future of computer-based testing -- identifying potential issues, developments, major advances and problems to overcome. Written by internationally recognized contributors, each chapter focuses on issues of control, quality, security and technology. These issues provide the basic structure for the International Test Commission's new Guidelines on Computer-Based Testing and Testing on the Internet. The contributions to this book have played a key role in the development of these guidelines. Computer-Based Testing and the Internet is a comprehensive guide for all professionals, academics and practitioners working in the fields of education, credentialing, personnel testing and organizational assessment. It will also be of value to students developing expertise in these areas.

Used worldwide in assessment and professional certification contexts, computerized adaptive testing (CAT) offers a powerful means to measure individual differences or make classifications. This authoritative work from CAT pioneer David J. Weiss and Alper Şahin provides a complete how-to guide for planning and implementing an effective CAT to create a test unique to each person in real time. The book reviews the history of CAT and the basics of item response theory used in CAT. It walks the reader through developing an item bank, pretesting and linking items, selecting required CAT options, and using simulations to design a CAT. Available software for CAT delivery is described, including links to free and commercial options. Engaging multidisciplinary examples illustrate applications of CAT for measuring ability, achievement, proficiency, personality, attitudes, perceptions, patients’ reports of their symptoms, and academic or clinical progress.