This book provides a unifying structure for the activities that fall under the process typically called "standard setting" on tests of proficiency. Standard setting refers to the methodology used to identify performance standards on tests of proficiency. The results from standard setting studies are critical for supporting the use of many types of tests. The process is frequently applied to educational, psychological, licensure/certification, and other types of tests and examination systems. The literature on procedures for standard setting is extensive, but the methodology for standard setting has evolved in a haphazard way over many decades without a unifying theory to support the evaluation of the methods and the validation of inferences made from the standards. This text provides a framework for going beyond specific standard setting methods to gain an understanding of the goals for the methods and how to evaluate whether the goals have been achieved. The unifying structure provided in this text considers policy that calls for the existence of performance standards, the relationship of proficiency test design to the policy, and tasks assigned to subject matter experts to help them convert the policy to estimates of locations on the reporting score scale for the test. Guidance is provided for how to connect the psychometric aspects of the standard setting process to the intentions of policy makers as expressed in policy statements. Further, the structure is used support validity arguments for inferences made when using standards. Examples are provided to show how the unifying structure can be used to evaluate and improve standard setting methodology.

Publisher description

The growing interest in new methods of assessing learning shows a dynamic progression towards a better understanding of the way assessment influences how teachers teach and how students learn However. despite greater awareness of the importance of precise and rigorous assessment, many practitioners are still uninformed of the Importance of psychometric or test theories which underlle the essential qualities of educational and psychological assessment, and the fundamental role they play in ensuring accurate and fair measurement. Without a thorough understanding of the principles of measurement and the use of defensible psychometric or test theories, even the best assessment methods cannot provide accurate and useful information about student learning, progress, and attainment. This introductory book was written with the hope to provide those involved in assessment and psychometric testing, a better understanding of psychometric theories, objective measurement, essential psychometric properties of cognitive tests and other psychological measurement instruments, errors in rater-mediated assessment methods and Issues in standard setting, and their impact on fair and equitable assessment and measurement.

Grounded in current knowledge and professional practice, this book provides up-to-date coverage of psychometric theory, methods, and interpretation of results. Essential topics include measurement and statistical concepts, scaling models, test design and development, reliability, validity, factor analysis, item response theory, and generalizability theory. Also addressed are norming and test equating, topics not typically covered in traditional psychometrics texts. Examples drawn from a dataset on intelligence testing are used throughout the book, elucidating the assumptions underlying particular methods and providing SPSS (or alternative) syntax for conducting analyses. The companion website presents datasets for all examples as well as PowerPoint slides of figures and key concepts. Pedagogical features include equation boxes with explanations of statistical notation, and end-of-chapter glossaries. The Appendix offers extensions of the topical chapters with example source code from SAS, SPSS, IRTPRO, BILOG-MG, PARSCALE, TESTFACT, and DIMTEST.

This new text provides the most current coverage of measurement and psychometrics in a single volume. Authors W. Holmes Finch and Brian F. French first review the basics of psychometrics and measurement, before moving on to more complex topics such as equating and scaling, item response theory, standard setting, and computer adaptive testing. Also included are discussions of cutting-edge topics utilized by practitioners in the field, such as automated test development, game-based assessment, and automated test scoring. This book is ideal for use as a primary text for graduate-level psychometrics/measurement courses, as well as for researchers in need of a broad resource for understanding test theory. Features: "How it Works" and "Psychometrics in the Real World" boxes break down important concepts through worked examples, and show how theory can be applied to practice. End-of-chapter exercises allow students to test their comprehension of the material, while suggested readings and website links provide resources for further investigation. A collection of free online resources include the full output from R, SPSS, and Excel for each of the analyses conducted in the book, as well as additional exercises, sample homework assignments, answer keys, and PowerPoint lecture slides.

Which types of validity evidence should be considered when determining whether a scale is appropriate for a given measurement situation? What about reliability evidence? Using clear explanations illustrated by examples from across the social and behavioral sciences, this engaging text prepares students to make effective decisions about the selection, administration, scoring, interpretation, and development of measurement instruments. Coverage includes the essential measurement topics of scale development, item writing and analysis, and reliability and validity, as well as more advanced topics such as exploratory and confirmatory factor analysis, item response theory, diagnostic classification models, test bias and fairness, standard setting, and equating. End-of-chapter exercises (with answers) emphasize both computations and conceptual understanding to encourage readers to think critically about the material. ÿ

Psychometrics and Psychological Assessment: Principles and Applications reports on contemporary perspectives and models on psychological assessment and their corresponding measures. It highlights topics relevant to clinical and neuropsychological domains, including cognitive abilities, adaptive behavior, temperament, and psychopathology.Moreover, the book examines a series of standard as well as novel methods and instruments, along with their psychometric properties, recent meta-analytic studies, and their cross-cultural applications. - Discusses psychometric issues and empirical studies that speak to same - Explores the family context in relation to children's behavioral outcomes - Features major personality measures as well as their cross cultural variations - Identifies the importance of coping and resilience in assessing personality and psychopathology - Examines precursors of aggression and violence for prediction and prevention