"Pedagogy is the study of teaching. Pedagogy of evaluation entails examining how and what evaluation teaches. This volume is inspired by and builds on the works of Paulo Freire, especially his classic, Pedagogy of the Oppressed. Freire understood and taught that all interactions between and among people are pedagogical; something is always being taught, conveyed, and proselytized. It follows that all evaluation approaches constitute a pedagogy of some kind. All evaluation teaches something"--Page [4] of cover.

First published in 2004. Measuring the outcomes of educational practices is a modern phenomenon. Valuing their worth is as old as philosophy itself. It is the singular value of this collection of papers set in context and introduced by Ernest House that it holds in dynamic equilibrium both the measurement and the valuing sides of educational evaluation. This book will appeal to the student who will find the theoretical analysis of educational evaluation in its several meanings, suggested practices and also the specialist will also find much, not least a critical and challenging appreciation of educational evaluation theory and practice as it faces the problems of the final decades of the twentieth century.

This is an up-to-date revision of the classic text first published in 1983. It includes a historical perspective on the growth of evaluation theory and practice and two comparative analyses of the various alternative perspectives on evaluation. It also includes articles representing the major schools of thought about evaluation written by the leaders who have developed these schools and models. The final section describes and discusses the Standards for Program Evaluation and the reformation of program evaluation.

With his 1973 address titled "Program Evaluation, Particularly Responsive Evaluation," Robert Stake offered a new vision and rationale for educational and social program evaluation. In this vision, evaluation was reframed--from the application of sophisticated analytic techniques that address distant policymakers' questions of program benefits and effectiveness "on the average" to an engagement with on-site practitioners about the quality and meaning of their practice. These innovative ideas helped accelerate a transformation of the evaluation enterprise into its current pluralistic character, within which remain multiple and varied legacies of key responsive evaluation principles. This volume offers some of those legacies, representing central epistemological, artistic, and political dimensions of Stake's original commitment to responsiveness. This is the 92nd issue of the Jossey-Bass series New Directions for Evaluation.

This comprehensive, interdisciplinary handbook reviews the latest methods and technologies used in automated essay evaluation (AEE) methods and technologies. Highlights include the latest in the evaluation of performance-based writing assessments and recent advances in the teaching of writing, language testing, cognitive psychology, and computational linguistics. This greatly expanded follow-up to Automated Essay Scoring reflects the numerous advances that have taken place in the field since 2003 including automated essay scoring and diagnostic feedback. Each chapter features a common structure including an introduction and a conclusion. Ideas for diagnostic and evaluative feedback are sprinkled throughout the book. Highlights of the book’s coverage include: The latest research on automated essay evaluation. Descriptions of the major scoring engines including the E-rater®, the Intelligent Essay Assessor, the IntellimetricTM Engine, c-raterTM, and LightSIDE. Applications of the uses of the technology including a large scale system used in West Virginia. A systematic framework for evaluating research and technological results. Descriptions of AEE methods that can be replicated for languages other than English as seen in the example from China. Chapters from key researchers in the field. The book opens with an introduction to AEEs and a review of the "best practices" of teaching writing along with tips on the use of automated analysis in the classroom. Next the book highlights the capabilities and applications of several scoring engines including the E-rater®, the Intelligent Essay Assessor, the IntellimetricTM engine, c-raterTM, and LightSIDE. Here readers will find an actual application of the use of an AEE in West Virginia, psychometric issues related to AEEs such as validity, reliability, and scaling, and the use of automated scoring to detect reader drift, grammatical errors, discourse coherence quality, and the impact of human rating on AEEs. A review of the cognitive foundations underlying methods used in AEE is also provided. The book concludes with a comparison of the various AEE systems and speculation about the future of the field in light of current educational policy. Ideal for educators, professionals, curriculum specialists, and administrators responsible for developing writing programs or distance learning curricula, those who teach using AEE technologies, policy makers, and researchers in education, writing, psychometrics, cognitive psychology, and computational linguistics, this book also serves as a reference for graduate courses on automated essay evaluation taught in education, computer science, language, linguistics, and cognitive psychology.

As a practice meant to improve society, evaluation is implicated in discussions about which societal and cultural values and principles of justice will prevail and which ones will get subverted or ignored altogether. For the most part, as currently configured, the relationship of evaluators to policy makers has jeopardized evaluation's ability to provide the critical lens needed for feedback on the effects of a society's practices, policies, and structures. Many theorists believe that it is only by examining and critically assessing how knowledge is produced and reproduced in society that we can better reflect on and imagine new, more socially just, social configurations and relations. One such approach, critical theory, is a pedagogical practice that employs a systemic and historical critique of social and cultural formations and practices in a way that fosters citizens' abilities to evaluate and alter them. The intent of this issue of New Directions for Evaluation is to show the relevance of critical social theory for evaluation practice. Each of the authors in this volume addresses in a different way and from a variety of disciplinary fields what a critical theory lens might offer evaluation practice. This is the 127th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.

This text will enable readers to use tools to design, conduct and report research in a way that transforms, when appropriate, the delivery of special education.