"What Counts as Credible Evidence in Applied Research and Evaluation Practice? is the first book of its kind to define and place into greater perspective the meaning of evidence for evaluation professionals and applied researchers. Editors Stewart I. Donaldson, Christina A. Christie, and Melvin M. Mark provide observations about the diversity and changing nature of credible evidence, include lessons from their own applied research and evaluation practice, and suggest ways in which practitioners might address the key issues and challenges of collecting credible evidence." "This book is appropriate for a wide range of courses, including Introduction to Evaluation Research, Research Methods, Evaluation Practice, Program Evaluation, Program Development and Evaluation, and evaluation courses in Social Work, Education, Public Health, and Public Policy."--BOOK JACKET.

Exploring the influence and application of Campbellian validity typology in the theory and practice of outcome evaluation, this volume addresses the strengths and weaknesses of this often controversial evaluation method and presents new perspectives for its use. Editors Huey T. Chen, Stewart I. Donaldson and Melvin M. Mark provide a historical overview of the Campbellian typology adoption, contributions and criticism. Contributing authors propose strategies in developing a new perspective of validity typology for advancing validity in program evaluation including Enhance External Validity Enhance Precision by Reclassifying the Campbellian Typology Expand the Scope of the Typology The volume concludes with William R. Shadish's spirited rebuttal to earlier chapters. A collaborator with Don Campbell, Shadish provides a balance to the perspective of the issue with a clarification and defense of Campbell's work. This is the 129th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.

Addressing one of the most important and contentious issues challenging applied research and evaluation practice today—what constitutes credible and actionable evidence?—this volume offers a balanced and current context in which to analyze the long-debated quantitative-qualitative paradigms. In the Second Edition, the contributors, a veritable "who’s who" in evaluation, discuss the diversity and changing nature of credible and actionable evidence; offer authoritative guidance about using credible and actionable evidence; explain how to use it to provide rigorous and influential evaluations; and include lessons from their own applied research and evaluation to suggest ways to address the key issues and challenges. Reflecting the latest developments in the field and covering both experimental and non-experimental methods, the new edition includes revised and updated chapters, summaries of strengths and weaknesses across varied approaches, and contains diverse definitions of evidence. Also included are two new chapters on assessing credibility and synthesizing evidence for policy makers. This is a valuable resource for students and others interested in how to best study and evaluate programs, policies, organizations, and other initiatives designed to improve aspects of the human condition and societal well-being.

Bringing together the expertise of top evaluation leaders from around the world, The SAGE International Handbook of Educational Evaluation addresses methods and applications in the field, particularly as they relate to policy- and decision-making in an era of globalization. The comprehensive collection of articles in the Handbook compels readers to consider globalization influences on educational evaluation within distinct genres or families of evaluation approaches. Key Features Discusses substantive issues surrounding globalization, and its implication for educational policy and practice and ultimately evaluation; Includes state-of-the-art theory chapters and method chapters within scientific, accountability-oriented, learning-oriented, and political genres of evaluation approaches; Provides real-world case exemplar chapters to illustrate core concepts within genres; Extends dialogue on controversial topics and contemporary educational evaluation tensions in the context of globalization; Summarizes, by means of an integration chapter, the issues, tensions and dilemmas confronting educational evaluators in an era of globalization. Serving as a state-of-the-art resource on educational evaluation, this volume is designed for graduate students, evaluation scholars and researchers and professional evaluation practitioners with an interest in educational program and policy evaluation.

This comprehensive Handbook is the first to provide a practical, interdisciplinary review of ethical issues as they relate to quantitative methodology including how to present evidence for reliability and validity, what comprises an adequate tested population, and what constitutes scientific knowledge for eliminating biases. The book uses an ethical framework that emphasizes the human cost of quantitative decision making to help researchers understand the specific implications of their choices. The order of the Handbook chapters parallels the chronology of the research process: determining the research design and data collection; data analysis; and communicating findings. Each chapter: Explores the ethics of a particular topic Identifies prevailing methodological issues Reviews strategies and approaches for handling such issues and their ethical implications Provides one or more case examples Outlines plausible approaches to the issue including best-practice solutions. Part 1 presents ethical frameworks that cross-cut design, analysis, and modeling in the behavioral sciences. Part 2 focuses on ideas for disseminating ethical training in statistics courses. Part 3 considers the ethical aspects of selecting measurement instruments and sample size planning and explores issues related to high stakes testing, the defensibility of experimental vs. quasi-experimental research designs, and ethics in program evaluation. Decision points that shape a researchers’ approach to data analysis are examined in Part 4 – when and why analysts need to account for how the sample was selected, how to evaluate tradeoffs of hypothesis-testing vs. estimation, and how to handle missing data. Ethical issues that arise when using techniques such as factor analysis or multilevel modeling and when making causal inferences are also explored. The book concludes with ethical aspects of reporting meta-analyses, of cross-disciplinary statistical reform, and of the publication process. This Handbook appeals to researchers and practitioners in psychology, human development, family studies, health, education, sociology, social work, political science, and business/marketing. This book is also a valuable supplement for quantitative methods courses required of all graduate students in these fields.

Addressing one of the most important and contentious issues challenging applied research and evaluation practice today—what constitutes credible and actionable evidence?—this volume offers a balanced and current context in which to analyze the long-debated quantitative-qualitative paradigms. In the Second Edition, the contributors, a veritable “who’s who” in evaluation, discuss the diversity and changing nature of credible and actionable evidence; offer authoritative guidance about using credible and actionable evidence; explain how to use it to provide rigorous and influential evaluations; and include lessons from their own applied research and evaluation to suggest ways to address the key issues and challenges. Reflecting the latest developments in the field and covering both experimental and non-experimental methods, the new edition includes revised and updated chapters, summaries of strengths and weaknesses across varied approaches, and contains diverse definitions of evidence. Also included are two new chapters on assessing credibility and synthesizing evidence for policy makers. This is a valuable resource for students and others interested in how to best study and evaluate programs, policies, organizations, and other initiatives designed to improve aspects of the human condition and societal well-being.