This book pulls together many perspectives on the theory, methods and practice of drawing judgments from panels of experts in assessing risks and making decisions in complex circumstances. The book is divided into four parts: Structured Expert Judgment (SEJ) current research fronts; the contributions of Roger Cooke and the Classical Model he developed; process, procedures and education; and applications. After an Introduction by the Editors, the first part presents chapters on expert elicitation of parameters of multinomial models; the advantages of using performance weighting by advancing the “random expert” hypothesis; expert elicitation for specific graphical models; modelling dependencies between experts’ assessments within a Bayesian framework; preventive maintenance optimization in a Bayesian framework; eliciting life time distributions to parametrize a Dirichlet process; and on an adversarial risk analysis approach for structured expert judgment studies. The second part includes Roger Cooke’s oration from 1995 on taking up his chair at Delft University of Technology; one of the editors reflections on the early decade of the Classical Model development and use; a current overview of the theory of the Classical Model, providing a deep and comprehensive perspective on its foundations and its application; and an interview with Roger Cooke. The third part starts with an interview with Professor Dame Anne Glover, who served as the Chief Scientific Advisor to the President of the European Commission. It then presents chapters on the characteristics of good elicitations by reviewing those advocated and applied; the design and development of a training course for SEJ; and on specific experiences with SEJ protocols with the intention of presenting the challenges and insights collected during these journeys. Finally, the fourth (and largest) part begins with some reflections from Willy Aspinall on his many experiences in applying the Classical Model in several application domains; it continues with related reflections on imperfect elicitations; and then it presents chapters with applications on medicines policy and management, supply chain cyber risk management, geo-political risks, terrorism and the risks facing businesses looking to internationalise.

Expert judgment is invaluable for assessing products, systems, and situations for which measurements or test results are sparse or nonexistent. Eliciting and Analyzing Expert Judgment: A Practical Guide takes the reader step by step through the techniques of eliciting and analyzing expert judgment, with special attention given to helping the reader develop elicitation methods and tools adaptable to a variety of unique situations and work areas. The analysis procedures presented in the book may require a basic understanding of statistics and probabilities, but the authors have provided detailed explanations of the techniques used and have taken special care to define all statistical jargon. Originally published in 1991, this book is designed so that those familiar with the use of expert judgment can quickly find the material appropriate for their advanced background.

Expert judgment is a major source of information that can provide vital input to project managers, who must ensure that projects are completed successfully, on time, and on budget. Too often, however, companies lack detailed processes for finding and consulting with experts—making it hard to match the required know-how with the project at hand. In Expert Judgment in Project Management: Narrowing the Theory-Practice Gap, Paul S. Szwed provides research that will help project managers become more adept at using expert judgment effectively.

Winner of the 2017 De Groot Prize awarded by the International Society for Bayesian Analysis (ISBA)A relatively new area of research, adversarial risk analysis (ARA) informs decision making when there are intelligent opponents and uncertain outcomes. Adversarial Risk Analysis develops methods for allocating defensive or offensive resources against

This book pulls together many perspectives on the theory, methods and practice of drawing judgments from panels of experts in assessing risks and making decisions in complex circumstances. The book is divided into four parts: Structured Expert Judgment (SEJ) current research fronts; the contributions of Roger Cooke and the Classical Model he developed; process, procedures and education; and applications. After an Introduction by the Editors, the first part presents chapters on expert elicitation of parameters of multinomial models; the advantages of using performance weighting by advancing the 2random expert3 hypothesis; expert elicitation for specific graphical models; modelling dependencies between experts’ assessments within a Bayesian framework; preventive maintenance optimization in a Bayesian framework; eliciting life time distributions to parametrize a Dirichlet process; and on an adversarial risk analysis approach for structured expert judgment studies. The second part includes Roger Cooke’s oration from 1995 on taking up his chair at Delft University of Technology; one of the editors reflections on the early decade of the Classical Model development and use; a current overview of the theory of the Classical Model, providing a deep and comprehensive perspective on its foundations and its application; and an interview with Roger Cooke. The third part starts with an interview with Professor Dame Anne Glover, who served as the Chief Scientific Advisor to the President of the European Commission. It then presents chapters on the characteristics of good elicitations by reviewing those advocated and applied; the design and development of a training course for SEJ; and on specific experiences with SEJ protocols with the intention of presenting the challenges and insights collected during these journeys. Finally, the fourth (and largest) part begins with some reflections from Willy Aspinall on his many experiences in applying the Classical Model in several application domains; it continues with related reflections on imperfect elicitations; and then it presents chapters with applications on medicines policy and management, supply chain cyber risk management, geo-political risks, terrorism and the risks facing businesses looking to internationalise.

This book is about elicitation: the facilitation of the quantitative expression of subjective judgement about matters of fact, interacting with subject experts, or about matters of value, interacting with decision makers or stakeholders. It offers an integrated presentation of procedures and processes that allow analysts and experts to think clearly about numbers, particularly the inputs for decision support systems and models. This presentation encompasses research originating in the communities of structured probability elicitation/calibration and multi-criteria decision analysis, often unaware of each other’s developments. Chapters 2 through 9 focus on processes to elicit uncertainty from experts, including the Classical Method for aggregating judgements from multiple experts concerning probability distributions; the issue of validation in the Classical Method; the Sheffield elicitation framework; the IDEA protocol; approaches following the Bayesian perspective; the main elements of structured expert processes for dependence elicitation; and how mathematical methods can incorporate correlations between experts. Chapters 10 through 14 focus on processes to elicit preferences from stakeholders or decision makers, including two chapters on problems under uncertainty (utility functions), and three chapters that address elicitation of preferences independently of, or in absence of, any uncertainty elicitation (value functions and ELECTRE). Two chapters then focus on cross-cutting issues for elicitation of uncertainties and elicitation of preferences: biases and selection of experts. Finally, the last group of chapters illustrates how some of the presented approaches are applied in practice, including a food security case in the UK; expert elicitation in health care decision making; an expert judgement based method to elicit nuclear threat risks in US ports; risk assessment in a pulp and paper manufacturer in the Nordic countries; and elicitation of preferences for crop planning in a Greek region.

Decision Analysis for Management Judgment is unique in its breadth of coverage of decision analysis methods. It covers both the psychological problems that are associated with unaided managerial decision making and the decision analysis methods designed to overcome them. It is presented and explained in a clear, straightforward manner without using mathematical notation. This latest edition has been fully revised and updated and includes a number of changes to reflect the latest developments in the field.