Experts, despite their importance and value, can be double-edged swords. They can make valuable contributions from their deep base of knowledge, but those contributions may also contain their own biases and pet theories. Therefore, selecting experts, eliciting their opinions, and aggregating their opinions must be performed and handled carefully, with full recognition of the uncertainties inherent in those opinions. Elicitation of Expert Opinions for Uncertainty and Risks illuminates those uncertainties and builds a foundation of philosophy, background, methods, and guidelines that helps its readers effectively execute the elicitation process. Based on the first-hand experiences of the author, the book is filled with illustrations, examples, case studies, and applications that demonstrate not only the methods and successes of expert opinion elicitation, but also its pitfalls and failures. Studies show that in the future, analysts, engineers, and scientists will need to solve ever more complex problems and reach decisions with limited resources. This will lead to an increased reliance on the proper treatment of uncertainty and on the use of expert opinions. Elicitation of Expert Opinions for Uncertainty and Risks will help prepare you to better understand knowledge and ignorance, to successfully elicit expert opinions, to select appropriate expressions of those opinions, and to use various methods to model and aggregate opinions.

Experts, despite their importance and value, can be double-edged swords. They can make valuable contributions from their deep base of knowledge, but those contributions may also contain their own biases and pet theories. Therefore, selecting experts, eliciting their opinions, and aggregating their opinions must be performed and handled carefully, w

Elicitation is the process of extracting expert knowledge about some unknown quantity or quantities, and formulating that information as a probability distribution. Elicitation is important in situations, such as modelling the safety of nuclear installations or assessing the risk of terrorist attacks, where expert knowledge is essentially the only source of good information. It also plays a major role in other contexts by augmenting scarce observational data, through the use of Bayesian statistical methods. However, elicitation is not a simple task, and practitioners need to be aware of a wide range of research findings in order to elicit expert judgements accurately and reliably. Uncertain Judgements introduces the area, before guiding the reader through the study of appropriate elicitation methods, illustrated by a variety of multi-disciplinary examples. This is achieved by: Presenting a methodological framework for the elicitation of expert knowledge incorporating findings from both statistical and psychological research. Detailing techniques for the elicitation of a wide range of standard distributions, appropriate to the most common types of quantities. Providing a comprehensive review of the available literature and pointing to the best practice methods and future research needs. Using examples from many disciplines, including statistics, psychology, engineering and health sciences. Including an extensive glossary of statistical and psychological terms. An ideal source and guide for statisticians and psychologists with interests in expert judgement or practical applications of Bayesian analysis, Uncertain Judgements will also benefit decision-makers, risk analysts, engineers and researchers in the medical and social sciences.

Expert judgment is invaluable for assessing products, systems, and situations for which measurements or test results are sparse or nonexistent. Eliciting and Analyzing Expert Judgment: A Practical Guide takes the reader step by step through the techniques of eliciting and analyzing expert judgment, with special attention given to helping the reader develop elicitation methods and tools adaptable to a variety of unique situations and work areas. The analysis procedures presented in the book may require a basic understanding of statistics and probabilities, but the authors have provided detailed explanations of the techniques used and have taken special care to define all statistical jargon. Originally published in 1991, this book is designed so that those familiar with the use of expert judgment can quickly find the material appropriate for their advanced background.

This book pulls together many perspectives on the theory, methods and practice of drawing judgments from panels of experts in assessing risks and making decisions in complex circumstances. The book is divided into four parts: Structured Expert Judgment (SEJ) current research fronts; the contributions of Roger Cooke and the Classical Model he developed; process, procedures and education; and applications. After an Introduction by the Editors, the first part presents chapters on expert elicitation of parameters of multinomial models; the advantages of using performance weighting by advancing the “random expert” hypothesis; expert elicitation for specific graphical models; modelling dependencies between experts’ assessments within a Bayesian framework; preventive maintenance optimization in a Bayesian framework; eliciting life time distributions to parametrize a Dirichlet process; and on an adversarial risk analysis approach for structured expert judgment studies. The second part includes Roger Cooke’s oration from 1995 on taking up his chair at Delft University of Technology; one of the editors reflections on the early decade of the Classical Model development and use; a current overview of the theory of the Classical Model, providing a deep and comprehensive perspective on its foundations and its application; and an interview with Roger Cooke. The third part starts with an interview with Professor Dame Anne Glover, who served as the Chief Scientific Advisor to the President of the European Commission. It then presents chapters on the characteristics of good elicitations by reviewing those advocated and applied; the design and development of a training course for SEJ; and on specific experiences with SEJ protocols with the intention of presenting the challenges and insights collected during these journeys. Finally, the fourth (and largest) part begins with some reflections from Willy Aspinall on his many experiences in applying the Classical Model in several application domains; it continues with related reflections on imperfect elicitations; and then it presents chapters with applications on medicines policy and management, supply chain cyber risk management, geo-political risks, terrorism and the risks facing businesses looking to internationalise.

Uncertainty has been of concern to engineers, managers and . scientists for many centuries. In management sciences there have existed definitions of uncertainty in a rather narrow sense since the beginning of this century. In engineering and uncertainty has for a long time been considered as in sciences, however, synonymous with random, stochastic, statistic, or probabilistic. Only since the early sixties views on uncertainty have ~ecome more heterogeneous and more tools to model uncertainty than statistics have been proposed by several scientists. The problem of modeling uncertainty adequately has become more important the more complex systems have become, the faster the scientific and engineering world develops, and the more important, but also more difficult, forecasting of future states of systems have become. The first question one should probably ask is whether uncertainty is a phenomenon, a feature of real world systems, a state of mind or a label for a situation in which a human being wants to make statements about phenomena, i. e. , reality, models, and theories, respectively. One cart also ask whether uncertainty is an objective fact or just a subjective impression which is closely related to individual persons. Whether uncertainty is an objective feature of physical real systems seems to be a philosophical question. This shall not be answered in this volume.

This book is an extensive survey and critical examination of the literature on the use of expert opinion in scientific inquiry and policy making. The elicitation, representation, and use of expert opinion is increasingly important for two reasons: advancing technology leads to more and more complex decision problems, and technologists are turning in greater numbers to "expert systems" and other similar artifacts of artificial intelligence. Cooke here considers how expert opinion is being used today, how an expert's uncertainty is or should be represented, how people do or should reason with uncertainty, how the quality and usefulness of expert opinion can be assessed, and how the views of several experts might be combined. He argues for the importance of developing practical models with a transparent mathematic foundation for the use of expert opinion in science, and presents three tested models, termed "classical," "Bayesian," and "psychological scaling." Detailed case studies illustrate how they can be applied to a diversity of real problems in engineering and planning.