Addressing 30 statistical myths in the areas of data, estimation, measurement system analysis, capability, hypothesis testing, statistical inference, and control charts, this book explains how to understand statistics rather than how to do statistics. Every statistical myth listed in this book has been stated in course materials used by the author

This book proposes and explores the idea that the forced union of the aleatory and epistemic aspects of probability is a sterile hybrid, inspired and nourished for 300 years by a false hope of formalizing inductive reasoning, making uncertainty the object of precise calculation. Because this is not really a possible goal, statistical inference is not, cannot be, doing for us today what we imagine it is doing for us. It is for these reasons that statistical inference can be characterized as a myth. The book is aimed primarily at social scientists, for whom statistics and statistical inference are a common concern and frustration. Because the historical development given here is not merely anecdotal, but makes clear the guiding ideas and ambitions that motivated the formulation of particular methods, this book offers an understanding of statistical inference which has not hitherto been available. It will also serve as a supplement to the standard statistics texts. Finally, general readers will find here an interesting study with implications far beyond statistics. The development of statistical inference, to its present position of prominence in the social sciences, epitomizes a number of trends in Western intellectual history of the last three centuries, and the 11th chapter, considering the function of statistical inference in light of our needs for structure, rules, authority, and consensus in general, develops some provocative parallels, especially between epistemology and politics.

This book provides an up-to-date review of commonly undertaken methodological and statistical practices that are sustained, in part, upon sound rationale and justification and, in part, upon unfounded lore. Some examples of these "methodological urban legends", as we refer to them in this book, are characterized by manuscript critiques such as: (a) "your self-report measures suffer from common method bias"; (b) "your item-to-subject ratios are too low"; (c) "you can’t generalize these findings to the real world"; or (d) "your effect sizes are too low". Historically, there is a kernel of truth to most of these legends, but in many cases that truth has been long forgotten, ignored or embellished beyond recognition. This book examines several such legends. Each chapter is organized to address: (a) what the legend is that "we (almost) all know to be true"; (b) what the "kernel of truth" is to each legend; (c) what the myths are that have developed around this kernel of truth; and (d) what the state of the practice should be. This book meets an important need for the accumulation and integration of these methodological and statistical practices.

Mounting failures of replication in social and biological sciences give a new urgency to critically appraising proposed reforms. This book pulls back the cover on disagreements between experts charged with restoring integrity to science. It denies two pervasive views of the role of probability in inference: to assign degrees of belief, and to control error rates in a long run. If statistical consumers are unaware of assumptions behind rival evidence reforms, they can't scrutinize the consequences that affect them (in personalized medicine, psychology, etc.). The book sets sail with a simple tool: if little has been done to rule out flaws in inferring a claim, then it has not passed a severe test. Many methods advocated by data experts do not stand up to severe scrutiny and are in tension with successful strategies for blocking or accounting for cherry picking and selective reporting. Through a series of excursions and exhibits, the philosophy and history of inductive inference come alive. Philosophical tools are put to work to solve problems about science and pseudoscience, induction and falsification.

This open access textbook provides the background needed to correctly use, interpret and understand statistics and statistical data in diverse settings. Part I makes key concepts in statistics readily clear. Parts I and II give an overview of the most common tests (t-test, ANOVA, correlations) and work out their statistical principles. Part III provides insight into meta-statistics (statistics of statistics) and demonstrates why experiments often do not replicate. Finally, the textbook shows how complex statistics can be avoided by using clever experimental design. Both non-scientists and students in Biology, Biomedicine and Engineering will benefit from the book by learning the statistical basis of scientific claims and by discovering ways to evaluate the quality of scientific reports in academic journals and news outlets.

This engaging book helps readers identify and then discard 52 misconceptions about data and statistical summaries. The focus is on major concepts contained in typical undergraduate and graduate courses in statistics, research methods, or quantitative analysis. Interactive Internet exercises that further promote undoing the misconceptions are found on the book's website. The author’s accessible discussion of each misconception has five parts: The Misconception - a brief description of the misunderstanding Evidence that the Misconception Exists – examples and claimed prevalence Why the Misconception is Dangerous – consequence of having the misunderstanding Undoing the Misconception - how to think correctly about the concept Internet Assignment - an interactive activity to help readers gain a firm grasp of the statistical concept and overcome the misconception. The book's statistical misconceptions are grouped into 12 chapters that match the topics typically taught in introductory/intermediate courses. However, each of the 52 discussions is self-contained, thus allowing the misconceptions to be covered in any order without confusing the reader. Organized and presented in this manner, the book is an ideal supplement for any standard textbook. An ideal supplement for undergraduate and graduate courses in statistics, research methods, or quantitative analysis taught in psychology, education, business, nursing, medicine, and the social sciences. The book also appeals to independent researchers interested in undoing their statistical misconceptions.

The modern world is brimming with statistical information—information relevant to our personal health and safety, the weather, or the robustness of the national or global economy, to name just a few examples. But don’t statistics lie? Well, no—people lie, and sometimes they use statistical language to do it. Knowing when you’re being hoodwinked requires a degree of statistical literacy, but most people don’t learn how to interpret statistical claims unless they take a formal course that trains them in the mathematical techniques of statistical analysis. This book won’t turn you into a statistician—that would require a much longer and more technical discussion—but it will give you the tools to understand statistical claims and avoid common pitfalls associated with translating statistical information from the language of mathematics to plain English.