The Flaws of Academic Statistics: the Null Ritual
Not Related! A Big-Braned Podcast · Not Related! with Luke Smith
Audio is streamed directly from the publisher (notrelated.xyz) as published in their RSS feed. Play Podcasts does not host this file. Rights-holders can request removal through the copyright & takedown page.
Show Notes
This episode...
Nearly every academic paper published since the 1960s has used statistics known to be faulty.
That sounds extreme, but it's actually not even controversial in the statistical literature.
In the 1950s, Ronald Fisher invented a statistical technique to solve the philosophical Problem of Induction. Neyman and Pearson developed a technique for statistical quality control in factories. Yet somehow, these two techniques were confused and merged into the Null Ritual of today, which is the neurotic pattern that every paper in many disciplines have to follow.
The Null Ritual is one of the clearest examples of academic consensus so far off the tracks that scholar treat the techniques in textbooks were religious devotion, rather than with critical awareness of what they are actually supposed to be. The end result? Nearly every field is rife with misuse of numbers, publication bias, misunderstandings and fake conclusions.
Readings and Links
Note that pay-walled academic articles may be obtained by feeding their URLs to sites like Sci-Hub.
- Rationality for Mortals (Gerd Gigerenzer)
- Mindless statistics (Gerd Gigerenzer)
- Statistical Methods and Scientific Induction (Ronald Fisher)
- "Inductive Behavior" as a Basic Concept of Philosophy of Science (Jerzy Neyman)
- Inductive Inference or Inductive Behavior: Fisher and Neyman: Pearson Approaches to Statistical Testing in Psychological Research (1940-1960) (Peter Halpin and Henderikus Stam)
- Fisher, Neyman-Pearson or NHST? A tutorial for teaching data testing (Jose Perezgonzalez)
- Why Most Published Research Findings Are False: Author's Reply to Goodman and Greenland (John Ioannidis)
- Replication, statistical consistency, and publication bias (Gregory Francis)
- "Positive" Results Increase Down the Hierarchy of the Sciences. (Daniele Fanelli)
- A Short Note on P-Value Hacking (Nassim Taleb)
More...
- The Not Related! website: notrelated.xyz
- Donations will be read in the middle of each episode: donate.notrelated.xyz