436: Stuart Ritchie | The Science Fictions Undermining Facts

Flimsy Studies

The discussion begins with the examination of studies with weak methodologies and their impact on scientific credibility. Stuart Ritchie highlights how certain studies, like those on power posing, gained popularity despite their flimsy scientific basis. He explains that the original power posing study was based on a small sample size and flawed statistical methods, leading to unreliable conclusions 1. This reflects a broader issue where incentives in research prioritize sensational results over factual accuracy. Jordan Harbinger shares his experience with the power posing phenomenon, noting its widespread acceptance despite its debunking 2.

The subjective feeling of power possibly is true, but it may also be — in the experiment with the comparisons between people slumped over versus people doing the power pose.

--- Stuart Ritchie

This highlights the need for skepticism and critical evaluation of scientific claims.

   

Psychic Study

The conversation shifts to an absurd scientific study that claimed psychic abilities in detecting pornographic images. Stuart Ritchie recounts how this study, published in a respected journal, suggested that participants could predict the presence of porn behind a curtain with slightly better than chance accuracy 3. This study exemplifies how flawed methodologies can lead to bizarre conclusions, questioning the reliability of standard scientific practices. Despite attempts to replicate the study, no psychic results were found, yet the original flashy findings were prioritized for publication 4.

It's not a case where someone has just made up data, but it's a case where the standard methods that we use in our studies have led us to the results that we kind of all know are not true.

--- Stuart Ritchie

This raises concerns about the biases in scientific publishing that favor sensationalism over accuracy.

   

Replication Crisis

The replication crisis in science is another critical issue discussed. Stuart Ritchie explains that many studies fail to produce the same results when repeated, highlighting a systemic problem in scientific research 5. He emphasizes the importance of independent verification and critiques from other scientists to ensure the reliability of findings. The conversation also touches on the biases in scientific publishing, where positive results are disproportionately favored, leading to a skewed representation of scientific progress 6.

The scientific literature, which is supposed to be a really nice reflection, like a clear, accurate reflection of what scientists have been doing does not accurately reflect what scientists have been doing.

--- Stuart Ritchie

This underscores the need for reform in research practices to prioritize truth over sensationalism.