Why Evidence-Based Policy Fails: A Review of Helen Pearson’s Beyond Belief

3

Helen Pearson’s Beyond Belief: How Evidence Shows What Really Works stands out in a crowded non-fiction market. While many books stretch thin arguments into unnecessary volumes, Pearson delivers a dense, punchy exploration of the “evidence revolution” that is both rigorous and highly readable. As a senior editor at Nature, Pearson examines how randomized controlled trials (RCTs) and systematic reviews are transforming fields ranging from international development to policing.

However, while the book successfully champions the use of data over intuition, it occasionally overlooks the sociopolitical realities that determine whether evidence-based policies actually succeed.

The Origins of Evidence-Based Practice

The core argument of the book is that decisions should be driven by empirical research rather than the authority of experts or conventional wisdom. Pearson traces this lineage back to medicine, where the methodology is most established.

The narrative highlights the 1747 experiment by naval surgeon James Lind aboard the HMS Salisbury. Facing an outbreak of scurvy—a disease characterized by swollen limbs and decaying gums—Lind divided 12 sailors into pairs, administering different dietary supplements. The pair given oranges and lemons recovered rapidly. Although vitamin C would not be identified for another century, the result was clear: citrus prevented scurvy. This early trial laid the groundwork for modern medical testing.

Yet, Pearson reveals a surprising gap: the term “evidence-based medicine” is only about 35 years old. For much of the 20th century, medical decisions were often based on the opinions of senior doctors rather than collective data. It was not until the 1970s, when junior doctor Iain Chalmers noticed inconsistent treatments for the same conditions, that the push for systematic reviews gained momentum. Chalmers and colleagues like Archie Cochrane pioneered meta-analyses, aggregating data from thousands of journals to determine what truly worked. This effort led to the creation of the Cochrane Collaboration, a global institution dedicated to high-quality systematic reviews.

From Medicine to Social Policy

Pearson extends this medical model to social policy, arguing that RCTs can improve outcomes in welfare, education, conservation, and policing. She provides compelling examples of wasted resources when evidence is ignored, such as the construction of “bat bridges” in the UK that bats never used.

However, applying medical trials to social systems introduces significant complexity. Unlike biological organisms, humans possess free will and operate within diverse cultural contexts. Pearson acknowledges that social policy trials are less reliable and harder to generalize than medical ones. For instance, a poverty-reduction strategy that succeeded in one community may fail in another due to local differences.

The Missing Context: Trust and Power

While Beyond Belief is a fascinating account of scientific rigor, it arguably underestimates the political and social barriers to implementation. The reviewer notes that even well-evidenced policies often fail not because the science is wrong, but because trust is missing.

Key Insight: Effective policy requires more than data; it requires community cohesion, democratic legitimacy, and trust in authority.

Examples cited include:
* Wolf reintroduction: Often opposed by local communities regardless of ecological benefits.
* Vaccination mandates: Frequently met with skepticism due to distrust in government motives.
* Environmental taxes: Struggle against public resistance to perceived unfairness.

In these cases, the problem is not a lack of evidence, but a deficit of power and equity. For example, in education, poor teaching outcomes are often linked to systemic issues like underfunding and teacher burnout, rather than a failure to apply the latest research. Teachers may simply lack the time or resources to implement evidence-based practices, regardless of how robust those practices are.

Pearson touches on the importance of involving Indigenous peoples in conservation efforts, recognizing their deep local knowledge. However, the book treats these sociopolitical challenges as minor obstacles (“wrinkles”) rather than central components of the solution.

Conclusion

Beyond Belief is a vital contribution to the discourse on evidence-based decision-making. It effectively demonstrates how scientific methods can bring clarity to complex fields. However, readers should approach it with the understanding that data alone is insufficient. For policies to succeed, evidence must be paired with genuine community engagement, political will, and an acknowledgment of the power dynamics at play.


Recommended Reading on Evidence and Policy

For those interested in exploring the limits and applications of evidence further, consider these three titles:

  1. Bad Science by Ben Goldacre
    • A doctor and broadcaster exposes how media often misrepresents scientific findings, promoting nonsense as fact.
  2. The Golem at Large by Harry Collins and Trevor Pinch
    • Sociologists examine how scientific methods struggle when applied to the messy uncertainties of the real world.
  3. The Blunders of Our Governments by Anthony King and Ivor Crewe
    • A humorous yet infuriating look at government failures, highlighting that lack of evidence is just one of many reasons politics goes wrong.