Saturday 14 March 2009

Bad Science

Read this book. Ben Goldacre is a doctor + blogger. This is his good-natured rant about the manipulative tricks of money grubbing charlatans who adopt the trappings of science. His targets include homeopaths (homeopathic drugs are no better than placebos), pharma companies (trials which show expensive drugs to be ineffective are not published), and the media (who publicise a fake health scare a week). Great fun.

I hereby proclaim that Moonballs from Planet Earth and Bad Science are kindred souls.

The trouble with bad science actually starts where the book leaves off, when one moves beyond pharmacology. There are many fields worthy of scientific enquiry, where placebo-controlled, double-blind, randomized trials are not possible.

For instance, Earth Sciences. It is worth knowing if we are making our planet uninhabitable. However, we can't find out by doing an experiment. We can't hold out a control sample of several dozen similar planets where the fossil fuels were never burnt, and compare the richness of life-forms observed a few thousand years later in the test and control. So scientists have to use models, which are intrinsically fallible.

Calling out the shortcomings of the models used is central to being an honest scientist. However, lists of model caveats don't make for good TV (or for good top-management presentations). So the media coverage of global warming is about as alarmist as the fake-health-scare-a-week stories that Ben Goldacre rants on about.

The guy who first called this non-science, was Bjorn Lomberg, in the Skeptical Environmentalist. It is not light reading, but it is also worth looking up, just to get a sense for how hard it really is to construct good science, with limited data, in the thick of an emotionally charged, politicized debate.

No comments: