Portlandia, Season 4, Episode 1 - Death By Confusion sketch
Working in Portland, Oregon as a biology instructor gives me ample anecdotal evidence that Portland is a health-crazed hotbed of all things "woo" and lifestyle choices based on partial scientific evidence. Then again, maybe this isn't just a "Portland" thing. Many of us in the global food allergy community are continually frustrated hearing the media reports of scientific findings that seemingly contradict each other. Seriously - Is Vitamin D "good" or "bad?" Should children consume or avoid nuts to prevent food allergies?
The deeper issue here is that the scientific process and how scientific findings typically get reported in the media are generally at odds with one another. What the Portlandia sketch highlights is that most people interact with scientific findings through a prettily packaged, media filter based on some personal emotion attached to the topic. "I read it in the New York Times..." or "I heard it on NPR..." Science is fact-based, but the media is typically emotion-laced facts. Emotion-laced facts are not in and of itself "wrong," but it sets up an inherent bias in that we tend to consume the information that supports our preconceived notions (as if I need an excuse to eat more chocolate, right? More on chocolate science at the end of the post). Well-designed scientific studies aim to take bias out of the equation as much as possible.Where we get into trouble is when media reports on the same topic of research disagree. How many times have media reports presented conflicting science on whether red wine/chocolate/coffee/beer/eggs/etc is "good" or "bad" for you?
And this gets to another point where science and media reports of science differ. Science is a slow and steady process with a whole lot of nuance, whereas media reports of science, rapidly distill partial understanding of natural phenomena as if it were ultimate, irrefutable proof. Any one scientific study is not enough evidence to change behavior/medical advice/etc. Only when a topic has been researched through many different studies through several different approaches do scientists feel comfortable saying, "yes, this is how we believe x, y, or z is happening, and people should do a, b, or c as a result." This is scientific consensus. In the media, however, scientific findings often focus on one novel study at a time instead of the slow steady zigzagging path toward consensus. Nuance and consensus often get lost in translation, and they don't make "exciting" headlines. Consensus may have been a novel report ten years ago along with the three other competing ideas of the day that were subsequently shown to be false. I'm tired of the media making scientists look bad and unreliable.
The great irony of "death by confusion" is that overstating any individual scientific finding in the media as if it were ultimate truth backfires when the next overblown claim gets reported six months down the road. While the skit itself overblows the end result (I hope?) of this back and forth reporting, I do think that the real world effect on people is more stress and anxiety rather than less. I want real hope, not false hope.
Some basic strategies to be a good consumer of science in the media:
1. If you read articles from mainstream media channels, look for the primary source (most likely a scientific journal article). If the article fails to link to the primary source, be very skeptical.
Example media report: People Magazine
Primary source: New England Journal of Medicine
2. Read AT LEAST the abstract (research summary) if not the whole primary source if it is freely available. Do the results/conclusions seem in line with the media report?
3. Do any credible educational, research, and professional organizations with a medical board comment on the topic? In the food allergy world, this means FARE, AAFA and KFA, FAACT, AAAAI, and ACAAI. The magazine, Allergic Living, also provides great coverage of scientific findings!
Post script:
A must read published two days ago at io9 showing science reporting without due diligence:
I Fooled Millions Into Thinking Chocolate Helps Weight Loss. Here's How. By John Bohannon
Good coverage by NPR that also highlights the controversy of the "fake" chocolate study.
Love it or hate it, I have a feeling this will be a case-study for science journalism in the years to come.