For a week now, I've been pondering an article I came across in ScienceDaily - Dying from Food Allergy Less Likely Than Being Murdered. As all good headlines should do, they grab the reader's attention and make you want to read more... MORE! As a parent of a severely food allergic child, this headline certainly grabbed my attention and elicited a most visceral response - how dare they minimize our daily struggle and fear to prevent a life-threatening reaction (anaphylaxis) by comparing it to something completely unrelated (like murder?!)! After an eye roll so large that I thought my eyeballs would permanently cramp at the top of their sockets, I opted to let the emotion settle a bit and break this down further. Clearly, I'm biased, but I needed time to analyze this while recognizing my own biases to see if there is indeed merit to the article and the original peer-reviewed article it is based upon.
Does the ScienceDaily headline/article truthfully report the scientific findings?

Garbage in. Garbage out? As already mentioned, the error surrounding their predicted incidence of deaths due to anaphylaxis is quite large, so the true incidence is quite hard to pin down. The problem with their "input" is that there are known errors in coding the cause of death due to anaphylaxis (e.g. coded as asthma instead of the anaphylaxis that caused the response). Another "input" problem is the difficulty in nailing down the true prevalence of food allergy. The study authors are well aware of these issues, and in fact, attempt a sensitivity analysis to see how the incidence of food-related anaphylactic deaths changes with different food allergy prevalence values. The numbers reported in the ScienceDaily article are based on a conservative estimate of food allergy prevalence, 3% of the general population.
So does the ScienceDaily headline reflect reality? In my opinion, it was disingenuous to compare the very squishy statistic of food-allergy related deaths to murder deaths. The predicted incidence values for food-related allergy deaths and murder are not nearly far enough away from one another for any comfort in that conclusion (in fact, no error values are reported for any of the "other" causes of death). Isn't it just apples and oranges anyway? The study authors themselves stick with a much more reasonable conclusion based on a more probable true difference in incidence and not so much emotion that "fatal food anaphylaxis for a food-allergic person is rarer than accidental death in the general population." Why didn't ScienceDaily report that? My conclusion is that the knee-jerk response of being compared to "murder" is a much more effective headline. So, yes, this is "1 reason I despise science headlines." I'll point out that unfair statistical comparisons is one of many reasons to loathe science headlines. Unfortunately, I'm sure there will be more fodder for future blog posts.
Stay tuned for a follow-up post (Link to follow-up post). I will put these findings in the context of what it means for the food allergic individual (or their caregivers) and highlight the recent study in the Journal of Allergy and Clinical Immunology (JACI), Anaphylaxis in America: The prevalence and characteristics of anaphylaxis in the United States.
PS - In an attempt to understand how headlines are written, I did a cursory Google search for "writing great headlines." My blog title reflects that advice - complete with a numerical value as the lead. We'll see how many blog hits I get (so scientific and completely unbiased, right?)!
It's getting harder to tell a good headline from "click-bait."
ReplyDeleteIndeed! I couldn't agree more...
DeleteGreat post Jessica. As someone who is trying to become an author, I learn a lot about author marketing and the need to come up with "sound bytes" but some people can certainly cross a line and it ends up being negative marketing. :(
ReplyDeleteThanks so much, Jessie! I definitely understand the need to have a catchy title, but it's so important that reporting of science gets it right - that the report is in line with the actual scientific findings. It can be bad for the news outlet, bad for the scientists who did the study, and bad for all of the non-scientists who are gaining a mistrust in science because of oversold stories :(.
Delete