Skip to main content

Funding: Tales of Defamation

Wide generalizations are being made in the media lately, regarding nutrition and obesity researchers and where they get their funding. Often, these get to levels of insulting comparisons accusing researchers of being just like big tobacco scientists. The most recent article trending in the NYT discusses the Global Energy Balance Network (GEBN) and a few of its top researchers, like Jim Hill and Steven Blair (not surprisingly, names that are too big in nutrition are left out - Arne Astrupp is the Vice President of the European branch but his name wasn't implicated as being bought out in the article). The issue with the researchers is that they've taken money from Coke for their research, that their research pushes exercise over dietary intake as a cause of obesity (IMO, it's pretty weak data- their one paper on the topic relies heavily on 'we can't trust NHANES') and they pretty stupidly didn't disclose the funding on their webpage until it was pointed out to them. While I don't fully agree with their perspective on obesity (though I do think the energy flux theory is worth further study), to claim that GEBN is a front group and that these researchers are bought out is a far stretch. Like much of the observational evidence that fuels debates surrounding obesity, reverse causality isn't considered; anyone who knows Blair and Hill's work (eg Hill, 1998, 2005 - Blair has published/written extensively about the 'fat but fit' paradigm) knows that their opinions on exercise, obesity and treating metabolically unhealthy individuals have been around long before they started this network (addendum: see this 2008 interview with Blair + this 2012 Youtube video of Blair: "I've been arguing with the obesity cartel for a number of years now)). However, this isn't considered in the media coverage that's selling the shill card pretty hard (though this current article is softer than others I've seen). The lay perspective of this article appears to see little beyond the conspiracy, as evidenced by the comments.

Even MedPageToday is telling readers that Coca Cola money has bought out these researchers:


I've been watching the industry funded research wars for a while now, and have popped in occasionally, particularly as the message has become less about improving research and talking about industry lobbying, and more about attacking independent researchers who have sought out industry funding. Often, I see little more than conjecture in accusations against researchers, and those shouting the loudest don't help their case when they just point out funding and insinuate folly (unless we're saying that the data has been outright fudged, some critique of the methodology should accompany -- lest you open yourself to new biases). It's not surprising that some of the loudest voices in this field are those with no need for funding themselves - the few common names we see popping up and commenting have jobs/positions that rarely require the individual to be constantly writing grants in hopes of getting just one, and the reputation of a couple researchers' is just a necessary casualty in the righteous crusade against industry funded research. This 'expose' of GEBN isn't the first attempt by zealous anti-indu$try folks to take down the reputation of researchers in their crusade - let's not forget the BMJ's sugar series, which required Barry Popkin to step in and defend Susan Jebb, or the actually good diet soda study from Gary Foster and colleagues. Coke funding does not make the research bad, despite their corporate interests. The sacrifice of independent researchers' reputations in this crusade is truly a shame, since Coke is going to run ads of thin people running with Coke bottles, regardless of whether or not scientists get funding from them.

We could talk forever and ever about what level of bias is instituted by industry funding, how we weigh that bias against the many other biases that occur in research, and whether that bias actually hurts the research in ways that things like peer review and editors can't detect. We could also talk forever about whether we should be working with or against industry (or just flat out ignoring them). But these are likely conversations we'll never get people to agree on (Katz and Nestle, two involved in this debate regularly, certainly don't - see last paragraph).

What I want from those concerned about industry funding is to come off as genuine as possible. From someone in research surrounded by people pulling their hair out about grants (myself included), and looking for money to keep their research going, your crusade comes off as disingenuous. It's promoting a 'problem' that requires good faith that it's actually a problem, while offering no alternative funding solution (the evidence that industry funding of independent researchers being a problem pretty heavily relies on one PloS paper - anyone who has read the paper in full and the individual studies included knows that it does not say what most who cite it say it does).  I challenge those concerned about industry funding to make a conscious effort to match every statement of concern about industry funding, with a call to action, to get taxpayers to write to their congressmen/women and advocate for higher NIH/NSF funding. Shout from the rooftops both your concerns, and the plight of researchers who write 14 grants in hopes of getting 1 or 2. If you can be concerned about industry funded research, you should be just as concerned about non-industry funding that is available. It's a simple request and a small burden that would gain you significant amounts of respect from those in the research field. At the very least, present the argument to the public that research costs money, and that if they don't want it to be industry, they better be okay with it being their tax dollars.

Until the industry funded research argument is balanced by an equally loud message that non-industry funding is highly limited, those shouting the loudest do little to address their own issue. This notion that researchers seeking industry money are doing conflicted research does little but subtly suggest that academic researchers find a new job or risk having their reputations threatened due to their funding source (no, I'm not being dramatic - go look at articles written about Susan Jebb). Keeping up with the academia lifestyle is busy enough without a bunch of people who aren't in your field telling you how you should fund yourself. If you get the time, I'd also urge you to consider educating individuals' to encourage NIH to fund nutrition research that has been established as a priority by organizations like ASN. As evidenced by the seemingly consistent stream of low-fat vs low-carb studies in the literature, NIH doesn't seem to be paying attention to these.

Dr. Katz commented on the issue of industry funding, and attempts to separate the issue based on the type of industry doing the funding - he defends his funding from the California Walnut Commission for his own research on walnuts, but notes that Coke funding is different when it comes to the issue of energy balance because it 'inveighs against their product'. This is an area that has spawned much debate, especially among the dietetics community that has been critiqued for its corporate influences. Do we only accept money from Quaker Oats and not the American Beverage Association? This can sound great on the surface, until you acknowledge that Quaker Oats is owned by Pepsi. The issue gets pretty complicated when you note that companies make many products e.g. do we not allow Coke funding because of their sugar sweetened beverages, even though they produce 100 percent fruit juices and diet beverages? Do we accept dairy money when they offer low fat milk but their product is also made into ice cream? Do we accept money from meat producers? Depending on who you ask, funding from the Whole Grain Council can be a sound choice or the biggest bias in the world. Fifty years ago, the California Avocado Commission would've been a blasphemous choice of funding. Do we only accept nutrient dense food producers, and soda producers are out because soda has no other nutrients besides sugars? Do we then not accept producers of foods like potatoes, that are 'associated' with more weight gain than are SSBs? I don't particularly agree with Katz's assessment here that there is righteous and non-righteous sources of funding (haven't even touched on the ethical/environmental aspects of food). Again, regardless of the outcomes of Blair and Hill's research on energy balance (which is only indirectly related to Coke unlike Katz's research), Coke will still make the claim that its SSBs can be consumed in moderation and balanced with activity - the basics of thermodynamics let them make this claim, not new research on energy flux. I should note that Katz chose a convenient example since walnuts are hardly disputed as 'health food' (unless you're part of the seemingly growing number of researchers who think that high linoleic acid consumption has contributed to obesity); odd that he didn't choose to defend his egg industry funding, where the shill card is much more easily played.  It gets into a dangerously ambiguous realm to start saying that some types of industry funding are good but others are not. Katz might be convinced that Drs Hill and Blair are serving their funders, but the authors' publication history suggests otherwise. If anything, personal bias from researchers' attachment to a theory seems the stronger hypothesis, as opposed to mindless drones/shills doing Coke's bidding. The fact that Coke wants to toss a bunch of money at their hypothesis is just business as usual.

Note: The NYT could've easily made this a story about how Coke chooses to fund researchers whose opinions/theories aren't supported by the totality of the data. They could've said anything about how these researchers have been pushing this perspective for years, long before GEBN. They chose not to.

Comments

  1. Could you say a bit more about the PloS study on industry-funded research? Why do most people get it wrong?

    ReplyDelete
    Replies
    1. Hi Anon,
      For starters, the PloS study is commenting on industry-funded studies in systematic reviews and meta-analyses. Often, this is the evidence that industry-funding of scientific studies is problematic - nothing about the study looked at individual studies' funding. At face value, it should lead us to scrutinize SR/MA's with industry influence.

      The PloS study also does little to take into the quality of the studies and the reviews - they're not evaluating who 'did the analyses right'. They just look at the wording of the conclusions and move compare that to funding. They list Forshee 2006 as not finding a positive link between SSBs, even though they did. They just argue that the magnitude of that link is small (in their discussion, they note that others have found similar effect sizes). This issue of magnitude is discussed in Gibson - they are given a 'no positive' designation, but their conclusion argues that the association isn't quite significant. In a time when individuals' are saying that SSBs 'cause' obesity, they might benefit from reading this alternative perspective and their take on magnitude.

      The PloS study doesn't truly ask why different conclusions are reached - they just point to funding and suggest folly. Some of the differences between reviews just comes from asking different questions. Are people drinking too much vs are SSBs uniquely associated with weight gain relative to other sources are 2 questions often asked and tested in this PloS study, yet the authors make no note that the SRs/MAs are asking different things. Since some have purported that switching out SSBs for other sources of calories can effect satiety and therefore body weight, the latter is a fair question to ask - is a public health campaign that tells people to reduce SSB going to do anything if people replace the calories? Mattes 2011' conclusion looks at 'unique' effects of SSBs - consider their conclusion statement in the discussion "shows that the currently available evidence on NSB consumption reduction programs is suggestive, but does not confirm that such programs may be effective". This gets a no association grading - but they admit that higher quality evidence relying on RCTs is suggestive and that we need better RCTs. Some don't like Allison because of his funding, but note that other 'independent' researchers have suggested the same thing. "http://www.nature.com/ijo/journal/v30/n3s/full/0803489a.html http://www.bmj.com/content/346/bmj.e7492"

      Much of the SSB/obesity debate has been about quality of studies - any who has followed David Allison's take on this knows that some in the field have an issue with basing policy off of associations. Passing off the SSB debate as being just about industry funding doesn't do it scientific justice. I highly highly encourage you to read Mattes 2011 's discussion for an actual analysis of the several of the studies in this PloS review, and why they come to different conclusions, before jumping to "industry funding is bad" http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3169649/

      You might be interested to know that the other analysis concerning industry funding cites Mattes 2011 as not being industry funded: http://ajcn.nutrition.org/content/early/2014/02/26/ajcn.113.063776.full.pdf+html .

      Delete
    2. Kevin,

      Thank you so much. That was way more that I expected I would get. I'm so happy Virginia Messina directed me to your blog.

      Best wishes,

      Mike

      Delete
    3. I'd also note a more simple problem, which is that the evidence component of the SR shifts over time to reflect the increasing numbers of RCTs. At the same time, the funding shifts too: the RCT driven SRs tend to be independently funded; the earlier observational study dominated SRs tend to show more industry funding (although the authors excluded three SRs that were independently funded and showed no effect from this earlier time period). When you add this to the crude methodology for evaluating effects, the claim of bias cannot be answered by the design of the study.

      Best

      Trevor

      Delete
    4. Trevor, who commented above, also wrote about this topic in Harvard Business Review! https://hbr.org/2014/03/when-research-should-come-with-a-warning-label/

      Delete
  2. David Katz is speaking out against this at FNCE right now.!

    ReplyDelete

Post a Comment

Popular posts from this blog

Beware the Meta-Analysis: Fat, Guidelines, and Biases

Headlines were abuzz this week, reporting that a new review of randomized controlled trials at the time of the low-fat guidelines didn't support their institution. Time , Business Insider , and The Verge all covered the topic with sensationalist headlines (e.g. 'We should never have told people to stop eating fat' #weneverdid). I won't spend every part of this blog picking apart the entire meta-analysis; you can read it over at the open access journal, BMJ Open Heart (1) -- (note, for myself, i'm adding an extra level of skepticism for anything that gets published in this journal). I'm also not going to defend low-fat diets either, but rather, use this meta-analysis to point out some critical shortcomings in nutritional sciences research, and note that we should be wary of meta-analyses when it comes to diet trials. First off, let's discuss randomized controlled trials (RCTs). They are considered the gold standard in biomedical research; in the hierarc

On PURE

The PURE macronutrients studies were published in the Lancet journals today and the headlines / commentaries are reminding us that everything we thought we think we were told we knew about nutrition is wrong/misguided, etc. Below is my non-epidemiologist's run down of what happened in PURE. A couple papers came out related to PURE, but the one causing the most buzz is the relationship of the macronutrients to mortality. With a median follow up of 7.4 years, 5796 people died and 4784 had a major cardiovascular event (stroke, MCI). The paper modeled the impacts of self reported dietary carbohydrate, total fat, protein, monounsaturated (MUFA), saturated (SFA), and polyunsaturated (PUFA) fatty acid intakes on cardiovascular (CVD), non-CVD and total mortality; all macros were represented as a percentage of total self reported energy intakes and reported/analyzed in quintiles (energy intakes between 500-5000kcals/day were considered plausible..). All dietary data was determined by a

Nutrition Recommendations Constantly Change...Don't They?

I was on Facebook the other day, and someone in a group I'm in made a statement about not being sure whether to eat dairy, because "one week its bad, and the next its good". This is something I hear all too often from people: nutrition is complex, confusing, and constantly changing. One week 'X' is bad, the next 'X' is good. From an outsider's perspective, nutrition seems like a battlefield - low fat vs low carb vs Mediterranean vs Paleo vs Veg*n. Google any of these diets and you'll find plenty of websites saying that the government advice is wrong and they've got the perfect diet, the solution to all of your chronic woes, guarantee'ing weight loss, muscle growth, longevity, etc. Basically, if you've got an ailment, 'X' diet is the cure. I can certainly see this as being overwhelming from a non-scientist/dietitian perspective. Nutrition is confusing...right? Screenshot, DGA: 1980, health.gov From an insider's pe