Why red meat consumption may appear unhealthy in scientific studies

There have been many academic articles in the past linking red meat intake with increased mortality, and there will be more in the future. I discussed one such article before here (, ). The findings in this article, which received an enormous amount of media attention, are the basis for my discussion in this post. I am interested in answering the question: Why red meat consumption may appear unhealthy in scientific studies?

This question leads to other questions, which are also addressed in this post. Can red meat intake be associated with increases and decreases in mortality, in the same study? Can red meat intake possibly cause increased mortality, at least for a percentage of the population?

All of the analyses discussed below have been conducted with the software WarpPLS (). This software supports multivariate analyses where relationships can be modeled as linear or nonlinear, with or without moderating effects included.

The ubiquitous J curve

The graph below shows how mortality varies with red meat intake. As you can see, the relationship is overall flat, meaning that red meat intake is overall unrelated with mortality. However, when we look at the two sets of points above and below the relationship line, for males and females, we see a different pattern. It appears that red meat intake and mortality are indeed significantly associated with one another, but in a J-curve pattern. That is, red meat intake is associated with increases and decreases in mortality, in the same study.

Each serving of red meat corresponds to approximately 84 g. Therefore, we could say, based on the graph above, that mortality would be minimized with consumption of a little less than 67 g/d of red meat (0.80*84) for males, and a little more than 115 g/d (1.37*84) for females. Not zero consumption, simply not a lot.

Now, one may say that this is very reasonable: a little bit of red meat is fine, but not too much. Generally females lose blood periodically, so they need a bit more than males. However, based on a number of other studies, it seems that the optimal intake amounts that we are seeing here are unusually low. If this is the case, what could be biasing the results?

Multivariate associations

Multivariate associations can distort results quite a lot. Such associations arise from correlations among multiple variables; correlations that should not per se be taken as strong indications of causality. Below are the correlations between “Red meat intake (servings/d)” and other relevant variables in the dataset taken from the study being considered here.

- Physical activity (MET-h/wk): -0.696. That is, increases in red meat intake are very strongly associated with decreases in physical activity in this study. One MET unit is equal to the energy produced per unit surface area of an average person seated at rest.

- Diabetes (%): 0.781. Increases in red meat intake are very strongly associated with increases in the percentages of individuals with diabetes.

- Food intake (cal/d): 0.604. Increases in red meat intake are strongly associated with increases in food intake in general.

- Current smoker (%): 0.519. Increases in red meat intake are strongly associated with increases in the percentages of smokers.

Let us take the physical activity variable, for example. It is inversely correlated with red meat intake, with a strong correlation coefficient, and it is unlikely that this correlation is due to direct causation - one way or the other. Below is the same graph as above, but now with labels indicating physical activity levels.

You can see that physical activity levels tend to be lower among females, which is in part due to them being on average smaller than males and thus burning fewer calories. Here you can see that physical activity is associated with mortality in a pattern that is pretty much the reverse of red meat intake. The reason for this is the strong inverse correlation between physical activity and red meat intake.

The highest mortality is associated with the lowest physical activity at the highest red meat intake. Interestingly, mortality goes up as one reaches the point at which physical activity is the highest at the lowest red meat intake.

Now take a look at the two graphs below. Both show the relationship between diabetes incidence and mortality. The first has biological sex indicated through legends. The second has physical activity levels indicated through labels.

One way to untangle the messy nature of the relationships above is to try to look for possible moderating effects, based on reasonable causal assumptions. One such assumption is that physical activity moderates the relationship between red meat intake and mortality.

The moderating effect of physical activity

The two graphs below show the relationships between red meat intake and mortality with (first graph) and without (second graph) the moderating effect of physical activity. Basically and with minimum statistical jargon, the numbers next to the arrows indicate the strengths of the associations (betas) and the probabilities that the associations are not real (Ps). By convention, a P value lower than 0.05 is normally seen as an indication that the association is strong enough to be considered real – i.e., not due to chance.

What the graphs above suggest is that increases in physical activity tend to make the relationship between red meat intake and mortality go from flat (or nonexistent) to negative. This is the meaning of the negative moderating coefficient next to the dashed arrow. In other words, as physical activity levels go up, more red meat intake is associated with less mortality.

The role of genetics

While being male or female means having different genetic profiles, with a full chromosome difference, the effect of biological sex on mortality appears to be confounded by the effect of physical activity. That is, physical activity, as measured in this study (using METs), is strongly correlated with biological sex, and also with mortality. As noted earlier, physical activity levels tend to be lower among females, which is in part due to them being on average smaller than males and thus burning fewer calories.

But another genetic factor that may influence the results and that is not included in this analysis is HFE hereditary haemochromatosis, a hereditary disease that leads to excessive intestinal absorption of dietary iron, resulting in iron overload. This genetic condition is relatively common in northern Europeans and their descendants, with a prevalence of 1 in 200 in this group. Factoid: it is quite common in Australia.

This level of prevalence matters when you are looking at mortality levels that vary along only approximately 8 in 1,000, as in this study. That translates to 0.4 in 200; much less than the prevalence of HFE hereditary haemochromatosis in northern Europeans and their descendants. That is, HFE hereditary haemochromatosis may be a major confounder in our analyses above, one that has not been controlled for. The study included 37,698 men from the Health Professionals Follow-up Study (1986-2008) and 83,644 women from the Nurses' Health Study (1980-2008). There must have been many individuals with HFE hereditary haemochromatosis in the sample.

In summary …

Based on all of the above, I think it is quite possible that for those who suffer from HFE hereditary haemochromatosis, both biological sex and physical activity affect the relationship between red meat intake and mortality.

Past menopause, women who suffer from HFE hereditary haemochromatosis should consider reducing their red meat intake, as well as intake of iron from other sources (particularly from pills). The same goes for men with the condition. Male and post-menopausal female sufferers should consider regularly donating blood.

Both men and women who suffer from HFE hereditary haemochromatosis should consider significantly increasing their level of physical activity to reduce the likelihood of iron overload. (This would be good for anyone.)

Why physical activity? Because iron is used to transport oxygen and in biological redox reactions, both of which are significantly increased during and after physical activity. In those who tend to accumulate iron in tissues, physical activity creates an increase in demand for iron that can balance the increased supply from iron-rich sources.

Our bodies evolved in the context of physical activity, often intense physical activity, and are thus maladapted for sedentary behavior.

The 2012 Arch Intern Med red meat-mortality study: Eating 234 g/d of red meat could reduce mortality by 23 percent

As we have seen in an earlier post on the China Study data (), which explored relationships hinted at by Denise Minger’s previous and highly perceptive analysis (), one can use a multivariate analysis tool like WarpPLS () to explore relationships based on data reported by others. This is true even when the dataset available is fairly small.

So I entered the data reported in the most recent (published online in March 2012) study looking at the relationship between red meat consumption and mortality into WarpPLS to do some exploratory analyses. I discussed the study in my previous post; it was conducted by Pan et al. (Frank B. Hu is the senior author) and published in the prestigious Archives of Internal Medicine (). The data I used is from Table 1 of the article; it reports figures on several variables along 5 quintiles, based on separate analyses of two samples, called “Health Professionals” and “Nurses Health” samples. The Health Professionals sample comprised males; the Nurses Health sample, females.

Below is an interesting exploratory model, with results. It includes a number of hypotheses, represented by arrows, which seem to make sense. This is helpful, because a model incorporating hypotheses that make sense allows for easy identification of nonsense results, and thus rejection of the model or the data. (Refutability is one of the most important characteristics of good theoretical models.) Keep in mind that the sample size here is very small (N=10), as the authors of the study reported data along 5 quintiles for the Health Professionals sample, together with 5 quintiles for the Nurses Health sample. In a sense, this is somewhat helpful, because a small sample tends to be “unstable”, leading nonsense results and other signs of problems to show up easily – one example would be multivariate coefficients of association (the beta coefficients reported near the arrows) greater than 1 due to collinearity ().

So what does the model above tell us? It tells us that smoking (Smokng) is associated with reduced physical activity (PhysAct); beta = -0.92. It tells us that smoking (Smokng) is associated with reduced food intake (FoodInt); beta = -0.36. It tells us that physical activity (PhysAct) is associated with reduced incidence of diabetes (Diabetes); beta = -0.25. It tells us that increased food intake (FoodInt) is associated with increased incidence of diabetes (Diabetes); beta = 0.93. It tells us that increased food intake (FoodInt) is associated with increased red meat intake (RedMeat); beta = 0.60. It tells us that increased incidence of diabetes (Diabetes) is associated with increased mortality (Mort); beta = 0.61. It tells us that being female (SexM1F2) is associated with reduced mortality (Mort); beta = -0.67.

Some of these betas are a bit too high (e.g., 0.93), due to the level of collinearity caused by such a small sample. Due to being quite high, they are statistically significant even in a small sample. Betas greater than 0.20 tend to become statistically significant when the sample size is 100 or greater; so all of the coefficients above would be statistically significant with a larger sample size. What is the common denominator of all of the associations above? The common denominator is that all of them make sense, qualitatively speaking; there is not a single case where the sign is the opposite of what we would expect. There is one association that is shown on the graph and that is missing from my summary of associations above; and it also makes sense, at least to me. The model also tells us that increased red meat intake (RedMeat) is associated with reduced mortality (Mort); beta = -0.25. More technically, it tells us that, when we control for biological sex (SexM1F2) and incidence of diabetes (Diabetes), increased red meat intake (RedMeat) is associated with reduced mortality (Mort).

How do we roughly estimate this effect in terms of amounts of red meat consumed? The -0.25 means that, for each standard deviation in the amount of red meat consumed, there is a corresponding 0.25 standard deviation reduction of mortality. (This interpretation is possible because I used WarpPLS’ linear analysis algorithm; a nonlinear algorithm would lead to a more complex interpretation.) The standard deviation for red meat consumption is 0.897 servings. Each serving has about 84 g. And the highest number of servings in the dataset is 3.1 servings, or 260 g/d (calculated as: 3.1*84). To stay a bit shy of this extreme, let us consider a slightly lower intake amount, which is 3.1 standard deviations, or 234 g/d (calculated as: 3.1*0.897*84). Since the standard deviation for mortality is 0.3 percentage points, we can conclude that an extra 234 g of red meat per day is associated with a reduction in mortality of approximately 23 percent (calculated as: 3.1*0.25*0.3).

Let me repeat for emphasis: the data reported by the authors suggests that, when we control for biological sex and incidence of diabetes, an extra 234 g of red meat per day is associated with a reduction in mortality of approximately 23 percent. This is exactly the opposite, qualitatively speaking, of what was reported by the authors in the article. I should note that this is also a minute effect, like the effect reported by the authors. (The mortality rates in the article are expressed as percentages, with the lowest being around 1 percent. So this 23 percent is a percentage of a percentage.) If you were to compare a group of 100 people who ate little red meat with another group of the same size that ate 234 g more of red meat every day, over a period of more than 20 years, you would not find a single additional death in either group. If you were to compare matched groups of 1,000 individuals, you would find only 2 additional deaths among the folks who ate little red meat.

At the same time, we can also see that excessive food intake is associated with increased mortality via its effect on diabetes. The product beta coefficient for the mediated effect FoodInt --> Diabetes --> Mort is 0.57. This means that, for each standard deviation of food intake in grams, there is a corresponding 0.57 standard deviation increase in mortality, via an increase in the incidence of diabetes. This is very likely at levels of food consumption where significantly more calories are consumed than spent, ultimately leading to many people becoming obese. The standard deviation for food intake is 355 calories. The highest daily food intake quintile reported in the article is 2,396 calories, which happens to be associated with the highest mortality (and is probably an underestimation); the lowest is 1,202 (also probably underestimated).

So, in summary, the data suggests that, for the particular sample studied (made up of two subsamples): (a) red meat intake is protective in terms of overall mortality, through a direct effect; and (b) the deleterious effect of overeating on mortality is stronger than the protective effect of red meat intake. These conclusions are consistent with those of my previous post on the same study (). The difference is that the previous post suggested a possible moderating protective effect; this post suggests a possible direct protective effect. Both effects are small, as was the negative effect reported by the authors of the study. Neither is statistically significant, due to sample size limitations (secondary data from an article; N=10). And all of this is based on a study that categorized various types of processed meat as red meat, and that did not distinguish grass-fed from non-grass-fed meat.

By the way, in discussions of red meat intake’s effect on health, often iron overload is mentioned. What many people don’t seem to realize is that iron overload is caused primarily by hereditary haemochromatosis. Another cause is “blood doping” to improve athletic performance (). Hereditary haemochromatosis is a very rare genetic disorder; rare enough to be statistically “invisible” in any study that does not specifically target people with this disorder.

The 2012 red meat-mortality study (Arch Intern Med): The data suggests that red meat is protective

I am not a big fan of using arguments such as “food questionnaires are unreliable” and “observational studies are worthless” to completely dismiss a study. There are many reasons for this. One of them is that, when people misreport certain diet and lifestyle patterns, but do that consistently (i.e., everybody underreports food intake), the biasing effect on coefficients of association is minor. Measurement errors may remain for this or other reasons, but regression methods (linear and nonlinear) assume the existence of such errors, and are designed to yield robust coefficients in their presence. Besides, for me to use these types of arguments would be hypocritical, since I myself have done several analyses on the China Study data (), and built what I think are valid arguments based on those analyses.

My approach is: Let us look at the data, any data, carefully, using appropriate analysis tools, and see what it tells us; maybe we will find evidence of measurement errors distorting the results and leading to mistaken conclusions, or maybe not. With this in mind, let us take a look at the top part of Table 3 of the most recent (published online in March 2012) study looking at the relationship between red meat consumption and mortality, authored by Pan et al. (Frank B. Hu is the senior author) and published in the prestigious Archives of Internal Medicine (). This is a prominent journal, with an average of over 270 citations per article according to Google Scholar. The study has received much media attention recently.

Take a look at the area highlighted in red, focusing on data from the Health Professionals sample. That is the multivariate-adjusted cardiovascular mortality rate, listed as a normalized percentage, in the highest quintile (Q5) of red meat consumption from the Health Professionals sample. The non-adjusted percentages are 1.4  percent mortality in Q5 and 1.13 in Q1 (from Table 1 of the same article); so the multivariate adjustment-normalization changed the values of the percentages somewhat, but not much. The highlighted 1.35 number suggests that for each group of 100 people who consumed a lot of red meat (Q5), when compared with a group of 100 people who consumed little red meat (Q1), there were on average 0.35  more deaths over the same period of time (more than 20 years).

The heavy red meat eaters in Q5 consumed 972.37 percent more red meat than those in Q1. This is calculated with data from Table 1 of the same article, as: (2.36-0.22)/0.22. In Q5, the 2.36 number refers to the number of servings of red meat per day, with each serving being approximately 84 g. So the heavy red meat eaters ate approximately 198 g per day (a bit less than 0.5 lb), while the light red meat eaters ate about 18 g per day. In other words, the heavy red meat eaters ate 9.7237 times more, or 972.37 percent more, red meat.

So, just to be clear, even though the folks in Q5 consumed 972.37 percent more red meat than the folks in Q1, in each matched group of 100 you would not find a single additional death over the same time period. If you looked at matched groups of 1,000 individuals, you would find 3 more deaths among the heavy red meat eaters. The same general pattern, of a minute difference, repeats itself throughout Table 3. As you can see, all of the reported mortality ratios are 1-point-something. In fact, this same pattern repeats itself in all mortality tables (all-cause, cardiovascular, cancer). This is all based on a multivariate analysis that according to the authors controlled for a large number of variables, including baseline history of diabetes.

Interestingly, looking at data from the same sample (Health Professionals), the incidence of diabetes is 75 percent higher in Q5 than in Q1. The same is true for the second sample (Nurses Health), where the Q5-Q1 difference in incidence of diabetes is even greater - 81 percent. This caught my eye, being diabetes such a prototypical “disease of affluence”. So I entered the whole data reported in the article into HCE () and WarpPLS (), and conducted some analyses. The graphs below are from HCE. The data includes both samples – Health Professionals and Nurses Health.

HCE calculates bivariate correlations, and so does WarpPLS. But WarpPLS stores numbers with a higher level of precision, so I used WarpPLS for calculating coefficients of association, including correlations. I also double-checked the numbers with other software, just in case (e.g., SPSS and MATLAB). Here are the correlations calculated by WarpPLS, which refer to the graphs above: 0.030 for red meat intake and mortality; 0.607 for diabetes and mortality; and 0.910 for food intake and diabetes. Yes, you read it right, the correlation between red meat intake and mortality is a very low and non-significant 0.030 in this dataset. Not a big surprise when you look at the related HCE graph, with the line going up and down almost at random. Note that I included the quintiles data from both the Health Professionals and Nurses Health samples in one dataset.

Those folks in Q5 had a much higher incidence of diabetes, and yet the increase in mortality for them was significantly lower, in percentage terms. A key difference between Q5 and Q1 being what? The Q5 folks ate a lot more red meat. This looks suspiciously suggestive of a finding that I came across before, based on an analysis of the China Study II data (). The finding was that animal food consumption (and red meat is an animal food) was protective, actually reducing the negative effect of wheat flour consumption on mortality. That analysis actually suggested that wheat flour consumption may not be so bad if you eat 221 g or more of animal food daily.

So, I built the model below in WarpPLS, where red meat intake (RedMeat) is hypothesized to moderate the relationship between diabetes incidence (Diabetes) and mortality (Mort). Below I am also including the graphs for the direct and moderating effects; the data is standardized, which reduces estimation error, particularly in moderating effects estimation. I used a standard linear algorithm for the calculation of the path coefficients (betas next to the arrows) and jackknifing for the calculation of the P values (confidence = 1 – P value). Jackknifing is a resampling technique that does not require multivariate normality and that tends to work well with small samples; as is the case with nonparametric techniques in general.

The direct effect of diabetes on mortality is positive (0.68) and almost statistically significant at the P < 0.05 level (confidence of 94 percent), which is noteworthy because the sample size here is so small – only 10 data points, 5 quintiles from the Health Professionals sample and 5 from the Nurses Health sample. The moderating effect is negative (-0.11), but not statistically significant (confidence of 61 percent). In the moderating effect graphs (shown side-by-side), this negative moderation is indicated by a slightly less steep inclination of the regression line for the graph on the right, which refers to high red meat intake. A less steep inclination means a less strong relationship between diabetes and mortality – among the folks who ate the most red meat.

Not too surprisingly, at least to me, the results above suggest that red meat per se may well be protective. Although we should consider a least two other possibilities. One is that red meat intake is a marker for consumption of some other things, possibly present in animal foods, that are protective - e.g., choline and vitamin K2. The other possibility is that red meat is protective in part by displacing other less healthy foods. Perhaps what we are seeing here is a combination of these.

Whatever the reason may be, red meat consumption seems to actually lessen the effect of diabetes on mortality in this sample. That is, according to this data, the more red meat is consumed, the fewer people die from diabetes. The protective effect might have been stronger if the participants had eaten more red meat, or more animal foods containing the protective factors; recall that the threshold for protection in the China Study II data was consumption of 221 g or more of animal food daily (). Having said that, it is also important to note that, if you eat excess calories to the point of becoming obese, from red meat or any other sources, your risk of developing diabetes will go up – as the earlier HCE graph relating food intake and diabetes implies.

Please keep in mind that this post is the result of a quick analysis of secondary data reported in a journal article, and its conclusions may be wrong, even though I did my best not to make any mistake (e.g., mistyping data from the article). The authors likely spent months, if not more, in their study; and have the support of one of the premier research universities in the world. Still, this post raises serious questions. I say this respectfully, as the authors did seem to try their best to control for all possible confounders.

I should also say that the moderating effect I uncovered is admittedly a fairly weak effect on this small sample and not statistically significant. But its magnitude is apparently greater than the reported effects of red meat on mortality, which are not only minute but may well be statistical artifacts. The Cox proportional hazards analysis employed in the study, which is commonly used in epidemiology, is nothing more than a sophisticated ANCOVA; it is a semi-parametric version of a special case of the broader analysis method automated by WarpPLS.

Finally, I could not control for confounders because, given the small sample, inclusion of confounders (e.g., smoking) leads to massive collinearity. WarpPLS calculates collinearity estimates automatically, and is particularly thorough at doing that (calculating them at multiple levels), so there is no way to ignore them. Collinearity can severely distort results, as pointed out in a YouTube video on WarpPLS (). Collinearity can even lead to changes in the signs of coefficients of association, in the context of multivariate analyses - e.g., a positive association appears to be negative. The authors have the original data – a much, much larger sample - which makes it much easier to deal with collinearity.

Moderating effects analyses () – we need more of that in epidemiological research eh?