Investigative journalism awarded excellence
Fonterra exaggerates study results to claim benefits of Milk for Schools campaign
Fonterra’s claims which link cow’s milk to improved bone health using a recent Massey University study have been criticised for exaggerating the study’s results.
The claims, which are posted on Fonterra’s Milk for Schools website, say children in the study who participate in their Milk for Schools campaign “had significantly improved bone health when compared to a control group recruited from schools that do not.”
While study leader Professor Marlena Kruger acknowledges the need to confirm her findings by a “larger and longer term study,” experts say Fonterra is making claims which the study’s results do not show.
“The claims are out of proportion with the study findings,” says Specialist Physician Dr. Marion Leighton.
“The current agreement in the scientific community is that anything with a p-value less than 0.05 is possibly significant. There were no statistically significant improvements in almost all areas [of the study], except bone mineral content in girls. This does not necessarily mean they have better bone health.”
While girls whole body bone mineral content shows a significant improvement in the study, with a p-value of 0.010, the increase in whole-body bone mineral content and the standard score for bone mineral content is insignificant.
The study also says that “on weekdays 85% of children in the control group were consuming at least two serves of either milk or milk products.” Professor Lumley from the University of Auckland Statistics Department says this weakens Fonterra’s claims as milk was being consumed by both groups.
“It’s not surprising that a small study would fail to provide strong evidence, especially when 85% of the children [in the control group] were already consuming the recommended 2+ servings of milk per day,” Lumley says.
Professor Lumley acknowledges Fonterra’s association of milk with improved bone health as rational but agrees that the claims exaggerate the study’s results.
“It’s certainly plausible that extra milk could increase bone mineral content, but I don’t think the study provides convincing evidence that it does. The p-values for the bone mineral measurements are not impressive (one just below the traditional cut-off and two not).”
Professor Lumley also notes that the study’s one statistically significant result only applies to girls, and this is not mentioned on the Milk for Schools website.
“There’s a slightly stronger indication [of improved bone health] in girls than boys, but Fonterra aren’t claiming milk should just be given to girls,” Lumley says.
Fonterra’s Milk for Schools campaign launched in 2013 and distributes free milk cartons to 70% of New Zealand primary schools. The campaign’s website advertises the benefits of milk for children’s bone health and uses Kruger’s study to show that Milk for Schools is having a positive effect.
A quote from General Manager of Nutrition Angela Rowan is also included on Fonterra’s webpage of the study saying “the positive influence Fonterra Milk for Schools is having on children is clear.”
While Dr. Leighton says the positive effect of Milk for Schools on children’s bone health is not clear from the study as “they (participants) did not have significantly improved bone health,” Professor Lumley says the study’s results could contribute to this claim but that they cannot confirm it.
“Overall, the study is certainly consistent with a benefit of the Milk for Schools programme, but it doesn’t provide much evidence for a benefit,” Lumley says.
The actual study acknowledges its results as marginally significant and specifies limitations, saying the milk group was on average older, taller and had higher bone mineral density than the control group. It also says that lean body mass and whole body mass significantly contributed to children’s bone health.
While Fonterra’s claims do not acknowledge the same limitations as the study, they include a quote from study leader Professor Kruger which does speak on some of these.
The quote says “This was a really positive outcome, however it was a relatively small study. The results need to be confirmed by a larger and longer term study.”
While Professor Kruger would not comment on Fonterra’s claims saying “it was created by Fonterra and I was not involved,” she acknowledges the quote on their website as her own.
“The quote which is said to come from me, and is on the website, is true. It is meant to be in general. I teach bone health to children as well as in adults as part of my work at Massey, and I teach my students the role of peak bone mass, and the role that dairy foods play. I teach this topic to the Master's students as well. So this quote is 100% true,” Kruger says.
While Professor Lumley acknowledges Kruger’s quote as accurate saying “she’s right”, Dr. Leighton says the quote could be more reflective of the study’s results.
“Professor Kruger could say that these findings show a marginal change and may be worthy of further study but they do not show a significant improvement in bone health as they claim,” Leighton says.
The study consisted of 60 children participating in the Milk for Schools programme and 58 children who were not, with measurements being taken for bone mineral density, bone mineral content, body composition, and more.
Although Kruger is honest about the study’s shortcomings saying “I tried to mention limitations of the study which included that we did not analyse diets, or look at vitamin D status, and we did not assess physical activity,” Dr. Leighton criticizes the study’s size and duration.
“The study just wasn’t big enough,” says Dr. Leighton. “I think pre-pubertal children are not growing enough over a year to measure.”
While Professor Kruger’s quote on Fonterra’s Milk for Schools website addresses Dr. Leighton’s concerns saying “The results need to be confirmed by a larger and longer term study,” Dr. Leighton says Fonterra’s claims do not address this.
“They have made claims on results that could be a coincidence and they need to do a bigger and better study,” Leighton says.
Dr. Leighton also addresses the information that 85% of the study’s control group had two serves of dairy a day, questioning Milk for School's role in New Zealand children’s dairy intake.
“If 85% of kids are getting two serves of dairy a day [without the Milk for Schools campaign] then do we really need Milk for Schools?” says Leighton.
The Milk for Schools website says it “provides dairy nutrition to more than 140,000 children every school day,” saying “at least 2-3 servings of milk or milk products are recommended every day for children aged 12 years and under.”
Dr. Leighton acknowledges milk as a good source of calcium but questions whether it is the best source.
“Right now in New Zealand, especially for children who are in poverty, milk may be the best source of calcium if they do not know how to get their calcium from other places or do not have the resources to do so.”
“The issue is not about calcium, but about milk being the best source of calcium. The question isn’t ‘is calcium good for us?’ It’s ‘is dairy the best source of calcium?’” Leighton says.
Fonterra has been contacted for comment but is yet to respond.