{"id":25261,"date":"2010-07-18T08:11:00","date_gmt":"2010-07-18T08:11:00","guid":{"rendered":"http:\/\/euvolution.com\/futurist-transhuman-news-blog\/terrible-anti-vaccine-study-terrible-reporting\/"},"modified":"2010-07-18T08:11:00","modified_gmt":"2010-07-18T08:11:00","slug":"terrible-anti-vaccine-study-terrible-reporting","status":"publish","type":"post","link":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/medicine\/terrible-anti-vaccine-study-terrible-reporting.php","title":{"rendered":"Terrible Anti-Vaccine Study, Terrible Reporting"},"content":{"rendered":"<p>One of my goals in writing for this blog is to educate the general  public about how to evaluate a scientific study, specifically medical  studies. New studies are being reported in the press all the time, and  the analysis provided by your average journalist leaves much to be  desired. Generally, they fail to put the study into context, often get  the bottom line incorrect, and then some headline writer puts a  sensationalistic bow on top.<\/p><p>In addition to mediocre science journalism we also face dedicated  ideological groups who go out of their way to spin, distort, and  mutilate the scientific literature all in one direction. The  anti-vaccine community is a shining example of this &ndash; they can dismiss  any study whose conclusions they do not like, while promoting any  horrible worthless study as long as it casts suspicion on vaccines.<\/p><p>Yesterday on Age of Autism (the propaganda blog for Generation  Rescue) <a rel=\"no\" href=\"http:\/\/www.ageofautism.com\/2010\/07\/new-study-shows-vaccines-cause-brain-changes-found-in-autism.html\">Mark  Blaxill gave us another example of this<\/a>, presenting a terrible  pilot study as if we could draw any conclusions from it. The study is  yet another publication apparently squeezed out of the same data set  that Laura Hewitson has been milking for several years now -<a href=\"http:\/\/www.ane.pl\/showarticle.php?art=7020\"> a study involving  macaque infants and vaccinations.<\/a> In this study Hewitson claims a  significant difference in brain maturation between vaccinated and  unvaccinated macaque infants, by MRI and PET analysis. Blaxill presents  the study without noting any of its crippling limitations, and the  commenters predictably gush.<\/p><p><img decoding=\"async\" src=\"http:\/\/euvolution.com\/futurist-transhuman-news-blog\/wp-content\/plugins\/wp-o-matic\/cache\/a581f_trans.gif\" alt=\"\" style=\"padding-left:10px; padding-right: 10px;\">The first (and  really only) thing you need to know about this study is that it  involves 9 vaccinated monkeys and 2 controls. That&rsquo;s right &ndash; just 2  controls. The fact that Hewitson bothers to do statistical analysis on  such a small set of subjects is laughable. Let&rsquo;s keep in mind that most  pilot studies turn out to be wrong &ndash; they are called pilot studies  because they are intended to point the way to further research, not as a  basis for any conclusions. Serious researches recognize that pilot  studies are shots in the dark &ndash; and that counts even for good pilot  studies, which this is not.<\/p><p>If the outcome were something hard and dramatic &ndash; like survival vs  death, then 2 subjects would be a reasonable pilot study. But in this  case Hewitson is doing a somewhat tricky measurement of brain volume  changes over time and binding of opioid ligands in the amygdala. It is  also worth noting that there were originally 4 controls, but one was  eliminated due to improper protocol. We never learn what happened to the  third monkey, we are just told there is data on two controls. This kind  of missing data, especially when the overall numbers are so  pathetically low, is very concerning.<\/p><p>She is also making multiple analyses (another red flag by itself),  which means she can compare multiple variables looking for any  difference. Then she invokes the sharpshooter fallacy and declares any  change she does find to be clinically meaningful. So while there is no  difference in brain volume or amygdala volume between exposed and  unexposed monkeys, she finds differences in the change over time. We  don&rsquo;t know if still other variables were looked at and not reported &ndash;  this is another weakness of pilot studies and why follow up studies  replicating the specific effects reported are necessary before any  conclusions can be drawn.<\/p><p>As further evidence of looking for any difference then declaring that  the outcome of interest, we can look back to Hewitson&rsquo;s 2008 reporting  of her monkey data, <a href=\"http:\/\/www.ageofautism.com\/2008\/05\/pediatric-vacci.html\">in  which she wrote:<\/a><\/p><blockquote><p>&ldquo;Compared with unexposed animals, exposed animals showed  attenuation of  amygdala growth and differences in the amygdala binding  of  [11C]diprenorphine.&rdquo;<\/p><\/blockquote><p>But in the current study she finds increased amygdala growth in  exposed monkeys:<\/p><blockquote><p>Not surprisingly, given the different maturational  trajectories in exposed vs. unexposed animals, (unexposed decreasing and  exposed increasing) there was a statistically significant interaction  between exposure and time on total amygdala volume (Wald ?2=10.93;  P=0.001). However, there were no significant main effects on total  amygdala volume of either exposure (Wald ?2=0.75; P=0.39) or time (Wald  ?2=1.14; P=0.29).<\/p><\/blockquote><p>So which is it? Reading the results of the current study, especially  in light of previous publications, gives the overall impression of a  random scatter of data with incredible cherry picking in order to make  the argument that there are any meaningful results at all.<\/p><p>Taken by itself, this is a worthless study. The numbers of subjects  is too small to do any meaningful analysis. The results are all over the  place, and not even consistent with prior publications by the same  authors. The analysis is also far-fetched. Hewitson argues that both  thimerosal-containing vaccine and MMR (which does not contain  thimerosal) contribute to the alleged brain changes she is reporting.  While the word &ldquo;autism&rdquo; does not appear in her report, Blaxill is  concluding in his reporting that these brain changes are the same as  those found in autism (an absurd conclusion given how non-specific these  changes are, even if real, which cannot be concluded from this study).  The anti-vaccine agenda is now clear &ndash; they get to have their cake and  eat it too. They can now argue that an interaction between thimerosal  and MMR cause or contribute to autism, through completely independent  mechanisms, apparently.<\/p><p>To put this study further into context, this research is being  conducted by the Thoughtful House Center for Children &ndash; Andrew  Wakefield&rsquo;s home after he was essentially kicked out of the UK and  subsequently struck off. Wakefield&rsquo;s name, however, does not appear  anywhere on the current study, although he was listed as final author on  previous publications from the same research. Apparently his name has  become too toxic for the Thoughtful House.<\/p><p>The current study also appears in a obscure journal, Acta  Neurobiologiae Experimentalis &ndash; which dedicated an entire issue to  publishing dubious research on autism. <a href=\"http:\/\/www.ane.pl\/showissue.php?v=70&amp;n=2\">The same issue<\/a> includes two articles by the father and son Geier team &ndash; other vaccine  and autism researchers who are off in their own world and whose research  cannot be replicated.<\/p><p><strong>Conclusion<\/strong><\/p><p>This current study, as well as the <a href=\"http:\/\/www.sciencebasedmedicine.org\/?p=100\">entire macaque  research program <\/a>by Hewitson, is a good example of terrible  research. The subject numbers are far too small for any meaningful  statistics, and the outcomes being followed are numerous and tricky with  a random scatter of results not even consistent between different  publications of the same research.<\/p><p>What we have is far worse than ideological reporting and spinning of  the scientific research &ndash; apparently we have the ideological conduction  of research in the first place. This is similar to the research program  of Benveniste on homeopathy.<\/p><p>In general it is a good rule to be suspicious of research that seems  to be unique to one researcher or research team and is out of step with  the broader research community. Unfortunately, such research  contaminates the literature and is easily exploited to confuse the media  and the public who often do not distinguish crank research from  legitimate science.<\/p><p>___________________<\/p><p>Crossposted on <a href=\"http:\/\/www.theness.com\/neurologicablog\/?p=2126\">NeuroLogicaBlog<\/a><\/p><p>Others reporting on this study:<\/p><p><a href=\"http:\/\/scienceblogs.com\/insolence\/2010\/07\/too_much_vaccineautism_monkey_business_f.php\">Respectful  Insolence<\/a> &ndash; Orac also points out that Hewitson failed to disclose  her COI &ndash; that she has a child with autism who is part of the Autism  Omnibus suit.<\/p><p><a href=\"http:\/\/leftbrainrightbrain.co.uk\/2010\/07\/the-genie-is-out-of-the-bottle-vaccines-cause-autism\/\">Ibrb<\/a> &ndash; Author, Sullivan, also points out that amygdala size should increase  in macaques, so it is especially odd that the non-exposed monkeys&rsquo;  amygdalas shrank. That makes no sense, and is likely due to the  quirkiness of having only two controls. So the authors conclusions are  entirely based upon a weird result in their tiny control group &ndash; i.e.  this is completely bunk science.<\/p><p><span><br><a href=\"http:\/\/slashdot.org\/bookmark.pl?url=http%3A%2F%2Fwww.sciencebasedmedicine.org%2F%3Fp%3D6088&amp;title=Terrible+Anti-Vaccine+Study%2C+Terrible+Reporting\" title=\"Slashdot It!\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/euvolution.com\/futurist-transhuman-news-blog\/wp-content\/plugins\/wp-o-matic\/cache\/a581f_favicon.ico\" height=\"16\" width=\"16\" alt=\"[Slashdot]\" style=\"padding-left:10px; padding-right: 10px;\"><\/a><br><a href=\"http:\/\/digg.com\/submit?phase=2&amp;url=http%3A%2F%2Fwww.sciencebasedmedicine.org%2F%3Fp%3D6088&amp;title=Terrible+Anti-Vaccine+Study%2C+Terrible+Reporting\" title=\"Digg This Story\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/euvolution.com\/futurist-transhuman-news-blog\/wp-content\/plugins\/wp-o-matic\/cache\/a581f_favicon.ico\" width=\"16\" height=\"16\" alt=\"[Digg]\" style=\"padding-left:10px; padding-right: 10px;\"><\/a><br><a href=\"http:\/\/reddit.com\/submit?url=http%3A%2F%2Fwww.sciencebasedmedicine.org%2F%3Fp%3D6088&amp;title=Terrible+Anti-Vaccine+Study%2C+Terrible+Reporting\" title=\"Reddit\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/euvolution.com\/futurist-transhuman-news-blog\/wp-content\/plugins\/wp-o-matic\/cache\/3e1c3_favicon.ico\" width=\"16\" height=\"16\" alt=\"[Reddit]\" style=\"padding-left:10px; padding-right: 10px;\"><\/a><br><a href=\"http:\/\/del.icio.us\/post?url=http%3A%2F%2Fwww.sciencebasedmedicine.org%2F%3Fp%3D6088&amp;title=Terrible+Anti-Vaccine+Study%2C+Terrible+Reporting\" title=\"Save to del.icio.us\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/euvolution.com\/futurist-transhuman-news-blog\/wp-content\/plugins\/wp-o-matic\/cache\/3e1c3_favicon.ico\" width=\"16\" height=\"16\" alt=\"[del.icio.us]\" style=\"padding-left:10px; padding-right: 10px;\"><\/a><br><a href=\"http:\/\/www.facebook.com\/share.php?u=http%3A%2F%2Fwww.sciencebasedmedicine.org%2F%3Fp%3D6088\" title=\"Share on Facebook\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/euvolution.com\/futurist-transhuman-news-blog\/wp-content\/plugins\/wp-o-matic\/cache\/3e1c3_favicon.ico\" width=\"16\" height=\"16\" alt=\"[Facebook]\" style=\"padding-left:10px; padding-right: 10px;\"><\/a><br><a href=\"http:\/\/technorati.com\/faves?add=http%3A%2F%2Fwww.sciencebasedmedicine.org%2F%3Fp%3D6088\" title=\"Add to my Technorati Favorites\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/euvolution.com\/futurist-transhuman-news-blog\/wp-content\/plugins\/wp-o-matic\/cache\/3e1c3_favicon.ico\" width=\"16\" height=\"16\" alt=\"[Technorati]\" style=\"padding-left:10px; padding-right: 10px;\"><\/a><br><a href=\"http:\/\/www.google.com\/bookmarks\/mark?op=edit&amp;output=popup&amp;bkmk=http%3A%2F%2Fwww.sciencebasedmedicine.org%2F%3Fp%3D6088&amp;title=Terrible+Anti-Vaccine+Study%2C+Terrible+Reporting\" title=\"Save to Google Bookmarks\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/euvolution.com\/futurist-transhuman-news-blog\/wp-content\/plugins\/wp-o-matic\/cache\/3e1c3_favicon.ico\" width=\"16\" height=\"16\" alt=\"[Google]\" style=\"padding-left:10px; padding-right: 10px;\"><\/a><br><a href=\"http:\/\/www.stumbleupon.com\/submit?url=http%3A%2F%2Fwww.sciencebasedmedicine.org%2F%3Fp%3D6088&amp;title=Terrible+Anti-Vaccine+Study%2C+Terrible+Reporting\" title=\"Stumble it!\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/euvolution.com\/futurist-transhuman-news-blog\/wp-content\/plugins\/wp-o-matic\/cache\/3e1c3_stumbleupon.jpg\" width=\"16\" height=\"16\" alt=\"[StumbleUpon]\" style=\"padding-left:10px; padding-right: 10px;\"><\/a><br><\/span><\/p>","protected":false},"excerpt":{"rendered":"<p>One of my goals in writing for this blog is to educate the general public about how to evaluate a scientific study, specifically medical studies. New studies are being reported in the press all the time, and the analysis provided &hellip; <a href=\"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/medicine\/terrible-anti-vaccine-study-terrible-reporting.php\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"limit_modified_date":"","last_modified_date":"","_lmt_disableupdate":"","_lmt_disable":"","footnotes":""},"categories":[35],"tags":[],"class_list":["post-25261","post","type-post","status-publish","format-standard","hentry","category-medicine"],"modified_by":null,"_links":{"self":[{"href":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/wp-json\/wp\/v2\/posts\/25261"}],"collection":[{"href":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/wp-json\/wp\/v2\/comments?post=25261"}],"version-history":[{"count":0,"href":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/wp-json\/wp\/v2\/posts\/25261\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/wp-json\/wp\/v2\/media?parent=25261"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/wp-json\/wp\/v2\/categories?post=25261"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/wp-json\/wp\/v2\/tags?post=25261"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}