Buy

Books
Click images for more details

Twitter
Support

 

Recent comments
Recent posts
Currently discussing
Links

A few sites I've stumbled across recently....

Powered by Squarespace
« On writing popular blog posts | Main | BBC backing climate change alarmism - official »
Monday
Aug112008

Caspar and the Jesus paper

There has been the most extraordinary series of postings at Climate Audit over the last week. As is usual at CA, there is a heavy mathematics burden for the casual reader, which, with a bit of research I think I can now just about follow. The story is a remarkable indictment of the corruption and cyncism that is rife among climate scientists, and I'm going to try to tell it in layman's language so that the average blog reader can understand it. As far as I know it's the first time the whole story has been set out in a single posting. It's a long tale - and the longest posting I think I've ever written and piecing it together from the individual CA postings has been a long, hard but fascinating struggle. You may want to get a long drink before starting, and those who suffer from heart disorders may wish to take their beta blockers first.

At some time or another, most people will have seen the hockey stick - the iconic graph which purports to show that after centuries of stable temperatures, the second half of the twentieth century saw a sudden and unprecedented warming of the globe. This was caused, we were told, by mankind burning fossil fuels and releasing carbon dioxide into the atmosphere. For a while, the hockey stick was everywhere - unimpeachable evidence that mankind was  damaging the planet - an impact that would require drastic measures to reverse.  The stick's most famous outing however was just a couple of years ago when it made a headlining appearance in Al Gore's drama-documentary, An Inconvenient Truth. The revelation of the long, thin graph with its dramatic temperature rise in the last few decades, and the audience gasps that accompanied it, is something of a key moment for many environmentalists.

Shortly after its publication, the hockey stick and its main author, Michael Mann, came under attack from Steve McIntyre, a retired statistician from Canada. In a series of scientific papers and later on his blog, Climate Audit, McIntyre took issue with the novel statistical procedures used by the hockey stick's authors. He was able to demonstrate that the way they had extracted the temperature signal from the tree ring records was biased so as to choose hockey-stick shaped graphs in preference to other shapes, and criticised Mann for not publishing the cross validation R2, a statistical measure of how well the temperature reconstruction correlated with actual temperature records. He also showed that the appearance of the graph was due solely to the use of an estimate of historic temperatures based on tree rings from bristlecone pines, a species that was known to be problematic for this kind of reconstruction.

The controversy raged for several years, involving blue riband panels, innumerable blog postings, endless name-calling and dark insinuations about motivations and conflicts of interest. In May 2005, at the height of the controversy, and on the very day that McIntyre was making a rare public appearance in Washington to discuss his findings, two Mann associates, Caspar Amman and Eugene Wahl, issued a press release in which they claimed that they had submitted two manuscripts for publication, which together showed that they had replicated the hockey stick exactly, confirmed its statistical underpinnings and demonstrated that McIntyre's criticisms were baseless.  This was trumpeted as independent confirmation of the hockey stick. A few eyebrows were raised at the dubious practice of using a press release to announce scientific findings. Some also noted that on the rare occasions that this kind of announcement is made, it tends to be about papers that have been published, or at least accepted for publication. To make such a dramatic announcement about the submission of a paper was unusual in the extreme.

The first of these papers ("the GRL paper") was submitted to Geophysical Research Letters, the journal of the American Geophysical Union. It took the form of a rebuttal of a McIntyre paper that had attacked the hockey stick and had been published in the same journal. From the first, the McIntyre paper had been controversial. Apart from Amman and Wahl's paper, there were three other papers taking issue with it. However, it turned out that some of these attempted rebuttals were less well formed  than others. In fairly short order, Amman and Wahl's paper was rejected, many of its criticisms either relating to other McIntyre papers than the one at hand, or relying on the second paper for their arguments. Since the second paper was unpublished, it was effectively impossible for McIntyre to defend himself against these criticisms. Shortly after Amman and Wahl's paper was rejected, another of the rebuttals, that of a physicist called David Ritson, was also shot down by the journal's editors.

Meanwhile the second, longer paper ("the CC paper") had started its long road to publication at the journal Climatic Change. This article purported to be a replication of the hockey stick and confirmation of its scientific correctness. However, in a surprising turn of events, the journal's editor, prominent global warming catastrophist Steven Schneider, mischievously asked none other than Steve McIntyre to be one of the paper's anonymous peer reviewers. 

We have seen above that one of the chief criticisms of the hockey stick was the fact that its author, Michael Mann, had withheld the validation statistics so that it was impossible for anyone to gauge the reliability of the reconstruction. These validation statistics were to be key to the subsequent story. At the time of their press release Wahl and Amman had made public the computer code that they'd used in their papers. By the time their paper was submitted to Climatic Change, McIntyre had reconciled their work with his own so that he understood every difference. And he therefore now knew that Wahl and Amman's work suffered from exactly the same problem as the hockey stick itself: the R2 number was so low as to suggest that the hockey stick had no meaning at all, although another statistic, the reduction of error statistic (or RE) was relatively high. It was only this latter figure that had been mentioned in the paper. In other words, far from confirming the scientific integrity of the hockey stick, Wahl and Amman's work confirmed McIntyre's criticisms of it! McIntyre's first action as a peer reviewer was therefore to request from Wahl and Amman the verification statistics for their replication of the stick. Confirmation that the R2 was close to zero would strike a serious blow at Wahl and Amman's work.

Caspar AmmanWahl and Amman's response was to refuse any access to the verification numbers, a clear flouting of the journal's rules. As a justification of this extraordinary action, they claimed that they had shown that McIntyre's criticisms had been rebutted in their forthcoming GRL paper, despite the fact that the paper had been rejected by the journal some days earlier. At the start of July, with his review of the CC paper complete, McIntyre took the opportunity to probe this point, by asking the journal to find out the anticipated publication date of the GRL paper. Wahl and Amman were forced to admit the rejection, but they declared that it was unjustified and that they would seek publication elsewhere.

Sir John HoughtonWith the replication of the hockey stick in tatters, reasonable people might have expected some sort of pause in the political momentum. Seasoned observers of the climate scene, however, will be unsurprised to hear that global warming eminences grises like Sir John Houghton and Michael Mann continued to cite the Wahl and Amman papers despite the CC paper being in publishing limbo and the GRL paper being apparently dead and buried. The Wahl and Amman press release was not withdrawn either.

Events soon took another surprising turn., It was announced that the editor in chief of Geophysical Research Letters, Jay Famiglietti, had taken over the file for the McIntyre paper and its responses. This was justified he claimed, because of the high number of responses - four - that the McIntyre paper had received. That two of those responses had been rejected and were no longer in play was not mentioned. The reason for the change quickly became apparent though when, at the end of September, the rejected response from David Ritson turned out not only to have been re-submitted but had also been accepted for publication. This was another clear breach of the journal's rules, which required that an article's author should be able to comment on responses before they were accepted. Famiglietti however refused to make any on-the-record comments about why he behaved as he did.

Jay Famiglietti

If McIntyre had any suspicions about the implications of Famiglietti's malfeasance, he must have been quite certain when, shortly afterwards, hockey stick author Michael Mann commented on his RealClimate blog that both the CC and the GRL papers were going to be accepted shortly. Sure enough, in the last week of September, the GRL paper was resubmitted and revisions were made to the CC paper. Both papers were back in play again.

As 2005 neared its end, two important events loomed large. The first was the year end deadline for submission of papers for the IPCC's Fourth Assessment Report on the state of the climate, and realisation soon dawned on McIntyre and the observers of the goings-on at GRL:

the IPCC needed to have the Wahl and Amman papers in the report so that they could continue to use the hockey stick, with its frightening and unprecedented uptick in temperatures. Mountains were going to be moved to keep the papers in play.

The other important happening was the fall meeting of the American Geophysical Union, which would be attended by many of the big names in paleoclimate and at which both McIntyre and Amman would be making presentations.  McIntyre's plan was to use the question and answer session after Amman's presentation to once again press for the R2 number for the hockey stick, a figure that had never been released, despite it being constantly requested over the previous years by McIntyre, journals, politicians and journalists. Sure enough, when confronted, Amman once again prevaricated.

After the session, McIntyre attempted to clear the air by inviting Amman to lunch. In the circumstances, this seems to have been a relatively amicable affair, but McIntyre's suggestion that he and Amman write a joint paper outlining where they agreed and where they differed was not taken up. When McIntyre later formalised this offer in an email, Amman failed even to acknowledge it.

While the AGU was meeting in San Francisco, Climate Change had provisionally accepted Wahl and Amman's CC paper, any objections which might have been raised by McIntyre swept aside by simple means of not inviting him to review the second draft. The resubmitted version of the paper turned out to be almost identical to the old one, except that a new section on the statistical treaments had been added, presumably as a condition of acceptance. And here there was an upside because, buried deep within the paper, Amman and Wahl had quietly revealed their verification R2 figures, which were, just as McIntyre had predicted, close to zero for most of the reconstruction, strongly suggesting that the hockey stick had little predictive power. Their decision to reveal these key data is necessarily obscure, but may well have been prompted by McIntyre's decision to file a complaint of academic misconduct about Amman with his employers, UCAR. Although the complaint was rejected, it may well have put sufficient pressure on Amman and the journal to show the numbers that everyone wanted to see.

The CC paper's provision acceptance date was December 12th, just a few days before the AR4 deadline. Strangely the version that was accepted seems to have been dated 24th Feb 2006, so according to its rules the IPCC shouldn't have been able to considered it. And what is more, it appears that the new sections discussing the statistical verifications were only added in this post year-end version. As McIntyre put it

So under its own rules, is IPCC allowed to refer to Ammann and Wahl [2006]? Of course not. Will they? We all know the answer to that. When they refer to Ammann and Wahl [2006], will they also refer to its confirmation of our claims about MBH verification r2 statistics. Of course not. That information was not available to them in December. But wait a minute, if Ammann and Wahl was in press in December, wouldn’t that information have been available to them? Silly me.

In other words, the version of the paper which had gone forward to the IPCC didn't include the adverse verification statistics, but the version accepted by the journal did. The IPCC got their rebuttal of McIntyre and the journal got a fig leaf of respectability to cover up its duplicity.

By March, the CC paper had been fully accepted, but there was to be another hiccup that would threaten its existence. After all the shenanigans at GRL with the replacement of the editor and the resubmission of letters, the journal decided once again to reject Wahl and Amman's attempt to rebut McIntyre's work. Ostensibly this was because the arguments were "already out there", but the truth was surely that there were so many holes in the statistical arguments as to make their publishing an embarrassment to the journal.

This new rejection was a problem for the CC paper, as I will explain below.  When using an R2 verification, researchers can refer to tables of benchmarks to gauge the significance of their results. Now that the fact that the hockey stick and Amman and Wahl's replication of it were public, Amman was arguing that the correct measure of significance was in fact the alternative RE statistic. His problem was that for RE statistics, there are no tables of benchmarks for the researcher to refer to - he has to establish a benchmark of his own by other means. And Amman had done this in the GRL paper which had just been rejected. Without the GRL paper, he couldn't even argue that his results in CC were statistically significant.

There is a rule of thumb for RE statistics: this says that positive RE numbers have some significance while negative ones do not. Unfortunately for Amman, this rule applies only to linear regressions; as the hockey stick was clearly not linear, it couldn't apply. The original hockey stick authors had claimed that they had created a benchmark through other means, and that the figure was still zero.  Now, while they had been silent on the issue in their original GRL submission, Amman and Wahl announced in their resubmission that they had performed benchmarking calculations and that had confirmed that the significance level for the RE should remain at zero.

However, now that the resubmission had been rejected by GRL, the "establishment" of this benchmark was cancelled out, and the statistical arguments in the CC paper which relied on it could no longer be maintained.

And then silence. A year later, the CC paper was nowhere to be seen, despite having been accepted for publication. It was stuck in a kind of publishing limbo once again. This left the IPCC and Climatic Change with a problem. McIntyre observed:

I’m intrigued as to what the final Wahl and Ammann version will look like. They have an intriguing choice: the inclusion of a reference to this article in AR4 was premised on their article being “in press” which would prohibit them from re-working their article to deal with the GRL rejection. But the article needs to be re-worked since it will look pretty silly to describe their GRL article as “under review” over 18 months after it has been rejected.

 

In the background, howevrer, much had been happening. Suddenly in September 2007, and with the IPCC report published, the CC paper suddenly appeared, preceded in the same journal by another paper by the same authors. What had happened was that Wahl and Amman were quietly allowed to rewrite their rejected GRL paper and submit it to Climatic Change instead. All reference to the rejected GRL paper in the CC paper could be replaced by reference to the new paper, (which I will call the Jesus paper, in light of its extraordinary resurrection and for lack of any less confusing name). With identical authorship, and a maze of cross-references between them, the two CC papers were carefully designed to make understanding how their arguments relied on each other as difficult as possible. 

The beauty of this approach was that it allowed for  retention of the original acceptance date for the CC paper, and hence its inclusion in the IPCC process. It did leave them with the embarrassing problem that a paper that was allegedly accepted in March 2006 relied upon another paper that even the journal itself said was only received until August (and in reality, is was even later than that) Readers should note that this matters because unless the paper was accepted by the journal by the deadline, it should not have been accepted by IPCC for inclusion in the Fourth Assessment Report. But the IPCC needed the CC paper and despite the inconsistency being pointed out to them, the IPCC they waved the objections aside as irrelevant.

The CC paper argument leads from the text, to the appendix and then onto the Jesus paper. At places in the Jesus paper the argument referred back to the CC paper creating a neat, if logically flawed, circular argument. One notable feature of the CC paper and the Jesus paper was that they relegated some of their key argumentation to their Supplementary Information (SI) sections, online appendices to the published papers. In particular, the Jesus paper stated that the statistical discussions and more precisely, the establishment of RE benchmarks could be seen there. To have key arguments in the SI was most unusual and it quickly became apparent why it had been done: the SI was nowhere to be seen. Even the peer reviewers appear not to have had access, and once again, Amman refused McIntyre's request for the data and code. His reply to this request was startling (and remember that Amman is a public servant):

Under such circumstances, why would I even bother answering your questions, isn’t that just lost time? 

Again, everything fell silent. For the next year nothing more was heard of the two papers. McIntyre pressed from his blog for release of the SI and the politicians were able to quietly take advantage of the political space created by the IPCC report. Then, just a few weeks ago, and entirely unannounced, Wahl and Amman's Supplementary Information suddenly appeared on Caspar Amman's website, some three years after that first press release announcing the refutation of McIntyre's work. With it, and a godsend to McIntyre, was the code used to establish the benchmark for the RE statistic.  With no more than a few days work, McIntyre was able to establish exactly what had been done.

You will remember that Amman and Wahl had claimed that they had established a benchmark of zero for a 99% significant RE score - that is to say, there is only a 1% chance that you might have got that score by chance. McIntyre had, much earlier, shown that if you ran red noise through the process, you could get RE scores of more than 0.5. (Red noise is best described as a "random walk" - a line which wiggles at random, but is not entirely random like white noise.) To reduce your chance of random error to 1% you actually needed to score 0.54 for RE.  How Amman had come up with zero as his benchmark was a mystery.

Now, with the code in front of him, McIntyre could see exactly what Wahl and Amman had done. And what they had done was to calculate almost exactly the same figure as he had! The number they had arrived at was 0.52, just a whisker away from McIntyre's own 0.54, but they had reported to the world that it was sufficient only to score a positive number! Of course, this wasn't picked up by the peer reviewers because, as we've seen, they didn't have access to the Supplementary Information, but the IPCC's purposes had been served - the hockey stick found its way intact into the Fourth Assessment Report, unscathed by skirmishes with inconvenient statistical truths.

However, the figure of 0.52 was insufficient for W&A's purposes. Their problem was that the key component of the hockey stick had a verification RE of 0.48, leaving it tantalisingly just below the calculated benchmark. They needed it to be in the top rank and getting it there was going to be tricky. For each simulation, a thousand runs through the statistical sausage machine were perfomed and the RE number, the correlation with the temperature record, was recorded. Then all the runs were sorted in order of RE value, the best runs having the highest RE and the worst the lowest.  W&A needed to show that the hockey stick RE was right up there with the best simulations - in the top one percent.  While its RE was high, it wasn't good enough. And it was no good simply removing runs which had a higher score than the hockey stick, since this would not increase its position enough - they would have been reducing the total number of runs as well as the number of runs which were scoring better than the hockey stick. To get the answer they needed, the higher scoring runs had to be made to be lower than the hockey stick, but left in the calculation.

To do this, Wahl and Amman came up with a value which they called a calibration/verification RE ratio. As the name suggests, this was the ratio of the two RE numbers for calibration and verification. This ratio is however, entirely unknown to statistics, or to any other branch of science. But it was not plucked out of the air. The ratio and the threshold value which was set for it by Wahl and Amman was carefully calculated. They argued that any run with a ratio less than 0.75 should be assigned a score of -9999. Since the hockey stick had a score of 0.813, 0.75 was pretty much the highest level you could go to without rejecting the hockey stick itself. However if you set your ratio threshold too low, not enough runs would be rejected and the hockey stick would no longer be "99% significant". Some of the results of this ratio were entirely perverse - it was possible for a run that had scored a reasonably good RE in the calibration (there was a good correlation between it and the actual temperatures) to be thrown out of the final assessment on the grounds that it had done very well in the verification - the correlation with actual temperatures was considered too good!

With this new, and pretty much entirely arbitrary hurdle in place, Wahl and Amman were able to reject several of the runs which stood between the hockey stick and what they saw as its rightful place as the gold standard for climate reconstructions. That the statistical foundations on which they had built this paleoclimate castle were a swamp of misrepresentation, deceit and malfeasance was, to Wahl and Amman, an irrelevance. For political and public consumption, the hockey stick still lived, ready to guide political decision-making for years to come.

12 Aug: Minor updates for typos etc. Also, I think I'm right in saying that the correct usage in UK English is "blue riband", not "blue ribbon", or that they are at least valid alternatives. Apologies to my North American readers. :-)Dissenting opinions welcome in the comments.

4 Sept. It was pointed out that I've used the term "CC paper" before defining it. I've changed the relevant paragraph to read "second paper".

PrintView Printer Friendly Version

References (11)

References allow you to track sources for this article, as well as articles that were written in response to this article.
  • Response
    Says the man from the Devil's Kitchen: Bishop Hill has pieced together the full story of the hockey-stick graph and it is, in the opinion of your humble Devil, fucking dynamite. Pardon his French. Unlike DK, I have not read this posting of BH's yet, although I most certainly will be ...
  • Response
    I dip my toe into Climate Audit regularly and despite Professor Dawkin's best efforts I can't claim to understand the statistics or the whole unraveling of the claims and machination of the AGW industry. Thank goodness that his ecclesiastical eminence...
  • Response
    A blogger calling himself Bishop Hill has written a fascinating post on the machinations behind the famous and influential "hockey stick" model of historical trends in global temperatures. (Thanks to AOG, who notes, sadly, "...But, then reality set it....
  • Response
    Response: Once Upon A Time
    There was a man and a hockey stick... The story is a remarkable indictment of the corruption and cyncism that is rife among climate scientists, and I'm going to try to tell it in layman's language so that the average...
  • Response
    To pretend that their "scientific consensus" is anything more than inserting And then a miracle occurs into their work to try and prove that we're melting the planet. Let me be frank: dickwads like those referred to in this article...
  • Response
    There has been the most extraordinary series of postings at Climate Audit over the last week. As is usual at CA, there is a heavy mathematics burden for the casual reader, which, with a bit of research I think...
  • Response
    "Bishop Hill" has done it again. He's posted another tale, understandable by laymen, of a scientific detective at work. It's similar to his classic Caspar and the Jesus paper. Nowadays, alas, the job of a truth-seeker is often to uncover the deceits of scientists themselves... (It's probably hard for most...
  • Response
    A. W. Montford posts a great list of 33 of the more outrageous emails from the Climatic Research Institute over at Bishop Hill Blog. Here are the first ten: Climate cuttings 33Welcome Instapundit readers! Hope this is useful for you....
  • Response
    For those of you who don’t know of the blog Bishop Hill, let me say that he is a succinct and careful writer who has earned praise from many (including myself and Steve McIntyre) in taking a difficult niche subject such as the Hockey Stick and paleo
  • Response
    Response: click here
    - Bishop Hill blog - Caspar and the Jesus paper
  • Response

Reader Comments (136)

Your Grace,

congratulations on an excellent summary of this long-running saga! I follow ClimateAudit avidly but, because there are so many threads going on and such a lot of mathematics at a level above my head, it is easy to lose track of the greater picture for each major thread. Your work here is, so far as I can remember, spot on and highlights the important bits very well.

In fact, I wish Steve McIntyre would produce these kinds of summaries from time to time, but he is very busy and of course entitled to pursue his own enquiries in the order he finds them most interesting, without going back over old ground for thickos like me.

If somebody - you? - would write up summaries like this for all the major threads, I am convinced the resulting story would make a fascinating publication. I don't think SMcI would object either, as long as the summaries were statistically correct (not to say significant).

"The Story of ClimateAudit" - once global warming is finally shown up for what it is, I think this would be a very important document in explaining how the world was frightened witless by a small group of people...
Aug 11, 2008 at 9:53 PM | Unregistered Commenteragn
I noticed in answering a recent comment at Real Climate that Gavin Schmidt distanced himself from the importance of paleoclimate reconstructions.
Aug 11, 2008 at 10:24 PM | Unregistered CommenterKit
Thanks for this excellent summary for laymen such as me. Although I was able to understand the conclusions at Climate Audit, I was unable to see the whole picture and was missing some of the pieces in this long running history.
Aug 11, 2008 at 10:43 PM | Unregistered Commenterbenpal
Fantastic post, milord bishop - if only the truth about climate change (or lack thereof) would emerge from the preserve of the blogosphere and become 'common knowledge'... would vindicate what a lot of better scientists than I have been arguing independently for years.
Thank you for clearing up the whole story at last!
Aug 12, 2008 at 12:10 AM | Unregistered CommenterMarius Ostrowski
This post will become a classic - and predicted without the aid of computer models!
Aug 12, 2008 at 1:22 AM | Unregistered Commenterwoodentop
Excellently done. McIntyre's work completely demolishes the 'hockey stick' and yet the propaganda resurfaces time and again.
Aug 12, 2008 at 3:29 AM | Unregistered CommenterMister Jones
Thanks for the encouragement everyone.

Agn

When I realised that McIntyre didn't have time to do the laymen friendly summaries of his work, II started the Climate Cuttings series of postings, of which this is, in some ways, just a special edition.

I have considered taking this further, perhaps ending up with a book At the moment though, work is far, far too busy to make it feasible.

Kit

Did he indeed? I must go and find that!
Aug 12, 2008 at 6:31 AM | Registered CommenterBishop Hill
This is one of the best pieces of journalism I have read all year, The end of newspapers is upon us, well done and thank you.
Aug 12, 2008 at 12:18 PM | Unregistered CommenterPasser By
Class bit of work! Should be required reading for all the doom-mongers. If everything is settled in their favour, why are they resorting to this sort of mendacity?
Aug 12, 2008 at 12:23 PM | Unregistered CommenterObnoxio The Clown
An excellent post Your Grace. I had known the hockey stick graph was bogus for some time, but I had no idea of the goings-on behind the scenes that had kept it in circulation. Truly shocking!
Aug 12, 2008 at 1:18 PM | Unregistered CommenterAndi
Bishop:
Neat summary. I think you have accurately captured Steve's perspective as documented at CA on this near epic story. Somewhat greedily, I guess, I like to see more of Amman's side of this story - not that I doubt the accuracy of what Steve has said, but more to ensure that genuine differences in interpretation of ambiguous events are at least acknowledged. Perhaps other readers can point you to statements, postings or comments by either Amman or Wahl that help flesh out the story.

P.S. The are a few typos you may want to catch.
Aug 12, 2008 at 1:43 PM | Unregistered Commenterbernie
Fantastic summary, the best I've ever read on the HS saga.
Thank YOU !
Aug 12, 2008 at 2:37 PM | Unregistered CommenterDemesure
AGW is a product of guttersnipe scientists.
Aug 12, 2008 at 2:47 PM | Unregistered CommenterPierre Gosselin
Hats off to this work. At CA, I'm also only able to discern the gist of what's going on. Bihop Hill has done a great job presenting this in sub-PHd terms.
Thank you very much!
Aug 12, 2008 at 2:52 PM | Unregistered CommenterPierre Gosselin
Bishop - go for it!
I'll certainly buy a the book if you write it.
Aug 12, 2008 at 2:54 PM | Unregistered CommenterPierre Gosselin
Yes, Ernie, I particularly like 'Blue Riband Panels'.
========================================
Aug 12, 2008 at 2:55 PM | Unregistered Commenterkim
A very clear and useful summary. As others have said, if you could do this for other topics that would be great.

One comment though: it was not 'mischievous' for Schneider to ask McIntyre to review the CC paper. If A writes a paper criticising the work of B, it is correct and standard practise for the editor to ask B to referee it. Of course the editor will also involve at least one other referee, and will take into account B's conflict of interest when reaching his verdict on whether to publish the paper.

Another thing that could be made a bit more explicit is that the 'RE statistic' itself is an invention of climate scientists. You won't find it in any statistics textbook I dont think.
Aug 12, 2008 at 2:55 PM | Unregistered CommenterPaulM
Here is one typo: "As 2005 two important events loomed large. " Was that supposed to be something like "As 2005 came to a close two important ..."? -- John M Reynolds
Aug 12, 2008 at 3:24 PM | Unregistered CommenterjmrSudbury
Kim:
Speaking of typos, it is Bernie not Ernie! ;)
Aug 12, 2008 at 4:02 PM | Unregistered CommenterBernie
An excellent, excellent article. Where does the Wegman panel report fit in here? Is it one of the blue riband panels you mention in the 4th paragraph? I would like to see a bit more of the time line of where that fits in and the Wegman testimony to Congress.
Aug 12, 2008 at 4:09 PM | Unregistered CommenterPhillip Bratby
Kim

Blue riband is UK English, Blue ribbon is American, I think.

http://en.wikipedia.org/wiki/Blue_ribbon
Aug 12, 2008 at 4:22 PM | Registered CommenterBishop Hill
Phillip B

Yes, Wegman is one of the blue riband (ribbon?) panels. My purpose in writing this piece was really to tell the Wahl and Amman story, because it's topical right now with the release of the SI. You are quite right that the hockey stick story is much wider though.
Aug 12, 2008 at 4:31 PM | Registered CommenterBishop Hill
JMRSudbury

Good spot. I'll fix that.
Aug 12, 2008 at 4:33 PM | Registered CommenterBishop Hill
Once the truth come out this saga will make a great book!
Aug 12, 2008 at 4:56 PM | Unregistered CommenterTed
<i>"I have considered taking this further, perhaps ending up with a book..."</i>

Well, if you want a co-author, then I would happily volunteer...

DK
Aug 12, 2008 at 5:01 PM | Unregistered CommenterDevil's Kitchen
A nice summary of the ongoing ClimateAudit discussion. Please note, just for the record, that the key McIntyre articles were co-authored by Ross McKitrick of Guelph Univ.

One small error: You say, "There <i>is</i> a rule of thumb for RE statistics: this says that positive RE numbers have some significance while negative ones do not. Unfortunately for Amman, this rule aplies only to linear regressions; as the hockey stick was clearly not linear, it couldn't apply."

Although the HS is a non-linear function of time, it is based on the assumption of a linear (or approximately linear) relation between temperature and its component tree-ring proxies, so that a positive RE value would indicate at least a little explanatory power.

How positive RE must be in order to be statistically significant is what is in dispute, not the linearity of the underlying relationship (or non-relationship, as the case may be).
Aug 12, 2008 at 5:10 PM | Unregistered CommenterHu McCulloch
Excellent summary!

<i>In fairly short order, Amman and Wahl's paper was rejected, many of its criticisms either relating to other McIntyre papers than the one at hand, or <b>relying on the CC paper</b> for their arguments.</i>

Begging your pardon, Sir, but is Climate Change Journal mentioned before this abbreviated reference? I did not see it. But then again, I am barely literate.
Aug 12, 2008 at 5:16 PM | Unregistered Commentersonicfrog
@PaulM: I too was bemused by 'Reduction of Error' statistic. I work with statistics (but not in climatology or related fields), and I've never heard of it. Sounds like a fudging method by the name, doesn't it!
Aug 12, 2008 at 5:22 PM | Unregistered CommenterQuestionThat
Paul M, Question That

Cor! I didn't know that. Just when you think it can get no worse.
Aug 12, 2008 at 5:26 PM | Registered CommenterBishop Hill
Sonic Frog

Is there an irony tag on this or something? Search the text for Climatic Change....?
Aug 12, 2008 at 5:27 PM | Registered CommenterBishop Hill
"This is one of the best pieces of journalism I have read all year, The end of newspapers is upon us, well done and thank you."
Passer By

Amen, PB. Imo, the "Deadwoods'" only true chance of resurrection/salvation/redemption is to return to reporting fact instead of obsessively constructing and Parroting deranged, infantile Fairy Tales after the manner of the ipcc, enc., "Climate Scientists", who themselves are obviously not doing actual Science - which seems to me to now even be the primary criterion for being called a "Climate Scientist", at least among AGW believers.

So, Your Grace, keep showing everyone the rational way to proceed, instead. Thanks. [I follow Climate Audit, and your summary seems right-on to me.]
Aug 12, 2008 at 5:29 PM | Unregistered CommenterJ. Peden
Hu

Of course, I know that McKitrick was co-author with McIntyre. I debated long and hard about whether to add this, but I was desperately trying to simplify and shorten what was going to be an over-long and over-complicated article. I feel terrible, having left him out completely, but that was the decision I took, and I've got to live with it.
Aug 12, 2008 at 5:30 PM | Registered CommenterBishop Hill
I like the hockey stick. I hope it is prominent in all GW reports. Like short films teaching US third graders to duck under their desks when the Soviet nuclear strike comes, the HS will survive as a graphic testament to the wisdom of men.
Aug 12, 2008 at 6:41 PM | Unregistered CommenterKevin
An excellent summary of how climate science is done!

Obfuscation is the rule not the exception in controversial areas of Climate Science. When several expert reviewers commented that the Climatic Change paper of Wahl and Ammann did not meet IPCC deadlines the authors just got the deadline changed and responded, “guidelines used for preparing the draft have been followed and new guidelines do not pose problems.”

These new guidelines were sent out a month after the deadline for expert comments and allowed almost a further month for papers to be ‘in press’ but with the strict condition that “In the case of in-press papers a copy of the final acceptance letter from the journal is requested for our records.” There should therefore be a letter on file from Climatic Change and I want to see it.

Despite its requirement to be open and transparent the IPCC does not answer questions or give out any information beyond what it has published. Several British Scientists and Defra took part in the IPCC assessment at our expense and should be subject to FOIA/ EIR disclosure.

I have been trying to get disclosure on the hockey stick saga for over 12 months with only limited success. John Mitchell at the Met Office said he had destroyed or deleted all his IPCC working papers. Keith Briffa at CRU admits to having relevant correspondence with Caspar Ammann, but claims FOIA Section 36 exemption, which in effect requires Ministerial agreement. CRU flat refuse to consider Climate Change under the Environmental Information Regulations 2004 which would not have the same exemption. How they figure that Climate Change is not an environmental issue out beats me but it could take two years to appeal it.

Defra made no effort to obtain IPCC assessment information from the IPCC, which it was entitled to have and which it had a clear duty to publish under the Environmental Information Regulations. They can not even give me a complete copy of the comments, on the draft IPCC report, made by the Reviewers for the Government of the United Kingdom. They did however assure me, a few months ago, that the official UK Government position is that (and I quote), “The hockey stick is alive and well and still beating up sceptics”.

However folks, stand by for a media blitz starting any time now as we get closer to the IPCC’s big 20th Birthday Party in Geneva on the 31st of August!
Aug 12, 2008 at 6:50 PM | Unregistered CommenterDavid Holland
Bishop - A great summary which should be widely publicised.
I have exchanged e- mails with Pachauri chairman of the IPCC which lead me to think that he may well be open to a reconsideration of the basic science of the IPCC reports. I suggest that you e-mail him a copy of your review of this affair .. His e-mail is pachauri@teri.res.in
Best Regards - Keep up the good work.
Aug 12, 2008 at 7:22 PM | Unregistered CommenterNorman Page
Thank you. I, too, am a constant follower of Steve McIntyre's efforts but alas like many in this thread I cannot always keep up with the maths. I intend to link to this from my place so your readership might go up by one!
Aug 12, 2008 at 7:47 PM | Unregistered CommenterDavid Duff
Nice work, Bishop. But please note (and fix) two hyperlinks that are broken by inclusion of a blank space before the URL: "surprising turn" and "appear not to have had access." Search for 'href="%20' in the HTML, and lose the '%20'.
Aug 12, 2008 at 8:41 PM | Unregistered CommenterJobius
Jobius

Thanks. Fixed now.
Aug 12, 2008 at 8:46 PM | Registered CommenterBishop Hill
Wonderful Summary. Great work. I too read CA often, but like many the math is above me. This summary reals like a mystery story where great deception is perpetrated to fool millions.
Aug 12, 2008 at 9:00 PM | Unregistered CommenterErv
Thank you for taking the time to sum up the situation. I'm a newcomer to this debate and it was a very interesting read.
Aug 12, 2008 at 10:12 PM | Unregistered CommenterDarren
Philip,

The Wegman Report powerfully reaffirmed McIntyre and McKitrick's original criticisms, and pointed out with appropriate analysis that the "independent" reconstructions were all done using more of less the same key proxies (including using the Mann reconstruction itself as a proxy) and all done by a very cosy team who all had direct links to MIchael Mann. Mathematically such links between themselves and Mann constituted a "clique", according to Wegman.
Aug 12, 2008 at 10:39 PM | Unregistered CommenterJohn A
Oh, I though CC stood for "Climate Change Journal" not Climate Change in general. I was misled by the previous reference to the "GRL paper" and then the reference to the "CC" paper. So, as Emily Litella would say.... Nevermind!
Aug 12, 2008 at 11:17 PM | Unregistered Commentersonicfrog
Bishop, excellent summary of the two Mc's excellent work.

As the wheels begin to fall off the AGW bandwagon I feel a prediction coming on. I've fed all the, (adjusted), data from recent years into my superlaptop and this is the result.

It's all the fault of BushChaneyHaliburtonBigOilBigEnergyBigCar!

You have probably noticed how big business is climbing on the AGW bandwagon at the moment. Every other car advert is for a model which has the lowest CO2 emissions 'in it's class'. Even the Hummer has the lowest emissions for a stonking great ripoff of a military vehicle.

Every energy company tells you how green it's energy is and will sell you 'renewable' energy, at a price, even if it is imported french nuclear energy.

Even ExxonMobil is advertising how much it's spending on sustainable energy sources.

And then there's carbon trading.

So, when the wheels finally fall off, the MSM will come out with the big expose of how it's all the fault off BushChaneyHaliburtonBigOilBigEnergyBigCar. Big Al will by then have MovedOn.

The MSM will of course congratulate itself on it's wonderful reprting of the issue, (a day late and a dollar short; or rather ten years late and ten billion dollars short), and award themselve lots of prizes.

And McIntyre and McKitrick and Watts and the rest?

They'll take the blame. They knew it was all a scam and failed to act.

How did my model come to this startling conclusion? I fed it the history of great journalistic moments of the last hundred years.
Aug 13, 2008 at 12:23 AM | Unregistered CommenterKevin B
Thanks for that. Like many others I have been following this at CA and sometimes got overwhelmed by the detail.

(Riband is fine)
Aug 13, 2008 at 1:53 AM | Unregistered CommenterMark Pollock
Bishop, thank you for writing this up. I've been reading Steve's write-ups on this and quite frankly, they can be hard to read sometimes.

Thanks again.
Aug 13, 2008 at 4:31 AM | Unregistered CommenterMark T
Thank you very much for doing something that I've wanted to do for a little while and put into layman's language the sordid reality behind the Climate Curtain.

By the way, 'Hokey Stick' is a much more apt term for the hockey stick.
Aug 13, 2008 at 4:52 AM | Unregistered CommenterJack Lacton
Fantastic summary, it is just what I needed to get up to speed on the posts at CA.

It is unfortunate that our faith in science and goodwill for environmentalism will be badly damaged when this outrageous scientific fraud is revealed.
Aug 13, 2008 at 9:49 AM | Unregistered CommenterMichaelL
I've posted a few times at Climate Audit but I'll say it again here. I'm the Controller of a company and if I pulled shenanigans like has been done with the Hockey Stick I would be in prison for a very long time. Wouldn't matter if my numbers were right or not - the very perception that I had manipulated the books and performed gyrations to hide a trail would be enough to put me behind bars. I simply cannot believe that this behaviour is allowed to go unpunished (if not rewarded) in the "scientific" community. I'm certainly not an advocate of punishing scientists for being wrong - but for being fraudulent I certainly am.

BTW - very nice recap of the chain of events. I read CA but don't always get to posts in their chronological order. Thanks!
Aug 13, 2008 at 1:39 PM | Unregistered CommenterMA in VA
Bishop, you write

"....bristlecone pines, a species that was known to be problematic..."

In fact, the *species* is no more problematic than others. It shares the general problems of this type of tree ring interpretation, viz the typically unproven temperature dependence and the assumption of a linear response.

The particular problem with the bristlecone data *series* is that it is composed with preference for "stripbark" specimens, where the bark is damaged and only some strip left, thus relying heavily on pathological cases.
Aug 13, 2008 at 3:57 PM | Unregistered CommenterUlises
Dear Bill,
Please find the time to visit this site in New Zealand, as it would be hard to find a more informative group of Scientists.

http://www.climatescience.org.nz/
Aug 13, 2008 at 5:48 PM | Unregistered CommenterGerald Pym

PostPost a New Comment

Enter your information below to add a new comment.

My response is on my own website »
Author Email (optional):
Author URL (optional):
Post:
 
Some HTML allowed: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <code> <em> <i> <strike> <strong>