Monday, December 07, 2009

Just when I thought the CRU folks might actually stuff the genie back in the bottle, we get this spectacularly stupid claim:

Jean-Pascal van Ypersele, the vice-chairman of the Intergovernmental Panel on Climate Change (IPCC), said he believed the theft of the emails was not the work of amateur climate sceptics.

“It’s very common for hackers in Russia to be paid for their services,” he told The Times.

“If you look at that mass of emails a lot of work was done, not only to download the data but it’s a carefully made selection of emails and documents that’s not random at all.

“This is 13 years of data and it’s not a job of amateurs.”

No--it wasn't the job of amateurs. There's every reason to believe the files and emails were assembled by trained professionals--on staff at the CRU, in response to a legitimate freedom of information act request.

The STUPID part of this claim is that it's so sensational that everybody who has been trying to ignore it now has to find a whole new reason to stifle the story. We're down to two irresistable memes--it's either "Deep Throat" or "Boris and Natasha." And when you make rash accusations about nuclear-armed oil-producing states who have a serious dog in the Copenhagen fight, you're making a serious PR error.

Digging into "Freedom of Information"

I'm trying to figure out from internal clues whether the FOIA.zip file at the heart of "Climategate" was hacked or leaked. A close analysis of the directory structure and vestigial email headers supports the theory that the .zip file was assembled in response to a freedom of information act request.

Here's the letter rejecting Steve McIntyre's FOI request:
ENVIRONMENTAL INFORMATION REGULATIONS 2004 – INFORMATION REQUEST (Our ref: FOI_09-44; EIR_09-03)

Pursuant to Mr. Palmer’s letter of 21 September 2009 to you regarding the handling of your appeal of 24 July to our response of the same date in regards your FOI request of 26 June 2009, I have undertaken a review of the contents of our file and have spoken with Mr. Palmer and other relevant staff involved in this matter.
According to McIntyre's blog post on this topic, the files in the FOIA.zip file go up to the day before the FOI request was refused. This comprehensive network analysis of the emails and other documents supports the hypothesis that the files were gathered pursuant to a FOI request.

Tracking back through the Internet, I find plenty of correspondence about Steve McIntyre's FOI requests. Here's one from July 24, 2009, documenting his request and CRU's rejection. The internal naming conventions revealed in this correspondence with CRU is "FOI_09-44," which certainly fits with somebody at CRU assembling a file named "FOI-something."

An Internet search for all documents containing "FOI_99" turns up lots of correspondence with CRU, and includes direct references to the relevant law--the British "Freedom of Information Act." That suggests that the original directory structure might easily have been FOIA, meaning there is no internal evidence to suggest the FOIA.zip file came from anywhere but CRU's own official files.

The timing of the dates of emails in the directory helps track down where the file came from. Files were being added to the directory up until 2:17 pm on Thursday, Nov. 12, 2009, the day before the rejection decision was made on Friday, Nov. 13, 2009. The FOIA.zip file first appeared on the Internet on Nov. 17, 2009. Given the size and nature of the FOIA.zip file, it seems likely that CRU staff were compiling the directory in response to one or more requests for information.

Somewhere during the five days between Nov. 12 and Nov. 17, somebody grabbed the file. If the contents of the directory seemed directly relevant to Steve McIntyre's FOI_99-44 request, it would seem like the file could have been grabbed at any time during those five or six days. If, on the other hand, the directory covers a lot more than just the files that would be assembled in response to FOI_99-44, then is makes more sense to assume the file was copied off on Nov. 12 or Nov. 13 by someone who was involved in either compiling the directory or in rejecting the request.

BUT--just to make things MUCH more interesting, the BBC got a copy of SOMETHING a full six weeks before the FOIA.zip file went rogue on November 17. That makes it very hard for me to think we're dealing with a hacker rather than a leaker.

Measuring the Measurements

This graph is one of the reasons I'm getting more skeptical about the Global Warming claims. Look at the lines in the graph. The bottom lines clearly show what used to be known as the "Medieval Warm Period" and the "Little Ice Age." The top lines show what people call the "Hockey Stick." In the run-up to the present, all the lines converge on a sharp up-slope.



If all the data is equally good, it makes sense to average things out and get a mild roller-coaster effect. If some of the data is unreliable, it makes sense to throw it out. I'm troubled by the possibility that researchers are motivated to find new lines of evidence that "eliminate" the Medieval Warm Period, but are not equally motivated to find evidence that confirms it. I'm suspicious that journals and grant agencies may call evidence of the MWP "old news," unworthy of grants or print, while evidence against it is "hot" and deserves fast-track treatment.

Friday, December 04, 2009

Urban Heat Islands

The more I look into the questionable foundations of climatology, the more nervous I get. One BIG assumption in the data for the last 60 years or so has been that "urban heat islands" are not artificially raising the measured temperatures. The urban heat island problem is pretty easy to understand: if you take the temperature of downtown Boston, you'll get a warming reading than if you take the same reading at Walden Pond (same latitude but a lot less people).

When you aggregate temperature readings from thousands of stations scattered all over the globe, you want to make sure that you are measuring the heat of the planet, not just the increased heat from islands of furnaces and air conditioners (both of which make things hotter, due to the miracle of the Second Law of Thermodynamics).

This article goes into a long email correspondence with one scientist inside the Climate Research Unit (CRU) who was clearly uncomfortable with the evidence other scientists relied on to discount the Urban Heat Island problem. You have to read all the way to the bottom to see his point, but its a good one.

Subverting Science

When a big televangelist gets caught with a hooker, priests and pastors are dismayed and immediately repudiate that sin. What happens when a scientist sins against the scientific method and peer review process?

Here's a specific claim by someone who is carefully following one thread of Climategate:
the Wahl and Ammann paper as finally published online on 31 August 2007...was in fact published in 2007, is nothing like the draft seen by the Expert Reviewers, and accordingly should not be referred to in the IPCC 2007 report released in May 2007? Instead the IPCC should have reflected the published peer-reviewed literature and concluded that the 2001 IPCC hockey stick was statistically invalid.

David Holland, the author of this quote filed a freedom of information request,asking (as far as I can tell) for information relating to the publication of this paper. Two days later, UEA Director Prof Phil Jones asked Professor Michael Mann (lead author of the "hockey stick") to tell his ex student Ammann to delete these emails. According to Holland, this is what leaked email 1212063122 is about.


There's something VERY suspicious about asking anyone to ask anyone else to delete emails that have been requested under a Freedom of Information Act request. Watergate was just a "third rate burglary" that toppled a president. Climategate could turn out to be even bigger.

Is Global Warming Man-made or Mann-made?


In my opinion, the "hockey stick chart" is the dominant icon of the Anthropogenic Global Warming (AGW) debate. It was produced by Michael Mann of Penn State in 2001 and relied on by a number of prominent scientists and government agencies, but was challenged and eventually abandoned.


What intrigues me about the hockey stick chart is its reliance on temperatures since 1960 and on other measurements (such as ice cores and tree rings) prior to that. The correlation between tree ring data and measured temperatures is fundamental to this model, which makes the following graph of tree rings and temperatures somewhat sensational:



Insofar as the "hockey stick" represents what people are debating when they talk about "Global Warming," I'd say it's definitely "Mann-made."

Thursday, December 03, 2009

What is HADCRUT3?