Treemometers: A new scientific scandal

Original URL: https://www.theregister.com/2009/09/29/yamal_scandal/

If a peer review fails in the woods...

Posted in Science, 29th September 2009 16:03 GMT

A scientific scandal is casting a shadow over a number of recent peer-reviewed climate papers.

At least eight papers purporting to reconstruct the historical temperature record times may need to be revisited, with significant implications for contemporary climate studies, the basis of the IPCC's assessments. A number of these involve senior climatologists at the British climate research centre CRU at the University East Anglia. In every case, peer review failed to pick up the errors.

At issue is the use of tree rings as a temperature proxy, or dendrochronology. Using statistical techniques, researchers take the ring data to create a "reconstruction" of historical temperature anomalies. But trees are a highly controversial indicator of temperature, since the rings principally record Co2, and also record humidity, rainfall, nutrient intake and other local factors.

Picking a temperature signal out of all this noise is problematic, and a dendrochronology can differ significantly from instrumented data. In dendro jargon, this disparity is called "divergence". The process of creating a raw data set also involves a selective use of samples - a choice open to a scientist's biases.

Yet none of this has stopped paleoclimataologists from making bold claims using tree ring data.

In particular, since 2000, a large number of peer-reviewed climate papers have incorporated data from trees at the Yamal Peninsula in Siberia. This dataset gained favour, curiously superseding a newer and larger data set from nearby. The older Yamal trees indicated pronounced and dramatic uptick in temperatures.

How could this be? Scientists have ensured much of the measurement data used in the reconstructions remains a secret - failing to fulfill procedures to archive the raw data. Without the raw data, other scientists could not reproduce the results. The most prestigious peer reviewed journals, including Nature and Science, were reluctant to demand the data from contributors. Until now, that is.

At the insistence of editors of the Royal Society's Philosophical Transactions B the data has leaked into the open - and Yamal's mystery is no more.

From this we know that the Yamal data set uses just 12 trees from a larger set to produce its dramatic recent trend. Yet many more were cored, and a larger data set (of 34) from the vicinity shows no dramatic recent warming, and warmer temperatures in the middle ages.

In all there are 252 cores in the CRU Yamal data set, of which ten were alive 1990. All 12 cores selected show strong growth since the mid-19th century. The implication is clear: the dozen were cherry-picked.

(This oversimplifies the story somewhat: for more detail, read this fascinating narrative by blogger BishopHill here.)

Controversy has been raging since 1995, when an explosive paper by Keith Briffa at the Climate Research Unit at the University of East Anglia asserted that that the medieval warm period was actually really cold, and recent warming is unusually warm. Both archaeology and the historical accounts, Briffa was declaring, were bunk. Briffa relied on just three cores from Siberia to demonstrate this.

Three years later Nature published a paper by Mann, Bradley and Hughes based on temperature reconstructions which showed something similar: warmer now, cooler then. With Briffa and Mann as chapter editors of the UN's Intergovernmental Panel on Climate Change (IPCC), this distinctive pattern became emblematic - the "Logo of Global Warming".

IPCC's Assessment Report from 2001 introduced the

IPCC's Assessment Report from 2001 - with the error bars in grey emphasised

Hokey hockey sticks

Mann too used dendrochronology to chill temperatures, and rebuffed attempts to publish his measurement data. Initially he said he had forgotten where he put it, then declined to disclosed it. (Some of Mann's data was eventually discovered, by accident, on his ftp server in a directory entitled 'BACKTO_1400-CENSORED'.)

Tree data was secondary in importance to Mann's statistical technique, which would produce a dramatic modern upturn in temperatures - which became nicknamed the "Hockey Stick" - even using red noise.

Similarly, all the papers that used the Yamal data have the same point to make. All suggest recent dramatic warming. Having scored a global hit with a combination of flawed statistics and dubious dendroclimatology, the acts repeated the formula.

"Late 20th century warmth is unprecedented for at least roughly the past two millennia for the Northern Hemisphere," wrote the two authors of Global Surface Temperatures over the Past Two Millennia published in Geophysical Research Letters in 2003 - Mann, and Phil Jones of CRU.

For example, Briffa's 2008 paper concludes that: "The extent of recent widespread warming across northwest Eurasia, with respect to 100- to 200-year trends, is unprecedented in the last 2000 years."

The same authors in 2004:

It continues to this day. A study purporting to show the Arctic was warmer now than for 2,000 years received front-page attention last month. Led by Northern Arizona University professor Darrell S Kaufman, and including dendro veteran Mann, this too relied heavily on Yamal, and produced the signature shape.

Now here's Yamal.

And when Yamal is plotted against the wider range of cores, the implications of the choice is striking:

A comparison of Yamal RCS chronologies. red - as archived with 12 picked cores; black - including Schweingruber's Khadyta River, Yamal (russ035w) archive and excluding 12 picked cores. Both smoothed with 21-year gaussian smooth. y-axis is in dimensionless chronology units centered on 1 (as are subsequent graphs (but represent age-adjusted ring width).

"The majority of these trees (like the Graybill bristlecones) have a prolonged growth pulse (for whatever reason) starting in the 19th century," wrote Canadian mathematician Steve McIntyre on his blog on Sunday. "When a one-size fits all age profile is applied to these particular tries, the relatively vigorous growth becomes monster growth - 8 sigma anomalies in some of them."

McIntyre's determination to reproduce the reconstructions has resulted in the Yamal data finally coming to light.

All the papers come from a small but closely knit of scientists who mutually support each other's work. All use Yamal data. And without the Yamal data, the temperature record shows a very different shape.

What went wrong?

The scandal has serious implications for public trust in science. The IPCC's mission is to reflect the science, not create it.

As the panel states, its duty is "assessing the scientific, technical and socioeconomic information relevant for the understanding of the risk of human-induced climate change. It does not carry out new research nor does it monitor climate-related data." But as lead author, Briffa was a key contributor in shaping (no pun intended) the assessment. A small group was able to rewrite history.

When the IPCC was alerted to peer-reviewed research that refuted the idea, it declined to include it. This leads to the more general, and more serious issue: what happens when peer-review fails - as it did here?

The scandal has only come to light because of the dogged persistence of a Canadian mathematician who attempted to reproduce the results. Steve McIntyre has written dozens of letters requesting the data and methodology, and over 7,000 blog posts. Yet Yamal has remained elusive for almost a decade. ®

Bootnote

The Royal Society's motto from the enlightenment era is Nullius in verba. "On nobody's authority" or colloquially, "take nobody's word for it". In 2007, the Society's then president suggested this be changed to "respect the facts".

Andrew warmly welcomes your comments.