State of the Planet

News from the Columbia Climate School


The Truth About Verification

The December 2011 precipitation forecast issued by the International Research Institute for Climate and Society called for a 75 percent chance of above normal precipitation over parts of the Philippines between January and March. As the months played out, storms brought roughly eight inches more rain than usual for the period. That’s about 85 percent more than usual.

Does this mean the forecast was right? What if the storms never materialized and the region received eight inches of rain less than normal? Would the forecast then have been wrong?

In both cases, the answer would be no. That’s because there’s no such thing as a right or wrong probabilistic forecast. A 75 percent chance of above-normal rain also implies a 25 percent chance of normal or below-normal rain.

However, a forecast’s merits (or lack thereof) can be judged using a handful of different metrics. IRI has been verifying its forecasts internally and in academic journals for years. However, last year IRI scientists Tony Barnston and Simon Mason worked with IRI staff members to make those results public.

The end result is a host of scores across five categories displayed using interactive charts and maps. Taken individually or as a whole, the scores given users a better sense of where IRI’s forecasts are more skillful and areas where there’s room for improvement. That in turn can help decision makers make, well, better decisions about whether to use the forecast and how much trust to put in it.

Read IRI’s Spotlight Feature to get the full story on the scores and how they’re being used by forecasters and decision makers.
Want more IRI news? Follow us on Twitter and like us on Facebook.
Banner featuring a collage of extreme heat images.

Recent record-breaking heat waves have affected communities across the world. The Extreme Heat Workshop will bring together researchers and practitioners to advance the state of knowledge, identify community needs, and develop a framework for evaluating risks with a focus on climate justice. Register by June 15

Notify of

1 Comment
Inline Feedbacks
View all comments
Débora Pereira
11 years ago

Your site is an important actor mapped in my PhD research about environmental movements on the Internet.
Please, can you answer a short questionnaire for my research project on “Environmental Networks and the Management of Nature”? (just 3 minutes)
Here the survey in ENGLISH :
Thank you very much!
Best wishes,
Débora de Carvalho Pereira
School of Information Science of the Federal University of Minas Gerais, Brazil.