Previous Thread
Next Thread
Print Thread
Which Hurricane Forecast Model Should You Trust? #469747
08/07/13 06:24 AM
08/07/13 06:24 AM
Joined: Oct 1999
Posts: 80,387
oregon, spr
Marty Offline OP

Marty  Offline OP

The National Hurricane Center (NHC) set a new record in 2012 for accuracy of their 1, 2, 3, and 4-day Atlantic tropical cyclone track forecasts, but had almost no skill making intensity forecasts, according to the 2012 National Hurricane Center Forecast Verification Report, issued in March 2013. The new records for track accuracy were set despite the fact that the seasonís storms were harder than average to forecast. The average error in a 1-day forecast was 46 miles, and was 79 miles for 2 days, 116 miles for 3 days, 164 miles for 4 days, and 224 miles for 5 days. The official track forecast had a westward bias of 10 - 17 miles for 1 - 3 day forecasts (i.e., the official forecast tended to fall to the west of the verifying position), and was 38 and 75 miles too far to the northeast for the 4- and 5-day forecasts, respectively.

Figure 1. Verification of official NHC hurricane track forecasts for the Atlantic, 1990 - 2012. Over the past 15 - 20 years, 1 - 3 day track forecast errors have been reduced by about 60%. Track forecast error reductions of about 50% have occurred over the past ten years for 4- and 5-day forecasts. Image credit: 2012 National Hurricane Center Forecast Verification Report.

NHC Intensity Forecasts: Little Improvement Since 1990
Official NHC intensity forecasts did better than usual in 2012, and had errors lower than the 5-year average error for 1, 2, 3, 4, and 5-day forecasts. However, 2012's storms were easier to predict than usual, due to due to a lack of rapidly intensifying hurricanes. These rapid intensifiers are typically the source of the largest forecast errors. The skill of official NHC 24-hour intensity forecasts made in 2012 for the Atlantic basin were only about 15% better than a "no-skill" forecast; 2, 3, 4, and 5-day intensity forecasts had no skill.

Figure 2. Verification of official NHC hurricane intensity forecasts for the Atlantic, 1990 - 2012. Intensity forecasts have shown little to no improvement since 1990. Image credit: 2012 National Hurricane Center Forecast Verification Report.

Which Track Model Should You Trust?
As usual, in 2012 the official NHC forecast for Atlantic storms was almost as good as or better than any individual computer models--though NOAA's GFS model did slightly better than the NHC official forecast at 12, 24, and 48-hour periods, and the European model forecast was slightly better at 12-hour forecasts. Despite all the attention given to how the European Center (ECMWF) model outperformed the GFS model for Hurricane Sandy's track at long ranges, the GFS model actually outperformed the European model in 2012 when summing up all track forecasts made for all Atlantic named storms. This occurred, in part, because the European model made a few disastrously bad forecasts for Tropical Storm Debby when it was in the Gulf of Mexico and steering currents were weak. For several runs, the model predicted a Texas landfall, but Debby ended up moving east-northeast to make a Northwest Florida landfall, like the GFS model had predicted. However, the best-performing model averaged over the past three years has been the European Center model, with the GFS model a close second. Wunderground provides a web page with computer model forecasts for many of the best-performing track models used to predict hurricane tracks. The European Center does not permit public display of tropical storm positions from their hurricane tracking module of their model, so we are unable to put ECMWF forecasts on this page. Here are some of the better models NHC regularly looks at:

ECMWF: The European Center's global forecast model
GFS: NOAA's global forecast model
NOGAPS: The Navy's global forecast model (now defunct, replaced by the NAVGEM model in 2013)
UKMET: The United Kingdom Met Office's global forecast model
GFDL: The Geophysical Fluid Dynamics Laboratory's hurricane model, initialized using GFS data
HWRF: The intended successor for the the GFDL hurricane model, also initialized using GFS data
CMC: The Canadian GEM model
BAMM: The very old Beta and Advection Model (Medium layer), which is still useful at longer ranges

If one averages together the track forecasts from the first six of these models, the NHC official forecast will rarely depart much from it. As seen in Figure 3, the HWRF and UKMET were well behind the ECMWF and GFS in forecast accuracy in 2012, but were still respectable. The simple BAMM model did well at 3, 4, and 5-day forecasts. The GFDL and CMC models did quite poorly compared to the ECMWF, GFS, UKMET, and HWRF. The Navy's NOGAPS model also did poorly in 2012, and has been retired. Its replacement for 2013 is called the NAVGEM model.

Figure 3. Skill of computer model forecasts of Atlantic named storms in 2012, compared to a "no skill" model called "CLIPER5" that uses just climatology and persistence to make a hurricane track forecast (persistence means that a storm will tend to keep going in the direction it's current going.) OFCL=Official NHC forecast; GFS=Global Forecast System model; GFDL=Geophysical Fluid Dynamic Laboratory model; HWRF=Hurricane Weather Research Forecasting model; UKMET=United Kingdom Met Office model; ECMWF=European Center for Medium Range Weather Forecasting model; TVCA=one of the consensus models that lends together several of the above models; CMC=Canadian Meteorological Center (GEM) model; BAMM=Beta Advection Model (Medium depth.) Image credit: National Hurricane Center 2012 verification report.

Which Intensity Model Should You Trust?
Don't trust any of them. NHC has two main statistical intensity models, LGEM and DSHP (the SHIPS model with inland decay of a storm factored in.) In addition, four dynamical models that are also use to track hurricanes--the GFS, ECMWF, HWRF, and GFDL models--all offer intensity forecasts. With the exception of the GFS model, which had a skill just 5% better than a "no-skill" intensity forecast for predictions going out 36 hours, all of these models had no skill in their intensity forecasts during 2012. The ECMWF and HWRF models were the worst models for intensity forecasts of 3, 4, and 5 days, with a skill of 20% - 60% lower than a "no-skill" forecast. The LGEM model, which was a decent intensity model in 2011, tanked badly in 2012 and had near-zero skill. The only model that was any good in 2012 was the IVCN "consensus" model, which averages together the intensity forecasts of two or more of the intensity models such as LGEM, GFDL, HWRF, and DSHP.

Some Promising Models From the Hurricane Forecast Improvement Project (HFIP)
Last year was the fourth year of a ten-year project, called the Hurricane Forecast Improvement Project (HFIP), aimed at reducing hurricane track and intensity errors by 50%. The new experimental models from HFIP generally performed poorly in 2012. However, the new FIM9 15-km global model was competitive with the ECMWF and GFS models for track, and the new CIRA Statistical Intensity Consensus (SPC3) model for intensity performed better than many of the traditional intensity models.

For those interested in learning more about the hurricane forecast models, NOAA has a 1-hour training video (updated for 2011.) Additional information about the guidance models used at the NHC can be found at NHC and the NOAA/HRD Hurricane FAQ.

Sources of Model Data
You can view 7-day ECMWF and 16-day GFS forecasts on wunderground's wundermap with the model layer turned on.
Longer ten-day ECMWF forecasts are available from the ECMWF web site.
FSU's experimental hurricane forecast page (CMC, ECMWF, GFDL, GFS, HWRF, and NAVGEM models)
NOAA's HFIP model comparison page (GFS, ECMWF, FIM, FIM9, UKMET, and CMC models.)
Experimental HFIP models

Jeff Masters

Re: Which Hurricane Forecast Model Should You Trust? [Re: Marty] #469811
08/08/13 05:06 AM
08/08/13 05:06 AM
Joined: Oct 2001
Posts: 6,260
San Pedro AC Belize
Diane Campbell Offline
Diane Campbell  Offline
Interesting to note the lack of reliability on intensity forecasts.

Portofino Resort- Now with a new BEACH BAR!!
Click for excellent scuba lessons with Elbert Greer!
Chaa Creek is an award-winning luxury Belize Resort, rated as one of the worlds best Eco Lodges. We are a pioneer in adventure travel to Belize since 1981!
Maruba Beach Klub and Spa is the premiere Secret Beach spa and restaurant located on the crystal blue waters of the Caribbean Sea at the center of Secret Beach, Belize
First Class Accommodations for the Budget Traveler
First Class Accommodations for the Budget Traveler

Things to do
Specials & Events
SPTB Calendar of Events

Daily News
Daily Weather

Classified Ads
San Pedro Sun
Ambergris Today
SP Town Council
Channel 7
Channel 5
Love FM
The Reporter
TV Newscasts
Radio Stations

Click for our
Search thousands of Belizean-only websites
To Get Your Questions Answered

Event Guides
Event Calendar
Specials & Events
Things to Do
Cayo Event Calendar

San Pedro Scoop!
Tia Chocolate
My Beautiful Belize
I-Travel Belize
Belize Adventure
Belize Hub
Romantic Travel
Belize Happy Adventures
Conch Creative
Caribbean Culture & Lifestyle
More Blogs...
Search thousands of Belizean-only websites
White Sands Dive Shop - 5 Star PADI Dive Facility - Daily diving, SCUBA instruction and Snorkeling
Caribbean Inspired All Natural Condiments & Spice Blends, Over 100 are Gluten Free!
We handle all aspects of the purchase of your Real Estate in Belize. From in depth property searches to your final closing.
Click for Ian Anderson's Caves Branch, Welcome to a World of Adventure
Lil Alphonse has snorkel equipment to fit anyone as well as Marine Park Tickets and flotation devices to assist those not as experienced.
Coastal Xpress offers a daily scheduled ferry run to most resorts, restaurants and private piers on the island of Anbergris Caye. We also offer  private and charter water taxi service.
Cayo Espanto
Click for Cayo Espanto, and have your own private island
More Links
Click for exciting and adventurous tours of Belize with Katie Valk!
ShoutChat Box
Who's Online Now
0 registered members (), 65 guests, and 0 spiders.
Key: Admin, Global Mod, Mod
Forum Statistics
Most Online7,413
Nov 7th, 2021 HELP! Visitor Center Goods & Services San Pedro Town Message Board Lodging Diving Fishing Things to Do History Maps Phonebook Belize Business Directory Picture of the Day

The opinions and views expressed on this board are the subjective opinions of Ambergris Caye Message Board members
and not of the Ambergris Caye Message Board its affiliates, or its employees.

Powered by UBB.threads™ PHP Forum Software 7.7.1