. "5 Overarching Recommendations." Completing the Forecast: Characterizing and Communicating Uncertainty for Better Decisions Using Weather and Climate Forecasts. Washington, DC: The National Academies Press, 2006.
The following HTML text is provided to enhance online
readability. Many aspects of typography translate only awkwardly to HTML.
Please use the page image
as the authoritative form to ensure accuracy.
Completing the Forecast: Characterizing and Communicating Uncertainty for Better Decisions Using Weather and Climate Forecasts
Product Development IncorporatingBroad Expertise and Knowledge from the Outset
Finding 2:3 Understanding user needs and effectively communicating the value of uncertainty information for addressing those needs are perhaps the largest and most important tasks for the Enterprise. Yet, forecast information is often provided without full understanding of user needs or how to develop products that best support user decisions.
Parts of the Enterprise (e.g., within the private sector and academia) have developed a sophisticated understanding of user needs. In addition, there is a wealth of relevant knowledge in the social and behavioral sciences that could be more effectively incorporated into product research and development. Currently, this variety of resources is not being fully tapped by NOAA,4 and user perspectives are not incorporated from the outset of the product development process.
Recommendation 2: NOAA should improve its productdevelopment process by collaborating with users andpartners in the Enterprise from the outset and engagingand using social and behavioral science expertise.
Education on Uncertainty and Risk Communication
Finding 3:5 Enhanced Enterprise-wide educational initiatives will underpin efforts to improve communication and use of uncertainty information. There are three critical areas of focus: (1) undergraduate and graduate education; (2) recurrent forecaster training, and (3) user outreach and education.
Recommendation 3: All sectors and professional organizations of the Enterprise should cooperate in educationalinitiatives that will improve communication and use ofuncertainty information. In particular, (1) hydrometeorological curricula should include understanding andcommunication of risk and uncertainty, (2) ongoingtraining of forecasters should expose them to the latesttools in these areas, and (3) forecast providers should helpusers, especially members of the public, understand thevalue of uncertainty information and work with users tohelp them effectively incorporate this information intotheir decisions.
Ensembles
Finding 4:6 The ability of NOAA to distribute and communicate uncertainty information is predicated on the capacity to produce post-processed probabilistic model guidance on a variety of spatial scales. Currently, NOAA maintains long-range (global) and short-range ensemble prediction systems. However, the short-range system undergoes no post-processing and uses an ensemble generation method (breeding) that may not be appropriate for short-range prediction. In addition, the short-range model has insufficient resolution to generate useful uncertainty information at the regional level. For forecasts at all scales, comprehensive post-processing is needed to produce reliable (or calibrated) uncertainty information.
Recommendation 4: NOAA should develop and maintainthe ability to produce objective uncertainty informationfrom the global to the regional scale.
Ensuring Widespread Availability ofUncertainty Information
Finding 5:7 NWS, through the National Centers for Environmental Prediction (NCEP), produces a large amount of model output from its deterministic and ensemble numerical weather prediction models. The ensemble forecasts and output from statistical post-processing (i.e., Model Output Statistics) already produce a wide variety of uncertainty information. However, both the model output and statistical information regarding its skill are difficult to access from outside NCEP. Thus, NWS is missing an opportunity to provide the underlying datasets that can drive improved uncertainty estimation and communication across the Enterprise.
Recommendation 5: To ensure widespread use of uncertainty information, NWS should make all raw andpost-processed probabilistic products easily accessibleto the Enterprise at full spatial and temporal resolution. Sufficient computer and communications resourcesshould be acquired to ensure effective access by externalusers and NWS personnel.
Broad Access to Comprehensive Verification Information
Finding 6:8 To make effective use of uncertainty products, users need complete forecast verification information that measures all aspects of forecast performance. In addition, comprehensive verification information is needed to improve forecasting systems. Such information includes previous numerical forecasts, observations, post-processed uncer-
Recognizing that private-sector entities gain a competitive advantage through knowledge of user needs, there is, nonetheless, some opportunity for information sharing that could significantly improve the effectiveness and efficiency of product development.
5
See Section 4.2.8.
6
See Chapter 3. Production of objective uncertainty information is covered in Sections 3.1 through 3.3.