Space Weather · 2008 · 156 citations · 42 references
Natural SciencesMeteorologyForecastingUncertainty QuantificationWeather ForecastingForecast VerificationProbabilistic ForecastingSolar Energetic ParticlesCategorical Verification MetricsFalse Alarm Rate AnalysisForecast Performance EvaluationRise TimeSolar Particle EventsSolar Proton EventsSpace Weather ForecastingSpace Weather Prediction Models
This paper evaluates the performance of an operational proton prediction model currently being used at NOAA's Space Weather Prediction Center. The evaluation is based on proton events that occurred between 1986 and 2004. Parameters for the associated solar events determine a set of necessary conditions, which are used to construct a set of control events. Model output is calculated for these events and performance of the model is evaluated using standard verification measures. For probability forecasts we evaluate the accuracy, reliability, and resolution and display these results using a standard attributes diagram. We identify conditions for which the model is systematically inaccurate. The probability forecasts are also evaluated for categorical forecast performance measures. We find an optimal probability and we calculate the false alarm rate and probability of detection at this probability. We also show results for peak flux and rise time predictions. These findings provide an objective basis for measuring future improvements.
42
Statistical Methods in the Atmospheric Sciences
Philip H. Ramsey, Daniel S. Wilks · Technometrics · 1996 · 7.7K citations
VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY
Glenn W. Brier · Monthly Weather Review · 1950 · 5.3K citations
Business, Mathematics, Meteorology +10
A New Vector Partition of the Probability Score
Allan H. Murphy · Journal of applied meteorology · 1973 · 1.1K citations · Full text
Business, Mathematics, Forecasting +15
A General Framework for Forecast Verification
Allan H. Murphy, Robert L. Winkler · Monthly Weather Review · 1987 · 687 citations · Full text
Business, Mathematics, Meteorology +13
John Wild, S. F. Smerd, A. A. Weiss · Annual Review of Astronomy and Astrophysics · 1963 · 639 citations