Skip to Content

FLOODS: Debris, Drinking Water, and Other Environmental Concerns

FLOODS: Debris, Drinking Water, and Other Environmental Concerns

Search tceq.texas.gov

Questions or Comments: amda@tceq.texas.gov

Texas Photochemical Modeling Results—Model Performance Statistics by Area and Day

Interactive bar chart and data table of model performance statistics comparing the results of the TCEQ’s air quality modeling with surface observations.

The purpose of evaluating model performance is to determine how well the model replicates an historical episode. Performance statistics do not feed directly into future ozone estimates or regulatory decisions.

To compare results of ozone photochemical modeling to actual observed data from surface monitoring sites, the TCEQ calculates the following statistical metrics, recommended by the EPA (Modeling Guidance for Demonstrating Attainment of Air Quality Goals for Ozone, PM2.5, and Regional Haze ).

  • Mo - Mean of Observed Values
  • Mm - Mean of Modeled Values (ideal if Mm = Mo)
  • MB - Mean Bias (mean difference; ideal value = 0)
  • ME - Mean Error (mean absolute difference; ideal value = 0)
  • RMSE - Root Mean Squared Error (ideal value = 0)
  • NMB - Normalized Mean Bias (relative mean difference; ideal value = 0)
  • NME - Normalized Mean Error (relative mean absolute difference; ideal value = 0)
  • FB - Fractional Bias (value range: -200% to 200%; ideal value = 0)
  • FE - Fractional Error (value range: 0 to 200%; ideal value = 0)
  • R2 - Coefficient of Determination (square of correlation coefficient; value range: 0 to 1; ideal value = 1)

This page shows interactive chart and data table of ozone performance statistics by days for a selected area from the 2012 photochemical modeling.

The statistical performance of the TCEQ's base case ozone modeling is comparable to and, in many cases, above average of other ozone modeling efforts discussed in a research paper Compilation and Interpretation of Photochemical Model Performance Statistics Published between 2006 and 2012 (Simon, et al, Atmospheric Environment 61:124–139, November 2012).

The median value, Interquartile Range (IQR) , and value range of ozone statistics presented in this paper (Fig. 4) are available to overlay on the chart for MB, ME, RMSE, NMB, NME, and R2 of hourly, daily maximum of hourly, and daily maximum of eight-hour data.

If you have any questions regarding this interactive chart, please send an email to amda@tceq.texas.gov with the subject "Texas Photochemical Modeling Results - Model Performance Statistics by Area and Day".

show instructions
Use regions/landmarks to skip ahead to chart and navigate between data series.

Model Performance Statistics of Hourly O3 Concentrations in tx_4km Domain. Mean Modeled (Mm) and Mean Observered (Mo) of All Data (cell values)

Long description.

No description available.

Structure.

Chart type: Combination chart.
The chart has 2 X axes displaying values and navigator-x-axis.
The chart has 2 Y axes displaying Mean Concentration (ppb) and navigator-y-axis.

View as data table.

Chart graphic.

Model Performance Statistics of Hourly O3 Concentrations in tx_4km DomainCreated with Highstock 5.0.10click to toggle on and offMedian/IQR/Range by Simon, et alExport image menuchange max value: hold left button, move up or downchange min value: hold left button, move up or down
Model Performance Statistics of Hourly O3 Concentrations in tx_4km Domain (cell values)
camx650_cb6r4h.tx.bc12_12sep.r6f2_r4f.2012_wrf371_p2ma_i2mSNgqsfc0_h.tx_4km
All Data
Episode
Date
Valid
Data
Mo
ppb
Mm
ppb
MB
ppb
ME
ppb
RMSE
ppb
NMB
%
NME% FB
%
FE
%
R2
 
20120901243820.8825.554.676.948.6622.3933.2624.0436.20.667
20120902256419.8123.323.56.47.7117.6832.3119.9338.630.635
20120903255920.0524.244.196.557.8220.8932.6822.238.190.699
20120904252320.824.483.686.828.3617.732.7821.1940.80.71
20120905252619.7423.884.147.118.692136.0426.8645.560.734
20120906251223.3829.155.7710.1313.7224.6743.3232.1555.240.657
20120907256124.1233.39.1811.4514.6638.0847.4743.5955.180.717
20120908254131.4536.364.929.1211.215.6329.0124.1436.680.644
20120909261335.2138.463.258.4610.99.2424.0218.2733.150.638
20120910259938.5141.42.8910.8613.917.5128.225.9445.460.671
20120911262343.2745.27211.9315.284.6227.5612.2839.170.437
20120912261928.9330.962.037.889.777.0127.226.0933.630.651
20120913259819.6327.878.2410.9313.8541.9555.6736.5451.140.293
20120914259221.9233.4111.4912.814.9452.3958.4141.9752.030.537
20120915254628.3439.0810.7511.9914.0837.9242.333.8241.160.664
20120916260727.8836.588.710.5612.931.237.8932.340.480.644
20120917261927.7840.0612.2812.9815.2944.1946.7141.344.360.588
20120918263727.0134.557.5411.3813.8327.9242.1341.4655.420.565
20120919262433.3434.511.177.699.873.5223.081133.180.708
20120920261937.5135.93-1.5710.513.46-4.228.0111.2445.230.657
20120921265538.7539.190.4412.115.031.1431.2417.7649.440.575
20120922258734.3440.065.7212.5915.7316.6636.6730.8550.90.537
20120923265732.9639.366.410.8813.4919.4332.9933.5448.430.687
20120924264337.4740.122.6411.0314.117.0629.4319.9544.480.571
20120925261341.4241.13-0.288.2210.73-0.6919.860.3524.720.404
20120926264539.4736.33-3.147.7910.47-7.9619.75-9.4926.580.473
20120927264130.6633.492.839.2211.439.2330.0813.5839.230.523
20120928262020.7129.979.2511.9114.3544.6857.5146.0460.620.521
20120929252018.0221.053.035.997.5916.8233.2413.138.320.538
20120930267429.1832.593.416.287.8711.6821.529.6322.490.596
all days7777529.1833.84.629.6312.315.8433.0123.3342.190.614
select an episode
(loads new page)
select a model run
choose a data type
choose a statistic type
choose 2×2-cell bi-linear interpolated or cell value
choose hourly or eight-hour value
choose ozone area
click a legend item to toggle the display of corresponding data series on the chart
click here to save chart image or data series
hold the left mouse button and select a rectangle in the chart area to zoom in
hover the cursor over chart to show the data values of a particular day
move the cursor into this label area, hold the left mouse button and move up or down to change the upper value; double-click to reset to a default value
similarly, change the bottom value here; the bottom value cannot be changed below zero
change date range by sliding the left and/or right handles on this navigation bar