Aggregate MPR lines using Statanalysis

[perthsb]

Hi,
I am trying to create a time series of Observation stations using matched pair generated by Pointstat. But I am getting error while doing that, like

ERROR :
ERROR : do_job_aggr_stat() -> the "-line_type" option must be used exactly once and the "-out_line_type" option must be used at least once: -job aggregate_stat -model point_stat -fcst_valid_hour 000000 -fcst_var AOTK -obs_var AOD -line_type MPR
ERROR :
ERROR :
ERROR : main() -> encountered an error value of 1. Calling clean_up() and usage() before exiting.
ERROR :

Logfile : /scratch1/NCEPDEV/stmp2/Partha.Bhattacharjee/METplus/Scripts/Regional/logs/metplus.log.20231130062145

Any help on this is appreciated. Thanks.

[CPKalb]

Hi:

From your log file, it looks like the job command given to Stat-Analysis is as follows:
-job aggregate_stat -model point_stat -fcst_valid_hour 000000 -fcst_var AOTK -obs_var AOD -line_type MPR

Although the command has the -line_type flag, it is missing the -out_line_type flag, which is the cause for the error. For any aggregate_stat job, the output line type is different from the input line type and MET needs that information to know what output line type to write and which statistics to compute. This table shows the options for output line types that can be produced from the MPR line type. What type of output statistics are you trying to create for the time series?

If you don't want to compute statistics, but just want to separate out certain variables or lines to create a time series, then the filter job would be the one to use.

Christina

[CPKalb]

Hi:

It sounds like you are wanting to average all the observations for a particular forecast hour, rather than having the same model matched to observations at slightly different times around the hour. This is best accomplished in your Point-Stat run, rather than using Stat-Analysis. Time averaging in Point-Stat is done using the OBS_SUMMARY option. For a simple average, this would be set to UW_MEAN.

OBS_SUMMARY is not yet an option yet in METplus for Point-Stat, so the way to set this variable is using a config override. Specifically, you would want to set the following in your Point-Stat METplus configuration file:
POINT_STAT_MET_CONFIG_OVERRIDES = obs_summary = UW_MEAN;

Then, run Point-Stat, and you should get only one output each hour matched to an average observation.

Christina

[georgemccabe]

Note: Starting in METplus v6.0.0 (upcoming release), obs_summary can be set with POINT_STAT_OBS_SUMMARY = UW_MEAN instead of POINT_STAT_MET_CONFIG_OVERRIDES.

[perthsb]

I have set POINT_STAT_OBS_SUMMARY = UW_MEAN in the config but getting similar result as before, that is without doing the averages of station obs around model forecast time. Check this : point_stat_140000L_20200906_140000V.stat in the output. Do I need to set something more in the config.

[CPKalb]

POINT_STAT_OBS_SUMMARY will be available when METplus version 6.0 comes out, but we we are currently on METplus version 5.1. So, at this time POINT_STAT_OBS_SUMMARY does not work. For now, you will want to set this variable using a config override. So, remove the POINT_STAT_OBS_SUMMARY = UW_MEAN in your configuration and add this line instead:
POINT_STAT_MET_CONFIG_OVERRIDES = obs_summary = UW_MEAN;

This produces only one output per station every hour when I run it on my end. Does it work on your end?

Thanks,
Christina

[perthsb]

Yes, it is working fine. Thanks Christina for all your help and patience.

[CPKalb]

Great. I am going to lock this discussion to prevent future posts. If you have additional information, feel free to start a new discussion.