Skip to content

Remove config.com dependency from GDASApp#2183

Open
AntonMFernando-NOAA wants to merge 8 commits into
NOAA-EMC:release/gfs.v17from
AntonMFernando-NOAA:feature/gfsv17-gdas_config_com
Open

Remove config.com dependency from GDASApp#2183
AntonMFernando-NOAA wants to merge 8 commits into
NOAA-EMC:release/gfs.v17from
AntonMFernando-NOAA:feature/gfsv17-gdas_config_com

Conversation

@AntonMFernando-NOAA

Copy link
Copy Markdown
Collaborator

Description

  • config.com is a legacy configuration mechanism that should be completely removed from the GDASApp. Currently, it is still referenced in:
  1. GDASApp: Configuration lookup and initialization

Companion PRs

Issues

Automated CI tests to run in Global Workflow

  • atm_jjob
  • C96C48_ufs_hybatmDA
  • C96C48_hybatmsnowDA
  • C96_gcafs_cycled
  • C48mx500_3DVarAOWCDA
  • C48mx500_hybAOWCDA
  • C96C48_ufsgsi_hybatmDA
  • C48_ufsenkf_atmDA
  • C96C48_hybatmDA

@RussTreadon-NOAA RussTreadon-NOAA left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

g-w PR #5068 uses the GDASApp hash from this PR. g-w PR #5068 documented that g-w CI passes with the changes in the g-w PR and this GDASApp PR.

g-w CI does not directly exercise the GDASApp jjob scripts modified by this PR. Given this, build g-w PR #5068 on Dogwood with GDASApp g-w CI turned on. This is done for two reasons. (1) confirm that the changes in this PR work for these ctests. (2) see if GDASApp ctests, including select g-w CI, work when using GFS v17 branches.

GDASApp ctests are not part of pre-implementation testing. Therefore, approve.

Comment thread test/atm/global-workflow/jjob_ens_init.sh

@AndrewEichmann-NOAA AndrewEichmann-NOAA left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No objections if it works, though I haven't worked with GDASApp ctests in a while

@AntonMFernando-NOAA AntonMFernando-NOAA marked this pull request as draft June 29, 2026 15:48
@AntonMFernando-NOAA AntonMFernando-NOAA force-pushed the feature/gfsv17-gdas_config_com branch from 930f384 to 8b0e395 Compare June 30, 2026 19:46
@AntonMFernando-NOAA AntonMFernando-NOAA marked this pull request as ready for review July 1, 2026 14:47
@AntonMFernando-NOAA

Copy link
Copy Markdown
Collaborator Author

@RussTreadon-NOAA @CoryMartin-NOAA @DavidNew-NOAA @AndrewEichmann-NOAA @DavidHuber-NOAA The scripts were further updated to reflect the recommendation against using template scripts.

Comment thread parm/atm/atm_det_config.yaml.j2 Outdated
'${MEMDIR}': 'mem%03d' | format(imem) }) %}
- ['{{ COM_ATMOS_HISTORY_TMPL | replace_tmpl(tmpl_dict) }}/{{ GPREFIX_ENS }}csg_atm.f006.nc', '{{ DATA }}/ens/{{ 'mem%03d' | format(imem) }}/{{ GPREFIX_ENS }}cubed_sphere_grid_atmf006.nc']
- ['{{ COM_ATMOS_HISTORY_TMPL | replace_tmpl(tmpl_dict) }}/{{ GPREFIX_ENS }}csg_sfc.f006.nc', '{{ DATA }}/ens/{{ 'mem%03d' | format(imem) }}/{{ GPREFIX_ENS }}cubed_sphere_grid_sfcf006.nc']
{% set ens_hist_prev = ROTDIR ~ '/enkfgdas.' ~ (previous_cycle | to_YMD) ~ '/' ~ (previous_cycle | strftime('%H')) ~ '/' ~ ('mem%03d' | format(imem)) ~ '/model/atmos/history' %}

@TravisElless-NOAA TravisElless-NOAA Jul 1, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since these are still COM variables I would suggest changing these variables being set to still use the COM nomenclature. Then as part of #3340 we would highlight in the respective J-Jobs that things are being set down here

Suggested change
{% set ens_hist_prev = ROTDIR ~ '/enkfgdas.' ~ (previous_cycle | to_YMD) ~ '/' ~ (previous_cycle | strftime('%H')) ~ '/' ~ ('mem%03d' | format(imem)) ~ '/model/atmos/history' %}
{% set COM_ATMOS_HISTORY_MEM_PREV = ROTDIR ~ '/enkfgdas.' ~ (previous_cycle | to_YMD) ~ '/' ~ (previous_cycle | strftime('%H')) ~ '/' ~ ('mem%03d' | format(imem)) ~ '/model/atmos/history' %}

@AntonMFernando-NOAA

Copy link
Copy Markdown
Collaborator Author

@TravisElless-NOAA See the new changes.

@DavidHuber-NOAA DavidHuber-NOAA self-requested a review July 2, 2026 16:33
Comment thread parm/atm/atm_det_config.yaml.j2 Outdated
'${MEMDIR}': 'mem%03d' | format(imem) }) %}
- ['{{ COM_ATMOS_HISTORY_TMPL | replace_tmpl(tmpl_dict) }}/{{ GPREFIX_ENS }}csg_atm.f006.nc', '{{ DATA }}/ens/{{ 'mem%03d' | format(imem) }}/{{ GPREFIX_ENS }}cubed_sphere_grid_atmf006.nc']
- ['{{ COM_ATMOS_HISTORY_TMPL | replace_tmpl(tmpl_dict) }}/{{ GPREFIX_ENS }}csg_sfc.f006.nc', '{{ DATA }}/ens/{{ 'mem%03d' | format(imem) }}/{{ GPREFIX_ENS }}cubed_sphere_grid_sfcf006.nc']
{% COMIN_ATMOS_HISTORY_PREV_MEM = ROTDIR ~ '/enkfgdas.' ~ (previous_cycle | to_YMD) ~ '/' ~ (previous_cycle | strftime('%H')) ~ '/' ~ ('mem%03d' | format(imem)) ~ '/model/atmos/history' %}

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just a minor suggestion from me would be to switch the order of MEM and other additional descriptors (PREV, ENSSTAT, etc.) throughout to be consistent with other COM variables.

Additionally can you point to the location of the CI log files that NOAA-EMC/global-workflow#5068 ran with these updates just as a double check to make sure things are being rendered correctly

Suggested change
{% COMIN_ATMOS_HISTORY_PREV_MEM = ROTDIR ~ '/enkfgdas.' ~ (previous_cycle | to_YMD) ~ '/' ~ (previous_cycle | strftime('%H')) ~ '/' ~ ('mem%03d' | format(imem)) ~ '/model/atmos/history' %}
{% COMIN_ATMOS_HISTORY_MEM_PREV = ROTDIR ~ '/enkfgdas.' ~ (previous_cycle | to_YMD) ~ '/' ~ (previous_cycle | strftime('%H')) ~ '/' ~ ('mem%03d' | format(imem)) ~ '/model/atmos/history' %}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants