Skip to content

FatesColdLUH2 tests fail with input files that have non-NaN fills #3789

Closed

Description

@samsrabin

Brief summary of bug

These tests are failing in RUN on the #3787 branch at hash 60a9c5d:

  • ERS_D_Ld30.f45_f45_mg37.I2000Clm50FatesCruRsGs.derecho_intel.clm-FatesColdLUH2
  • ERS_D_Ld30.f45_f45_mg37.I2000Clm50FatesCruRsGs.derecho_intel.clm-FatesColdLUH2HarvestArea
  • ERS_D_Ld30.f45_f45_mg37.I2000Clm50FatesCruRsGs.derecho_intel.clm-FatesColdLUH2HarvestMass

General bug information

CTSM version you are using: the #3787 branch at hash 60a9c5d

Does this bug cause significantly incorrect results in the model's science? No

Configurations affected: Unclear

Important output or errors that show the problem

See testing in /glade/derecho/scratch/samrabin/tests_0301-171531de/.

Here are the namelist diffs from the ERS_D_Ld30.f45_f45_mg37.I2000Clm50FatesCruRsGs.derecho_intel.clm-FatesColdLUH2 test:

  BASE: flandusepftdat = fates_landuse_pft_map_4x5_240206.nc'
  COMP: flandusepftdat = fates_landuse_pft_map_4x5_240206.no_nan_fill.nc'
  BASE: fluh_timeseries = LUH2_states_transitions_management.timeseries_4x5_hist_simyr0850-2015_c240216.nc'
  COMP: fluh_timeseries = LUH2_states_transitions_management.timeseries_4x5_hist_simyr0850-2015_c240216.no_nan_fill.nc'
  BASE: paramfile = clm50_params.c250311.nc'
  COMP: paramfile = clm50_params.c250311.no_nan_fill.nc'
  BASE: stream_meshfile_cropcal = 360x720_120830_ESMFmesh_c20210507_cdf5.tweaked_latlons.nc'
  COMP: stream_meshfile_cropcal = 360x720_120830_ESMFmesh_c20210507_cdf5.tweaked_latlons.no_nan_fill.nc'

And here's the error for one task in that run:

dec1447.hsn.de.hpc.ucar.edu 433:  negative area           1           1           1  -999.000000000000
dec1447.hsn.de.hpc.ucar.edu 433:  ENDRUN:
dec1447.hsn.de.hpc.ucar.edu 433:  ERROR in EDInitMod.F90 at line 608
dec1447.hsn.de.hpc.ucar.edu 433: Image              PC                Routine            Line        Source
dec1447.hsn.de.hpc.ucar.edu 433: cesm.exe           00000000038A6BE5  shr_abort_backtra         110  shr_abort_mod.F90
dec1447.hsn.de.hpc.ucar.edu 433: cesm.exe           00000000038A6B94  shr_abort_abort            65  shr_abort_mod.F90
dec1447.hsn.de.hpc.ucar.edu 433: cesm.exe           0000000001939AA0  fates_endrun              103  FatesGlobals.F90
dec1447.hsn.de.hpc.ucar.edu 433: cesm.exe           00000000017937E7  set_site_properti         608  EDInitMod.F90
dec1447.hsn.de.hpc.ucar.edu 433: cesm.exe           00000000009AB049  init_coldstart           2174  clmfates_interfaceMod.F90
dec1447.hsn.de.hpc.ucar.edu 433: cesm.exe           000000000092B146  initialize2               760  clm_initializeMod.F90
dec1447.hsn.de.hpc.ucar.edu 433: cesm.exe           0000000000853824  initializerealize         677  lnd_comp_nuopc.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D93661A79  callVFuncPtr             2192  ESMCI_FTable.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D93660BA0  ESMCI_FTableCallE         849  ESMCI_FTable.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D93AF5850  enter                    2732  ESMCI_VMKernel.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D93ADBDCA  enter                    1365  ESMCI_VM.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D93661E19  c_esmc_ftablecall        1006  ESMCI_FTable.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D9404A129  c_esmc_ftablecall           0  ESMF_Comp.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D9403B9A8  esmf_compexecute         1272  ESMF_Comp.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D9479412B  esmf_gridcompinit        1449  ESMF_GridComp.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D9501A855  loopmodelcompss          2793  NUOPC_Driver.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D9500D662  initializeipdv02p        1953  NUOPC_Driver.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D93661A79  callVFuncPtr             2192  ESMCI_FTable.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D93660BA0  ESMCI_FTableCallE         849  ESMCI_FTable.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D93AF5850  enter                    2732  ESMCI_VMKernel.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D93ADBDCA  enter                    1365  ESMCI_VM.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D93661E19  c_esmc_ftablecall        1006  ESMCI_FTable.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D9404A129  c_esmc_ftablecall           0  ESMF_Comp.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D9403B9A8  esmf_compexecute         1272  ESMF_Comp.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D9479412B  esmf_gridcompinit        1449  ESMF_GridComp.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D9501A855  loopmodelcompss          2793  NUOPC_Driver.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D9500D7CB  initializeipdv02p        1958  NUOPC_Driver.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D94FEC5E6  initializegeneric         505  NUOPC_Driver.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D93661A79  callVFuncPtr             2192  ESMCI_FTable.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D93660BA0  ESMCI_FTableCallE         849  ESMCI_FTable.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D93AF5850  enter                    2732  ESMCI_VMKernel.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D93ADBDCA  enter                    1365  ESMCI_VM.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D93661E19  c_esmc_ftablecall        1006  ESMCI_FTable.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D9404A129  c_esmc_ftablecall           0  ESMF_Comp.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D9403B9A8  esmf_compexecute         1272  ESMF_Comp.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so         0000148D9479412B  esmf_gridcompinit        1449  ESMF_GridComp.F90
dec1447.hsn.de.hpc.ucar.edu 433: cesm.exe           000000000043B29D  esmapp                    128  esmApp.F90
dec1447.hsn.de.hpc.ucar.edu 433: cesm.exe           000000000041A89D  Unknown               Unknown  Unknown
dec1447.hsn.de.hpc.ucar.edu 433: libc.so.6          0000148D88697E6C  Unknown               Unknown  Unknown
dec1447.hsn.de.hpc.ucar.edu 433: libc.so.6          0000148D88697F35  __libc_start_main     Unknown  Unknown
dec1447.hsn.de.hpc.ucar.edu 433: cesm.exe           000000000041A7A1  Unknown               Unknown  Unknown
dec1447.hsn.de.hpc.ucar.edu 433:  ESMF_Finalize: Error closing trace stream
dec1447.hsn.de.hpc.ucar.edu 433: MPICH ERROR [Rank 433] [job id d7efdb09-bf80-4e6c-83bf-a433d14ae838] [Sun Mar  1 17:31:42 2026] [dec1447] - Abort(1) (rank 433 in comm 496): application called MPI_Abort(comm=0x84000001, 1) - process 433
dec1447.hsn.de.hpc.ucar.edu 433:```

Activity

  1. added theissue type on Mar 2, 2026
  2. added
    bugsomething is working incorrectly
    nextthis should get some attention in the next week or two. Normally each Thursday SE meeting.
    on Mar 2, 2026
  3. assigned and unassigned on Mar 2, 2026
  4. glemieux commented on Mar 12, 2026

    @glemieux
    Contributor

    I'm only just now getting around to this. Did these get exercised with the ctsm5.4.024 fixes?

  5. self-assigned this
    on Mar 19, 2026
  6. removed
    nextthis should get some attention in the next week or two. Normally each Thursday SE meeting.
    on Mar 19, 2026
  7. changed the title [-]FatesColdLUH2 tests fail with ifx compiler[/-] [+]FatesColdLUH2 tests fail with input files that have non-NaN fills[/+] on Mar 19, 2026
  8. added
    externalissue needs to be addressed elsewhere (submodule); issue here for the sake of project tracking
    on Mar 19, 2026
  9. samsrabin commented on Mar 19, 2026

    @samsrabin
    MemberAuthor

    I'm only just now getting around to this. Did these get exercised with the ctsm5.4.024 fixes?

    Looks like no, they were last tested during the ctsm5.4.023 testing.

  10. added a commit that references this issue on Apr 13, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Labels

bugsomething is working incorrectlyexternalissue needs to be addressed elsewhere (submodule); issue here for the sake of project tracking

Type

Projects

No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions