Repository navigation
Labels
bugsomething is working incorrectlysomething is working incorrectlyexternalissue needs to be addressed elsewhere (submodule); issue here for the sake of project trackingissue needs to be addressed elsewhere (submodule); issue here for the sake of project tracking
Milestone
Description
Brief summary of bug
These tests are failing in RUN on the #3787 branch at hash 60a9c5d:
ERS_D_Ld30.f45_f45_mg37.I2000Clm50FatesCruRsGs.derecho_intel.clm-FatesColdLUH2ERS_D_Ld30.f45_f45_mg37.I2000Clm50FatesCruRsGs.derecho_intel.clm-FatesColdLUH2HarvestAreaERS_D_Ld30.f45_f45_mg37.I2000Clm50FatesCruRsGs.derecho_intel.clm-FatesColdLUH2HarvestMass
General bug information
CTSM version you are using: the #3787 branch at hash 60a9c5d
Does this bug cause significantly incorrect results in the model's science? No
Configurations affected: Unclear
Important output or errors that show the problem
See testing in /glade/derecho/scratch/samrabin/tests_0301-171531de/.
Here are the namelist diffs from the ERS_D_Ld30.f45_f45_mg37.I2000Clm50FatesCruRsGs.derecho_intel.clm-FatesColdLUH2 test:
BASE: flandusepftdat = fates_landuse_pft_map_4x5_240206.nc'
COMP: flandusepftdat = fates_landuse_pft_map_4x5_240206.no_nan_fill.nc'
BASE: fluh_timeseries = LUH2_states_transitions_management.timeseries_4x5_hist_simyr0850-2015_c240216.nc'
COMP: fluh_timeseries = LUH2_states_transitions_management.timeseries_4x5_hist_simyr0850-2015_c240216.no_nan_fill.nc'
BASE: paramfile = clm50_params.c250311.nc'
COMP: paramfile = clm50_params.c250311.no_nan_fill.nc'
BASE: stream_meshfile_cropcal = 360x720_120830_ESMFmesh_c20210507_cdf5.tweaked_latlons.nc'
COMP: stream_meshfile_cropcal = 360x720_120830_ESMFmesh_c20210507_cdf5.tweaked_latlons.no_nan_fill.nc'
And here's the error for one task in that run:
dec1447.hsn.de.hpc.ucar.edu 433: negative area 1 1 1 -999.000000000000
dec1447.hsn.de.hpc.ucar.edu 433: ENDRUN:
dec1447.hsn.de.hpc.ucar.edu 433: ERROR in EDInitMod.F90 at line 608
dec1447.hsn.de.hpc.ucar.edu 433: Image PC Routine Line Source
dec1447.hsn.de.hpc.ucar.edu 433: cesm.exe 00000000038A6BE5 shr_abort_backtra 110 shr_abort_mod.F90
dec1447.hsn.de.hpc.ucar.edu 433: cesm.exe 00000000038A6B94 shr_abort_abort 65 shr_abort_mod.F90
dec1447.hsn.de.hpc.ucar.edu 433: cesm.exe 0000000001939AA0 fates_endrun 103 FatesGlobals.F90
dec1447.hsn.de.hpc.ucar.edu 433: cesm.exe 00000000017937E7 set_site_properti 608 EDInitMod.F90
dec1447.hsn.de.hpc.ucar.edu 433: cesm.exe 00000000009AB049 init_coldstart 2174 clmfates_interfaceMod.F90
dec1447.hsn.de.hpc.ucar.edu 433: cesm.exe 000000000092B146 initialize2 760 clm_initializeMod.F90
dec1447.hsn.de.hpc.ucar.edu 433: cesm.exe 0000000000853824 initializerealize 677 lnd_comp_nuopc.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D93661A79 callVFuncPtr 2192 ESMCI_FTable.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D93660BA0 ESMCI_FTableCallE 849 ESMCI_FTable.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D93AF5850 enter 2732 ESMCI_VMKernel.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D93ADBDCA enter 1365 ESMCI_VM.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D93661E19 c_esmc_ftablecall 1006 ESMCI_FTable.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D9404A129 c_esmc_ftablecall 0 ESMF_Comp.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D9403B9A8 esmf_compexecute 1272 ESMF_Comp.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D9479412B esmf_gridcompinit 1449 ESMF_GridComp.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D9501A855 loopmodelcompss 2793 NUOPC_Driver.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D9500D662 initializeipdv02p 1953 NUOPC_Driver.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D93661A79 callVFuncPtr 2192 ESMCI_FTable.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D93660BA0 ESMCI_FTableCallE 849 ESMCI_FTable.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D93AF5850 enter 2732 ESMCI_VMKernel.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D93ADBDCA enter 1365 ESMCI_VM.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D93661E19 c_esmc_ftablecall 1006 ESMCI_FTable.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D9404A129 c_esmc_ftablecall 0 ESMF_Comp.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D9403B9A8 esmf_compexecute 1272 ESMF_Comp.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D9479412B esmf_gridcompinit 1449 ESMF_GridComp.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D9501A855 loopmodelcompss 2793 NUOPC_Driver.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D9500D7CB initializeipdv02p 1958 NUOPC_Driver.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D94FEC5E6 initializegeneric 505 NUOPC_Driver.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D93661A79 callVFuncPtr 2192 ESMCI_FTable.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D93660BA0 ESMCI_FTableCallE 849 ESMCI_FTable.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D93AF5850 enter 2732 ESMCI_VMKernel.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D93ADBDCA enter 1365 ESMCI_VM.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D93661E19 c_esmc_ftablecall 1006 ESMCI_FTable.C
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D9404A129 c_esmc_ftablecall 0 ESMF_Comp.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D9403B9A8 esmf_compexecute 1272 ESMF_Comp.F90
dec1447.hsn.de.hpc.ucar.edu 433: libesmf.so 0000148D9479412B esmf_gridcompinit 1449 ESMF_GridComp.F90
dec1447.hsn.de.hpc.ucar.edu 433: cesm.exe 000000000043B29D esmapp 128 esmApp.F90
dec1447.hsn.de.hpc.ucar.edu 433: cesm.exe 000000000041A89D Unknown Unknown Unknown
dec1447.hsn.de.hpc.ucar.edu 433: libc.so.6 0000148D88697E6C Unknown Unknown Unknown
dec1447.hsn.de.hpc.ucar.edu 433: libc.so.6 0000148D88697F35 __libc_start_main Unknown Unknown
dec1447.hsn.de.hpc.ucar.edu 433: cesm.exe 000000000041A7A1 Unknown Unknown Unknown
dec1447.hsn.de.hpc.ucar.edu 433: ESMF_Finalize: Error closing trace stream
dec1447.hsn.de.hpc.ucar.edu 433: MPICH ERROR [Rank 433] [job id d7efdb09-bf80-4e6c-83bf-a433d14ae838] [Sun Mar 1 17:31:42 2026] [dec1447] - Abort(1) (rank 433 in comm 496): application called MPI_Abort(comm=0x84000001, 1) - process 433
dec1447.hsn.de.hpc.ucar.edu 433:```
Metadata
Metadata
Assignees
Labels
bugsomething is working incorrectlysomething is working incorrectlyexternalissue needs to be addressed elsewhere (submodule); issue here for the sake of project trackingissue needs to be addressed elsewhere (submodule); issue here for the sake of project tracking
Activity
Restore tests still expected to fail due to ESCOMP#3788 AND ESCOMP#3789.
glemieux commentedon Mar 12, 2026
I'm only just now getting around to this. Did these get exercised with the
ctsm5.4.024fixes?[-]FatesColdLUH2 tests fail with ifx compiler[/-][+]FatesColdLUH2 tests fail with input files that have non-NaN fills[/+]samsrabin commentedon Mar 19, 2026
Looks like no, they were last tested during the ctsm5.4.023 testing.
remove ESCOMP#3789 issue tests from expected fails