SRW for NASA NCCS Discover

[ssinno]

I've been struggling to build SRW on NASA's Discover platform against spack-stack version 2.0.0 & 2.1.0. Perusing through the repo suggests I'd succeed with version 1.9.2, which isn't available on Discover, not sure if that can be dropped in? If not, are there plans in the works to support newer spack-stack releases? Mine seem to fail trying to find the 'sp' package which doesn't appear to be included in 2.0.0 and up.

[MichaelLueken]

Hello @ssinno,

Thank you for creating this discussion!

For UFS-based applications, spack-stack changes need to be made in the weather model first, then they get propagated to the rest of the applications. The SRW App will begin the process of updating to use spack-stack 2.1.0 once the UFS weather model's PR #3174 has been opened, reviewed, and merged.

There is no ETA on when the weather model PR will get merged, or the subsequent PR to update the SRW App.

[mathomp4]

@MichaelLueken A query: Do you know if anyone has built SRW with spack-stack 1.9.3? All your code here points to 1.9.2 but from what I see, 1.9.3 wasn't that different. And yet @ssinno couldn't seem to build SRW with 1.9.3

[MichaelLueken]

Hi @mathomp4,

I'm not aware of anyone building the SRW with spack-stack 1.9.3.

[gspetro-NOAA]

@ssinno To Mike Lueken's point, the SRW App won't be updated to build w/spack-stack v2.1.x until after this PR (#3174) goes into the UFS WM. However, you can take a look at the changes in the WM PR if you're interested in trying to build the SRW w/v2.1.0 on Discover. You'll see that sp has indeed been removed, since all sp functionality has been rolled into ip. It will probably be an uphill battle to build w/unsupported (for now) versions on an unsupported system, but at least that PR provides a little more info.

[ssinno]

Much obliged for the input.  I was able to get the 'develop' branch to build against spack-stack 1.9.3 on Discover after a few tries at it, using gnu/openmpi.  If there's interest in submitting the relevant modulefile ('build_discover_gnu.lua') I certainly can.  

[jdkublnick]

Hello @ssinno,

Glad you were able to get the develop branch to build! Thanks for offering to share the modulefile. We actually have a meeting tomorrow to discuss the future direction of SRW. That said, I do imagine there would be community interest in seeing how you configured the build_discover_gnu.lua modulefile and what was needed to get things building successfully on Discover with spack-stack 1.9.3.

After the meeting tomorrow, we should have a better sense of the preferred approach and can follow up with you then.

Thanks,
Josh Kublnick
Epic User Support

[ssinno]

 Not sure I have permissions to push so ye ole copy-paste lies below.

[ssinno@discover31 ufs]cat modulefiles/build_discover_gnu.lua
help([[
This module loads libraries for building the UFS SRW App on
NCCS's Discover platform using spack-stack 1.9.3 + gcc 12.3.0
]])

whatis([===[Loads libraries needed for building the UFS SRW App on Discover ]===])

prepend_path("MODULEPATH", "/discover/swdev/gmao_SIteam/modulefiles-SLES15")
prepend_path("MODULEPATH", "/discover/swdev/jcsda/spack-stack/scu17/modulefiles")
prepend_path("MODULEPATH", "/gpfsm/dswdev/jcsda/spack-stack/scu17/spack-stack-1.9.3/envs/ue-gcc-12.3.0/install/modulefiles/Core")

load("stack-gcc/12.3.0")
load("stack-openmpi/4.1.6")
load("ufs-srw-app-env")
load("crtm/2.4.0.1")
load("sp")

prepend_path("CPPFLAGS", " -I/usr/include/slurm")
setenv("CC", "mpicc")
setenv("CXX", "mpic++")
setenv("FC", "mpif90")
setenv("CMAKE_Platform", "discover.gnu")