Skip to content

Script to run regional simulations similar to run_neon script #1533

Closed

Description

@wwieder

We want to provide a script to run regional simulations that's similar to the run_neon script. It will be built to use the inputdata files that results from the subset_data script. One important point about the regional case from single point cases is that mesh files are required, so that will change the setup a bit. Also single point cases set PTS_LAT/PTS_LON which won't be done for the regional case.

A separate but related task to this is to have a script to run a single points site after subset_data is run. There's likely a lot of infrastructure that the run_neon, run_tower, and run_regional scripts could have in common. We should try to structure them so they can share as much code as possible, which will make them much easier to maintain.

This is the original start of this issue from Will. We decided this overlaps with #1513 so we are separating it out to just this one issue...

regional simulations with nuopc will need to generate mesh files. @mvertens @ekluzek noted there are .ncl tools available for this, but @danicalombardozzi and @negin513 suggested this be wrapped into a run_regional wrapper script that does this for users.

This functionally isn't really part of the NEON project, but it could leverage some of the python wrapper tools used in run_neon that have already been created by @jedwards4b and @negin513.

Activity

  1. added
    enhancementnew capability or improved behavior of existing capability
    on Oct 21, 2021
  2. added this to the ctsm5.2.0 milestone on Oct 21, 2021
  3. ekluzek commented on Oct 21, 2021

    @ekluzek
    Contributor

    @wwieder this is pretty much a duplicate of #1513. The mesh file creation wouldn't go into run_regional it would go into subset_data. The thing I'm not clear on is exactly how we do that. One process would be to create a mesh file from the domain file that subset_data creates. That might be a mid-term solution, because in the end we don't need domain files. I'm just not sure about how to create a mesh file from subset_data.

    In principle subset_data can also subset SCRIP grid files, but the problem is that they are in 1D vector format, so the subsetting doesn't look the same as the 2D grid files. I suppose it is the same for unstructured grids though.

  4. danicalombardozzi commented on Oct 21, 2021

    @danicalombardozzi
    Contributor

    @ekluzek I think there are two parts to this process. First is that the mesh files need to be created, and the second is that all the files for the regional simulation need to be updated in the case. It sounds like the first part might be similar to #1513. The second part is what @adrifoster, @negin513, and I have discussed tackling. I think both pieces would be very useful to help people set up regional simulations easily, similar to the super easy workflow in the run_neon script.

  5. wwieder commented on Oct 21, 2021

    @wwieder
    ContributorAuthor

    I'm happy to migrate this conversation over to #1513 to avoid duplicating issues. Your call @ekluzek and @danicalombardozzi

  6. ekluzek commented on Oct 22, 2021

    @ekluzek
    Contributor

    Ahh, OK, thanks for the discussion. @danicalombardozzi I think what you are saying is that you want a run_regional script that works similar to the run_neon script. So that's a script that you run after subset_data to run a regional case. subset_data should create all the input datafiles needed to run the regional case, but you could use run_regional to create the case for you.

    If that's correct, then I propose that we change this issue into one that's about making the run_regional script, and leave #1513 as it is.

  7. danicalombardozzi commented on Oct 22, 2021

    @danicalombardozzi
    Contributor

    @ekluzek, yes, a 'run_regional' script would set up the case similar to the run_neon script. It would set up all the newly created datm and mesh files (and anything else required) in a case that a user could run. This would majorly simplify the process for running a regional simulation. We've also been discussing a similar script for single point simulations, similar to the run_neon, but for a user specified location rather than the NEON data we already have available.

  8. changed the title [-]regional simulations with nuopc[/-] [+]Script to run regional simulations similar to run_neon script[/+] on Oct 22, 2021
  9. ekluzek commented on Dec 8, 2021

    @ekluzek
    Contributor

    We have some disscussion in #1565 that overlaps with this.

  10. ekluzek commented on Feb 2, 2022

    @ekluzek
    Contributor

    Polly B. and Sanjiv K. from the community are willing to be guinea pigs for this work on regional scripts.

  11. moved this from Needs Prioritization to Todo ~ weeks in CESM: infrastructure / cross-component SE prioritieson May 1, 2022
  12. 12 remaining items

  13. ekluzek commented on Sep 6, 2023

    @ekluzek
    Contributor

    I thought this would be part of the hackathon we plan. So I started assigning the team to work on this. But, I realized this is about regional cases so I unassigned the team from it.

    This still somewhat applies though in that we should be thinking about the python modules being able to work for both single-point and regional cases. There might be a separate tool (or python module like in subset_data), but we do want to have some part of it shared between single-point and regional cases.

  14. wwieder commented on Mar 11, 2025

    @wwieder
    ContributorAuthor

    At this point I don't suggest we create and maintain a python wrapper to run regional cases. Instead, clearer documentation that walks a user through subsetting data capabilities, mesh creation, and that provides an example of how to create a new case seems more appropriate?

    Maybe the other think I'll add here is that using subset_data for point cases creates usermod_dirs that set up cases correctly for users. I'm assuming this is also true for regional applications, but if not, maybe that's where we can invest a bit of time?

  15. negin513 commented on Mar 12, 2025

    @negin513
    Contributor

    @wwieder : This gist walks through the exact steps you outlined here for running regional cases:
    https://gist.github.com/negin513/d71268419f808b91a82cde5530d390b1

  16. samsrabin commented on Mar 13, 2025

    @samsrabin
    Member

    Closing as too hard and not useful.

  17. moved this from In Progress to Done (or no longer holding things up) in CESM: infrastructure / cross-component SE prioritieson Mar 13, 2025
  18. added
    closed: wontfixWe won't fix this issue, because it would be too difficult and/or isn't important enough to fix
    on Mar 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    closed: wontfixWe won't fix this issue, because it would be too difficult and/or isn't important enough to fixenhancementnew capability or improved behavior of existing capability

    Type

    No type

    Projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions