Global Workflow

Global-workflow is the end-to-end workflow designed to run global configurations of medium range weather forecasting for the UFS weather model. It supports both development and operational implementations. In its current format it supports the Global Forecast System (GFS) and the Global Ensemble Forecast System (GEFS) configurations

Status

• State of develop (HEAD) branch: GFSv17+ development

• State of operations (dev/gfs.v16 branch): GFS v16.3.13 tag: [gfs.v16.3.13]

Code managers

• Kate Friedman - @KateFriedman-NOAA / kate.friedman@noaa.gov

• Walter Kolczynski - @WalterKolczynski-NOAA / walter.kolczynski@noaa.gov

Announcements

General updates: NOAA employees and affiliates can join the gfs-announce distribution list to get updates on the GFS and global-workflow. Contact Kate Friedman (kate.friedman@noaa.gov) and Walter Kolczynski (walter.kolczynski@noaa.gov) to get added to the list or removed from it.

GitHub updates: Users should adjust their “Watch” settings for this repo so they receive notifications as they’d like to. Find the “Watch” or “Unwatch” button towards the top right of the authoritative global-workflow repository page and click it to adjust how you watch the repo.

Table of Contents

• 1. Contributing to the Global Workflow
  • 1.1. Code managers
  • 1.2. Where to do development?
  • 1.3. Protected branches
  • 1.4. How to get changes into develop (HEAD) branch
  • 1.5. Development Tools
    • 1.5.1. Comparison Tools
  • 1.6. Code standards
  • 1.7. Pull request standards
  • 1.8. How to sync fork with the authoritative repository
• 2. Global Workflow Components
  • 2.1. Component repositories
  • 2.2. External dependencies
    • 2.2.1. Libraries
    • 2.2.2. Observation data (OBSPROC/prep)
• 3. GFS Configuration
  • 3.1. Jobs in the GFS Configuration
• 4. HPC Settings and Help
  • 4.1. Experiment troubleshooting help
  • 4.2. HPC helpdesks
  • 4.3. Restricted data access
  • 4.4. Optimizing the global workflow on S4
  • 4.5. Git settings
    • 4.5.1. Merges
    • 4.5.2. Version
    • 4.5.3. Output format
  • 4.6. Stacksize on R&Ds (Hera, Orion, Hercules, Jet, S4)
  • 4.7. Forecast hangs due to issue with ssh-keys
• 5. Plotting Output
  • 5.1. Analysis output
  • 5.2. Forecast output
• 6. Run Global Workflow
  • 6.1. Clone and build Global Workflow
    • 6.1.1. Quick Instructions
    • 6.1.2. Clone workflow and component repositories
    • 6.1.3. Build components
    • 6.1.4. Link components
  • 6.2. Initial Conditions
    • 6.2.1. Staged Initial Conditions
    • 6.2.2. Prepare Initial Conditions
  • 6.3. Experiment Setup
    • 6.3.1. Forecast-only experiment
    • 6.3.2. Cycled experiment
  • 6.4. Configure Run
  • 6.5. Start your run
    • 6.5.1. Start your run from within your EXPDIR
    • 6.5.2. Set up your experiment cron
  • 6.6. Monitor ROCOTO Run
    • 6.6.1. Using command line
    • 6.6.2. Use ROCOTO viewer
  • 6.7. View Experiment output
    • 6.7.1. Forecast-only
    • 6.7.2. Cycled
  • 6.8. Common Errors Known Issues
    • 6.8.1. Error: “ImportError” message when running setup script
    • 6.8.2. Error: curses default colors when running viewer
    • 6.8.3. Issue: Directory name change for EnKF folder in ROTDIR
• 7. Configuring NOAA Cloud Service Providers
  • 7.1. Login to the NOAA CSP
  • 7.2. Configure the NOAA CSP Instance
  • 7.3. Configure the NOAA CSP Cluster
  • 7.4. Using the NOAA CSP Cluster
  • 7.5. Running the Global Workflow