Running on Gadi

This page explains the execution model and the safest way to choose a stage. It is not a replacement for the detailed run guide, which includes current resource settings, file paths, restart instructions, known failure modes, and monitoring commands.

Two-job execution model

  1. Submit a config/launch_*.pbs launcher from config/.

  2. The launcher starts an outer Python driver job.

  3. The driver loads and marshals a model, then pyISSM submits the inner ISSM compute job.

  4. The driver waits for the inner job, loads its results, and saves the model checkpoint.

The outer job may therefore wait for both the inner queue delay and the compute time. A launcher that appears to be waiting indefinitely can also indicate a rejected inner submission; the run guide describes how to inspect the generated queue file.

Select a step with the environment

For the main HO/upstream driver, use AIS3_STEPS at submission time rather than editing the shared steps list while jobs may still be queued:

cd config
qsub -v AIS3_STEPS=ho_thermal_steadystate launch_ho_relaxation.pbs

For the pure-SSA driver, select a step the same way:

cd config
qsub -v AIS3_STEPS=historical_dhdt_tuning_ssa launch_ais_0.1_SSA.pbs

Use the launcher and resource settings documented for that stage. Do not infer that all launchers have interchangeable PBS resource requests: HO memory requirements are much higher than SSA’s.

Before running

  • Confirm the stage’s input checkpoint and output name in the workflow map and full run guide.

  • Check the active step/status in the source worklogs; dated status may be stale.

  • Confirm the selected Python environment, ISSM build/module, project/storage, paths, and user settings for your checkout.

  • Choose a new tag or archive an existing output before rerunning. Several stages refuse to overwrite outputs; others use the existing checkpoint to resume.

  • Check the relevant queue and resource limits before requesting a long HO solve.

The detailed run guide currently documents Gadi project au88 and contains user- and filesystem-specific paths. It must be adapted before use from another account or checkout.