535.weather_t
SPEChpc™ 2021 Benchmark Description

Benchmark Name

535.weather (miniWeather)

Benchmark Author

Matthew Norman <normanmr_at_ornl.gov>

Benchmark Program General Category

Weather

Benchmark Description

The miniWeather code mimics the basic dynamics seen in atmospheric weather and climate. The dynamics themselves are dry compressible, stratified, non-hydrostatic flows dominated by buoyant forces that are relatively small perturbations on a hydrostatic background state. The equations in this code themselves form the backbone of pretty much all fluid dynamics codes, and this particular flavor forms the base of all weather and climate modeling. With about 500 total lines of code (and only about 200 lines that you care about), it serves as an approachable place to learn parallelization and porting using MPI + X, where X is OpenMP, OpenACC, CUDA, or potentially other approaches to CPU and accelerated parallelization. The code uses periodic boundary conditions in the x-direction and solid wall boundary conditions in the z-direction.

Brief Description of the Code

Domain Parameters:

A fuller description of the science, math, and dynamics are play are given later, but this section is reserved to describing some of the main variables and flow in the code. The code is decomposed in two spatial dimensions, x and z, with nx_glob and nz_glob cells in the global domain and nx and nz cells in the local domain, using straightforward domain decomposition for MPI-level parallelization. The global domain is of size xlen and zlen meters, and hs "halo" cells are appended to both sides of each dimension for convenience in forming stencils of cells for reconstruction.

Fluid State Variables

There are four main arrays used in this code: state, state_tmp, flux, and tend, and the dimensions for each are given in the code upon declaration in the comments. Each of these arrays is described briefly below:

state: This is the fluid state at the current time step, and it is the only array that persists from one time step to the next. The other four are only used within the calculations to advance the model to the next time step. The fluid state describes the average state over each cell area in the spatial domain. This variable contains four fluid states, which are the traditional mass, momenta, and thermodynamic quantities of most fluid models:
1. Density (ID_DENS): The 2-D density of the fluid, \large \rho, in \large \text{kg}\ \text{m}^{-2} (note this is normally \large \text{kg}\ \text{m}^{-3}, but this is a 2-D model, not 3-D)
2. U-momentum (ID_UMOM): The momentum per unit area of the fluid in the x-direction calculated as \large \rho u, where u is the x-direction wind velocity. The units are \large \text{kg}\ \text{m}^{-1}\ \text{s}^{-1}. Note that to get true momentum, you must integrate over the cell.
3. W-momentum (ID_WMOM): The momentum per unit area of the fluid in the z-direction calculated as \large \rho w, where w is the z-direction wind velocity. The units are \large \text{kg}\ \text{m}^{-1}\ \text{s}^{-1}. Note that to get true momentum, you must integrate over the cell.
4. Potential Temperature (ID_RHOT): The product of density and potential temperature, \large \rho \theta, where \large \theta=T\left(P_{0}/P\right)^{R_{d}/c_{p}}, \large P_{0}=10^{5}\,\text{Pa}, T is the true temperature, and \large R_d and\large c_p are the dry air constant and specific heat at constant pressure for dry air, respectively. The units of this quantity are \large \text{K}\,\text{kg}\,\text{m}^{-2}.
state_tmp: This is a temporary copy of the fluid state used in the Runge-Kutta integration to keep from overwriting the state at the beginning of the time step, and it has the same units and meaning.
flux: This is fluid state at cell boundaries in the x- and z-directions, and the units and meanings are the same as for state and state_tmp. In the x-direction update, the values of flux at indices i and i+1 represents the fluid state at the left- and right-hand boundaries of cell i. The indexing is analagous in the z-direction. The fluxes are used to exchange fluid properties with neighboring cells.
tend: This is the time tendency of the fluid state \large \partial\mathbf{q}/\partial t, where \large \mathbf{q} is the the state vector, and as the name suggests, it has the same meaning and units as state, except per unit time (appending \large \text{s}^{-1} to the units). In the Finite-Volume method, the time tendency of a cell is equivalent to the divergence of the flux across a cell.

Overal Model Flow

This code follows a traditional Finite-Volume control flow.

To compute the time tendency, given an initial state at the beginning of a time step that contains cell-averages of the fluid state, the value of the state at cell boundaries is reconstructed using a stencil. Then, a viscous term is added to the fluid state at the cell boundaries to improve stability. Next, the tendencies are computed as the divergence of the flux across the cell. Finally, the tendencies are applied to the fluid state.

Once the time tendency is computed, the fluid PDEs are essentially now cast as a set of ODEs varying only in time, and this is called the "semi-discretized" form of the equations. To solve the equations in time, an ODE solver is used, in this case, a Runge-Kutta method. Finally, at the highest level, the equations are split into separate solves in each dimension, x and z.

Input Description

The benchmark takes the following 6 input parameters:

NetCDF output file name
Global X-dimension size
Global Z-dimension size
Number of time-steps to run
Output ever N number of time-steps
Model number to use:
1. Colliding Thermals
2. Rising Thermals
3. Mountain Gravity Waves (not-used in hpc2020 due to time constraints)
4. Turbulence (not-used in hpc2020 since model uses random numbers)
5. Density Current
6. Injection

Output Description

Each run produces NetCDF files containing the output from the run. The utility 997.ncmpidiff is then used to compare the the generated files to a set of known correct results.

Programming Language

Fortran

External Dependencies

PNetCDF Library, MPI Library, NcmpiDiff utility

Runtime Limitations (such as number of ranks)

No known runtime limitations.

Known portability issues

No known portability issues.

Version and Licensing

Application Version: versioning not used. Original source for the miniWeather git repository:

git clone https://github.com/mrnorman/miniWeather.git
git checkout 1d142b026ca7ec9812bfe4cd6d45f239895a466c

License: BSD 2-Clause "Simplified" License

References

miniWeather on Github

Last updated: $Date$

535.weather_t SPEChpc™ 2021 Benchmark Description