132.zeusmp2
John Hayes
Lawrence Livermore National Laboratory
PO Box 808, L-550
Livermore, CA 94550
Physics / Hydrodynamics / Magnetohydrodynamics
ZEUS-MP is a computational fluid dynamics code developed at the Laboratory for Computational Astrophysics (NCSA, SDSC, University of Illinois at Urbana-Champaign, UC San Diego) for the simulation of astrophysical phenomena. The program solves the equations of ideal (non-resistive), non-relativistic, hydrodynamics and magnetohydrodynamics, including externally applied gravitational fields and self-gravity. The gas can be adiabatic or isothermal, and the thermal pressure is isotropic. Boundary conditions may be specified as reflecting, periodic, inflow, or outflow.
ZEUS-MP Version 2 is a new branch of ZEUS-MP under development at UCSD (by John Hayes). Besides it is a Fortran 90 rewrite of ZEUS-MP, new physics models such as flux-limited radiation diffusion (FLD) and multispecies fluid advection are added to the physics set. Application flexibility is also improved in this version.
132.zeusmp2 is based on ZEUS-MP Version 2. It has been modified to be able to run at arbitrary rank sizes with one input file.
ZEUS-MP divides the computational space into 3D tiles that are distributed across processors. Nonblocking point-to-point communication MPI_Isend with MPI_Irecv and MPI_Waitall are major MPI calls in this code. MPI_Allreduce is the primary collective calls along with a smattering of other MPI calls.
For medium data set, the code supports all jobs sizes between 1 and 512. For large data set, it supports all job sizes between 1 and 2048. However, it runs at rank counts that show generally increasing performance. At some cases, some ranks may be idled due to the requirement of minimal number of zones along each axis.
The optimal rank counts (without idled ranks) for mref dataset are: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 12, 14, 15, 16, 18, 20, 21, 24, 25, 28, 30, 32, 35, 36, 40, 42, 45, 48, 49, 50, 56, 60, 63, 64, 70, 72, 75, 80, 84, 90, 96, 98, 100, 105, 112, 120, 126, 128, 140, 144, 147, 150, 160, 168, 175, 180, 192, 196, 200, 210, 224, 225, 240, 245, 252, 256, 280, 288, 294, 300, 315, 320, 336, 350, 360, 384, 392, 400, 420, 441, 448, 450, 480, 490, 504, 512.
The optimal rank counts (without idled ranks) for lref dataset are:1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 12, 14, 15, 16, 18, 20, 21, 24, 25, 28, 30, 32, 35, 36, 40, 42, 45, 48, 49, 50, 56, 60, 63, 64, 70, 72, 75, 80, 84, 90, 96, 98, 100, 105, 112, 120, 126, 128, 140, 144, 147, 150, 160, 168, 175, 180, 192, 196, 200, 210, 224, 225, 240, 245, 252, 256, 280, 288, 294, 300, 315, 320, 336, 350, 360, 384, 392, 400, 420, 441, 448, 450, 480, 490, 504, 512, 525, 560, 576, 588, 600, 630, 640, 672, 700, 720, 735, 768, 784, 800, 840, 882, 896, 900, 960, 980, 1008, 1024, 1050, 1120, 1152, 1176, 1200, 1225, 1260, 1280, 1344, 1400, 1440, 1470, 1536, 1568, 1575, 1600, 1680, 1764, 1792, 1800, 1920, 1960, 2016, 2048.
The physical problem solved in SPEC MPI2007 is a 3-D blastwave simulated with the presence of a uniform magnetic field along the x-direction. A Cartesian grid is used and the boundaries are "outflow."See http://lca.ucsd.edu/portal/codes/zeusmp2/examples/mhdblastwave/.
To adapt to MPI2007 suite, some modifications have been made. Number of zones in 3 dimensions, nbl in ggen1-3, have been moved to nbllarray as nbll. ntiles in mpitop, IZONES,JZONES,KZONES and MAXIJK in ARRAYCONF will be computed during run time.
The input file zmp_inp contains many parameters from which the problem is built, among them:
Benchmark information is output on screen if the code runs interactively. It includes information about number of timesteps, number of zone-cycles of the run.
"usraa*" files contain information about the density distribution at the end of the run. These files are aggregated into one file zeusmp.val for validation.
Fortran 90.
None
"Simulating Radiating and Magnetized Flows in Multiple Dimensions with ZEUS-MP," Hayes et al. 2006, Astrophysical Journal Supplement Series, Vol. 165, Issue 1, pp. 188-288.
http://lca.ucsd.edu/portal/codes/zeusmp2
Last updated: September 3, 2009