Version: AMD Zen HPCG 2022-11

Dependencies:

  • This binary executable was built with AVX512 support, and will only run properly on systems that support AVX512 instructions
    • Specifically: AMD “Zen4”-based processors such as the AMD 4th Generation EPYC™ CPUs.
    • The binary will NOT run on AMD “Zen3”-based or prior processors.
  • The binary was built on Red Hat® Enterprise Linux® 9 and should only be expected to run on such systems.
  • OpenMPI 4: This binary was built against OpenMPI 4.1.4 and should run without issue as long as OpenMPI 4 is in the PATH.

Recommended Settings:

  • Boost : ON
  • Transparent Hugepages : always
  • SMT : OFF
  • NPS : 4
  • Determinism : Power

How to Run:

  • Ensure Open MPI 4.x is installed and loaded in your environment.
  • Place the supplied hpcg.dat file in the same directory as the AMD Zen HPCG binary.  Modify hpcg.dat as necessary for your purpose.
    • By default, hpcg.dat will define a very small problem, where the 2nd line represents values of nx, ny, and nz, respectively and the 3rd line represents the runtime. For valid benchmark runs the problem size should use at least 1/4 of the total available main memory, and the runtime should be at least 1800 seconds.
    • Alternatively, you may pass these arguments in the command line
      • Ex) –nx=<value> –ny=<value> –nz=<value> –rt=<value>
      • Note: These parameters will override the values set in hpcg.dat
  • Example Run Command for Single Node
    • For a short run on Dual Socket System with 96 Cores/socket and 1.5TB RAM:
      mpirun -np 96 –bind-to core –map-by ppr:4:l3cache:pe=2 -x OMP_NUM_THREADS=2 -x OMP_PROC_BIND=true -x OMP_PLACES=cores ./xhpcg –nx=192 –ny=192 –nz=192 –rt=60