SLURM-GPU's

GPU's

Some programs can take advantage of the unique hardware architecture in a graphics processing unit (GPU). You have to check your documentation for compatibility. To request a GPU, add one of the following lines to your script:

--gres=gpu:<number>

or

--gres=gpu:<GPU_type>:<number>

where:

• <number> is the number of GPUs per node requested.
• <GPU_type> is one of the following: 2080ti.

Use the chart below to determine which of the above GPU_type's you wish to request:

GPU_type	Max Number of GPUs Per Node	GPU Model
2080ti	4	NVIDIA 2080TI

For interactive sessions utilizing GPUs, after salloc has run and you are on a compute node, you need to use the srun command to execute your commands:

               $ nvidia-smi
               No devices were found
               
               $ srun -n1 nvidia-smi
               +-----------------------------------------------------------------------------+
               | NVIDIA-SMI 390.25                 Driver Version: 390.25                    |
               |-------------------------------+----------------------+----------------------|
               | GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
               | Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
               |===============================+======================+======================|
               |   0  RTX 2080TI          On   | 00000000:08:00.0 Off |                    0 |
               | N/A   29C    P8    25W / 225W |      0MiB /  4743MiB |      0%      Default |
               +-------------------------------+----------------------+----------------------+