GPU Config with Complex Attributes
What we want:
- only one or two GPUs on each (12-core) host, so need one or two slots only (not 12);
- want interactive and batch, mutually-subordinate;
- want to be able to separate out 2070s from 2050s;
- have both IB-connected and not hosts.
1. |
Complex Attributes and Host Configs |
qconf -sc:
#name shortcut type relop requestable consumable default urgency #------------------------------------------------------------------------------------------ 2070 2070 BOOL == YES NO 0 0
qconf -se gpu08:
hostname gpu08.danzek.itservices.manchester.ac.uk
load_scaling NONE
complex_values slots=12,2070=1
#
# ...2050-hosting hosts do not have the "2070=1" bit...
#
load_values arch=lx24-amd64,num_proc=12,mem_total=48251.902344M, \
swap_total=16383.992188M,virtual_total=64635.894531M, \
. .
2. |
Non IB-Connected Queues |
M610x-GPU.q:
qname M610x-GPU.q hostlist @M610x-GPU . . qtype BATCH . . slots 1 . . user_lists nvidiaGPU.userset xuser_lists NONE subordinate_list M610x-GPU-interactive.q=1, M610x-low-priority.q=1 complex_values nvidia=1 . .
M610x-GPU-interactive.q:
qname M610x-GPU-interactive.q hostlist @M610x-GPU . . qtype INTERACTIVE . . slots 1 . . user_lists nvidiaGPU.userset xuser_lists NONE subordinate_list M610x-GPU.q=1, M610x-low-priority.q=1 complex_values nvidia=1,interactive=1 . .
3. |
IB Connected |
4. |
Examples |
qrsh -l inter -l nvidia -l 2070
# ...always gets you on a 2070-hosting host...
qrsh -l inter -l nvidia
# ...you might get a 2050, you might get a 2070...