- What we got:
-
- We have eight nodes with lots of memory — FAT nodes.
- Each has 12 cores.
- What we want:
-
- Users to be able to run serial, SMP and MPI jobs on the FAT nodes.
- To be able to use these nodes as Very FAT also, by halving the
number of slots in the queues — so mutual-subordination is
definitely necessary!
- To be able to run interactively too.
- Implementation — four queues. . .
-
C6100-FAT.q
C6100-VFAT.q
C6100-FAT-interactive.q
C6100-VFAT-interactive.q
- . . .some complex attributes. . .
-
#name shortcut type relop requestable consumable default urgency
#------------------------------------------------------------------------------------------
highmem highmem BOOL == FORCED NO 0 0
vhighmem vhighmem BOOL == FORCED NO 0 0
interactive inter BOOL == FORCED NO 0 0
- . . .plus a resource quota
-
{
name C6100-FAT.rqs
description NONE
enabled TRUE
limit hosts {@C6100-FAT} to slots=12
}
- Why all those queues?
-
- We want to be able to impose different limits on the interactive queues and the batch queues.
- We need some queues with slots=12 and some with slots=6.
- We may want the interactive queues to be serial only.
- Usage
-
qsub -l highmem ...
qsub -l vhighmem ...
qrsh -l highmem -l inter ...
qrsh -l vhighmem -l inter ...
- Resource Quota and Subordination
-
- The resource quota allows us to run C6100-FAT.q and C6100-FAT-interactive.q on
the same hosts at the same time (without overloading these hosts).
- Each FAT queue subordinates both of the VFAT queues.
- Each VFAT queue subordinates all other queues.