Stuff

UoM::RCS::Talby::Danzek::SGE



Page Group

Basic Config:

Extra Stuff:

Applications:

Scripts Etc.







FAT and VFAT, with/out Interactive all on One Hostgroup

What we got:
  • We have eight nodes with lots of memory — FAT nodes.
  • Each has 12 cores.
What we want:
  • Users to be able to run serial, SMP and MPI jobs on the FAT nodes.
  • To be able to use these nodes as Very FAT also, by halving the number of slots in the queues — so mutual-subordination is definitely necessary!
  • To be able to run interactively too.
Implementation — four queues. . .
  C6100-FAT.q
  C6100-VFAT.q

  C6100-FAT-interactive.q
  C6100-VFAT-interactive.q
. . .some complex attributes. . .
  #name               shortcut     type        relop requestable consumable default  urgency 
  #------------------------------------------------------------------------------------------

  highmem             highmem      BOOL        ==    FORCED      NO         0        0
  vhighmem            vhighmem     BOOL        ==    FORCED      NO         0        0

  interactive         inter        BOOL        ==    FORCED      NO         0        0
. . .plus a resource quota
  {
    name         C6100-FAT.rqs
    description  NONE
    enabled      TRUE
    limit        hosts {@C6100-FAT} to slots=12
  }
Why all those queues?
  • We want to be able to impose different limits on the interactive queues and the batch queues.
  • We need some queues with slots=12 and some with slots=6.
  • We may want the interactive queues to be serial only.
Usage
  qsub -l highmem ...
  qsub -l vhighmem ...

  qrsh -l highmem  -l inter ...
  qrsh -l vhighmem -l inter ...
Resource Quota and Subordination
  • The resource quota allows us to run C6100-FAT.q and C6100-FAT-interactive.q on the same hosts at the same time (without overloading these hosts).
  • Each FAT queue subordinates both of the VFAT queues.
  • Each VFAT queue subordinates all other queues.