techstaff:slurm
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revisionNext revisionBoth sides next revision | ||
techstaff:slurm [2017/08/23 13:48] – [Notice] kauffman | techstaff:slurm [2017/08/31 16:14] – kauffman | ||
---|---|---|---|
Line 1: | Line 1: | ||
- | ===== Notice ===== | + | ===== Notice ===== |
- | The SLURM cluster will become unavailable starting | + | **2017-08-31**: Configuration change to allow allocation |
- | **2017-08-22 1800**: Main cluster upgraded. You can try to use it now but I can't guarantee that I won't kill your job tomorrow or Firday. | ||
- | |||
- | **2017-08-23 1345**: GPU servers upgraded and added back to the cluster. They may be missing some software that was not automatable at previous time of installation. Send me an email if you find anything missing. | ||
- | |||
- | We still run systems with Ubuntu 14.04 installed. As of right now these systems cannot submit jobs to the cluster. This is on purpose. The slurm version jump between 14.04 and 16.04 was so huge that this was unavoidable. This means you should prefer to use linux.cs.uchicago.edu or any CS machine that run Ubuntu 16.04. | ||
====== Peanut Job Submission Cluster ====== | ====== Peanut Job Submission Cluster ====== | ||
Line 36: | Line 31: | ||
* [[http:// | * [[http:// | ||
* [[https:// | * [[https:// | ||
- | + | * [[http:// | |
===== Infrastructure ===== | ===== Infrastructure ===== | ||
Line 45: | Line 39: | ||
* 64gb RAM | * 64gb RAM | ||
* 2x 500GB SATA 7200RPM in RAID1 | * 2x 500GB SATA 7200RPM in RAID1 | ||
- | |||
- | To better manage the cluster we have virtualized the job submission nodes and give them all resources of the hardware. So, the actual resources you can consume on any one node is: | ||
- | * 14 Cores, 14 threads | ||
- | * 62GB RAM | ||
==== Storage ==== | ==== Storage ==== | ||
Line 117: | Line 107: | ||
===== Usage ===== | ===== Usage ===== | ||
Below are some common examples. You should consult the [[http:// | Below are some common examples. You should consult the [[http:// | ||
+ | |||
+ | === Default Quotas === | ||
+ | By default we set a job to be run on one CPU and allocate 100MB of RAM. If you require more than that you should specify what you need. Using the following options will do: '' | ||
=== Exclusive access to a node === | === Exclusive access to a node === | ||
Line 126: | Line 119: | ||
=== Sample script === | === Sample script === | ||
Make sure you create a directory in which to deposit the '' | Make sure you create a directory in which to deposit the '' | ||
- | mkdir -p $HOME/ | + | mkdir -p $HOME/ |
< | < | ||
Line 133: | Line 126: | ||
#SBATCH --mail-user=cnetid@cs.uchicago.edu | #SBATCH --mail-user=cnetid@cs.uchicago.edu | ||
#SBATCH --mail-type=ALL | #SBATCH --mail-type=ALL | ||
- | #SBATCH --output=/ | + | #SBATCH --output=/ |
- | #SBATCH --error=/ | + | #SBATCH --error=/ |
#SBATCH --workdir=/ | #SBATCH --workdir=/ | ||
#SBATCH --partition=debug | #SBATCH --partition=debug | ||
Line 140: | Line 133: | ||
#SBATCH --nodes=1 | #SBATCH --nodes=1 | ||
#SBATCH --ntasks=1 | #SBATCH --ntasks=1 | ||
+ | #SBATCH --mem-per-cpu=500 | ||
#SBATCH --time=15: | #SBATCH --time=15: | ||
/var/lib/dokuwiki/data/pages/techstaff/slurm.txt · Last modified: 2021/01/06 16:13 by kauffman