techstaff:slurm
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revisionNext revisionBoth sides next revision | ||
techstaff:slurm [2018/12/18 15:44] – [More] kauffman | techstaff:slurm [2020/06/22 10:07] – kauffman | ||
---|---|---|---|
Line 1: | Line 1: | ||
- | ===== Notice ===== | ||
- | **2017-08-31**: | ||
- | |||
====== Peanut Job Submission Cluster ====== | ====== Peanut Job Submission Cluster ====== | ||
- | We are currently **alpha** testing and gauging user interest in a cluster of machines that allows for the submission of long running compute jobs. Think of these machines as a dumping ground for discrete computing tasks that might be rude or disruptive to execute on the main (shared) shell servers (i.e., linux1, linux2, linux3). | + | Think of these machines as a dumping ground for discrete computing tasks that might be rude or disruptive to execute on the main (shared) shell servers (i.e., linux1, linux2, linux3). |
For job submission we will be using a piece of software called [[http:// | For job submission we will be using a piece of software called [[http:// | ||
Line 44: | Line 41: | ||
==== Hardware ==== | ==== Hardware ==== | ||
Our cluster contains nodes with the following specs: | Our cluster contains nodes with the following specs: | ||
+ | |||
+ | '' | ||
* 16 Cores (2x 8core 3.1GHz Processors), | * 16 Cores (2x 8core 3.1GHz Processors), | ||
* 64gb RAM | * 64gb RAM | ||
* 2x 500GB SATA 7200RPM in RAID1 | * 2x 500GB SATA 7200RPM in RAID1 | ||
+ | '' | ||
+ | * 24 Cores (2x 24core Intel Xeon Silver 4116 CPU @ 2.10GHz), 48 threads | ||
+ | * 128gb RAM | ||
+ | * OS: 2x 240GB Intel SSD in RAID1 | ||
+ | * /local: 2x 960GB Intel SSD RAID0 | ||
+ | |||
+ | '' | ||
+ | * 6 Cores (Intel(R) Core(TM) i7-5930K CPU @ 3.50GHz), 12 threads | ||
+ | * 32gb RAM | ||
+ | * OS: 1x 512gb SSD | ||
+ | |||
+ | '' | ||
+ | * 16 Cores (Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz), 32 threads | ||
+ | * 128gb RAM | ||
+ | * OS: 2x Samsung SSD 850 PRO 128GB | ||
+ | * /local: ZFS mirror (2x Samsung SSD 850 PRO 1TB) | ||
+ | * 2x Quadro P4000 | ||
+ | |||
+ | '' | ||
+ | * 8 Core (Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz), 16 threads | ||
+ | * 64gb RAM | ||
+ | * OS: 1x 1TB 7200k spinning disk. | ||
+ | * 4x GeForce GTX 1080 Ti | ||
==== Storage ==== | ==== Storage ==== | ||
There is slow scratch space mounted to '' | There is slow scratch space mounted to '' | ||
Line 98: | Line 120: | ||
| **debug** | The partition your job will be submitted to if none is specified. The purpose of this partition is to make sure your code is running as it should before submitting a long running job to the general queue. | | | **debug** | The partition your job will be submitted to if none is specified. The purpose of this partition is to make sure your code is running as it should before submitting a long running job to the general queue. | | ||
| **general** | All jobs that have been thoroughly tested can be submitted here. This partition will have access to more nodes and will process most of the jobs. If you need to use the '' | | **general** | All jobs that have been thoroughly tested can be submitted here. This partition will have access to more nodes and will process most of the jobs. If you need to use the '' | ||
- | | **pascal** | 2018-05-04: 1x Nvidia GTX1080. You will be forced to use this server exclusively for now. Please keep your time in interactive mode to a minimum.| | + | | **fast** | 2019-12-02: 48 threads, 128GB RAM | |
- | | **titan** | 2018-05-04: 4x Nvidia GTX1080Ti. | + | | **quadro** | 2019-12-02: 2x Quadro P4000. *| |
+ | | **pascal** | 2018-05-04: 1x Nvidia GTX1080.| | ||
+ | | **titan** | 2018-05-04: 4x Nvidia GTX1080Ti. | ||
+ | * This partition is shared and you MUST use the '' | ||
====== Job Submission ====== | ====== Job Submission ====== | ||
Jobs submitted to the cluster are run from the command line. Almost anything that you can run via the command line on any of our machines in our labs can be run on our job submission server agents. | Jobs submitted to the cluster are run from the command line. Almost anything that you can run via the command line on any of our machines in our labs can be run on our job submission server agents. | ||
Line 168: | Line 193: | ||
< | < | ||
user@host: | user@host: | ||
- | research2 | + | slurm2 |
- | research2 | + | slurm2 |
</ | </ | ||
Line 200: | Line 225: | ||
user@host: | user@host: | ||
PARTITION AVAIL TIMELIMIT | PARTITION AVAIL TIMELIMIT | ||
- | debug* | + | debug* |
- | general | + | fast up 1-00: |
- | pascal | + | general |
- | tesla | + | pascal |
+ | quadro | ||
+ | titan up 3-00: | ||
</ | </ | ||
Line 308: | Line 335: | ||
< | < | ||
$ sinfo -O partition, | $ sinfo -O partition, | ||
- | PARTITION | + | PARTITION |
- | debug* | + | debug* |
- | general | + | fast slurm[9-14] |
- | pascal | + | general |
- | titan | + | pascal |
+ | quadro | ||
+ | titan | ||
</ | </ | ||
Line 411: | Line 440: | ||
</ | </ | ||
STDERR should be blank. | STDERR should be blank. | ||
- | ====== | + | ====== |
If you feel this documentation is lacking in some way please let techstaff know. Email [[techstaff@cs.uchicago.edu]], | If you feel this documentation is lacking in some way please let techstaff know. Email [[techstaff@cs.uchicago.edu]], | ||
+ | |||
+ | ====== More ====== | ||
+ | Sometimes other universities have documentation that is better in some areas. | ||
+ | |||
+ | - [[ https:// | ||
+ | - [[ https:// |
/var/lib/dokuwiki/data/pages/techstaff/slurm.txt · Last modified: 2021/01/06 16:13 by kauffman