techstaff:slurm
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revisionNext revisionBoth sides next revision | ||
techstaff:slurm [2015/12/29 15:52] – [Partitions / Queues] kauffman | techstaff:slurm [2016/01/04 16:46] – kauffman | ||
---|---|---|---|
Line 8: | Line 8: | ||
SLURM is similar to most other queue systems in that you write a batch script, then submit it to the queue manager. The queue manager schedules your job to run on the queue (or partition in SLURM parlance) that you designate. Below is an outline of how to submit jobs to SLURM, how SLURM decides when to schedule your job, and how to monitor progress. | SLURM is similar to most other queue systems in that you write a batch script, then submit it to the queue manager. The queue manager schedules your job to run on the queue (or partition in SLURM parlance) that you designate. Below is an outline of how to submit jobs to SLURM, how SLURM decides when to schedule your job, and how to monitor progress. | ||
+ | |||
+ | ===== Where to begin ===== | ||
+ | SLURM is a set of command line utilities that can be accessed via the command line from **most** any computer science system you can login to. Using our main shell servers (linux.cs.uchicago.edu) is expected to be our most common use case, so you should start there. | ||
+ | |||
+ | ssh user@linux.cs.uchicago.edu | ||
+ | |||
===== Documentation ===== | ===== Documentation ===== | ||
Line 41: | Line 47: | ||
* Files older than 90 days will be deleted automatically. | * Files older than 90 days will be deleted automatically. | ||
* Scratch space is shared by all users. | * Scratch space is shared by all users. | ||
+ | |||
+ | === Access === | ||
+ | Scratch space is only mounted on nodes associated with the cluster. If you want to be able to transfer files to the scratch space you will want to run an [[techstaff: | ||
+ | |||
+ | - You should only do a file transfer via the debug partition: '' | ||
+ | - Now you can create a directory of your own: '' | ||
+ | |||
+ | == Example == | ||
+ | |||
+ | Request interactive shell | ||
+ | < | ||
+ | |||
+ | Change into my scratch directory: | ||
+ | < | ||
+ | |||
+ | Get the files I need: | ||
+ | < | ||
+ | user@research2:/ | ||
+ | foo | ||
+ | </ | ||
+ | Check that the file now exists: | ||
+ | < | ||
+ | user@research2:/ | ||
+ | -rw------- 1 user user 105121 Dec 29 2015 foo | ||
+ | </ | ||
+ | |||
+ | I can now exit my interactive shell. | ||
==== Utilization Dashboard ==== | ==== Utilization Dashboard ==== | ||
Sometimes it is useful to see how much of the cluster is utilized. You can do that via the following URL: http:// | Sometimes it is useful to see how much of the cluster is utilized. You can do that via the following URL: http:// | ||
Line 143: | Line 176: | ||
PARTITION AVAIL TIMELIMIT | PARTITION AVAIL TIMELIMIT | ||
debug* | debug* | ||
- | general | + | general |
- | hardware | + | |
</ | </ | ||
/var/lib/dokuwiki/data/pages/techstaff/slurm.txt · Last modified: 2021/01/06 16:13 by kauffman