Differences

This shows you the differences between two versions of the page.

--- techstaff:slurm [2015/12/07 16:59] – kauffman
+++ techstaff:slurm [2015/12/29 16:03] – [Storage] kauffman
@@ Line 1: / Line 1: @@
-====== DRAFT | Peanut Job Submission Cluster | DRAFT ======
+====== DRAFT | Peanut Job Submission Cluster ======
 We are currently **alpha** testing and gauging user interest in a cluster of machines that allows for the submission of long running compute jobs. Think of these machines as a dumping ground for discrete computing tasks that might have been rude or disruptive to execute on the main (shared) shell servers (i.e., linux1, linux2, linux3).
@@ Line 37: / Line 37: @@
 ==== Storage ====
-Shared scratch storage is being planned, but not yet available. Techstaff hopes to have this done in time for the winter quarter.
+There is slow scratch space mounted to ''%%/scratch%%''. It is a ZFS pool consisting of 10x 2TB 7200RPM SAS drives connected via a LSI 9211-8i and is made up of 5 mirrored VDEVs, which is similar to a RAID10. The servers uplink is 1G ethernet.
+  * Files older than 90 days will be deleted automatically.
+  * Scratch space is shared by all users.
+=== Access ===
+Scratch space is only mounted on nodes associated with the cluster. If you want to be able to transfer files to the scratch space you will want to run an [[techstaff:slurm#interactive_jobs|interactive shell]]. Now you will be able to use standard tools such as ''%%scp%%'' or ''%%rsync%%'' to transfer files.
+  * You should only do a file transfer via the debug partition.
+<code> srun -p debug --pty --mem 500 -t 0-00:30 /bin/bash</code>
 ==== Utilization Dashboard ====
@@ Line 43: / Line 52: @@
 ==== Partitions / Queues ====
-As of December, 2015 we have 3 partitions in our cluster.
+To find out what partitions we offer, checkout the [[techstaff:slurm#sinfo|sinfo]] command.
+As of December, 2015 we have will have at least 2 partitions in our cluster; 'debug' and 'general'.
 ^ Partition Name ^ Description ^
 | **debug** | The partition your job will be submitted to if none is specified. The purpose of this partition is to make sure your code is running as it should before submitting a long running job to the general queue. |
 | **general** | All jobs that have been thoroughly tested can be submitted here. This partition will have access to more nodes and will process most of the jobs. If you need to use the ''%%--exclusive%%'' flag it should be done here.|
-| **hardware** | The purpose of this partition is to set aside nodes that do not use the virtualization layer. This is important if you need true hardware access. |
@@ Line 140: / Line 150: @@
 PARTITION AVAIL  TIMELIMIT  NODES  STATE NODELIST
 debug*       up      30:00      1   idle research2
-general      up   infinite      5   idle research[3-7]
+general      up 1-00:00:00      6   idle research[3-8]
-hardware     up    1:00:00      1   idle research8
 </code>