Differences

This shows you the differences between two versions of the page.

--- slurm:ai [2021/01/06 16:10] – kauffman
+++ slurm:ai [2021/06/25 14:41] – [Infrastructure] kauffman
@@ Line 5: / Line 5: @@
 Feedback is requested:
- [[https://discord.gg/ZVjX8Gv|#ai-cluster Discord channel]] or email Phil Kauffman (kauffman@cs dot uchicago dot edu).
+ [[https://discord.gg/ZVjX8Gv|#slurm Discord channel]]
-Knowledge of how to use Slurm already is preferred at this stage of testing.
-The information from the older cluster mostly applies and I suggest you read that documentation: https://howto.cs.uchicago.edu/techstaff:slurm
+The information from the older cluster mostly applies and I suggest you read that documentation: https://howto.cs.uchicago.edu/slurm
 ====== Infrastructure ======
-Summary of nodes installed on the cluster
+Summary of nodes installed on the cluster.
+  * [[ http://monitor.ai.cs.uchicago.edu|Ganglia Monitoring ]]
+  * [[ https://monitor2.ai.cs.uchicago.edu|Grafana Graphs ]]
+    * Use `guest` as the username and password to login.
 ===== Computer/GPU Nodes =====
@@ Line 26: / Line 29: @@
     * 384G RAM
     * 4x Nvidia Quadro RTX 8000
+  * 3x nodes
+    * 2x AMD EPYC 7302 16-Core Processor
+    * 512G RAM
+    * 4x Nvidia A40
+    * Note that not all nodes are online yet.
   * all:
@@ Line 39: / Line 48: @@
     * /home/<username>
       * We intend to set user quotas, however, there are no quotas right now.
-    * /net/projects: (Please ignore this for now)
+    * /net/projects:
       * Lives on the home directory server.
       * Idea would be to create a dataset with a quota for people to use.
@@ Line 53: / Line 62: @@
     * zfs mirror with previous snapshots of 'ai-storage1'.
     * NOT a backup.
-    * Not enabled yet.
@@ Line 123: / Line 132: @@
 </code>
-==== Notes on CUDA_VISIBLE_DEVICES ====
-CUDA_VISIBLE_DEVICES: Displays relative gpu device number available to you.
-  * This variable should NOT be modified. Ever.
-  * Relative means that if you requested one gpu it will show up as 0. Even if all other gpus on the server are being used by others.
-===== Fairshare/QOS =====
-By default all usage is tracked and charged to a users default account. A fairshare value is computed and used in prioritizing a job on submission.
-Details are being worked out for anyone that donates to the cluster. This will be some sort of tiered system where you get to use a higher priority when you need it.
-You will need to charge an account on job submission ''%%--account=<name>%%'' and most likely select the priority level you wish to use and that you are allowed to use: ''%%--qos=<level>%%''
@@ Line 186: / Line 185: @@
   - This will make an ssh tunnel on your local machine that fowards traffic sent to ''%%localhost:8888%%'' to ''%%$NODEIP:$NODEPORT%%'' via the ssh tunnel. This command will appear to hang since we are using the -N option which tells ssh not to run any commands including a shell on the remote machine.
   - Open your local browser and visit: ''%%http://localhost:8888%%''
+====== Contribution Policy =====
+This section can be ignored by most people. [[techstaff:aicluster-admin|If you contributed to the cluster or are in a group that has you can read more here]].