User Tools

Site Tools


slurm:ai

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
slurm:ai [2021/06/29 09:27] – [Login] kauffmanslurm:ai [2022/04/04 10:58] (current) – fix typos and add code snippet for interactive jupyter notebook chaochunh
Line 1: Line 1:
 ====== AI Cluster - Slurm ====== ====== AI Cluster - Slurm ======
-Cluster is up and running now. Anyone with CS account who wishes to test it out should do so.+Please send in ticket requesting to be added if it is your first time using the AI cluster.
  
  
Line 34: Line 34:
     * 512G RAM     * 512G RAM
     * 4x Nvidia A40     * 4x Nvidia A40
-    * Note that not all nodes are online yet. 
  
   * all:   * all:
Line 47: Line 46:
     * uplink to cluster network: 2x 25G     * uplink to cluster network: 2x 25G
     * /home/<username>     * /home/<username>
-      * We intend to set user quotas, however, there are no quotas right now.+      * 20G quota per user.
     * /net/projects:     * /net/projects:
       * Lives on the home directory server.       * Lives on the home directory server.
Line 67: Line 66:
 ====== Login ====== ====== Login ======
  
-Anyone with a CS account is allowed to login. +Anyone with a CS account who has previously sent in a ticket to request access to be added is allowed to login. 
  
 There are a set of front end nodes that give you access to the Slurm cluster. You will connect through these nodes and need to be on these nodes to submit jobs to the cluster. There are a set of front end nodes that give you access to the Slurm cluster. You will connect through these nodes and need to be on these nodes to submit jobs to the cluster.
Line 169: Line 168:
 Make a new ssh connection to tunnel your traffic. The format will be something like: Make a new ssh connection to tunnel your traffic. The format will be something like:
  
-''%%ssh -N -L 8888:###.###.###.###:#### user@fe01.ai.cs.uchicago.edu.edu%%''+''%%ssh -N -L 8888:###.###.###.###:#### user@fe01.ai.cs.uchicago.edu%%''
  
 This command will appear to hang since we are using the -N option which tells ssh not to run any commands including a shell on the remote machine. This command will appear to hang since we are using the -N option which tells ssh not to run any commands including a shell on the remote machine.
Line 183: Line 182:
   - Make a new ssh connection with a tunnel to access your notebook   - Make a new ssh connection with a tunnel to access your notebook
   - ''%%ssh -N -L 8888:$NODEIP:$NODEPORT user@fe01.ai.cs.uchicago.edu%%'' using the values not variables   - ''%%ssh -N -L 8888:$NODEIP:$NODEPORT user@fe01.ai.cs.uchicago.edu%%'' using the values not variables
-  - This will make an ssh tunnel on your local machine that fowards traffic sent to ''%%localhost:8888%%'' to ''%%$NODEIP:$NODEPORT%%'' via the ssh tunnel. This command will appear to hang since we are using the -N option which tells ssh not to run any commands including a shell on the remote machine.+  - This will make an ssh tunnel on your local machine that forwards traffic sent to ''%%localhost:8888%%'' to ''%%$NODEIP:$NODEPORT%%'' via the ssh tunnel. This command will appear to hang since we are using the -N option which tells ssh not to run any commands including a shell on the remote machine.
   - Open your local browser and visit: ''%%http://localhost:8888%%''   - Open your local browser and visit: ''%%http://localhost:8888%%''
  
 +Copy the following code snippt to the interactive node directly: 
 +<code>
 +unset XDG_RUNTIME_DIR
 +NODEIP=$(hostname -i)
 +NODEPORT=$(( $RANDOM + 1024))
 +echo "ssh command: ssh -N -L 8888:$NODEIP:$NODEPORT `whoami`@fe01.ai.cs.uchicago.edu"
 +jupyter-notebook --ip=$NODEIP --port=$NODEPORT --no-browser
 +</code>
  
 ====== Contribution Policy ===== ====== Contribution Policy =====
 This section can be ignored by most people. [[techstaff:aicluster-admin|If you contributed to the cluster or are in a group that has you can read more here]]. This section can be ignored by most people. [[techstaff:aicluster-admin|If you contributed to the cluster or are in a group that has you can read more here]].
  
/var/lib/dokuwiki/data/attic/slurm/ai.1624976860.txt.gz · Last modified: 2021/06/29 09:27 by kauffman

Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki