User Tools

Site Tools


techstaff:aicluster

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revisionBoth sides next revision
techstaff:aicluster [2020/12/10 12:55] – [Jupyter Notebook Tips] kauffmantechstaff:aicluster [2020/12/10 12:56] – [Batch] kauffman
Line 153: Line 153:
 ===== Jupyter Notebook Tips ===== ===== Jupyter Notebook Tips =====
 ==== Batch ==== ==== Batch ====
-?+The process for a batch job is very similar.
  
 +jupyter-notebook.sbatch
 +<code>
 +#!/bin/bash
 +unset XDG_RUNTIME_DIR
 +NODEIP=$(hostname -i)
 +NODEPORT=$(( $RANDOM + 1024))
 +echo "ssh command: ssh -N -L 8888:$NODEIP:$NODEPORT `whoami`@slurm.ttic.edu"
 +. ~/myenv/bin/activate
 +jupyter-notebook --ip=$NODEIP --port=$NODEPORT --no-browser
 +</code>
 +
 +Check the output of your job to find the ssh command to use when accessing your notebook.
 +
 +Make a new ssh connection to tunnel your traffic. The format will be something like:
 +
 +''%%ssh -N -L 8888:###.###.###.###:#### user@fe01.ai.cs.uchicago.edu.edu%%''
 +
 +This command will appear to hang since we are using the -N option which tells ssh not to run any commands including a shell on the remote machine.
 +
 +Open your local browser and visit: ''%%http://localhost:8888%%''
 ==== Interactive ==== ==== Interactive ====
   - ''%%srun --pty bash%%'' run an interactive job   - ''%%srun --pty bash%%'' run an interactive job
/var/lib/dokuwiki/data/pages/techstaff/aicluster.txt · Last modified: 2021/01/06 16:11 by kauffman

Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki