slurm:ai
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
slurm:ai [2021/02/01 17:47] – kauffman | slurm:ai [2022/04/04 10:58] (current) – fix typos and add code snippet for interactive jupyter notebook chaochunh | ||
---|---|---|---|
Line 1: | Line 1: | ||
====== AI Cluster - Slurm ====== | ====== AI Cluster - Slurm ====== | ||
- | Cluster is up and running now. Anyone with a CS account who wishes | + | Please send in a ticket requesting |
Line 15: | Line 15: | ||
Summary of nodes installed on the cluster. | Summary of nodes installed on the cluster. | ||
- | [[ http:// | + | * [[ http:// |
+ | * [[ https:// | ||
+ | * Use '' | ||
===== Computer/ | ===== Computer/ | ||
Line 27: | Line 29: | ||
* 384G RAM | * 384G RAM | ||
* 4x Nvidia Quadro RTX 8000 | * 4x Nvidia Quadro RTX 8000 | ||
+ | |||
+ | * 3x nodes | ||
+ | * 2x AMD EPYC 7302 16-Core Processor | ||
+ | * 512G RAM | ||
+ | * 4x Nvidia A40 | ||
* all: | * all: | ||
Line 39: | Line 46: | ||
* uplink to cluster network: 2x 25G | * uplink to cluster network: 2x 25G | ||
* / | * / | ||
- | * We intend to set user quotas, however, there are no quotas right now. | + | * 20G quota per user. |
- | * / | + | * / |
* Lives on the home directory server. | * Lives on the home directory server. | ||
* Idea would be to create a dataset with a quota for people to use. | * Idea would be to create a dataset with a quota for people to use. | ||
Line 54: | Line 61: | ||
* zfs mirror with previous snapshots of ' | * zfs mirror with previous snapshots of ' | ||
* NOT a backup. | * NOT a backup. | ||
- | * Not enabled yet. | + | |
====== Login ====== | ====== Login ====== | ||
- | There are a set of front end nodes that give you access to the Slurm cluster. You will connect through these nodes and need to be on these nodes to submit jobs to the cluster. | ||
- | ssh cnetid@fe.ai.cs.uchicago.edu | + | Anyone with a CS account who has previously sent in a ticket to request access to be added is allowed to login. |
- | * Requires | + | There are a set of front end nodes that give you access to the Slurm cluster. You will connect through these nodes and need to be on these nodes to submit jobs to the cluster. |
+ | ssh cnetid@fe.ai.cs.uchicago.edu | ||
==== File Transfer ==== | ==== File Transfer ==== | ||
You will use the FE nodes to transfer your files onto the cluster storage infrastructure. The network connections on those nodes are 2x 10G each. | You will use the FE nodes to transfer your files onto the cluster storage infrastructure. The network connections on those nodes are 2x 10G each. | ||
Line 126: | Line 133: | ||
- | ===== Fairshare/ | ||
- | By default all usage is tracked and charged to a users default account. A fairshare value is computed and used in prioritizing a job on submission. | ||
- | |||
- | Details are being worked out for anyone that donates to the cluster. This will be some sort of tiered system where you get to use a higher priority when you need it. | ||
- | You will need to charge an account on job submission '' | ||
Line 166: | Line 168: | ||
Make a new ssh connection to tunnel your traffic. The format will be something like: | Make a new ssh connection to tunnel your traffic. The format will be something like: | ||
- | '' | + | '' |
This command will appear to hang since we are using the -N option which tells ssh not to run any commands including a shell on the remote machine. | This command will appear to hang since we are using the -N option which tells ssh not to run any commands including a shell on the remote machine. | ||
Line 173: | Line 175: | ||
==== Interactive ==== | ==== Interactive ==== | ||
- '' | - '' | ||
- | - '' | + | - '' |
- '' | - '' | ||
- '' | - '' | ||
- '' | - '' | ||
- | - '' | + | - '' |
- Make a new ssh connection with a tunnel to access your notebook | - Make a new ssh connection with a tunnel to access your notebook | ||
- '' | - '' | ||
- | - This will make an ssh tunnel on your local machine that fowards | + | - This will make an ssh tunnel on your local machine that forwards |
- Open your local browser and visit: '' | - Open your local browser and visit: '' | ||
+ | |||
+ | Copy the following code snippt to the interactive node directly: | ||
+ | < | ||
+ | unset XDG_RUNTIME_DIR | ||
+ | NODEIP=$(hostname -i) | ||
+ | NODEPORT=$(( $RANDOM + 1024)) | ||
+ | echo "ssh command: ssh -N -L 8888: | ||
+ | jupyter-notebook --ip=$NODEIP --port=$NODEPORT --no-browser | ||
+ | </ | ||
+ | |||
+ | ====== Contribution Policy ===== | ||
+ | This section can be ignored by most people. [[techstaff: | ||
/var/lib/dokuwiki/data/attic/slurm/ai.1612223259.txt.gz · Last modified: 2021/02/01 17:47 by kauffman