techstaff:slurm
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revisionNext revisionBoth sides next revision | ||
techstaff:slurm [2016/05/09 15:08] – [Example] kauffman | techstaff:slurm [2017/08/24 14:54] – [Notice] kauffman | ||
---|---|---|---|
Line 1: | Line 1: | ||
- | ====== DRAFT | Peanut Job Submission Cluster ====== | + | ===== Notice |
+ | **All is back to normal. Please submit jobs from linux1,2,3. Email techstaff@cs.uchicago.edu if you find that something is amiss.** | ||
- | We are currently **alpha** testing and gauging user interest in a cluster of machines that allows for the submission of long running compute jobs. Think of these machines as a dumping ground for discrete computing tasks that might have been rude or disruptive to execute on the main (shared) shell servers (i.e., linux1, linux2, linux3). | + | The SLURM cluster will become unavailable starting 2017-08-22 for an upgrade. Normal service should resume on 2017-08-25. Please check back here for status updates. |
+ | |||
+ | **2017-08-22 1800**: Main cluster upgraded. You can try to use it now but I can't guarantee that I won't kill your job tomorrow or Firday. | ||
+ | |||
+ | **2017-08-23 1345**: GPU servers upgraded and added back to the cluster. They may be missing some software that was not automatable at previous time of installation. Send me an email if you find anything missing. | ||
+ | |||
+ | We still run systems with Ubuntu 14.04 installed. As of right now these systems cannot submit jobs to the cluster. This is on purpose. The slurm version jump between 14.04 and 16.04 was so huge that this was unavoidable. This means you should prefer to use linux.cs.uchicago.edu or any CS machine that run Ubuntu 16.04. | ||
+ | |||
+ | **2017-08-24**: | ||
+ | ====== Peanut Job Submission Cluster ====== | ||
+ | |||
+ | We are currently **alpha** testing and gauging user interest in a cluster of machines that allows for the submission of long running compute jobs. Think of these machines as a dumping ground for discrete computing tasks that might be rude or disruptive to execute on the main (shared) shell servers (i.e., linux1, linux2, linux3). | ||
For job submission we will be using a piece of software called [[http:// | For job submission we will be using a piece of software called [[http:// | ||
Line 228: | Line 240: | ||
====== Using the GPU ====== | ====== Using the GPU ====== | ||
+ | ===== Paths ===== | ||
+ | You will need to add the following to your $PATH and $LD_LIBRARY_PATH. | ||
+ | |||
+ | export PATH=$PATH:/ | ||
+ | export LD_LIBRARY_PATH=$LD_LIBRARY_PATH=/ | ||
+ | |||
+ | |||
===== Example ===== | ===== Example ===== | ||
This sbatch script will get device information from the installed Tesla gpu. | This sbatch script will get device information from the installed Tesla gpu. | ||
Line 240: | Line 259: | ||
#SBATCH --partition=gpu | #SBATCH --partition=gpu | ||
#SBATCH --job-name=get_tesla_info | #SBATCH --job-name=get_tesla_info | ||
+ | |||
+ | export PATH=$PATH:/ | ||
+ | export LD_LIBRARY_PATH=$LD_LIBRARY_PATH=/ | ||
cat << EOF > / | cat << EOF > / |
/var/lib/dokuwiki/data/pages/techstaff/slurm.txt · Last modified: 2021/01/06 16:13 by kauffman