Differences

This shows you the differences between two versions of the page.

--- techstaff:aicluster-admin [2021/02/10 13:42] – [TODO] kauffman
+++ techstaff:aicluster-admin [2021/02/23 19:58] (current) – kauffman
@@ Line 1: / Line 1: @@
 ====== AI Cluster Policy Description ======
-After various iterations we (Bob, Har, and I) believe to have an
-implementation of the policy that meets the requirements discussed
-previously.
 ===== TODO =====
   - There are multiple methods used to calculate priority reflected on the spreadsheet.
@@ Line 20: / Line 15: @@
 ==== Sheet usage ====
-  - All donations will get logged into the spreadsheet under the 'log' sheet.
+  * Red: Do not edit
-  - Hardware donation gets converted to USD by techstaff. A receipt of the purchase is good starting point.
+  * Green: user input (This will be Techstaff 95% of the time)
-  - donations get assigned a POSIX group. Group must have a primary contact, who then gets to set members for that group.
+  * `groups` sheet:
-  - The group 'cs' is calculated on the spreadsheet but doesn't actually get any priority set. 'general' is for all CS users. It needs to be part of the total sum but is treated as a special case with 0 priority.
+    * contributions get assigned a POSIX group. Group must have a primary contact, who then gets to set members for that group.
-  - Red: Do not edit
-  - Green: user input (This will be Techstaff 95% of the time)
-  - `groups` sheet:
     * calculates contribution amount for use in `contrib-priority`.
     * tracks group name and primary owner
-  - `contrib-priority` calculation references contrib amounts calculated in `groups`.
+  * `log` sheet
+    * All contributions will get entered here.
+    * Hardware contribution gets converted to USD by techstaff. A receipt of the purchase is good starting point.
+  * The group 'cs' is calculated on the spreadsheet but doesn't actually get any priority set. 'general' is for all CS users. It needs to be part of the total sum but is treated as a special case with 0 priority.
+  * `contrib-priority` calculation references contrib amounts calculated in `groups`.
@@ Line 70: / Line 66: @@
 *Note that this example may not be up to date when you read this.
-==== How we modify job priority to favor contributors ====
+===== How we modify job priority to favor contributors =====
   * We adjust those priorities with partitions for those who have donated either monetarily or with hardware. Hardware donations get converted a monetary value when logged on the spreadsheet.
@@ Line 79: / Line 75: @@
 <code>
 PartitionName=general Nodes=a[001-008]
-PartitionName=cdac-own Nodes=a[005-008] AllowGroups=cdac Priority=100
+#PartitionName=cdac-own Nodes=a[005-008] AllowGroups=cdac Priority=100
 PartitionName=cdac-contrib Nodes=a[001-008] AllowGroups=cdac Priority=5
 </code>
@@ Line 85: / Line 81: @@
 ^Partition^Description^Priority^
 |general| For all users| 0 |
-|${group}-own | Machines $group has donated | 100 |
+|${group}-own | Machines $group has donated. Enabled when asked. | 100 |
 |${group}-contrib | A method to give slightly higher job priority to groups who have donated but do not own machines.| Variable based on spreadsheet calculation. |
@@ Line 102: / Line 98: @@
 The percent will end up as an integer.
+There is a [[https://vcs.cs.uchicago.edu/kauffman/slurm-tools/blob/master/cluster_partition_usage.py|python script]] that does this and sends techstaff a report. The repo is currently not available for everyone to see but I think that it should be eventually. In the mean time you can take a look at it on the front end nodes (/usr/local/slurm-tools/cluster_partition_usage.py).
@@ Line 111: / Line 109: @@
-Note that the term "idleness" should not be taken literally. I don't know of way to actually calculate true idleness. I believe that the current calculation reflects the intent of the term.
+Note that the term "idleness" should not be taken literally. I don't know of way to actually calculate true idleness. I believe that the current calculation reflects the intended usage.