CSCWiki - User contributions [en]

SLURM

2026-10-23T23:52:11Z

D2acosta: added why

== Why ==
Slurm (Simple Linux Utility for Resource Management) is a job scheduler. Basically use this if too many people are trying to use a system at the same time and its crashing or you want to distribute resources more fairly.

== Installation/Config ==
First you need to install the "slurm" packages and dependencies so run<syntaxhighlight lang="bash" start="1">
sudo apt update
sudo apt install slurm-wlm slurmd slurmctld munge -y
</syntaxhighlight>Then you need to verify that there are MUNGE keys, which there should already be but run the following to check<syntaxhighlight lang="bash">
sudo test -f /etc/munge/munge.key && echo "Key exists" || echo "Key is missing"
</syntaxhighlight>For this next part, you are going to need the systems hostname, CPU core count, and total RAM. Now create the file /etc/slurm/slurm.conf and write the following in it (replacing the temps with the mentioned data)<syntaxhighlight lang="ini" start="1" line="1">ClusterName=localcluster
SlurmctldHost=<your-hostname>

# Authentication
AuthType=auth/munge
CredType=cred/munge

# Process tracking and resource limits
ProctrackType=proctrack/cgroup
TaskPlugin=task/cgroup,task/affinity
SelectTypeParameters=CR_Core_Memory

# Paths and logging
SlurmUser=slurm
StateSaveLocation=/var/lib/slurm/slurmctld
SlurmdSpoolDir=/var/lib/slurm/slurmd
SlurmctldPidFile=/run/slurmctld.pid
SlurmdPidFile=/run/slurmd.pid
SlurmctldLogFile=/var/log/slurmctld.log
SlurmdLogFile=/var/log/slurmd.log

# Node definition
NodeName=<your-hostname> CPUs=<CPU-cores> RealMemory=<Total-RAM> State=UNKNOWN

# Partition definition
PartitionName=debug Nodes=<your-hostname> Default=YES MaxTime=INFINITE State=UP</syntaxhighlight>Also create the file /etc/slurm/cgroup.conf and write<syntaxhighlight lang="ini" line="1" start="1">
CgroupAutomount=yes
ConstrainCores=yes
ConstrainRAMSpace=yes
</syntaxhighlight>The last config step is to create the need directories for slurm's processes (state and spool) and transfer their ownership to slurm. To do that run the following<syntaxhighlight lang="bash">
sudo mkdir -p /var/lib/slurm/slurmd /var/lib/slurm/slurmctld
sudo chown slurm:slurm /var/lib/slurm/slurmd /var/lib/slurm/slurmctld
</syntaxhighlight>Now enable the slurm controller/compute deamons <syntaxhighlight lang="bash">
sudo systemctl enable slurmctld slurmd
sudo systemctl start slurmctld slurmd
</syntaxhighlight>

== Basic Testing ==
To check the install/to make sure it's running<syntaxhighlight lang="bash">
systemctl status slurmctld
systemctl status slurmd
sinfo
</syntaxhighlight>If sinfo shows the node as down or drain, you can set it to idle by<syntaxhighlight lang="bash">sudo scontrol update nodename=localhost state=idle</syntaxhighlight>If sinfo fails to connect or the node is unresponsive, you can check the log by<syntaxhighlight lang="bash">
sudo tail -f /var/log/slurmctld.log
</syntaxhighlight>

SLURM

2026-10-23T09:34:54Z

D2acosta:

== Installation/Config ==
First you need to install the "slurm" packages and dependencies so run<syntaxhighlight lang="bash" start="1">
sudo apt update
sudo apt install slurm-wlm slurmd slurmctld munge -y
</syntaxhighlight>Then you need to verify that there are MUNGE keys, which there should already be but run the following to check<syntaxhighlight lang="bash">
sudo test -f /etc/munge/munge.key && echo "Key exists" || echo "Key is missing"
</syntaxhighlight>For this next part, you are going to need the systems hostname, CPU core count, and total RAM. Now create the file /etc/slurm/slurm.conf and write the following in it (replacing the temps with the mentioned data)<syntaxhighlight lang="ini" start="1" line="1">ClusterName=localcluster
SlurmctldHost=<your-hostname>

# Authentication
AuthType=auth/munge
CredType=cred/munge

# Process tracking and resource limits
ProctrackType=proctrack/cgroup
TaskPlugin=task/cgroup,task/affinity
SelectTypeParameters=CR_Core_Memory

# Paths and logging
SlurmUser=slurm
StateSaveLocation=/var/lib/slurm/slurmctld
SlurmdSpoolDir=/var/lib/slurm/slurmd
SlurmctldPidFile=/run/slurmctld.pid
SlurmdPidFile=/run/slurmd.pid
SlurmctldLogFile=/var/log/slurmctld.log
SlurmdLogFile=/var/log/slurmd.log

# Node definition
NodeName=<your-hostname> CPUs=<CPU-cores> RealMemory=<Total-RAM> State=UNKNOWN

# Partition definition
PartitionName=debug Nodes=<your-hostname> Default=YES MaxTime=INFINITE State=UP</syntaxhighlight>Also create the file /etc/slurm/cgroup.conf and write<syntaxhighlight lang="ini" line="1" start="1">
CgroupAutomount=yes
ConstrainCores=yes
ConstrainRAMSpace=yes
</syntaxhighlight>The last config step is to create the need directories for slurm's processes (state and spool) and transfer their ownership to slurm. To do that run the following<syntaxhighlight lang="bash">
sudo mkdir -p /var/lib/slurm/slurmd /var/lib/slurm/slurmctld
sudo chown slurm:slurm /var/lib/slurm/slurmd /var/lib/slurm/slurmctld
</syntaxhighlight>Now enable the slurm controller/compute deamons <syntaxhighlight lang="bash">
sudo systemctl enable slurmctld slurmd
sudo systemctl start slurmctld slurmd
</syntaxhighlight>

== Basic Testing ==
To check the install/to make sure it's running<syntaxhighlight lang="bash">
systemctl status slurmctld
systemctl status slurmd
sinfo
</syntaxhighlight>If sinfo shows the node as down or drain, you can set it to idle by<syntaxhighlight lang="bash">sudo scontrol update nodename=localhost state=idle</syntaxhighlight>If sinfo fails to connect or the node is unresponsive, you can check the log by<syntaxhighlight lang="bash">
sudo tail -f /var/log/slurmctld.log
</syntaxhighlight>

SLURM

2026-10-23T09:33:13Z

D2acosta: v1

SLURM

2026-10-23T09:29:45Z

D2acosta:

== Installation/Config ==
First you need to install the "slurm" packages and dependencies so run<syntaxhighlight lang="bash" start="1">
sudo apt update
sudo apt install slurm-wlm slurmd slurmctld munge -y
</syntaxhighlight>Then you need to verify that there are MUNGE keys, which there should already be but run the following to check<syntaxhighlight lang="bash">
sudo test -f /etc/munge/munge.key && echo "Key exists" || echo "Key is missing"
</syntaxhighlight>For this next part, you are going to need the systems hostname, CPU core count, and total RAM. Now create the file /etc/slurm/slurm.conf and write the following in it (replacing the temps with the mentioned data)<syntaxhighlight lang="bash" start="1" line="1">
ClusterName=localcluster
SlurmctldHost=<your-hostname>

# Authentication
AuthType=auth/munge
CredType=cred/munge

# Process tracking and resource limits
ProctrackType=proctrack/cgroup
TaskPlugin=task/cgroup,task/affinity
SelectTypeParameters=CR_Core_Memory

# Paths and logging
SlurmUser=slurm
StateSaveLocation=/var/lib/slurm/slurmctld
SlurmdSpoolDir=/var/lib/slurm/slurmd
SlurmctldPidFile=/run/slurmctld.pid
SlurmdPidFile=/run/slurmd.pid
SlurmctldLogFile=/var/log/slurmctld.log
SlurmdLogFile=/var/log/slurmd.log

# Node definition
NodeName=<your-hostname> CPUs=<CPU-cores> RealMemory=<Total-RAM> State=UNKNOWN

# Partition definition
PartitionName=debug Nodes=<your-hostname> Default=YES MaxTime=INFINITE State=UP
</syntaxhighlight>Also create the file /etc/slurm/cgroup.conf and write<syntaxhighlight lang="bash" line="1" start="1">
CgroupAutomount=yes
ConstrainCores=yes
ConstrainRAMSpace=yes
</syntaxhighlight>The last config step is to create the need directories for slurm's processes (state and spool) and transfer their ownership to slurm. To do that run the following<syntaxhighlight lang="bash">
sudo mkdir -p /var/lib/slurm/slurmd /var/lib/slurm/slurmctld
sudo chown slurm:slurm /var/lib/slurm/slurmd /var/lib/slurm/slurmctld
</syntaxhighlight>Now enable the slurm controller/compute deamons <syntaxhighlight lang="bash">
sudo systemctl enable slurmctld slurmd
sudo systemctl start slurmctld slurmd
</syntaxhighlight>

== Basic Testing ==

SLURM

2026-10-23T09:25:26Z

D2acosta:

SLURM

2026-10-23T09:16:22Z

D2acosta: Start installation guide

== Installation ==
First you need to install the "slurm" packages and dependencies so run<syntaxhighlight lang="bash" start="1">
sudo apt update
sudo apt install slurm-wlm slurmd slurmctld munge -y
</syntaxhighlight>Then you need to verify that there are MUNGE keys, which there should already be but run <nowiki><code lang="bash>sudo test -f /etc/munge/munge.key && echo "Key exists" || echo "Key is missing" </code></nowiki>

Main Page

2026-10-23T09:08:04Z

D2acosta:

This is the Wiki of the [[Computer Science Club]]. Feel free to start adding pages and information.

[[Special:AllPages]]

== Member/Club Rep Documentation ==
To access our Linux machines, see [[How to SSH]] and select one of the general-use machines from [[Machine List#General-Use Servers]].

To host a website, see [[Web Hosting]]. If you are trying to host websites for clubs, see [[Club Hosting]].

To view instruction on playing music at the office, see [[Music]].

To use our Nextcloud instance (similar to Google Drive and Dropbox), go to [https://files.csclub.uwaterloo.ca CSC Files].

=== Guides ===
<div style="-webkit-column-count:3; -moz-column-count:3; column-count:3;">
* [[New Member Guide]]
* [[Club Hosting]]
* [[Web Hosting]]
* [[Git Hosting]]
* [[How to IRC]]
* [[How to SSH]]
* [[MySQL]]
* [[PostgreSQL]]
</div>

=== News and Events ===
<div style="-webkit-column-count:3; -moz-column-count:3; column-count:3;">
* [[Meeting:Meetings|Meetings]]
* [[Talks]]
* [[Projects]]
</div>

== Club Operation ==
<div style="-webkit-column-count:3; -moz-column-count:3; column-count:3;">
* [[Budget Guide]]
* [[ceo]]
* [[Exec Manual]]
* [[MEF Guide]]
* [[Office Policies]]
* [[Office Staff]]
* [[Sysadmin Guide]]
* [[How to (Extra) Ban Someone]]
* [[SCS Guide]]
* [[Kerberos |Password Reset]]
* [[Keys and Fobs]]

* [[Talks Guide]]
</div>

== Systems Documentation ==
=== Introductions ===
Start here if you have no clue how a subsystem works
<div style="-webkit-column-count:3; -moz-column-count:3; column-count:3;">
* [[Intro to Authentication]]
</div>

=== Hardware Infrastructure (the bare metals) ===
<div style="-webkit-column-count:3; -moz-column-count:3; column-count:3;">
* [[Machine List]]
* [[Decommissioned Machines]]
* [[Filer]]
* [[Switches]]
* [[IPMI101]]
* [[Disk Drive RMA Process]]
</div>

=== Software Infrastructure ===
To see a complete list of services, where to find them and when they are updated, see [[Service List]].

<div style="-webkit-column-count:3; -moz-column-count:3; column-count:3;">
* [[ADFS]]
* [[Backups]]
* [[CUDA]]
* [[DNS]]
* [[Debian Repository]]
* [[Firewall]]
* [[Kerberos]]
* [[Matrix]]
* [[MatterMost]]
* [[Load-balancer]]
* [[Proxmox]]
* [[Plane]]
* [[RT]]
* [[Keycloak]]
* [[KVM]]
* [[LDAP]]
* [[Network]]
* [[New CSC Machine]]
* [[Observability]]
* [[OID Assignment]]
* [[Podman]]
* [[Scratch]]
* [[SNMP]]
* [[SSL]]
* [[SLURM|slurm]]
* [[Syscom Todo]]
* [[Systemd]]
* [[Systemd-nspawn]]
* [[Two-Factor Authentication]]
* [[UID/GID Assignment]]
</div>

=== Services ===
<div style="-webkit-column-count:3; -moz-column-count:3; column-count:3;">
* [[Application List]]
* [[BigBlueButton]]
* [[CodeyBot]]
* [[Mail]]
* [[Mailing Lists]]
* [[Mirror]]
* [[Music]]
* [[Nextcloud]]
* [[Immich]]
* [[Printing]]
* [[Pulseaudio]]
* [[Webmail]]
</div>

=== CSC Cloud ===
<div style="-webkit-column-count:3; -moz-column-count:3; column-count:3;">
* [[Ceph]]
* [[Cloud Networking]]
* [[CloudStack]]
* [[CloudStack Templates]]
* [[Kubernetes]]
</div>

== Miscellaneous ==
<div style="-webkit-column-count:3; -moz-column-count:3; column-count:3;">
* [[Acronyms]]
* [[Finance:Budget]]
* [[Executive]]
* [[Past Executive]]
* [[History]]
</div>

== Historical ==
<div style="-webkit-column-count:3; -moz-column-count:3; column-count:3;">
* [[New NetApp]]
* [[Robot Arm]]
* [[Webcams]]
* [[Website]]
* [[Digital Cutter]]
* [[Electronics]]
* [[NetApp]]
* [[Frosh]]
* [[Virtualization (LXC Containers)]]
* [[Serial Connections]]
* [[Library]]
* [[Finance:MEF Proposals]]
* [[Proposed Constitution Changes]]
* [[NFS/Kerberos]]
* [[Hardware]]
* [[Imapd Guide]]
__NOTOC__