Cluster users, Please see news below regarding the COE cluster. Changes to MIG on dgxh partition Earlier this Spring quarter, MIG was enabled on all GPUs of the dgxh partition to increase availability of the H100 GPUs, and to allow requesting of certain VRAM configurations. It has come to my attention that enabling the MIG feature happens to disable other important features of the H100. To accommodate those who require these features, the number of H100 GPUs with MIG enabled will be reduced, and the “7g.80gb” and “7g.140gb” MIG devices will be phased out. In the meantime, you may use the Slurm options below to request the following VRAM configurations on the dgxh partition: 80 GB or more VRAM: use “--constraint=vram80g” 140 GB VRAM: use “--constraint=vram140g” Or if you are using the HPC portal, put vram80g or vram140g, respectively, into the features field. More changes regarding MIG are planned but will not be implemented until the maintenance period (see below). Summer maintenance This is a reminder that the next cluster-wide maintenance is scheduled for the week of June 16, after Finals week. The maintenance activities planned for this time include: DDN (hpc-share) storage system updates Slurm update and configuration changes Operating system image updates Nvidia GPU, infiniband, and storage driver updates BIOS and firmware updates as needed Miscellaneous hardware maintenance as needed The entire cluster will be offline starting Monday, June 16 at 1pm, and will remain offline until approximately Wednesday the 18th at 4pm. Jobs scheduled to run into that offline period will remain pending with the message “ReqNodeNotAvail, Reserved for maintenance”. If you wish for your Slurm job to start and finish before the offline period begins, you will need to adjust your time limit accordingly, e.g. if there is less than 3 days until the maintenance begins, then to change the time limit of your pending job to 2 days do: scontrol update job {jobid} TimeLimit=2-00:00:00 Alternatively, you can cancel your pending job, adjust your walltime (using the --time option) and resubmit. HPC scratch share This is just a reminder that the HPC scratch storage (hpc-share) should not be considered permanent storage. This filesystem is not backed up, and it does not currently support snapshots. If files are accidently deleted or lost, there are no tools available for recovery. Please make sure to save your important data to a permanent storage solution. For more information on other storage options within the College of Engineering, check out the link below: https://it.engineering.oregonstate.edu/data-storage-options<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fit.engineering.oregonstate.edu%2Fdata-storage-options&data=05%7C02%7Ccluster-users%40lists.engr.oregonstate.edu%7C2e9a98de5c3a4526c33c08dda2f2b0f3%7Cce6d05e13c5e4d6287a84c4a2713c113%7C0%7C0%7C638845885403491330%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C0%7C%7C%7C&sdata=MgODJMvR1%2FvJ0WGRxuT3QRKDxj3MHXQFJ0cf8noCzb4%3D&reserved=0> For up-to-date status on the cluster, check out the link below: https://it.engineering.oregonstate.edu/hpc/hpc-cluster-status-and-news<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fit.engineering.oregonstate.edu%2Fhpc%2Fhpc-cluster-status-and-news&data=05%7C02%7Ccluster-users%40lists.engr.oregonstate.edu%7C2e9a98de5c3a4526c33c08dda2f2b0f3%7Cce6d05e13c5e4d6287a84c4a2713c113%7C0%7C0%7C638845885403512120%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C0%7C%7C%7C&sdata=4w7gPVpLOm8opTQTxLUakvhSWV5T0%2FhZZYmuJdoWYzo%3D&reserved=0> Rob Yelle HPC Manager