June 2023 - cluster-users - Engineering Mailing Lists

CoE HPC News, June 30 2023: More AC maintenance
by Yelle, Robert Brian 30 Jun '23

30 Jun '23

Cluster users, The cluster is back online near full capacity. Here is more news regarding the COE HPC cluster: More AC maintenance Another round of AC maintenance is scheduled for next Thursday July 6 which will impact the KEC server rooms. To mitigate the heat load, the cluster will operate at reduced capacity again starting next Wednesday evening the 5th, until the server room temperature returns to a safe operating level, which should be the night of the 6th based on this past round of AC maintenance. Early Thursday morning during the AC maintenance, I plan to relocate two submit servers, submit-b and submit-c. This will require that I power them off which will terminate any srun sessions running on them. Jobs submitted through sbatch on these nodes or through the HPC portal will be unaffected. In addition, the Slurm scheduler will temporarily be offline early Thursday morning. This will prevent new submissions (which will be limited anyways) or queries on job and node status, but running jobs will not be affected. I anticipate that Slurm will be back online by 10am and the two submit nodes by 11am. For up-to-date status on the cluster, check out the link below: https://it.engineering.oregonstate.edu/hpc/hpc-cluster-status-and-news<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fit.engine…> If you have any questions or concerns, let me know. Have a great weekend! Rob Yelle HPC Manager

1 0

CoE HPC News, June 29 2023: AC maintenance
by Yelle, Robert Brian 30 Jun '23

30 Jun '23

HPCC users, Maintenance was performed on the KEC chillers earlier today. The KEC server room temperature is still quite warm since the maintenance, but is expected to cool down slowly over time. The cluster resources are currently offline until the server room temperature returns to normal. Jobs currently running in the cluster will continue, but in the event that the temperature rises, I may need to perform an emergency shutdown of parts or most of the cluster, which may result in terminating those running jobs. I will post updates of the cluster status in the link below: https://it.engineering.oregonstate.edu/hpc/hpc-cluster-status-and-news<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fit.engine…> Rob Yelle HPC Manager

1 0

CoE HPC News, June 5 2023: Summer break maintenance
by Yelle, Robert Brian 22 Jun '23

22 Jun '23

HPCC users, Please check out the latest HPC cluster news regarding upcoming maintenance below. Summer break maintenance The cluster will undergo its regularly scheduled quarterly maintenance during Summer break, June 19-21. The following activities will be performed: Operating system updates Slurm upgrade and configuration changes BIOS and firmware updates as needed Nvidia/CUDA driver updates Infiniband updates The entire cluster will be offline starting Monday afternoon the 19th at 1pm, and until approximately Wednesday the 21st at 3pm. Jobs scheduled to run into this offline period will remain pending with the message “ReqNodeNotAvail, Reserved for maintenance”. If you wish for your Slurm job to start and finish before the offline period begins, you will need to adjust your time accordingly. For the latest cluster news and status updates, check out the link below: https://it.engineering.oregonstate.edu/hpc/hpc-cluster-status-and-news<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fit.engine…> Robert Yelle HPC Manager

1 2