cluster-users

Download

cluster-users@lists.engr.oregonstate.edu

February 2024

1 participants
2 discussions

FW: Free GenAI/LLM Virtual Workshop Series for Higher-Ed
by Yelle, Robert Brian 12 Feb '24

12 Feb '24

Cluster users, Please see announcement below regarding Free GenAI/LLM workshop series, which starts this Thursday the 15th: Free GenAI/LLM Virtual Workshop Series for Higher Ed (NALA)<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fevents.nv…> Join NVIDIA’s Deep Learning Institute (DLI) this February for a series of free, virtual instructor-led workshops providing hands-on experience with GPU-accelerated servers in the cloud to complete end-to-end projects in the areas of Generative AI and Large Language Models (LLMs). Each of these workshops are led by a DLI Certified Instructor and offer an opportunity to earn an industry-recognized certificate of competency based on assessments to support your career growth. This GenAI/LLM workshop series follows the larger DLI Learning Path for GenAI and LLMs<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fnvdam.wid…>. North America Workshops (taught in English): * Fundamentals of Deep Learning * February 15, 2024 @ 8:00 a.m.-4:00 p.m. PST * Generative AI With Diffusion Models * February 15, 2024 @ 8:00 a.m.-4:00 p.m. PST * Fundamentals of Deep Learning * February 16, 2024 @ 8:00 a.m.-4:00 p.m. PST * Generative AI With Diffusion Models * February 16, 2024 @ 8:00 a.m.-4:00 p.m. PST * Building Transformer Based Natural Language Processing Applications * February 22, 2024 @ 8:00 a.m.-4:00 p.m. PST * Building Conversational AI Applications * February 23, 2024 @ 8:00 a.m.-4:00 p.m. PST * Model Parallelism: Building and Deploying Large Neural Networks * February 28, 2024 @ 8:00 a.m.-4:00 p.m. PST * Data Parallelism: How to Train Deep Learning Models on Multiple GPUs * February 29, 2024 @ 8:00 a.m.-4:00 p.m. PST Rob Yelle HPC Manager

1 0

CoE HPC News, February 2 2024: Updates on EL8/EL9 migration, EL9 fixes, VSCode
by Yelle, Robert Brian 02 Feb '24

02 Feb '24

HPCC users, See below the latest news on the CoE HPC cluster. Busy queues The demand for resources, especially GPUs, has been very high lately, due to upcoming deadlines. This is resulting in much longer wait times than usual, so please be patient. If you have been waiting for over a day for your resources, let me know and leave your job in the queue as I may be able to work it in or at least determine what is holding it up. EL8/EL9 upgrades The cluster upgrade to EL8 and EL9 has been progressing slowly as various bugs are being worked through. Progress is expected to pick up the week of February 12, as submit nodes and more compute nodes from the “share”, “dgx2” and “dgxs” partition will be migrated. These partitions will not be migrated all at once, but each week one or more nodes from each partition will be upgraded until the migration is completed. At this point it is anticipated that the migration will be completed by the end of March. At present the DGX nodes “dgx2-4” and “dgxs-3” have been upgraded to EL9 with support for Cuda 12.2, and are now available through the dgx2 and dgxs partitions. Note that if you do not wish to land on an EL8 or EL9 node at this time, then you may request the “el7” feature, either through the HPC portal or by adding the “--constraint=el7” option to your srun or sbatch options. For those of you who would prefer to land on an EL9 node, for instance, because of updated dependencies and software support, or the availability of more recent versions of Cuda, then you may request the “el9” feature through the portal or use the “--constraint=el9” option in srun or sbatch. Please continue to report any issues that you encounter with the cluster as the upgrade progresses. Portal and ssh fixes on Nvidia DGX H100 and other EL9 systems The HPC portal and ssh are now working properly on the dgxh and other EL9 systems. The dgxh partition is currently available on the Advanced Desktop (Xfce desktop only!) and Jupyter Server apps. Note that with the Advanced Desktop on EL9 systems, you should disable the screen lock or you risk being locked out of your session and you’ll have to start over. To do this, click on “Applications” on the upper left hand corner, then select “Settings”, then “Xfce screensaver”, then the “Lock Screen” tab, and turn off the “Enable Lock Screen”. The dgxh partition will remain in testing phase until further notice while other issues are being addressed. VSCode issues Some users have recently reported a problem using VSCode on the HPC submit nodes. It appears that the latest version or update of VSCode no longer supports EL7, so you may not be able to run it on the submit nodes. The submit nodes will be upgraded to EL8 later this month through early March. Until then, my recommendation is to use an older version of VSCode if possible, or use the Flip servers until the submit nodes are upgraded. Springbreak Maintenance The next cluster maintenance is scheduled for Springbreak, March 25-29. If you have any questions or concerns, let me know. For up-to-date status on the cluster, check out the link below: https://it.engineering.oregonstate.edu/hpc/hpc-cluster-status-and-news<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fit.engine…> Have a nice weekend, Rob Yelle HPC Manager

1 0