Jeffrey
Winters
Anvil REU Automating Research Software Deployment - PLENUM Pipeline Mathematical/Computation Sciences
Abstract profile. Full document pending author claim.
Authors:
Jeffrey Winters
Date Created:
Not specified
Course Title:
Professor:
Not specified
About Paper:
Much of modern research requires HPC resources to facilitate the use of complex scientific software, however the installation of this software is often cumbersome and tedious. Additionally, the baseline technical skillset required to use tools intended to install such software places elevated demands on researchers. The PLENUM (Purdue Local ENvironment User Modules) Pipeline allows for the remediation of this. The intention is to provide a software toolset that removes technical barriers, automates software setup tedium, accommodates software installation repeatability, and is modular enough to be used at any institution. Technologies utilized include Spack, Jenkins, PostgreSQL, Kubernetes, Charm.sh TUI (terminal user interface) Golang libraries. To access PLENUM, users may SSH into a frontend node or log into a web-based cluster portal, such as Open OnDemand. After invoking PLENUM, users enter the parameters needed for each software they would like installed. Once each set of parameters has been finalized, the parameters are sent to Jenkins to automate the Spack installations. The user receives live feedback on the progress of each build in addition to the ability to view the full Spack spec for their builds. Once the installations are completed, they are added to their local system modules to be loaded whenever necessary. Keywords: HPC; Automation; CI/CD; Spack; Software Deployment
Source:
Purdue University / 2024
Topics:
No topics listed
Co-authors:
Jeffrey Winters