Nayeli
Gurrola

SURF,ANVIL Data Analytics: Instrument and perform analysis of scientific application workloads on the Anvil system

Abstract profile. Full document pending author claim.

Authors:

Nayeli Gurrola

Date Created:

Not specified

Course Title:
Professor:

Not specified

About Paper:

Effective collecting, management, and analysis of performance data on Purdue University's Anvil supercomputer is crucial for system administrators to gain valuable insights into software usage and performance metrics. XALT is an instrumental tool in capturing data related to software dependencies and execution on the Anvil system. In this project, we leveraged XALT alongside Python and web-based visualization frameworks to develop an interactive dashboard. The dashboard empowers system administrators to explore and analyze the Anvil software ecosystem, facilitating data-driven decision-making for optimizing system resources and enhancing user experiences. We extracted and transformed relevant data from XALT using SQL and Python, revealing valuable insights. These insights were presented interactively using Dash, a Python framework for building interactive web applications. By integrating XALT, SQL, Python, and Dash, our project enables system administrators to comprehensively understand software usage patterns and system utilization of the Anvil supercomputer. Our project showcases the potential of XALT and modern technologies in analyzing and visualizing performance data. It contributes to system administration, system optimization as well as better user support in high-performance computing (HPC) environments, specifically on Purdue University's Anvil supercomputer.

Source:

Purdue University / 2023

Topics:

No topics listed

Co-authors:

Nayeli Gurrola