English
Related papers

Related papers: LASSi: Metric based I/O analytics for HPC

200 papers

Information storage, reflecting the capability of a dynamical system to keep predictable information during its evolution over time, is a key element of intrinsic distributed computation, useful for the description of the dynamical…

MLModelCI provides multimedia researchers and developers with a one-stop platform for efficient machine learning (ML) services. The system leverages DevOps techniques to optimize, test, and manage models. It also containerizes and deploys…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-16 Huaizheng Zhang , Yuanming Li , Yizheng Huang , Yonggang Wen , Jianxiong Yin , Kyle Guan

This paper presents Recorder, a parallel I/O tracing tool designed to capture comprehensive I/O information on HPC applications. Recorder traces I/O calls across various I/O layers, storing all function parameters for each captured call.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-09 Chen Wang , Izzet Yildirim , Hariharan Devarajan , Kathryn Mohror , Marc Snir

The plethora of complex artificial intelligence (AI) algorithms and available high performance computing (HPC) power stimulates the expeditious development of AI components with heterogeneous designs. Consequently, the need for cross-stack…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-16 Zhixiang Ren , Yongheng Liu , Tianhui Shi , Lei Xie , Yue Zhou , Jidong Zhai , Youhui Zhang , Yunquan Zhang , Wenguang Chen

This paper addresses the problem of providing a novel approach to sourcing significant training data for LLMs focused on science and engineering. In particular, a crucial challenge is sourcing parallel scientific codes in the ranges of…

Software Engineering · Computer Science 2025-05-06 Matthew T. Dearing , Yiheng Tao , Xingfu Wu , Zhiling Lan , Valerie Taylor

Domain-specific SoCs (DSSoCs) are attractive solutions for domains with stringent power/performance/area constraints; however, they suffer from two fundamental complexities. On the one hand, their many specialized hardware blocks result in…

High-performance computing (HPC) systems and cloud data centers are converging, and containers are becoming the default method of portable software deployment. Yet, while containers simplify software management, they face significant…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-23 Marcin Copik , Eiman Alnuaimi , Alok Kamatar , Valerie Hayot-Sasson , Alberto Madonna , Todd Gamblin , Kyle Chard , Ian Foster , Torsten Hoefler

Accurate prediction of resource consumption and runtime for cloud workflow jobs is critical for scheduling efficiency, yet remains challenging due to the semi-structured nature of job configurations -- comprising shell commands,…

Machine Learning · Computer Science 2026-05-18 Yuxuan Yin , Shengke Zhou , Yunjie Zhang , Ajay Mohindra , Boxun Xu , Peng Li

A new class of Second generation high-performance computing applications with heterogeneous, dynamic and data-intensive properties have an extended set of requirements, which cover application deployment, resource allocation, -control, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-28 Ole Weidner , Malcolm Atkinson , Adam Barker , Rosa Filgueira

In the era of Cyber Physical Systems, designers need to offer support for run-time adaptivity considering different constraints, including the internal status of the system. This work presents a run-time monitoring approach, based on the…

Hardware Architecture · Computer Science 2021-03-02 Tiziana Fanni , Daniel Madronal , Claudio Rubattu , Carlo Sau , Francesca Palumbo , Eduardo Juarez , Maxime Pelcat , Cesar Sanz , Luigi Raffo

Profiling techniques are used extensively at different parts of the computing stack to achieve many goals. One major goal is to make a piece of software execute more efficiently on a specific hardware platform, where efficiency spans…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-07 Chris Quackenbush , Mohamed Zahran

A distributed application executing on a Network of Workstations (NOW) needs to be resource state aware to possibly adapt itself accordingly in order to keep satisfying the desired Quality of Service (QoS) demands throughout its lifespan.…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-07-31 Feras Al-Hawari , Elias Manolakos

Error-bounded lossy compression is becoming more and more important to today's extreme-scale HPC applications because of the ever-increasing volume of data generated because it has been widely used in in-situ visualization, data stream…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-24 Baodi Shan , Aabid Shamji , Jiannan Tian , Guanpeng Li , Dingwen Tao

Concerns regarding the scalability of the inter-domain routing have encouraged researchers to start elaborating a more robust Internet architecture. While consensus on the exact form of the solution is yet to be found, the need for a…

Networking and Internet Architecture · Computer Science 2013-12-09 Florin Coras , Jordi Domingo-Pascual , Darrel Lewis , Albert Cabellos-Aparicio

The IRIS-HEP Analysis Grand Challenge (AGC) is designed to be a realistic environment for investigating how analysis methods scale to the demands of the HL-LHC. The analysis task is based on publicly available Open Data and allows for…

High Energy Physics - Experiment · Physics 2023-04-12 Oksana Shadura , Alexander Held

FaaS offers significant advantages with its infrastructure abstraction, on-demand execution, and attractive no idle resource pricing for modern cloud applications. Despite these benefits, challenges such as startup latencies, static…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-11 Siddharth Agarwal , Maria A. Rodriguez , Rajkumar Buyya

Detecting performance issues and identifying their root causes in the runtime is a challenging task. Typically, developers use methods such as logging and tracing to identify bottlenecks. These solutions are, however, not ideal as they are…

Performance · Computer Science 2022-07-15 Sneh Patel , Brendan Park , Naser Ezzati-Jivan , Quentin Fournier

The rapid advancement of Artificial Intelligence (AI) has created unprecedented demands for computational power, yet methods for evaluating the performance, efficiency, and environmental impact of deployed models remain fragmented. Current…

Performance · Computer Science 2025-10-22 Hongyuan Liu , Xinyang Liu , Guosheng Hu

Dynamic resource management opens up numerous opportunities in High Performance Computing. It improves the system-level services as well as application performance. Checkpointing can also be deemed as a system-level service and can reap the…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-09 Jophin John , Michael Gerndt

Service meshes play a central role in the modern application ecosystem by providing an easy and flexible way to connect different services that form a distributed application. However, because of the way they interpose on application…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-05 Xiangfeng Zhu , Guozhen She , Bowen Xue , Yu Zhang , Yongsu Zhang , Xuan Kelvin Zou , Xiongchun Duan , Peng He , Arvind Krishnamurthy , Matthew Lentz , Danyang Zhuo , Ratul Mahajan