English
Related papers

Related papers: I/O in Machine Learning Applications on HPC System…

200 papers

Detection of easily missed hidden patterns with fast processing power makes machine learning (ML) indispensable to today's healthcare system. Though many ML applications have already been discovered and many are still under investigation,…

Machine Learning · Computer Science 2023-07-27 Mrinmoy Roy , Sarwar J. Minar , Porarthi Dhar , A T M Omor Faruq

The increasing capabilities of Machine Learning (ML) models go hand in hand with an immense amount of data and computational power required for training. Therefore, training is usually outsourced into HPC facilities, where we have started…

Machine Learning · Computer Science 2025-01-28 Sabrina Herbst , Vincenzo De Maio , Ivona Brandic

Artificial Intelligence (AI) and Machine Learning (ML) are weaving their way into the fabric of society, where they are playing a crucial role in numerous facets of our lives. As we witness the increased deployment of AI and ML in various…

Emerging Technologies · Computer Science 2022-12-23 Sasitharan Balasubramaniam , Samitha Somathilaka , Sehee Sun , Adrian Ratwatte , Massimiliano Pierobon

We examine the computational energy requirements of different systems driven by the geometrical scaling law, and increasing use of Artificial Intelligence or Machine Learning (AI-ML) over the last decade. With more scientific and technology…

Hardware Architecture · Computer Science 2022-11-30 Sadasivan Shankar , Albert Reuther

AI accelerator processing capabilities and memory constraints largely dictate the scale in which machine learning workloads (e.g., training and inference) can be executed within a desirable time frame. Training a state of the art,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-12 Michael Benington , Leo Phan , Chris Pierre Paul , Evan Shoemaker , Priyanka Ranade , Torstein Collett , Grant Hodgson Perez , Christopher Krieger

Traditional simulations on High-Performance Computing (HPC) systems typically involve modeling very large domains and/or very complex equations. HPC systems allow running large models, but limits in performance increase that have become…

HPC datacenters offer a backbone to the modern digital society. Increasingly, they run Machine Learning (ML) jobs next to generic, compute-intensive workloads, supporting science, business, and other decision-making processes. However,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-16 Xiaoyu Chu , Daniel Hofstätter , Shashikant Ilager , Sacheendra Talluri , Duncan Kampert , Damian Podareanu , Dmitry Duplyakin , Ivona Brandic , Alexandru Iosup

Artificial intelligence (AI) and Machine learning (ML) workloads are an increasingly larger share of the compute workloads in traditional High-Performance Computing (HPC) centers and commercial cloud systems. This has led to changes in…

Heterogeneous hardware and dynamic workloads worsen long-standing OS bottlenecks in scalability, adaptability, and manageability. At the same time, advances in machine learning (ML), large language models (LLMs), and agent-based methods…

Operating Systems · Computer Science 2025-11-12 Yifan Zhang , Xinkui Zhao , Ziying Li , Guanjie Cheng , Jianwei Yin , Lufei Zhang , Zuoning Chen

Machine learning (ML) is a rapidly evolving technology with expanding applications across various fields. This paper presents a comprehensive survey of recent ML applications in agriculture for sustainability and efficiency. Existing…

Machine Learning · Computer Science 2025-03-19 Aashu Katharria , Kanchan Rajwar , Millie Pant , Juan D. Velásquez , Václav Snášel , Kusum Deep

Machine learning (ML) technologies are emerging in the Internet of Things (IoT) to provision intelligent services. This survey moves beyond existing ML algorithms and cloud-driven design to investigate the less-explored systems, scaling and…

Computers and Society · Computer Science 2020-12-02 Wiebke Toussaint , Aaron Yi Ding

AI integration is revolutionizing the landscape of HPC simulations, enhancing the importance, use, and performance of AI-driven HPC workflows. This paper surveys the diverse and rapidly evolving field of AI-driven HPC and provides a common…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-26 Wes Brewer , Ana Gainaru , Frédéric Suter , Feiyi Wang , Murali Emani , Shantenu Jha

Machine Learning (ML) has become a fast-growing, trending approach in solution development in practice. Deep Learning (DL) which is a subset of ML, learns using deep neural networks to simulate the human brain. It trains machines to learn…

Software Engineering · Computer Science 2022-02-23 Nipuni Hewage , Dulani Meedeniya

Purpose- The significance of business processes has fostered a close collaboration between academia and industry. Moreover, the business landscape has witnessed continuous transformation, closely intertwined with technological advancements.…

It has been a long time that computer architecture and systems are optimized for efficient execution of machine learning (ML) models. Now, it is time to reconsider the relationship between ML and systems, and let ML transform the way that…

Machine Learning · Computer Science 2022-02-25 Nan Wu , Yuan Xie

Machine learning (ML) is a rapidly growing area of research in the field of particle physics, with a vast array of applications at the CERN LHC. ML has changed the way particle physicists conduct searches and measurements as a versatile…

High Energy Physics - Experiment · Physics 2024-10-01 Javier M. Duarte

An evident challenge ahead for the integrated circuit (IC) industry in the nanometer regime is the investigation and development of methods that can reduce the design complexity ensuing from growing process variations and curtail the…

Machine Learning · Computer Science 2023-02-16 Deepthi Amuru , Harsha V. Vudumula , Pavan K. Cherupally , Sushanth R. Gurram , Amir Ahmad , Andleeb Zahra , Zia Abbas

Machine learning and AI have been recently embraced by many companies. Machine Learning Operations, (MLOps), refers to the use of continuous software engineering processes, such as DevOps, in the deployment of machine learning models to…

Software Engineering · Computer Science 2024-10-01 Abhijit Chakraborty , Suddhasvatta Das , Kevin Gary

With the ever-growing need of data in HPC applications, the congestion at the I/O level becomes critical in super-computers. Architectural enhancement such as burst-buffers and pre-fetching are added to machines, but are not sufficient to…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-23 Guillaume Aupy , Ana Gainaru , Valentin Le Fèvre

The emergence and continued reliance on the Internet and related technologies has resulted in the generation of large amounts of data that can be made available for analyses. However, humans do not possess the cognitive capabilities to…

Machine Learning · Computer Science 2021-01-12 MohammadNoor Injadat , Abdallah Moubayed , Ali Bou Nassif , Abdallah Shami