English
Related papers

Related papers: I/O in Machine Learning Applications on HPC System…

200 papers

The next generation of particle physics experiments will face a new era of challenges in data acquisition, due to unprecedented data rates and volumes along with extreme environments and operational constraints. Harnessing this data for…

Instrumentation and Detectors · Physics 2026-03-12 Julia Gonski , Jenni Ott , Shiva Abbaszadeh , Sagar Addepalli , Matteo Cremonesi , Jennet Dickinson , Giuseppe Di Guglielmo , Erdem Yigit Ertorer , Lindsey Gray , Ryan Herbst , Christian Herwig , Tae Min Hong , Benedikt Maier , Maryam Bayat Makou , David Miller , Mark S. Neubauer , Cristián Peña , Dylan Rankin , Seon-Hee , Seo , Giordon Stark , Alexander Tapper , Audrey Corbeil Therrien , Ioannis Xiotidis , Keisuke Yoshihara , G Abarajithan , Sagar Addepalli , Nural Akchurin , Carlos Argüelles , Saptaparna Bhattacharya , Lorenzo Borella , Christian Boutan , Tom Braine , James Brau , Martin Breidenbach , Antonio Chahine , Talal Ahmed Chowdhury , Yuan-Tang Chou , Seokju Chung , Alberto Coppi , Mariarosaria D'Alfonso , Abhilasha Dave , Chance Desmet , Angela Di Fulvio , Karri DiPetrillo , Javier Duarte , Auralee Edelen , Jan Eysermans , Yongbin Feng , Emmett Forrestel , Dolores Garcia , Loredana Gastaldo , Julián García Pardiñas , Lino Gerlach , Loukas Gouskos , Katya Govorkova , Carl Grace , Christopher Grant , Philip Harris , Ciaran Hasnip , Timon Heim , Abraham Holtermann , Tae Min Hong , Gian Michele Innocenti , Koji Ishidoshiro , Miaochen Jin , Jyothisraj Johnson , Stephen Jones , Andreas Jung , Georgia Karagiorgi , Ryan Kastner , Nicholas Kamp , Doojin Kim , Kyoungchul Kong , Katie Kudela , Jelena Lalic , Bo-Cheng Lai , Yun-Tsung Lai , Tommy Lam , Jeffrey Lazar , Aobo Li , Zepeng Li , Haoyun Liu , Vladimir Lončar , Luca Macchiarulo , Christopher Madrid , Benedikt Maier , Zhenghua Ma , Prashansa Mukim , Mark S. Neubauer , Victoria Nguyen , Sungbin Oh , Isobel Ojalvo , Hideyoshi Ozaki , Simone Pagan Griso , Myeonghun Park , Christoph Paus , Santosh Parajuli , Benjamin Parpillon , Sara Pozzi , Ema Puljak , Benjamin Ramhorst , Amy Roberts , Larry Ruckman , Kate Scholberg , Sebastian Schmitt , Noah Singer , Eluned Anne Smith , Alexandre Sousa , Michael Spannowsky , Sioni Summers , Yanwen Sun , Daniel Tapia Takaki , Antonino Tumeo , Caterina Vernieri , Belina von Krosigk , Yash Vora , Linyan Wan , Michael H. L. S. Wang , Amanda Weinstein , Andy White , Simon Williams , Felix Yu

In this community review report, we discuss applications and techniques for fast machine learning (ML) in science -- the concept of integrating power ML methods into the real-time experimental data processing loop to accelerate scientific…

Machine Learning · Computer Science 2023-02-07 Allison McCarn Deiana , Nhan Tran , Joshua Agar , Michaela Blott , Giuseppe Di Guglielmo , Javier Duarte , Philip Harris , Scott Hauck , Mia Liu , Mark S. Neubauer , Jennifer Ngadiuba , Seda Ogrenci-Memik , Maurizio Pierini , Thea Aarrestad , Steffen Bahr , Jurgen Becker , Anne-Sophie Berthold , Richard J. Bonventre , Tomas E. Muller Bravo , Markus Diefenthaler , Zhen Dong , Nick Fritzsche , Amir Gholami , Ekaterina Govorkova , Kyle J Hazelwood , Christian Herwig , Babar Khan , Sehoon Kim , Thomas Klijnsma , Yaling Liu , Kin Ho Lo , Tri Nguyen , Gianantonio Pezzullo , Seyedramin Rasoulinezhad , Ryan A. Rivera , Kate Scholberg , Justin Selig , Sougata Sen , Dmitri Strukov , William Tang , Savannah Thais , Kai Lukas Unger , Ricardo Vilalta , Belinavon Krosigk , Thomas K. Warburton , Maria Acosta Flechas , Anthony Aportela , Thomas Calvet , Leonardo Cristella , Daniel Diaz , Caterina Doglioni , Maria Domenica Galati , Elham E Khoda , Farah Fahim , Davide Giri , Benjamin Hawks , Duc Hoang , Burt Holzman , Shih-Chieh Hsu , Sergo Jindariani , Iris Johnson , Raghav Kansal , Ryan Kastner , Erik Katsavounidis , Jeffrey Krupa , Pan Li , Sandeep Madireddy , Ethan Marx , Patrick McCormack , Andres Meza , Jovan Mitrevski , Mohammed Attia Mohammed , Farouk Mokhtar , Eric Moreno , Srishti Nagu , Rohin Narayan , Noah Palladino , Zhiqiang Que , Sang Eon Park , Subramanian Ramamoorthy , Dylan Rankin , Simon Rothman , Ashish Sharma , Sioni Summers , Pietro Vischia , Jean-Roch Vlimant , Olivia Weng

In the past decade, Artificial Intelligence (AI) has become a part of our daily lives due to major advances in Machine Learning (ML) techniques. In spite of an explosive growth in the raw AI technology and in consumer facing applications on…

Software Engineering · Computer Science 2020-06-18 P. Santhanam

Understanding cluster-wide I/O patterns of large-scale HPC clusters is essential to minimize the occurrence and impact of I/O interference. Yet, most previous work in this area focused on monitoring and predicting task and node-level I/O…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-22 Ehsan Saeedizade , Roya Taheri , Engin Arslan

Characterizing and predicting the training performance of modern machine learning (ML) workloads on compute systems with compute and communication spread between CPUs, GPUs, and network devices is not only the key to optimization and…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-27 Zhongyi Lin , Ning Sun , Pallab Bhattacharya , Xizhou Feng , Louis Feng , John D. Owens

Cloud computing has rapidly emerged as model for delivering Internet-based utility computing services. In cloud computing, Infrastructure as a Service (IaaS) is one of the most important and rapidly growing fields. Cloud providers provide…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-12 Tahseen Khan , Wenhong Tian , Rajkumar Buyya

New machine learning accelerators are being announced and released each month for a variety of applications from speech recognition, video object detection, assisted driving, and many data center applications. This paper updates the survey…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-18 Albert Reuther , Peter Michaleas , Michael Jones , Vijay Gadepally , Siddharth Samsi , Jeremy Kepner

The emergence of new services and applications in emerging wireless networks (e.g., beyond 5G and 6G) has shown a growing demand for the usage of artificial intelligence (AI) in the Internet of Things (IoT). However, the proliferation of…

Networking and Internet Architecture · Computer Science 2023-10-17 Mai Le , Thien Huynh-The , Tan Do-Duy , Thai-Hoc Vu , Won-Joo Hwang , Quoc-Viet Pham

Over the last decade, the long-running endeavour to automate high-level processes in machine learning (ML) has risen to mainstream prominence, stimulated by advances in optimisation techniques and their impact on selecting ML…

Machine Learning · Computer Science 2022-03-30 David Jacob Kedziora , Katarzyna Musial , Bogdan Gabrys

Machine learning is playing an increasingly significant role in emerging mobile application domains such as AR/VR, ADAS, etc. Accordingly, hardware architects have designed customized hardware for machine learning algorithms, especially…

Machine Learning · Computer Science 2018-02-05 Yuhao Zhu , Matthew Mattina , Paul Whatmough

Over the Eight decades, computing paradigms have shifted from large, centralized systems to compact, distributed architectures, leading to the rise of the Distributed Computing Continuum (DCC). In this model, multiple layers such as cloud,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-10 Praveen Kumar Donta , Qiyang Zhang , Schahram Dustdar

The increasing deployment of advanced digital technologies such as Internet of Things (IoT) devices and Cyber-Physical Systems (CPS) in industrial environments is enabling the productive use of machine learning (ML) algorithms in the…

Machine Learning · Computer Science 2021-12-21 Nicolas Jourdan , Sagar Sen , Erik Johannes Husom , Enrique Garcia-Ceja , Tobias Biegel , Joachim Metternich

Machine learning (ML) provides algorithms to create computer programs based on data without explicitly programming them. In business process management (BPM), ML applications are used to analyse and improve processes efficiently. Three…

Machine Learning · Computer Science 2024-05-28 Sven Weinzierl , Sandra Zilker , Sebastian Dunzer , Martin Matzner

A new class of Second generation high-performance computing applications with heterogeneous, dynamic and data-intensive properties have an extended set of requirements, which cover application deployment, resource allocation, -control, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-28 Ole Weidner , Malcolm Atkinson , Adam Barker , Rosa Filgueira

In the past couple of decades, the computational abilities of supercomput- ers have increased tremendously. Leadership scale supercomputers now are capable of petaflops. Likewise, the problem size targeted by applications running on such…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-09-06 Robert Louis Cloud

Proper Production Planning and Control (PPC) is capital to have an edge over competitors, reduce costs and respect delivery dates. With regard to PPC, Machine Learning (ML) provides new opportunities to make intelligent decisions based on…

Machine Learning · Computer Science 2021-06-25 Juan Pablo Usuga Cadavid , Samir Lamouri , Bernard Grabot , Arnaud Fortin

The purpose of this study is to investigate the development process for Artificial inelegance (AI) and machine learning (ML) applications in order to provide the best support environment. The main stages of ML are problem understanding,…

Software Engineering · Computer Science 2023-08-16 Taha Khamis , Hamam Mokayed

Training deep learning (DL) models on petascale datasets is essential for achieving competitive and state-of-the-art performance in applications such as speech, video analytics, and object recognition. However, existing distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-08 Alex Aizman , Gavin Maltby , Thomas Breuel

Nowadays, intelligent systems and services are getting increasingly popular as they provide data-driven solutions to diverse real-world problems, thanks to recent breakthroughs in Artificial Intelligence (AI) and Machine Learning (ML).…

Software Engineering · Computer Science 2022-01-03 Md Saidur Rahman , Foutse Khomh , Alaleh Hamidi , Jinghui Cheng , Giuliano Antoniol , Hironori Washizaki