English
Related papers

Related papers: I/O in Machine Learning Applications on HPC System…

200 papers

Development of machine learning (ML) workflows is a tedious process of iterative experimentation: developers repeatedly make changes to workflows until the desired accuracy is attained. We describe our vision for a "human-in-the-loop" ML…

Databases · Computer Science 2018-04-18 Doris Xin , Litian Ma , Jialin Liu , Stephen Macke , Shuchen Song , Aditya Parameswaran

Data processing frameworks such as Apache Beam and Apache Spark are used for a wide range of applications, from logs analysis to data preparation for DNN training. It is thus unsurprising that there has been a large amount of work on…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-07 Ubaid Ullah Hafeez , Martin Maas , Mustafa Uysal , Richard McDougall

The realization that AI-driven decision-making is indispensable in today's fast-paced and ultra-competitive marketplace has raised interest in industrial machine learning (ML) applications significantly. The current demand for analytics…

Machine Learning · Computer Science 2025-06-03 Marc Schmitt

Cloud workloads today are typically managed in a distributed environment and processed across geographically distributed data centers. Cloud service providers have been distributing data centers globally to reduce operating costs while also…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-18 Ninad Hogade , Sudeep Pasricha

Future 6G networks are expected to heavily utilize machine learning capabilities in a wide variety of applications with features and benefits for both, the end user and the provider. While the options for utilizing these technologies are…

Networking and Internet Architecture · Computer Science 2024-07-02 Marc Michalke , Chukwuemeka Muonagor , Admela Jukan

Current trends point to a future where large-scale scientific applications are tightly-coupled HPC/AI hybrids. Hence, we urgently need to invest in creating a seamless, scalable framework where HPC and AI/ML can efficiently work together…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-06 Jens Domke , Mohamed Wahib , Anshu Dubey , Tal Ben-Nun , Erik W. Draeger

The advancements in machine learning opened a new opportunity to bring intelligence to the low-end Internet-of-Things nodes such as microcontrollers. Conventional machine learning deployment has high memory and compute footprint hindering…

Machine Learning · Computer Science 2022-12-22 Swapnil Sayan Saha , Sandeep Singh Sandha , Mani Srivastava

Machine learning (ML) techniques are increasingly prevalent in education, from their use in predicting student dropout, to assisting in university admissions, and facilitating the rise of MOOCs. Given the rapid growth of these novel uses,…

Artificial Intelligence · Computer Science 2022-09-09 Lydia T. Liu , Serena Wang , Tolani Britton , Rediet Abebe

Modern Artificial Intelligence (AI) technologies, led by Machine Learning (ML), have gained unprecedented momentum over the past decade. Following this wave of "AI summer", the network research community has also embraced AI/ML algorithms…

Networking and Internet Architecture · Computer Science 2024-10-28 Qiong Liu , Tianzhu Zhang , Masoud Hemmatpour , Han Qiu , Dong Zhang , Chung Shue Chen , Marco Mellia , Armen Aghasaryan

Resource-aware machine learning has been a trending topic in recent years, focusing on making ML computational aspects more exploitable by the edge devices in the Internet of Things. This paper attempts to review a conceptually and…

Machine Learning · Computer Science 2021-11-02 Vahid Mohammadi Safarzadeh , Hamed Ghasr Loghmani

Artificial intelligence (AI) and machine learning (ML) techniques have been increasingly used in several fields to improve performance and the level of automation. In recent years, this use has exponentially increased due to the advancement…

Edge computing has gained significant traction in recent years, promising enhanced efficiency by integrating artificial intelligence capabilities at the edge. While the focus has primarily been on the deployment and inference of Machine…

Machine Learning · Computer Science 2024-10-14 Aymen Rayane Khouas , Mohamed Reda Bouadjenek , Hakim Hacid , Sunil Aryal

As Machine Learning (ML) applications increase in data size and model complexity, practitioners turn to distributed clusters to satisfy the increased computational and memory demands. Unfortunately, effective use of clusters for ML requires…

Machine Learning · Computer Science 2014-10-31 Wei Dai , Abhimanu Kumar , Jinliang Wei , Qirong Ho , Garth Gibson , Eric P. Xing

In this big data era, the use of large dataset in conjunction with machine learning (ML) has been increasingly popular in both industry and academia. In recent times, the field of materials science is also undergoing a big data revolution,…

Materials Science · Physics 2023-09-27 Sue Sin Chong , Yi Sheng Ng , Hui-Qiong Wang , Jin-Cheng Zheng

The breakthrough in Deep Learning neural networks has transformed the use of AI and machine learning technologies for the analysis of very large experimental datasets. These datasets are typically generated by large-scale experimental…

Machine Learning · Computer Science 2021-10-26 Jeyan Thiyagalingam , Mallikarjun Shankar , Geoffrey Fox , Tony Hey

Machine learning (ML) has seen a significant surge and uptake across many diverse applications. The high flexibility, adaptability and computing capabilities it provides extends traditional approaches used in multiple fields including…

Networking and Internet Architecture · Computer Science 2020-10-23 Huiling Jiang , Qing Li , Yong Jiang , Gengbiao Shen , Richard Sinnott , Chen Tian , Mingwei Xu

Machine learning (ML) has become an integral component of high energy physics data analyses and is likely to continue to grow in prevalence. Physicists are incorporating ML into many aspects of analysis, from using boosted decision trees to…

High Energy Physics - Experiment · Physics 2024-01-04 Elliott Kauffman , Alexander Held , Oksana Shadura

The computational power of High-Performance Computing (HPC) systems is constantly increasing, however, their input/output (IO) performance grows relatively slowly, and their storage capacity is also limited. This unbalance presents…

Modern large-scale physics experiments create datasets with sizes and streaming rates that can exceed those from industry leaders such as Google Cloud and Netflix. Fully processing these datasets requires both sufficient compute power and…

Hyperparameters in machine learning (ML) have received a fair amount of attention, and hyperparameter tuning has come to be regarded as an important step in the ML pipeline. But just how useful is said tuning? While smaller-scale…

Machine Learning · Computer Science 2022-09-05 Moshe Sipper
‹ Prev 1 4 5 6 7 8 10 Next ›