中文
相关论文

相关论文: I/O in Machine Learning Applications on HPC System…

200 篇论文

Development of machine learning (ML) workflows is a tedious process of iterative experimentation: developers repeatedly make changes to workflows until the desired accuracy is attained. We describe our vision for a "human-in-the-loop" ML…

数据库 · 计算机科学 2018-04-18 Doris Xin , Litian Ma , Jialin Liu , Stephen Macke , Shuchen Song , Aditya Parameswaran

Data processing frameworks such as Apache Beam and Apache Spark are used for a wide range of applications, from logs analysis to data preparation for DNN training. It is thus unsurprising that there has been a large amount of work on…

分布式、并行与集群计算 · 计算机科学 2022-11-07 Ubaid Ullah Hafeez , Martin Maas , Mustafa Uysal , Richard McDougall

The realization that AI-driven decision-making is indispensable in today's fast-paced and ultra-competitive marketplace has raised interest in industrial machine learning (ML) applications significantly. The current demand for analytics…

机器学习 · 计算机科学 2025-06-03 Marc Schmitt

Cloud workloads today are typically managed in a distributed environment and processed across geographically distributed data centers. Cloud service providers have been distributing data centers globally to reduce operating costs while also…

分布式、并行与集群计算 · 计算机科学 2022-05-18 Ninad Hogade , Sudeep Pasricha

Future 6G networks are expected to heavily utilize machine learning capabilities in a wide variety of applications with features and benefits for both, the end user and the provider. While the options for utilizing these technologies are…

网络与互联网体系结构 · 计算机科学 2024-07-02 Marc Michalke , Chukwuemeka Muonagor , Admela Jukan

Current trends point to a future where large-scale scientific applications are tightly-coupled HPC/AI hybrids. Hence, we urgently need to invest in creating a seamless, scalable framework where HPC and AI/ML can efficiently work together…

分布式、并行与集群计算 · 计算机科学 2025-05-06 Jens Domke , Mohamed Wahib , Anshu Dubey , Tal Ben-Nun , Erik W. Draeger

The advancements in machine learning opened a new opportunity to bring intelligence to the low-end Internet-of-Things nodes such as microcontrollers. Conventional machine learning deployment has high memory and compute footprint hindering…

机器学习 · 计算机科学 2022-12-22 Swapnil Sayan Saha , Sandeep Singh Sandha , Mani Srivastava

Machine learning (ML) techniques are increasingly prevalent in education, from their use in predicting student dropout, to assisting in university admissions, and facilitating the rise of MOOCs. Given the rapid growth of these novel uses,…

人工智能 · 计算机科学 2022-09-09 Lydia T. Liu , Serena Wang , Tolani Britton , Rediet Abebe

Modern Artificial Intelligence (AI) technologies, led by Machine Learning (ML), have gained unprecedented momentum over the past decade. Following this wave of "AI summer", the network research community has also embraced AI/ML algorithms…

网络与互联网体系结构 · 计算机科学 2024-10-28 Qiong Liu , Tianzhu Zhang , Masoud Hemmatpour , Han Qiu , Dong Zhang , Chung Shue Chen , Marco Mellia , Armen Aghasaryan

Resource-aware machine learning has been a trending topic in recent years, focusing on making ML computational aspects more exploitable by the edge devices in the Internet of Things. This paper attempts to review a conceptually and…

机器学习 · 计算机科学 2021-11-02 Vahid Mohammadi Safarzadeh , Hamed Ghasr Loghmani

Artificial intelligence (AI) and machine learning (ML) techniques have been increasingly used in several fields to improve performance and the level of automation. In recent years, this use has exponentially increased due to the advancement…

Edge computing has gained significant traction in recent years, promising enhanced efficiency by integrating artificial intelligence capabilities at the edge. While the focus has primarily been on the deployment and inference of Machine…

机器学习 · 计算机科学 2024-10-14 Aymen Rayane Khouas , Mohamed Reda Bouadjenek , Hakim Hacid , Sunil Aryal

As Machine Learning (ML) applications increase in data size and model complexity, practitioners turn to distributed clusters to satisfy the increased computational and memory demands. Unfortunately, effective use of clusters for ML requires…

机器学习 · 计算机科学 2014-10-31 Wei Dai , Abhimanu Kumar , Jinliang Wei , Qirong Ho , Garth Gibson , Eric P. Xing

In this big data era, the use of large dataset in conjunction with machine learning (ML) has been increasingly popular in both industry and academia. In recent times, the field of materials science is also undergoing a big data revolution,…

材料科学 · 物理学 2023-09-27 Sue Sin Chong , Yi Sheng Ng , Hui-Qiong Wang , Jin-Cheng Zheng

The breakthrough in Deep Learning neural networks has transformed the use of AI and machine learning technologies for the analysis of very large experimental datasets. These datasets are typically generated by large-scale experimental…

机器学习 · 计算机科学 2021-10-26 Jeyan Thiyagalingam , Mallikarjun Shankar , Geoffrey Fox , Tony Hey

Machine learning (ML) has seen a significant surge and uptake across many diverse applications. The high flexibility, adaptability and computing capabilities it provides extends traditional approaches used in multiple fields including…

网络与互联网体系结构 · 计算机科学 2020-10-23 Huiling Jiang , Qing Li , Yong Jiang , Gengbiao Shen , Richard Sinnott , Chen Tian , Mingwei Xu

Machine learning (ML) has become an integral component of high energy physics data analyses and is likely to continue to grow in prevalence. Physicists are incorporating ML into many aspects of analysis, from using boosted decision trees to…

高能物理 - 实验 · 物理学 2024-01-04 Elliott Kauffman , Alexander Held , Oksana Shadura

The computational power of High-Performance Computing (HPC) systems is constantly increasing, however, their input/output (IO) performance grows relatively slowly, and their storage capacity is also limited. This unbalance presents…

Modern large-scale physics experiments create datasets with sizes and streaming rates that can exceed those from industry leaders such as Google Cloud and Netflix. Fully processing these datasets requires both sufficient compute power and…

Hyperparameters in machine learning (ML) have received a fair amount of attention, and hyperparameter tuning has come to be regarded as an important step in the ML pipeline. But just how useful is said tuning? While smaller-scale…

机器学习 · 计算机科学 2022-09-05 Moshe Sipper