English
Related papers

Related papers: Efficient Training Approaches for Performance Anom…

200 papers

Many emerging AI applications request distributed machine learning (ML) among edge systems (e.g., IoT devices and PCs at the edge of the Internet), where data cannot be uploaded to a central venue for model training, due to their large…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-11-19 Hanpeng Hu , Dan Wang , Chuan Wu

It is usually infeasible to fit and train an entire large deep neural network (DNN) model using a single edge device due to the limited resources. To facilitate intelligent applications across edge devices, researchers have proposed…

Machine Learning · Computer Science 2023-11-13 Yuhao Chen , Yuxuan Yan , Qianqian Yang , Yuanchao Shu , Shibo He , Zhiguo Shi , Jiming Chen

Outdoor acoustic events detection is an exciting research field but challenged by the need for complex algorithms and deep learning techniques, typically requiring many computational, memory, and energy resources. This challenge discourages…

Audio and Speech Processing · Electrical Eng. & Systems 2020-01-30 Gianmarco Cerutti , Rahul Prasad , Alessio Brutti , Elisabetta Farella

The rapid scaling of Large Language Models (LLMs) has pushed training workloads far beyond the limits of single-node analysis, demanding a deeper understanding of how these models behave across large-scale, multi-GPU systems. In this paper,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-22 Seokjin Go , Joongun Park , Spandan More , Hanjiang Wu , Irene Wang , Aaron Jezghani , Tushar Krishna , Divya Mahajan

6G networks are envisioned to support on-demand AI model downloading to accommodate diverse inference requirements of end users. By proactively caching models at edge nodes, users can retrieve the requested models with low latency for…

Networking and Internet Architecture · Computer Science 2025-10-07 Yang Fu , Peng Qin , Yueyue Zhang , Pao Cheng , Jun Lu , Yifei Wang

Training an effective Machine learning (ML) model is an iterative process that requires effort in multiple dimensions. Vertically, a single pipeline typically includes an initial ETL (Extract, Transform, Load) of raw datasets, a model…

Machine Learning · Computer Science 2024-01-31 Dachi Chen , Weitian Ding , Chen Liang , Chang Xu , Junwei Zhang , Majd Sakr

The majority of IoT devices like smartwatches, smart plugs, HVAC controllers, etc., are powered by hardware with a constrained specification (low memory, clock speed and processor) which is insufficient to accommodate and execute large,…

Machine learning-based performance models are increasingly being used to build critical job scheduling and application optimization decisions. Traditionally, these models assume that data distribution does not change as more samples are…

Machine Learning · Computer Science 2023-10-27 Ray A. O. Sinurat , Anurag Daram , Haryadi S. Gunawi , Robert B. Ross , Sandeep Madireddy

Characterizing and predicting the training performance of modern machine learning (ML) workloads on compute systems with compute and communication spread between CPUs, GPUs, and network devices is not only the key to optimization and…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-27 Zhongyi Lin , Ning Sun , Pallab Bhattacharya , Xizhou Feng , Louis Feng , John D. Owens

Smart manufacturing systems are being deployed at a growing rate because of their ability to interpret a wide variety of sensed information and act on the knowledge gleaned from system observations. In many cases, the principal goal of the…

Machine Learning · Computer Science 2022-06-14 Mustafa Abdallah , Byung-Gun Joung , Wo Jae Lee , Charilaos Mousoulis , John W. Sutherland , Saurabh Bagchi

Clustered federated Multitask learning is introduced as an efficient technique when data is unbalanced and distributed amongst clients in a non-independent and identically distributed manner. While a similarity metric can provide client…

Networking and Internet Architecture · Computer Science 2023-05-02 Abdullatif Albaseer , Mohamed Abdallah , Ala Al-Fuqaha , Abegaz Mohammed , Aiman Erbad , Octavia A. Dobre

With the rapid expansion of the Internet of Things (IoT), sensors, smartphones, and wearables have become integral to daily life, powering smart applications in home automation, healthcare, and intelligent transportation. However, these…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-18 Habib Larian , Faramarz Safi-Esfahani

Resource-constrained edge deployments demand AI solutions that balance high performance with stringent compute, memory, and energy limitations. In this survey, we present a comprehensive overview of the primary strategies for accelerating…

Machine Learning · Computer Science 2025-01-30 Jacob Sander , Achraf Cohen , Venkat R. Dasari , Brent Venable , Brian Jalaian

The increasing deployment of low-cost industrial IoT (IIoT) sensor platforms on industrial assets enables great opportunities for anomaly classification in industrial plants. The performance of such a classification model depends highly on…

Machine Learning · Computer Science 2021-10-08 Jana Kemnitz , Thomas Bierweiler , Herbert Grieb , Stefan von Dosky , Daniel Schall

Edge machine learning involves the deployment of learning algorithms at the network edge to leverage massive distributed data and computation resources to train artificial intelligence (AI) models. Among others, the framework of federated…

Information Theory · Computer Science 2020-07-16 Qunsong Zeng , Yuqing Du , Kaibin Huang , Kin K. Leung

Future machine learning (ML) powered applications, such as autonomous driving and augmented reality, involve training and inference tasks with timeliness requirements and are communication and computation intensive, which demands for the…

Networking and Internet Architecture · Computer Science 2020-09-24 Yuxuan Sun , Wenqi Shi , Xiufeng Huang , Sheng Zhou , Zhisheng Niu

Estimating CPU power on heterogeneous ARM-based commodity devices is challenging due to limited access to CPU's voltage domains. As a result, state-of-the-art energy-aware Federated Learning (FL) frameworks typically rely on simplified…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-28 Chaimae Jallouli , Karim Boubouh , Robert Basmadjian

Continual learning (CL) on edge devices requires not only high accuracy but also training-time efficiency to support on-device adaptation under strict memory and computational constraints. While prompt-based continual learning (PCL) is…

Machine Learning · Computer Science 2026-04-10 Wonseon Lim , Jaesung Lee , Dae-Won Kim

The rapid proliferation of Internet of Medical Things (IoMT) devices in healthcare has introduced unique cybersecurity challenges, primarily due to the diverse communication protocols and critical nature of these devices This research aims…

Cryptography and Security · Computer Science 2025-02-18 Prathamesh Chandekar , Mansi Mehta , Swet Chandan

To effectively address the issues of low sensitivity and high time consumption in time series anomaly detection, we propose an anomaly detection method based on cross-modal deep metric learning. A cross-modal deep metric learning feature…

Machine Learning · Computer Science 2025-09-17 Wei Li , Zheze Yang