English
Related papers

Related papers: SCoTTi: Save Computation at Training Time with an …

200 papers

The ubiquity of vision transformers (ViTs) for various edge applications, including personalized learning, has created the demand for on-device fine-tuning. However, training with the limited memory and computation power of edge devices…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Sreetama Sarkar , Souvik Kundu , Kai Zheng , Peter A. Beerel

Data collected by IoT devices are often private and have a large diversity across users. Therefore, learning requires pre-training a model with available representative data samples, deploying the pre-trained model on IoT devices, and…

Machine Learning · Computer Science 2022-06-28 Zhongnan Qu , Zimu Zhou , Yongxin Tong , Lothar Thiele

Resource-constrained IoT devices, such as sensors and actuators, have become ubiquitous in recent years. This has led to the generation of large quantities of data in real-time, which is an appealing target for AI systems. However,…

Machine Learning · Computer Science 2021-10-07 M. G. Sarwar Murshed , Christopher Murphy , Daqing Hou , Nazar Khan , Ganesh Ananthanarayanan , Faraz Hussain

Learn in-situ is a growing trend for Edge AI. Training deep neural network (DNN) on edge devices is challenging because both energy and memory are constrained. Low precision training helps to reduce the energy cost of a single training…

Machine Learning · Computer Science 2020-12-24 Tian Huang , Tao Luo , Joey Tianyi Zhou

While there are many advantages to deploying machine learning models on edge devices, the resource constraints of mobile platforms, the dynamic nature of the environment, and differences between the distribution of training versus…

Machine Learning · Computer Science 2025-03-21 Cynthia Dong , Hong Jia , Young D. Kwon , Georgios Rizos , Cecilia Mascolo

It is usually infeasible to fit and train an entire large deep neural network (DNN) model using a single edge device due to the limited resources. To facilitate intelligent applications across edge devices, researchers have proposed…

Machine Learning · Computer Science 2023-11-13 Yuhao Chen , Yuxuan Yan , Qianqian Yang , Yuanchao Shu , Shibo He , Zhiguo Shi , Jiming Chen

Microservice architectures are increasingly used to modularize IoT applications and deploy them in distributed and heterogeneous edge computing environments. Over time, these microservice-based IoT applications are susceptible to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-26 Duneesha Fernando , Maria A. Rodriguez , Patricia Arroba , Leila Ismail , Rajkumar Buyya

Edge learning facilitates ubiquitous intelligence by enabling model training and adaptation directly on data-generating devices, thereby mitigating privacy risks and communication latency. However, the high computational and energy overhead…

Machine Learning · Computer Science 2026-02-03 Laha Ale , Hu Luo , Mingsheng Cao , Shichao Li , Huanlai Xing , Haifeng Sun

Real-world deployment often exposes models to distribution shifts, making test-time adaptation (TTA) critical for robustness. Yet most TTA methods are unfriendly to edge deployment, as they rely on backpropagation, activation buffering, or…

Machine Learning · Computer Science 2026-05-08 Xinyu Luo , Jie Liu , Kecheng Chen , Junyi Yang , Bo Ding , Arindam Basu , Haoliang Li

Owing to the large volume of sensed data from the enormous number of IoT devices in operation today, centralized machine learning algorithms operating on such data incur an unbearable training time, and thus cannot satisfy the requirements…

Signal Processing · Electrical Eng. & Systems 2020-07-21 Shashank Jere , Qiang Fan , Bodong Shang , Lianjun Li , Lingjia Liu

Many IoT applications at the network edge demand intelligent decisions in a real-time manner. The edge device alone, however, often cannot achieve real-time edge intelligence due to its constrained computing resources and limited local…

Machine Learning · Computer Science 2020-05-12 Sen Lin , Guang Yang , Junshan Zhang

Low-Latency IoT applications such as autonomous vehicles, augmented/virtual reality devices and security applications require high computation resources to make decisions on the fly. However, these kinds of applications cannot tolerate…

Networking and Internet Architecture · Computer Science 2022-01-31 Amine Abouaomar , Soumaya Cherkaoui , Zoubeir Mlika , Abdellatif Kobbane

The heterogeneity of the Internet-of-things (IoT) network can be exploited as a dynamic computational resource environment for many devices lacking computational capabilities. A smart mechanism for allocating edge and mobile computers to…

Social and Information Networks · Computer Science 2020-07-09 Abdullah Khanfor , Raby Hamadi , Hakim Ghazzai , Ye Yang , Mohammad R. Haider , Yehia Massoud

Currently, it is a hot research topic to realize accurate, efficient, and real-time identification of massive spectral data with the help of deep learning and IoT technology. Deep neural networks played a key role in spectral analysis.…

Machine Learning · Computer Science 2022-06-28 Yundong Sun , Dongjie Zhu , Haiwen Du , Yansong Wang , Zhaoshuo Tian

We consider a network of smart sensors for an edge computing application that sample a time-varying signal and send updates to a base station for remote global monitoring. Sensors are equipped with sensing and compute, and can either send…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-11 Luca Ballotta , Giovanni Peserico , Francesco Zanini , Paolo Dini

Matrix computations are a fundamental building-block of edge computing systems, with a major recent uptick in demand due to their use in AI/ML training and inference procedures. Existing approaches for distributing matrix computations…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-12 Anindya Bijoy Das , Aditya Ramamoorthy , David J. Love , Christopher G. Brinton

Onboard learning is a transformative approach in edge AI, enabling real-time data processing, decision-making, and adaptive model training directly on resource-constrained devices without relying on centralized servers. This paradigm is…

Machine Learning · Computer Science 2026-01-22 Monirul Islam Pavel , Siyi Hu , Mahardhika Pratama , Ryszard Kowalczyk

A practical issue of edge AI systems is that data distributions of trained dataset and deployed environment may differ due to noise and environmental changes over time. Such a phenomenon is known as a concept drift, and this gap degrades…

Machine Learning · Computer Science 2023-01-31 Takeya Yamada , Hiroki Matsutani

In this work, we investigate the challenging problem of on-demand federated learning (FL) over heterogeneous edge devices with diverse resource constraints. We propose a cost-adjustable FL framework, named AnycostFL, that enables diverse…

Machine Learning · Computer Science 2023-10-31 Peichun Li , Guoliang Cheng , Xumin Huang , Jiawen Kang , Rong Yu , Yuan Wu , Miao Pan

Emerging technologies and applications including Internet of Things (IoT), social networking, and crowd-sourcing generate large amounts of data at the network edge. Machine learning models are often built from the collected data, to enable…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-19 Shiqiang Wang , Tiffany Tuor , Theodoros Salonidis , Kin K. Leung , Christian Makaya , Ting He , Kevin Chan