English
Related papers

Related papers: Resource-Constrained On-Device Learning by Dynamic…

200 papers

Energy-efficient machine learning models that can run directly on edge devices are of great interest in IoT applications, as they can reduce network pressure and response latency, and improve privacy. An effective way to obtain…

Machine Learning · Computer Science 2022-04-08 Francesco Daghero , Alessio Burrello , Daniele Jahier Pagliari , Luca Benini , Enrico Macii , Massimo Poncino

Decentralized optimization methods enable on-device training of machine learning models without a central coordinator. In many scenarios communication between devices is energy demanding and time consuming and forms the bottleneck of the…

Optimization and Control · Mathematics 2020-11-04 Dmitry Kovalev , Anastasia Koloskova , Martin Jaggi , Peter Richtarik , Sebastian U. Stich

In this paper, the problem of energy efficient transmission and computation resource allocation for federated learning (FL) over wireless communication networks is investigated. In the considered model, each user exploits limited local…

Information Theory · Computer Science 2020-11-19 Zhaohui Yang , Mingzhe Chen , Walid Saad , Choong Seon Hong , Mohammad Shikh-Bahaei

Contextual Artificial Intelligence (AI) based on emerging Transformer models is predicted to drive the next technology revolution in interactive wearable devices such as new-generation smart glasses. By coupling numerous sensors with small,…

Hardware Architecture · Computer Science 2025-03-27 Severin Bochem , Victor J. B. Jung , Arpan Prasad , Francesco Conti , Luca Benini

Nowadays, devices are equipped with advanced sensors with higher processing/computing capabilities. Further, widespread Internet availability enables communication among sensing devices. As a result, vast amounts of data are generated on…

Machine Learning · Computer Science 2020-02-26 Ahmed Imteaj , Urmish Thakker , Shiqiang Wang , Jian Li , M. Hadi Amini

Federated learning becomes a prominent approach when different entities want to learn collaboratively a common model without sharing their training data. However, Federated learning has two main drawbacks. First, it is quite bandwidth…

Cryptography and Security · Computer Science 2021-03-02 Raouf Kerkouche , Gergely Ács , Claude Castelluccia , Pierre Genevès

On-device training enables the model to adapt to new data collected from the sensors by fine-tuning a pre-trained model. Users can benefit from customized AI models without having to transfer the data to the cloud, protecting the privacy.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Ji Lin , Ligeng Zhu , Wei-Ming Chen , Wei-Chen Wang , Chuang Gan , Song Han

Energy-efficiency is a key concern for neural network applications. To alleviate this issue, hardware acceleration using FPGAs or GPUs can provide better energy-efficiency than general-purpose processors. However, further improvement of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-29 Seyed Morteza Nabavinejad , Behzad Salami

With the rapid growth in the volume of data sets, models, and devices in the domain of deep learning, there is increasing attention on large-scale distributed deep learning. In contrast to traditional distributed deep learning, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-10 Feng Liang , Zhen Zhang , Haifeng Lu , Victor C. M. Leung , Yanyi Guo , Xiping Hu

Deep Learning has enabled many advances in machine learning applications in the last few years. However, since current Deep Learning algorithms require much energy for computations, there are growing concerns about the associated…

Machine Learning · Computer Science 2023-03-06 Vanessa Mehlin , Sigurd Schacht , Carsten Lanquillon

Machine learning at the edge offers great benefits such as increased privacy and security, low latency, and more autonomy. However, a major challenge is that many devices, in particular edge devices, have very limited memory, weak…

Machine Learning · Computer Science 2019-09-05 Yang Li , Thomas Strohmer

Health monitoring applications increasingly rely on machine learning techniques to learn end-user physiological and behavioral patterns in everyday settings. Considering the significant role of wearable devices in monitoring human body…

Machine Learning · Computer Science 2022-08-03 Sina Shahhosseini , Yang Ni , Hamidreza Alikhani , Emad Kasaeyan Naeini , Mohsen Imani , Nikil Dutt , Amir M. Rahmani

Currently, the world experiences an unprecedentedly increasing generation of application data, from sensor measurements to video streams, thanks to the extreme connectivity capability provided by 5G networks. Going beyond 5G technology,…

Signal Processing · Electrical Eng. & Systems 2022-04-21 Mattia Merluzzi , Miltiadis C. Filippou , Leonardo Gomes Baltar , Emilio Calvanese Strinati

Federated learning (FL) necessitates that edge devices conduct local training and communicate with a parameter server, resulting in significant energy consumption. A key challenge in practical FL systems is the rapid depletion of…

Machine Learning · Computer Science 2025-06-24 Kai Zhang , Xuanyu Cao , Khaled B. Letaief

Federated learning (FL) is an effective paradigm for enhancing the learning capability of edge devices while preserving data privacy. In geographically dispersed FL systems, such as sensor networks in remote areas, unmanned aerial vehicles…

Machine Learning · Computer Science 2026-05-26 Shiqian Guo , Jianqing Liu , Beatriz Lorenzo

Federated learning can enable remote workers to collaboratively train a shared machine learning model while allowing training data to be kept locally. In the use case of wireless mobile devices, the communication overhead is a critical…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-11 Kai Yue , Richeng Jin , Chau-Wai Wong , Huaiyu Dai

In this paper, we optimize the energy efficiency (bits/s/Hz/J) of device-to-multi-device (D2MD) wireless communications. While the device-to-device scenario has been extensively studied to improve the spectral efficiency in cellular…

Networking and Internet Architecture · Computer Science 2019-08-19 Mariem Hmila , Manuel Fernández-Veiga , Miguel Rodríguez-Pérez , Sergio Herrería-Alonso

Federated learning is a method of training models on private data distributed over multiple devices. To keep device data private, the global model is trained by only communicating parameters and updates which poses scalability challenges…

Federated Learning (FL) is a promising distributed method for edge-level machine learning, particularly for privacysensitive applications such as those in military and medical domains, where client data cannot be shared or transferred to a…

Machine Learning · Computer Science 2024-06-27 Lucas Grativol Ribeiro , Mathieu Leonardon , Guillaume Muller , Virginie Fresse , Matthieu Arzel

Federated learning struggles with their heavy energy footprint on battery-powered devices. The learning process keeps all devices awake while draining expensive battery power to train a shared model collaboratively, yet it may still leak…

Machine Learning · Computer Science 2021-02-08 Wenting Zou , Li Li , Zichen Xu , Chengzhong Xu