English
Related papers

Related papers: Continual Learning at the Edge: Real-Time Training…

200 papers

Imaging in clinical routine is subject to changing scanner protocols, hardware, or policies in a typically heterogeneous set of acquisition hardware. Accuracy and reliability of deep learning models suffer from those changes as data and…

Machine Learning · Computer Science 2021-06-08 Matthias Perkonigg , Johannes Hofmanninger , Georg Langs

Federated edge learning is a promising technology to deploy intelligence at the edge of wireless networks in a privacy-preserving manner. Under such a setting, multiple clients collaboratively train a global generic model under the…

Machine Learning · Computer Science 2023-02-27 Zihan Chen , Zeshen Li , Howard H. Yang , Tony Q. S. Quek

Learn in-situ is a growing trend for Edge AI. Training deep neural network (DNN) on edge devices is challenging because both energy and memory are constrained. Low precision training helps to reduce the energy cost of a single training…

Machine Learning · Computer Science 2020-12-24 Tian Huang , Tao Luo , Joey Tianyi Zhou

The exponential growth of Internet-connected devices has presented challenges to traditional centralized computing systems due to latency and bandwidth limitations. Edge computing has evolved to address these difficulties by bringing…

This paper presents an implementation of machine learning model training using private federated learning (PFL) on edge devices. We introduce a novel framework that uses PFL to address the challenge of training a model using users' private…

Transformer-based large language models (LLMs) have demonstrated impressive capabilities in a variety of natural language processing (NLP) tasks. Nonetheless, it is challenging to deploy and fine-tune LLMs on mobile edge devices with…

Machine Learning · Computer Science 2023-11-23 Yuhao Chen , Yuxuan Yan , Qianqian Yang , Yuanchao Shu , Shibo He , Jiming Chen

The predominant paradigm for using machine learning models on a device is to train a model in the cloud and perform inference using the trained model on the device. However, with increasing number of smart devices and improved hardware,…

Machine Learning · Computer Science 2020-07-27 Sauptik Dhar , Junyao Guo , Jiayi Liu , Samarth Tripathi , Unmesh Kurup , Mohak Shah

Federated learning enables a cluster of decentralized mobile devices at the edge to collaboratively train a shared machine learning model, while keeping all the raw training samples on device. This decentralized training approach is…

Machine Learning · Computer Science 2021-07-20 Young Geun Kim , Carole-Jean Wu

Streaming end-to-end speech recognition models have been widely applied to mobile devices and show significant improvement in efficiency. These models are typically trained on the server using transcribed speech data. However, the server…

Fast contextual adaptation has shown to be effective in improving Automatic Speech Recognition (ASR) of rare words and when combined with an on-device personalized training, it can yield an even better recognition result. However, the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-08 Tsendsuren Munkhdalai , Khe Chai Sim , Angad Chandorkar , Fan Gao , Mason Chua , Trevor Strohman , Françoise Beaufays

This literature review explores continual learning methods for on-device training in the context of neural networks (NNs) and decision trees (DTs) for classification tasks on smart environments. We highlight key constraints, such as data…

Machine Learning · Computer Science 2025-02-26 Afonso Lourenço , João Rodrigo , João Gama , Goreti Marreiros

The right to be forgotten mandates that machine learning models enable the erasure of a data owner's data and information from a trained model. Removing data from the dataset alone is inadequate, as machine learning models can memorize…

Machine Learning · Computer Science 2024-10-16 Xiaoyu Xia , Ziqi Wang , Ruoxi Sun , Bowen Liu , Ibrahim Khalil , Minhui Xue

Deep Learning (DL) model-based AI services are increasingly offered in a variety of predictive analytics services such as computer vision, natural language processing, speech recognition. However, the quality of the DL models can degrade…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-04 Anirban Bhattacharjee , Ajay Dev Chhokra , Hongyang Sun , Shashank Shekhar , Aniruddha Gokhale , Gabor Karsai , Abhishek Dubey

Deep learning has shown its power in many applications, including object detection in images, natural-language understanding, and speech recognition. To make it more accessible to end users, many deep learning models are now embedded in…

Machine Learning · Computer Science 2021-02-05 Yujin Huang , Han Hu , Chunyang Chen

On-device learning remains a formidable challenge, especially when dealing with resource-constrained devices that have limited computational capabilities. This challenge is primarily rooted in two key issues: first, the memory available on…

Machine Learning · Computer Science 2024-01-19 Lorenzo Vorabbi , Davide Maltoni , Guido Borghi , Stefano Santi

Achieving personalized intelligence at the edge with real-time learning capabilities holds enormous promise in enhancing our daily experiences and helping decision making, planning, and sensing. However, efficient and reliable edge learning…

Neural and Evolutionary Computing · Computer Science 2024-08-29 Kenneth Stewart , Michael Neumeier , Sumit Bam Shrestha , Garrick Orchard , Emre Neftci

Big Artificial Intelligence (AI) models have emerged as a crucial element in various intelligent applications at the edge, such as voice assistants in smart homes and autonomous robotics in smart factories. Training big AI models, e.g., for…

Machine Learning · Computer Science 2024-04-30 Liekang Zeng , Shengyuan Ye , Xu Chen , Yang Yang

As edge devices become more capable and pervasive in wireless networks, there is growing interest in leveraging their collective compute power for distributed learning. However, optimizing learning at the network edge entails unique…

Machine Learning · Computer Science 2025-04-14 Thomas Tsouparopoulos , Iordanis Koutsopoulos

This article surveys Cognitive Edge Computing as a practical and methodical pathway for deploying reasoning-capable Large Language Models (LLMs) and autonomous AI agents on resource-constrained devices at the network edge. We present a…

Machine Learning · Computer Science 2025-11-10 Xubin Wang , Qing Li , Weijia Jia

Ubiquitous wearable and mobile devices provide access to a diverse set of data. However, the mobility demand for our devices naturally imposes constraints on their computational and communication capabilities. A solution is to locally learn…

Machine Learning · Computer Science 2025-11-07 Fan Mo , Mohammad Malekzadeh , Soumyajit Chatterjee , Fahim Kawsar , Akhil Mathur