English
Related papers

Related papers: Breaking On-device Training Memory Wall: A Systema…

200 papers

In the realm of efficient on-device learning under extreme memory and computation constraints, a significant gap in successful approaches persists. Although considerable effort has been devoted to efficient inference, the main obstacle to…

Machine Learning · Computer Science 2023-12-12 Aël Quélennec , Enzo Tartaglione , Pavlo Mozharovskyi , Van-Tam Nguyen

In this chapter, we will mainly focus on collaborative training across wireless devices. Training a ML model is equivalent to solving an optimization problem, and many distributed optimization algorithms have been developed over the last…

Machine Learning · Computer Science 2021-12-13 Emre Ozfatura , Deniz Gunduz , H. Vincent Poor

Large machine learning models trained on diverse data have recently seen unprecedented success. Federated learning enables training on private data that may otherwise be inaccessible, such as domain-specific datasets decentralized across…

The advancements in machine learning opened a new opportunity to bring intelligence to the low-end Internet-of-Things nodes such as microcontrollers. Conventional machine learning deployment has high memory and compute footprint hindering…

Machine Learning · Computer Science 2022-12-22 Swapnil Sayan Saha , Sandeep Singh Sandha , Mani Srivastava

The conventional cloud-based large model learning framework is increasingly constrained by latency, cost, personalization, and privacy concerns. In this survey, we explore an emerging paradigm: collaborative learning between on-device small…

Machine Learning · Computer Science 2025-04-23 Chaoyue Niu , Yucheng Ding , Junhui Lu , Zhengxiang Huang , Hang Zeng , Yutong Dai , Xuezhen Tu , Chengfei Lv , Fan Wu , Guihai Chen

Despite its importance for federated learning, continuous learning and many other applications, on-device training remains an open problem for EdgeAI. The problem stems from the large number of operations (e.g., floating point…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Yuedong Yang , Guihong Li , Radu Marculescu

To facilitate the evolution of edge intelligence in ever-changing environments, we study on-device incremental learning constrained in limited computation resource in this paper. Current on-device training methods just focus on efficient…

Machine Learning · Computer Science 2024-12-04 Dingwen Zhang , Yan Li , De Cheng , Nannan Wang , Junwei Han

Machine learning models may inadvertently memorize sensitive, unauthorized, or malicious data, posing risks of privacy breaches, security vulnerabilities, and performance degradation. To address these issues, machine unlearning has emerged…

Machine Learning · Computer Science 2024-04-08 Jie Xu , Zihan Wu , Cong Wang , Xiaohua Jia

The world has recently witnessed an unprecedented acceleration in demands for Machine Learning and Artificial Intelligence applications. This spike in demand has imposed tremendous strain on the underlying technology stack in supply chain,…

Emerging Technologies · Computer Science 2024-10-15 Paolo Faraboschi , Ellis Giles , Justin Hotard , Konstanty Owczarek , Andrew Wheeler

Mobile authentication using behavioral biometrics has been an active area of research. Existing research relies on building machine learning classifiers to recognize an individual's unique patterns. However, these classifiers are not…

Machine Learning · Computer Science 2020-08-18 Cong Wang , Yanru Xiao , Xing Gao , Li Li , Jun Wang

The recent success of neural networks for solving difficult decision tasks has incentivized incorporating smart decision making "at the edge." However, this work has traditionally focused on neural network inference, rather than training,…

Machine Learning · Computer Science 2021-07-16 Albert Gural , Phillip Nadeau , Mehul Tikekar , Boris Murmann

The rapid uptake of mobile devices and the rising popularity of mobile applications and services pose unprecedented demands on mobile and wireless networking infrastructure. Upcoming 5G systems are evolving to support exploding mobile…

Networking and Internet Architecture · Computer Science 2019-01-31 Chaoyun Zhang , Paul Patras , Hamed Haddadi

The rapid advancement of neuromorphic technology aims to address the memory wall challenge inherent in conventional von Neumann architectures. This paper critically examines current digital neuromorphic processors and their strategies to…

Hardware Architecture · Computer Science 2026-04-13 Amirreza Yousefzadeh , Sameed Sohail , Ana Lucia Varbanescu

With the recent increase in the computational power of modern mobile devices, machine learning-based heavy tasks such as face detection and speech recognition are now integral parts of such devices. This requires frameworks to execute…

Machine Learning · Computer Science 2021-09-22 Amin Eslami Abyane , Hadi Hemmati

This paper presents ProFL, a new framework that effectively addresses the memory constraints in FL. Rather than updating the full model during local training, ProFL partitions the model into blocks based on its original architecture and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-22 Yebo Wu , Li Li , Chengzhong Xu

Deep Learning has revolutionized the fields of computer vision, natural language understanding, speech recognition, information retrieval and more. However, with the progressive improvements in deep learning models, their number of…

Machine Learning · Computer Science 2024-04-17 Gaurav Menghani

On-device learning allows AI models to adapt to user data, thereby enhancing service quality on edge platforms. However, training AI on resource-limited devices poses significant challenges due to the demanding computing workload and the…

Hardware Architecture · Computer Science 2023-12-27 Sai Qian Zhang , Thierry Tambe , Nestor Cuevas , Gu-Yeon Wei , David Brooks

Transformer models have emerged as potent solutions to a wide array of multidisciplinary challenges. The deployment of Transformer architectures is significantly hindered by their extensive computational and memory requirements,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-03 Zhengxian Lu , Fangyu Wang , Zhiwei Xu , Fei Yang , Tao Li

On-device training is an emerging approach in machine learning where models are trained on edge devices, aiming to enhance privacy protection and real-time performance. However, edge devices typically possess restricted computational power…

Machine Learning · Computer Science 2023-12-27 Ziyu Lin , Enzo Tartaglione , Van-Tam Nguyen

Modern mobile applications are benefiting significantly from the advancement in deep learning, e.g., implementing real-time image recognition and conversational system. Given a trained deep learning model, applications usually need to…

Performance · Computer Science 2019-03-01 Tian Guo