English
Related papers

Related papers: Train-On-Request: An On-Device Continual Learning …

200 papers

Brain Computer Interface (BCI) technologies have the potential to improve the lives of millions of people around the world, whether through assistive technologies or clinical diagnostic tools. Despite advancements in the field, however, at…

Machine Learning · Computer Science 2023-01-31 Chad Mello , Troy Weingart , Ethan M. Rudd

Neural operators generally demonstrate strong predictive performance on in-distribution (ID) problems. However, a critical limitation of existing methods is their significant performance degradation when encountering out-of-distribution…

Machine Learning · Computer Science 2026-05-07 Yizheng Wang , Mohammad Sadegh Eshaghi , Xiaoying Zhuang , Timon Rabczuk , Yinghua Liu

Autonomous offroad driving is essential for applications like emergency rescue, military operations, and agriculture. Despite progress, systems struggle with high-speed vehicles exceeding 10m/s due to the need for accurate long-range (>…

Robotics · Computer Science 2024-10-15 Eric Chen , Cherie Ho , Mukhtar Maulimov , Chen Wang , Sebastian Scherer

Test-Time Optimization enables models to adapt to new data during inference by updating parameters on-the-fly. Recent advances in Vision-Language Models (VLMs) have explored learning prompts at test time to improve performance in downstream…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Dhruv Sarkar , Aprameyo Chakrabartty , Bibhudatta Bhanja

The ubiquity of vision transformers (ViTs) for various edge applications, including personalized learning, has created the demand for on-device fine-tuning. However, training with the limited memory and computation power of edge devices…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Sreetama Sarkar , Souvik Kundu , Kai Zheng , Peter A. Beerel

On-device learning enables edge devices to continually adapt the AI models to new data, which requires a small memory footprint to fit the tight memory constraint of edge devices. Existing work solves this problem by reducing the number of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Han Cai , Chuang Gan , Ligeng Zhu , Song Han

On-device training is essential for user personalisation and privacy. With the pervasiveness of IoT devices and microcontroller units (MCUs), this task becomes more challenging due to the constrained memory and compute resources, and the…

Machine Learning · Computer Science 2024-06-12 Young D. Kwon , Rui Li , Stylianos I. Venieris , Jagmohan Chauhan , Nicholas D. Lane , Cecilia Mascolo

Online continual learning (OCL) enables real-time adaptation to new data, making it crucial for dynamic robotic applications. However, its practical deployment is hindered by memory constraints in resource-limited systems, which affect key…

Systems and Control · Electrical Eng. & Systems 2026-05-27 Zexin Li , Nikil Dutt , Cong Liu

The accuracy of tinyML applications is often affected by various environmental factors, such as noises, location/calibration of sensors, and time-related changes. This article introduces a neural network based on-device learning (ODL)…

Machine Learning · Computer Science 2023-12-27 Kazuki Sunaga , Masaaki Kondo , Hiroki Matsutani

Existing approaches for improving the efficiency of Large Vision-Language Models (LVLMs) are largely based on the concept of visual token reduction. This approach, however, creates an information bottleneck that impairs performance,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Adrian Bulat , Alberto Baldrati , Ioannis Maniadis Metaxas , Yassine Ouali , Georgios Tzimiropoulos

On-device tuning of deep neural networks enables long-term adaptation at the edge while preserving data privacy. However, the high computational and memory demands of backpropagation pose significant challenges for ultra-low-power,…

Hardware Architecture · Computer Science 2026-03-11 Run Wang , Victor J. B. Jung , Philip Wiese , Francesco Conti , Alessio Burrello , Luca Benini

Brain-Machine Interfaces (BMIs) have recently emerged as a clinically viable option to restore voluntary movements after paralysis. These devices are based on the ability to extract information about movement intent from neural signals…

Machine Learning · Computer Science 2019-01-16 Ali Farshchian , Juan A. Gallego , Joseph P. Cohen , Yoshua Bengio , Lee E. Miller , Sara A. Solla

On-device training is an emerging approach in machine learning where models are trained on edge devices, aiming to enhance privacy protection and real-time performance. However, edge devices typically possess restricted computational power…

Machine Learning · Computer Science 2023-12-27 Ziyu Lin , Enzo Tartaglione , Van-Tam Nguyen

The performance of brain-computer interfaces (BCIs) improves with the amount of available training data, the statistical distribution of this data, however, varies across subjects as well as across sessions within individual subjects,…

Human-Computer Interaction · Computer Science 2016-09-20 Vinay Jayaram , Morteza Alamgir , Yasemin Altun , Bernhard Schölkopf , Moritz Grosse-Wentrup

Battery-powered mobile devices (e.g., smartphones, AR/VR glasses, and various IoT devices) are increasingly being used for AI training due to their growing computational power and easy access to valuable, diverse, and real-time data.…

Machine Learning · Computer Science 2025-01-29 Jiaru Zhang , Zesong Wang , Hao Wang , Tao Song , Huai-an Su , Rui Chen , Yang Hua , Xiangwei Zhou , Ruhui Ma , Miao Pan , Haibing Guan

Mobile platforms must satisfy the contradictory requirements of fast response time and minimum energy consumption as a function of dynamically changing applications. To address this need, system-on-chips (SoC) that are at the heart of these…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-24 Sumit K. Mandal , Ganapati Bhat , Janardhan Rao Doppa , Partha Pratim Pande , Umit Y. Ogras

Tactile sensing has been used for a variety of robotic exploration and manipulation tasks but a common constraint is a requirement for a large amount of training data. This paper addresses the issue of data-efficiency by proposing a novel…

Robotics · Computer Science 2020-08-13 Elizabeth A. Stone , Nathan F. Lepora , David A. W. Barton

Drawing inspiration from gradient-based meta-learning methods with infinitely small gradient steps, we introduce Continuous-Time Meta-Learning (COMLN), a meta-learning algorithm where adaptation follows the dynamics of a gradient vector…

Machine Learning · Computer Science 2022-03-04 Tristan Deleu , David Kanaa , Leo Feng , Giancarlo Kerg , Yoshua Bengio , Guillaume Lajoie , Pierre-Luc Bacon

A major challenge in the field of education is providing review schedules that present learned items at appropriate intervals to each student so that memory is retained over time. In recent years, attempts have been made to formulate item…

Artificial Intelligence · Computer Science 2021-08-03 Yoshiki Kubotani , Yoshihiro Fukuhara , Shigeo Morishima

Imaging in clinical routine is subject to changing scanner protocols, hardware, or policies in a typically heterogeneous set of acquisition hardware. Accuracy and reliability of deep learning models suffer from those changes as data and…

Machine Learning · Computer Science 2021-06-08 Matthias Perkonigg , Johannes Hofmanninger , Georg Langs