English
Related papers

Related papers: Train-On-Request: An On-Device Continual Learning …

200 papers

Standard model-based reinforcement learning (MBRL) approaches fit a transition model of the environment to all past experience, but this wastes model capacity on data that is irrelevant for policy improvement. We instead propose a new…

Machine Learning · Computer Science 2023-05-23 Yecheng Jason Ma , Kausik Sivakumar , Jason Yan , Osbert Bastani , Dinesh Jayaraman

Personalized motion planning holds significant importance within urban automated driving, catering to the unique requirements of individual users. Nevertheless, prior endeavors have frequently encountered difficulties in simultaneously…

Robotics · Computer Science 2024-08-06 Fangze Lin , Ying He , Fei Yu

On-device training has become an increasingly popular approach to machine learning, enabling models to be trained directly on mobile and edge devices. However, a major challenge in this area is the limited memory available on these devices,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-13 Shitian Li , Chunlin Tian , Kahou Tam , Rui Ma , Li Li

Multimodal Large Language Models (MLLMs) struggle with continual learning, often suffering from catastrophic forgetting when adapting to sequential tasks. We introduce a routing-based architecture that integrates new capabilities while…

Machine Learning · Computer Science 2026-04-08 Jay Mohta , Kenan Emir Ak , Gwang Lee , Dimitrios Dimitriadis , Yan Xu , Mingwei Shen

This paper presents a lightweight K-Means anomaly detection model and a distributed model-sharing workflow designed for resource-constrained microcontrollers (MCUs). Using real power measurements from a mini-fridge appliance, the system…

Machine Learning · Computer Science 2026-03-31 Abdulrahman Albaiz , Fathi Amsaad

Dynamic resource management has become one of the major areas of research in modern computer and communication system design due to lower power consumption and higher performance demands. The number of integrated cores, level of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-25 Sumit K. Mandal , Umit Y. Ogras , Janardhan Rao Doppa , Raid Z. Ayoub , Michael Kishinevsky , Partha P. Pande

In this study, we propose a tailored DL framework for patient-specific performance that leverages the behavior of a model intentionally overfitted to a patient-specific training dataset augmented from the prior information available in an…

Machine Learning · Computer Science 2022-04-06 Jaehee Chun , Justin C. Park , Sven Olberg , You Zhang , Dan Nguyen , Jing Wang , Jin Sung Kim , Steve Jiang

Reinforcement learning (RL) can in principle let robots automatically adapt to new tasks, but current RL methods require a large number of trials to accomplish this. In this paper, we tackle rapid adaptation to new tasks through the…

Transformer-based models excel in speech recognition. Existing efforts to optimize Transformer inference, typically for long-context applications, center on simplifying attention score calculations. However, streaming speech recognition…

Machine Learning · Computer Science 2024-01-22 Yang Li , Liangzhen Lai , Yuan Shangguan , Forrest N. Iandola , Zhaoheng Ni , Ernie Chang , Yangyang Shi , Vikas Chandra

On-policy distillation (OPD) has shown strong potential for transferring reasoning ability from frontier or domain-specific models to smaller students. While effective on static single-turn tasks, its behavior in multi-turn agent settings…

Machine Learning · Computer Science 2026-04-30 Jiaqi Wang , Wenhao Zhang , Weijie Shi , Yaliang Li , James Cheng

On-device control agents, especially on mobile devices, are responsible for operating mobile devices to fulfill users' requests, enabling seamless and intuitive interactions. Integrating Multimodal Large Language Models (MLLMs) into these…

Machine Learning · Computer Science 2025-02-24 Taiyi Wang , Zhihao Wu , Jianheng Liu , Jianye Hao , Jun Wang , Kun Shao

Deep learning models in recommender systems are usually trained in the batch mode, namely iteratively trained on a fixed-size window of training data. Such batch mode training of deep learning models suffers from low training efficiency,…

Information Retrieval · Computer Science 2020-09-07 Yichao Wang , Huifeng Guo , Ruiming Tang , Zhirong Liu , Xiuqiang He

Pretrained on web-scale open data, VLMs offer powerful capabilities for solving downstream tasks after being adapted to task-specific labeled data. Yet, data labeling can be expensive and may demand domain expertise. Active Learning (AL)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Tong Wang , Jiaqi Wang , Shu Kong

We introduce Train/Test-Time Adaptation with Retrieval (${\rm T^3AR}$), a method to adapt models both at train and test time by means of a retrieval module and a searchable pool of external samples. Before inference, ${\rm T^3AR}$ adapts a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Luca Zancato , Alessandro Achille , Tian Yu Liu , Matthew Trager , Pramuditha Perera , Stefano Soatto

Sub-\SI{50}{\gram} nano-drones are gaining momentum in both academia and industry. Their most compelling applications rely on onboard deep learning models for perception despite severe hardware constraints (\ie sub-\SI{100}{\milli\watt}…

Robotics · Computer Science 2024-03-08 Elia Cereda , Manuele Rusci , Alessandro Giusti , Daniele Palossi

Continual learning (CL) is a new online learning technique over sequentially generated streaming data from different tasks, aiming to maintain a small forgetting loss on previously-learned tasks. Existing work focuses on reducing the…

Machine Learning · Computer Science 2024-12-25 Shugang Hao , Lingjie Duan

As robotics continues to advance, the need for adaptive and continuously-learning embodied agents increases, particularly in the realm of assistance robotics. Quick adaptability and long-term information retention are essential to operate…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Paolo Cudrano , Xiaoyu Luo , Matteo Matteucci

Offline reinforcement learning (RL) seeks to learn optimal policies from static datasets without interacting with the environment. A common challenge is handling multi-modal action distributions, where multiple behaviours are represented in…

Machine Learning · Computer Science 2025-03-20 Mianchu Wang , Yue Jin , Giovanni Montana

Dynamic Item Response Models extend the standard Item Response Theory (IRT) to capture temporal dynamics in learner ability. While these models have the potential to allow instructional systems to actively monitor the evolution of learner…

Machine Learning · Computer Science 2023-11-16 Yunsung Kim , Sreechan Sankaranarayanan , Chris Piech , Candace Thille

Projection-based Reduced Order Models (ROMs) are often deployed as static surrogates, which limits their practical utility once a system leaves the training manifold. We formalize and study adaptive non-intrusive ROMs that update both the…

Machine Learning · Computer Science 2026-02-13 Amirpasha Hedayat , Alberto Padovan , Karthik Duraisamy