English
Related papers

Related papers: Repairing Learning-Enabled Controllers While Prese…

200 papers

Large language models trained on web-scale corpora can memorize undesirable data containing misinformation, copyrighted material, or private or sensitive information. Recently, several machine unlearning algorithms have been proposed to…

Computation and Language · Computer Science 2025-05-27 Keivan Rezaei , Khyathi Chandu , Soheil Feizi , Yejin Choi , Faeze Brahman , Abhilasha Ravichander

Classical navigation systems typically operate using a fixed set of hand-picked parameters (e.g. maximum speed, sampling rate, inflation radius, etc.) and require heavy expert re-tuning in order to work in new environments. To mitigate this…

Robotics · Computer Science 2020-11-03 Zifan Xu , Gauraang Dhamankar , Anirudh Nair , Xuesu Xiao , Garrett Warnell , Bo Liu , Zizhao Wang , Peter Stone

This paper introduces an optimal control framework to address the inverse problem using a learned regularizer, with applications in image reconstruction. We build upon the concept of Learnable Optimization Algorithms (LOA), which combine…

Optimization and Control · Mathematics 2024-09-04 Wanyu Bian

Automated program repair (APR) has achieved promising results, especially using neural networks. Yet, the overwhelming majority of patches produced by APR tools are confined to one single location. When looking at the patches produced with…

Software Engineering · Computer Science 2024-07-11 He Ye , Martin Monperrus

The dilemma between plasticity and stability presents a significant challenge in Incremental Learning (IL), especially in the exemplar-free scenario where accessing old-task samples is strictly prohibited during the learning of a new task.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Wenju Sun , Qingyong Li , Wen Wang , Yangli-ao Geng

In this paper, we propose an incremental learning method for end-to-end Automatic Speech Recognition (ASR) which enables an ASR system to perform well on new tasks while maintaining the performance on its originally learned ones. To…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-17 Li Fu , Xiaoxiao Li , Libo Zi , Zhengchen Zhang , Youzheng Wu , Xiaodong He , Bowen Zhou

The ability of artificial agents to increment their capabilities when confronted with new data is an open challenge in artificial intelligence. The main challenge faced in such cases is catastrophic forgetting, i.e., the tendency of neural…

Machine Learning · Computer Science 2020-12-16 Eden Belouadah , Adrian Popescu , Ioannis Kanellos

Reinforcement Learning (RL) offers promising solutions for control tasks in industrial cyber-physical systems (ICPSs), yet its real-world adoption remains limited. This paper demonstrates how seemingly small but well-designed modifications…

Systems and Control · Electrical Eng. & Systems 2025-03-27 Georg Schäfer , Tatjana Krau , Jakob Rehrl , Stefan Huber , Simon Hirlaender

Traditional quantum system control methods often face different constraints, and are easy to cause both leakage and stochastic control errors under the condition of limited resources. Reinforcement learning has been proved as an efficient…

Emerging Technologies · Computer Science 2024-05-14 Wenjie Liu , Bosi Wang , Jihao Fan , Yebo Ge , Mohammed Zidan

Identifying the optimal diagnostic test and hardware system instance to infer reliability characteristics using field data is challenging, especially when constrained by fixed budgets and minimal maintenance cycles. Active Learning (AL) has…

Applications · Statistics 2025-07-25 Michael Potter , Beyza Kalkanlı , Deniz Erdoğmuş , Michael Everett

Compared to traditional imitation learning methods such as DAgger and DART, intervention-based imitation offers a more convenient and sample efficient data collection process to users. In this paper, we introduce Reinforced…

Robotics · Computer Science 2022-03-30 Rom Parnichkun , Matthew N. Dailey , Atsushi Yamashita

A well-trained Convolutional Neural Network can easily be pruned without significant loss of performance. This is because of unnecessary overlap in the features captured by the network's filters. Innovations in network architecture such as…

Computer Vision and Pattern Recognition · Computer Science 2019-02-26 Aaditya Prakash , James Storer , Dinei Florencio , Cha Zhang

Reinforcement learning (RL) offers a principled way to enhance the reasoning capabilities of large language models, yet its effectiveness hinges on training signals that remain informative as models evolve. In practice, RL progress often…

Artificial Intelligence · Computer Science 2026-05-05 Caijun Xu , Changyi Xiao , Zhongyuan Peng , Xinrun Wang , Yixin Cao

Continual lifelong learning is an machine learning framework inspired by human learning, where learners are trained to continuously acquire new knowledge in a sequential manner. However, the non-stationary nature of streaming training data…

Machine Learning · Computer Science 2024-05-14 Xingyu Li , Bo Tang , Haifeng Li

In this work we provide provable regret guarantees for an online meta-learning control algorithm in an iterative control setting, where in each iteration the system to be controlled is a linear deterministic system that is different and…

Machine Learning · Computer Science 2022-02-07 Deepan Muthirayan , Pramod Khargonekar

We study regenerative stopping problems in which the system starts anew whenever the controller decides to stop and the long-term average cost is to be minimized. Traditional model-based solutions involve estimating the underlying process…

Machine Learning · Computer Science 2021-05-07 Kishor Jothimurugan , Matthew Andrews , Jeongran Lee , Lorenzo Maggi

In this paper, we study a novel episodic risk-sensitive Reinforcement Learning (RL) problem, named Iterated CVaR RL, which aims to maximize the tail of the reward-to-go at each step, and focuses on tightly controlling the risk of getting…

Machine Learning · Computer Science 2023-05-12 Yihan Du , Siwei Wang , Longbo Huang

Agentic Reinforcement Learning (RL) has empowered Large Language Models (LLMs) to utilize tools like Python interpreters for complex problem-solving. However, for parameter-constrained models (e.g., 4B--7B), the exploration phase is often…

Machine Learning · Computer Science 2026-01-22 Tianshi Xu , Yuteng Chen , Meng Li

Multimodal Automated Program Repair (MAPR) extends traditional program repair by requiring models to jointly reason over source code, textual issue descriptions, and visual artifacts such as GUI screenshots. While recent LLM-based repair…

Software Engineering · Computer Science 2026-03-19 Ruize Ma , Yilei Jiang , Shilin Zhang , Zheng Ma , Yi Feng , Vincent Ng , Zhi Wang , Xiangyu Yue , Chuanyi Li , Lewei Lu

In this paper, we introduce new formal methods and provide empirical evidence to highlight a unique safety concern prevalent in reinforcement learning (RL)-based recommendation algorithms -- 'user tampering.' User tampering is a situation…

Artificial Intelligence · Computer Science 2023-07-25 Charles Evans , Atoosa Kasirzadeh