English
Related papers

Related papers: Repairing Learning-Enabled Controllers While Prese…

200 papers

Imitation learning (IL) and reinforcement learning (RL) each offer distinct advantages for robotics policy learning: IL provides stable learning from demonstrations, and RL promotes generalization through exploration. While existing robot…

Understanding how to efficiently learn while adhering to safety constraints is essential for using online reinforcement learning in practical applications. However, proving rigorous regret bounds for safety-constrained reinforcement…

Machine Learning · Statistics 2025-04-29 Benjamin Schiffer , Lucas Janson

Cyber-physical systems (CPS) with reinforcement learning (RL)-based controllers are increasingly being deployed in complex physical environments such as autonomous vehicles, the Internet-of-Things(IoT), and smart cities. An important…

Systems and Control · Electrical Eng. & Systems 2024-06-26 Changjian Zhang , Parv Kapoor , Eunsuk Kang , Romulo Meira-Goes , David Garlan , Akila Ganlath , Shatadal Mishra , Nejib Ammar

Large Language Models (LLMs) possess encompassing capabilities that can process diverse language-related tasks. However, finetuning on LLMs will diminish this general skills and continual finetuning will further cause severe degradation on…

Machine Learning · Computer Science 2025-07-09 Kai Tong , Kang Pan , Xiao Zhang , Erli Meng , Run He , Yawen Cui , Nuoyan Guo , Huiping Zhuang

Reinforcement Learning (RL) algorithms have found limited success beyond simulated applications, and one main reason is the absence of safety guarantees during the learning process. Real world systems would realistically fail or break…

Machine Learning · Computer Science 2019-03-22 Richard Cheng , Gabor Orosz , Richard M. Murray , Joel W. Burdick

Machine learning (ML) training algorithms often possess an inherent self-correcting behavior due to their iterative-convergent nature. Recent systems exploit this property to achieve adaptability and efficiency in unreliable computing…

Machine Learning · Computer Science 2018-10-18 Aurick Qiao , Bryon Aragam , Bingjing Zhang , Eric P. Xing

Artificial intelligence (AI) and reinforcement learning (RL) have shown significant promise in wireless systems, enabling dynamic spectrum allocation, traffic management, and large-scale Internet of Things (IoT) coordination. However, their…

Networking and Internet Architecture · Computer Science 2026-02-17 Abdikarim Mohamed Ibrahim , Rosdiadee Nordin

In control problems for insect-scale direct-drive experimental platforms under tandem wing influence, the primary challenge facing existing reinforcement learning models is their limited safety in the exploration process and the stability…

Artificial Intelligence · Computer Science 2024-05-24 Minghao Zhang , Bifeng Song , Changhao Chen , Xinyu Lang

Recently, safe reinforcement learning (RL) with the actor-critic structure for continuous control tasks has received increasing attention. It is still challenging to learn a near-optimal control policy with safety and convergence…

Machine Learning · Computer Science 2024-02-06 Xinglong Zhang , Yaoqian Peng , Biao Luo , Wei Pan , Xin Xu , Haibin Xie

Reinforcement learning (RL) promises to enable autonomous acquisition of complex behaviors for diverse agents. However, the success of current reinforcement learning algorithms is predicated on an often under-emphasised requirement -- each…

Machine Learning · Computer Science 2021-10-29 Archit Sharma , Abhishek Gupta , Sergey Levine , Karol Hausman , Chelsea Finn

Post-training algorithms based on deep reinforcement learning can push the limits of robotic models for specific objectives, such as generalizability, accuracy, and robustness. However, Intervention-requiring Failures (IR Failures) (e.g., a…

Robotics · Computer Science 2026-01-13 Huanyu Li , Kun Lei , Sheng Zang , Kaizhe Hu , Yongyuan Liang , Bo An , Xiaoli Li , Huazhe Xu

Incremental learning is one paradigm to enable model building and updating at scale with streaming data. For end-to-end automatic speech recognition (ASR) tasks, the absence of human annotated labels along with the need for privacy…

Chemical sensors are usually affected by drift, have low fabrication reproducibility and can experience failure or breaking events over the long term. Albeit improvements in fabrication processes are often slow and inadequate for completely…

Signal Processing · Electrical Eng. & Systems 2020-01-13 Gabriele Magna , Corrado Di Natale , Eugenio Martinelli

Human interventions are a common source of data in autonomous systems during testing. These interventions provide an important signal about where the current policy needs improvement, but are often noisy and incomplete. We define Robust…

Machine Learning · Computer Science 2026-02-04 Ethan Pronovost , Khimya Khetarpal , Siddhartha Srinivasa

Hierarchical reinforcement learning (HRL) has the potential to solve complex long horizon tasks using temporal abstraction and increased exploration. However, hierarchical agents are difficult to train due to inherent non-stationarity. We…

Machine Learning · Computer Science 2025-02-11 Utsav Singh , Vinay P. Namboodiri

Not a day goes by without hearing about the impressive feats of large language models (LLMs), and equally, not a day passes without hearing about their challenges. LLMs are notoriously vulnerable to biases in their dataset, leading to…

Computation and Language · Computer Science 2025-03-12 Sayem Mohammad Imtiaz , Astha Singh , Fraol Batole , Hridesh Rajan

Continual learning is an emerging topic in the field of deep learning, where a model is expected to learn continuously for new upcoming tasks without forgetting previous experiences. This field has witnessed numerous advancements, but few…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Aupendu Kar , Krishnendu Ghosh , Prabir Kumar Biswas

Sampling-based model predictive control (MPC) has found significant success in optimal control problems with non-smooth system dynamics and cost function. Many machine learning-based works proposed to improve MPC by a) learning or…

Machine Learning · Computer Science 2024-01-08 Sungwook Yang , Chaoying Pei , Ran Dai , Chuangchuang Sun

As neural theorem provers become increasingly agentic, the ability to interpret and act on compiler feedback is critical. However, existing Lean datasets consist almost exclusively of correct proofs, offering little supervision for…

Machine Learning · Computer Science 2026-03-17 Evan Wang , Simon Chess , Daniel Lee , Siyuan Ge , Ajit Mallavarapu , Jarod Alper , Vasily Ilin

Combining deep neural networks with reinforcement learning has shown great potential in the next-generation intelligent control. However, there are challenges in terms of safety and cost in practical applications. In this paper, we propose…

Robotics · Computer Science 2018-11-16 Fan Wang , Bo Zhou , Ke Chen , Tingxiang Fan , Xi Zhang , Jiangyong Li , Hao Tian , Jia Pan