English
Related papers

Related papers: Conformal Selective Acting: Anytime-Valid Risk Con…

200 papers

This paper presents a risk-aware safe reinforcement learning (RL) control design for stochastic discrete-time linear systems. Rather than using a safety certifier to myopically intervene with the RL controller, a risk-informed safe…

Systems and Control · Electrical Eng. & Systems 2025-05-16 Babak Esmaeili , Nariman Niknejad , Hamidreza Modares

Safe reinforcement learning (RL) aims to learn policies that satisfy certain constraints before deploying them to safety-critical applications. Previous primal-dual style approaches suffer from instability issues and lack optimality…

Machine Learning · Computer Science 2022-06-20 Zuxin Liu , Zhepeng Cen , Vladislav Isenbaev , Wei Liu , Zhiwei Steven Wu , Bo Li , Ding Zhao

Modern deployments require LLMs to enforce safety policies at scale, yet many controls rely on inference-time interventions that add recurring compute cost and serving complexity. Activation steering is widely used, but it requires runtime…

Computation and Language · Computer Science 2026-02-05 Aditya Kasliwal , Pratinav Seth , Vinay Kumar Sankarapu

Reinforcement learning with verifiable rewards (RLVR) has become a key technique for en- hancing LLM reasoning, yet its data ineffi- ciency remains a major bottleneck. Existing methods address this problem only partially, each missing at…

Machine Learning · Computer Science 2026-05-28 Yuhan Li , Mingxu Zhang , Dazhong Shen , Ying Sun

Graphical user interface (GUI) agents powered by vision language models (VLMs) are rapidly moving from passive assistance to autonomous operation. However, this unrestricted action space exposes users to severe and irreversible financial,…

Machine Learning · Computer Science 2026-04-13 Yushi Feng , Junye Du , Qifan Wang , Zizhan Ma , Qian Niu , Yutaka Matsuo , Long Feng , Lequan Yu

In this paper, a continuous-time adaptive actor-critic reinforcement learning (RL) controller is developed for drift-free nonlinear systems. Practical examples of such systems are image-based visual servoing (IBVS) and wheeled mobile robots…

Systems and Control · Electrical Eng. & Systems 2024-06-14 Ashwin P. Dani , Shubhendu Bhasin

Reinforcement learning (RL) offers a compelling data-driven paradigm for synthesizing controllers for complex systems when accurate physical models are unavailable; however, most existing control-oriented RL methods assume stationarity and,…

Machine Learning · Computer Science 2026-04-22 Austin Coursey , Abel Diaz-Gonzalez , Marcos Quinones-Grueiro , Gautam Biswas

The interest in using reinforcement learning (RL) controllers in safety-critical applications such as robot navigation around pedestrians motivates the development of additional safety mechanisms. Running RL-enabled systems among uncertain…

Robotics · Computer Science 2023-12-08 Kegan J. Strawn , Nora Ayanian , Lars Lindemann

Large Language and Vision-Language Models (LLMs/VLMs) are increasingly used in safety-critical applications, yet their opaque decision-making complicates risk assessment and reliability. Uncertainty quantification (UQ) helps assess…

Machine Learning · Computer Science 2025-02-12 Sina Tayebati , Divake Kumar , Nastaran Darabi , Dinithi Jayasuriya , Ranganath Krishnan , Amit Ranjan Trivedi

Vanilla Reinforcement Learning (RL) can efficiently solve complex tasks but does not provide any guarantees on system behavior. To bridge this gap, we propose a three-step safe RL procedure for continuous action spaces that provides…

Robotics · Computer Science 2023-09-29 Hanna Krasowski , Prithvi Akella , Aaron D. Ames , Matthias Althoff

Monitoring binomial proportions across multiple independent streams is a critical challenge in Statistical Process Control (SPC), with applications from manufacturing to cybersecurity. While EWMA charts offer sensitivity to small shifts,…

Machine Learning · Statistics 2026-04-15 Faruk Muritala , Austin Brown , Dhrubajyoti Ghosh , Sherry Ni

As the number of spacecraft on orbit continues to grow, it is challenging for human operators to constantly monitor and plan for all missions. Autonomous control methods such as reinforcement learning (RL) have the power to solve complex…

Systems and Control · Electrical Eng. & Systems 2024-05-14 Kyle Dunlap , Nathaniel Hamilton , Francisco Viramontes , Derrek Landauer , Evan Kain , Kerianne L. Hobbs

Increased dependence on networked, software based control has escalated the vulnerabilities of Cyber Physical Systems (CPSs). Detection and monitoring components developed leveraging dynamical systems theory are often employed as…

Cryptography and Security · Computer Science 2026-02-17 Ipsita Koley , Sunandan Adhikary , Soumyajit Dey

One of the main challenges in reinforcement learning (RL) is that the agent has to make decisions that would influence the future performance without having complete knowledge of the environment. Dynamically adjusting the level of epistemic…

Machine Learning · Computer Science 2026-03-02 Yupeng Wu , Wenyun Li , Wenjie Huang , Chin Pang Ho

Robotic arms are increasingly deployed in uncertain environments, yet conventional control pipelines often become rigid and brittle when exposed to perturbations or incomplete information. Virtual Model Control (VMC) enables compliant…

Robotics · Computer Science 2025-10-28 Jingzehua Xu , Yangyang Li , Yangfei Chen , Guanwen Xie , Shuai Zhang

In deploying artificial intelligence (AI) models, selective prediction offers the option to abstain from making a prediction when uncertain about model quality. To fulfill its promise, it is crucial to enforce strict and precise error…

Methodology · Statistics 2026-03-27 Tian Bai , Ying Jin

Safety in reinforcement learning is often specified through cumulative cost constraints, but these trajectory-level guarantees do not directly prevent unsafe individual decisions, especially under nonstationarity. In continual and…

Machine Learning · Computer Science 2026-05-20 Timofey Tomashevskiy

Safety has been recognized as the central obstacle to preventing the use of reinforcement learning (RL) for real-world applications. Different methods have been developed to deal with safety concerns in RL. However, learning reliable…

Machine Learning · Computer Science 2023-02-08 Huiliang Zhang , Di Wu , Benoit Boulet

This paper develops a safety analysis method for stochastic systems that is sensitive to the possibility and severity of rare harmful outcomes. We define risk-sensitive safe sets as sub-level sets of the solution to a non-standard optimal…

Systems and Control · Electrical Eng. & Systems 2022-06-28 Margaret P. Chapman , Riccardo Bonalli , Kevin M. Smith , Insoon Yang , Marco Pavone , Claire J. Tomlin

Safe reinforcement learning in nonstationary environments requires safety mechanisms that adapt as environmental conditions change. Standard safe reinforcement learning methods often assume fixed constraints or stable environmental…

Machine Learning · Computer Science 2026-05-20 Timofey Tomashevskiy