中文
相关论文

相关论文: COPA: Certifying Robust Policies for Offline Reinf…

200 篇论文

Conformal prediction provides model-agnostic and distribution-free uncertainty quantification through prediction sets that are guaranteed to include the ground truth with any user-specified probability. Yet, conformal prediction is not…

机器学习 · 计算机科学 2025-03-18 Yan Scholten , Stephan Günnemann

For any black-box model, conformal prediction (CP) returns prediction sets guaranteed to include the true label with high adjustable probability. Robust CP (RCP) extends the guarantee to the worst case noise up to a pre-defined magnitude.…

机器学习 · 计算机科学 2025-12-09 Soroush H. Zargarbashi , Mohammad Sadegh Akhondzadeh , Aleksandar Bojchevski

Reinforcement learning provides an appealing framework for robotic control due to its ability to learn expressive policies purely through real-world interaction. However, this requires addressing real-world constraints and avoiding…

机器人学 · 计算机科学 2024-05-09 Kyle Stachowicz , Sergey Levine

Neural network (NN) controllers achieve strong empirical performance on nonlinear dynamical systems, yet deploying them in safety-critical settings requires robustness to disturbances and uncertainty. We present a method for jointly…

系统与控制 · 电气工程与系统科学 2026-04-02 Neelay Junnarkar , Yasin Sonmez , Murat Arcak

Ensuring reliability in modern software systems requires rigorous pre-production testing across highly heterogeneous and evolving environments. Because exhaustive evaluation is infeasible, practitioners must decide how to allocate limited…

软件工程 · 计算机科学 2025-10-08 Yu Zhu

Offline reinforcement learning (RL) aims to optimize a policy using collected data without online interactions. Model-based approaches are particularly appealing for addressing offline RL challenges because of their capability to mitigate…

Offline reinforcement learning enables sample-efficient policy acquisition without risky online interaction, yet policies trained on static datasets remain brittle under action-space perturbations such as actuator faults. This study…

机器人学 · 计算机科学 2026-03-02 Shingo Ayabe , Hiroshi Kera , Kazuhiko Kawamoto

Offline reinforcement learning (RL) refers to the problem of learning policies entirely from a large batch of previously collected data. This problem setting offers the promise of utilizing such datasets to acquire policies without any…

机器学习 · 计算机科学 2020-11-24 Tianhe Yu , Garrett Thomas , Lantao Yu , Stefano Ermon , James Zou , Sergey Levine , Chelsea Finn , Tengyu Ma

Safe exploration is critical for using reinforcement learning (RL) in risk-sensitive environments. Recent work learns risk measures which measure the probability of violating constraints, which can then be used to enable safety. However,…

Reinforcement learning has significantly enhanced the reasoning capabilities of Large Language Models (LLMs) in complex problem-solving tasks. Recently, the introduction of DeepSeek R1 has inspired a surge of interest in leveraging…

机器学习 · 计算机科学 2025-08-07 Jinghang Han , Jiawei Chen , Hang Shao , Hao Ma , Mingcheng Li , Xintian Shen , Lihao Zheng , Wei Chen , Tao Wei , Lihua Zhang

Recent advances in reinforcement learning (RL) enable its use on increasingly complex tasks, but the lack of formal safety guarantees still limits its application in safety-critical settings. A common practical approach is to augment the RL…

机器学习 · 计算机科学 2026-02-12 Donggeon David Oh , Duy P. Nguyen , Haimin Hu , Jaime F. Fisac

This paper investigates a hybrid learning framework for reinforcement learning (RL) in which the agent can leverage both an offline dataset and online interactions to learn the optimal policy. We present a unified algorithm and analysis and…

机器学习 · 计算机科学 2025-07-01 Ruiquan Huang , Donghao Li , Chengshuai Shi , Cong Shen , Jing Yang

In this discussion paper, we survey recent research surrounding robustness of machine learning models. As learning algorithms become increasingly more popular in data-driven control systems, their robustness to data uncertainty must be…

机器学习 · 计算机科学 2022-09-28 Brendon G. Anderson , Tanmay Gautam , Somayeh Sojoudi

Safe reinforcement learning (Safe RL) refers to a class of techniques that aim to prevent RL algorithms from violating constraints in the process of decision-making and exploration during trial and error. In this paper, a novel model-free…

系统与控制 · 电气工程与系统科学 2024-08-14 Homayoun Honari , Mehran Ghafarian Tamizi , Homayoun Najjaran

Given the availability of more comprehensive measurement data in modern power systems, reinforcement learning (RL) has gained significant interest in operation and control. Conventional RL relies on trial-and-error interactions with the…

系统与控制 · 电气工程与系统科学 2025-07-01 Tong Su , Tong Wu , Junbo Zhao , Anna Scaglione , Le Xie

Pretraining a policy on offline data followed by fine-tuning through online interactions, known as Offline-to-Online Reinforcement Learning (O2O RL), has emerged as a promising paradigm for real-world RL deployment. However, both offline…

机器学习 · 计算机科学 2025-10-17 Longxiang He , Deheng Ye , Junbo Tan , Xueqian Wang , Li Shen

While Reinforcement Learning (RL) achieves tremendous success in sequential decision-making problems of many domains, it still faces key challenges of data inefficiency and the lack of interpretability. Interestingly, many researchers have…

人工智能 · 计算机科学 2023-06-02 Yan Zeng , Ruichu Cai , Fuchun Sun , Libo Huang , Zhifeng Hao

Recent breakthroughs both in reinforcement learning and trajectory optimization have made significant advances towards real world robotic system deployment. Reinforcement learning (RL) can be applied to many problems without needing any…

机器人学 · 计算机科学 2019-10-23 Guillaume Bellegarda , Katie Byl

Backdoor attacks, which maliciously control a well-trained model's outputs of the instances with specific triggers, are recently shown to be serious threats to the safety of reusing deep neural networks (DNNs). In this work, we propose an…

计算与语言 · 计算机科学 2021-10-18 Wenkai Yang , Yankai Lin , Peng Li , Jie Zhou , Xu Sun

This paper presents a comprehensive benchmarking suite tailored to offline safe reinforcement learning (RL) challenges, aiming to foster progress in the development and evaluation of safe learning algorithms in both the training and…

机器学习 · 计算机科学 2023-06-19 Zuxin Liu , Zijian Guo , Haohong Lin , Yihang Yao , Jiacheng Zhu , Zhepeng Cen , Hanjiang Hu , Wenhao Yu , Tingnan Zhang , Jie Tan , Ding Zhao