中文
相关论文

相关论文: Risk-Averse Model Uncertainty for Distributionally…

200 篇论文

Reinforcement learning is about learning agent models that make the best sequential decisions in unknown environments. In an unknown environment, the agent needs to explore the environment while exploiting the collected information, which…

机器学习 · 计算机科学 2021-02-12 Hong Qian , Yang Yu

Diffusion models surpass previous generative models in sample quality and training stability. Recent works have shown the advantages of diffusion models in improving reinforcement learning (RL) solutions. This survey aims to provide an…

机器学习 · 计算机科学 2024-02-26 Zhengbang Zhu , Hanye Zhao , Haoran He , Yichao Zhong , Shenyu Zhang , Haoquan Guo , Tingting Chen , Weinan Zhang

The ability to learn disentangled representations that split underlying sources of variation in high dimensional, unstructured data is important for data efficient and robust use of neural networks. While various approaches aiming towards…

机器学习 · 统计学 2019-05-15 Raphael Suter , Đorđe Miladinović , Bernhard Schölkopf , Stefan Bauer

To overcome the sim-to-real gap in reinforcement learning (RL), learned policies must maintain robustness against environmental uncertainties. While robust RL has been widely studied in single-agent regimes, in multi-agent environments, the…

机器学习 · 计算机科学 2024-05-10 Laixi Shi , Eric Mazumdar , Yuejie Chi , Adam Wierman

Robust Reinforcement Learning aims to find the optimal policy with some extent of robustness to environmental dynamics. Existing learning algorithms usually enable the robustness through disturbing the current state or simulating…

机器学习 · 计算机科学 2020-06-02 Linfang Hou , Liang Pang , Xin Hong , Yanyan Lan , Zhiming Ma , Dawei Yin

Reinforcement learning is a machine learning approach concerned with solving dynamic optimization problems in an almost model-free way by maximizing a reward function in state and action spaces. This property makes it an exciting area of…

投资组合管理 · 定量金融 2020-10-12 Miquel Noguer i Alonso , Sonam Srivastava

Research in machine learning is making progress in fixing its own reproducibility crisis. Reinforcement learning (RL), in particular, faces its own set of unique challenges. Comparison of point estimates, and plots that show successful…

机器学习 · 计算机科学 2024-02-07 Ted Fujimoto , Joshua Suetterlein , Samrat Chatterjee , Auroop Ganguly

Robust reinforcement learning (RL) aims to learn policies that remain effective despite uncertainties in its environment, which frequently arise in real-world applications due to variations in environment dynamics. The robust RL methods…

机器学习 · 计算机科学 2025-05-30 Linh Le Pham Van , Minh Hoang Nguyen , Hung Le , Hung The Tran , Sunil Gupta

A particularly challenging problem in AI safety is providing guarantees on the behavior of high-dimensional autonomous systems. Verification approaches centered around reachability analysis fail to scale, and purely statistical approaches…

We introduce a fine-grained framework for uncertainty quantification of predictive models under distributional shifts. This framework distinguishes the shift in covariate distributions from that in the conditional relationship between the…

统计方法学 · 统计学 2025-05-20 Jiahao Ai , Zhimei Ren

We study the problem of assessing the robustness of counterfactual explanations for deep learning models. We focus on $\textit{plausible model shifts}$ altering model parameters and propose a novel framework to reason about the robustness…

机器学习 · 计算机科学 2024-07-11 Luca Marzari , Francesco Leofante , Ferdinando Cicalese , Alessandro Farinelli

Reinforcement learning is considered to be a strong AI paradigm which can be used to teach machines through interaction with the environment and learning from their mistakes. Despite its perceived utility, it has not yet been successfully…

机器学习 · 统计学 2017-04-11 Ahmad El Sallab , Mohammed Abdou , Etienne Perot , Senthil Yogamani

Robust Markov Decision Processes (RMDPs) intend to ensure robustness with respect to changing or adversarial system behavior. In this framework, transitions are modeled as arbitrary elements of a known and properly structured uncertainty…

机器学习 · 计算机科学 2019-07-25 Esther Derman , Daniel Mankowitz , Timothy Mann , Shie Mannor

Deep reinforcement learning enables algorithms to learn complex behavior, deal with continuous action spaces and find good strategies in environments with high dimensional state spaces. With deep reinforcement learning being an active area…

机器学习 · 计算机科学 2018-10-17 Winfried Lötzsch

Reinforcement learning (RL) is recognized as lacking generalization and robustness under environmental perturbations, which excessively restricts its application for real-world robotics. Prior work claimed that adding regularization to the…

机器学习 · 计算机科学 2023-12-06 Yuan Zhang , Jianhong Wang , Joschka Boedecker

This paper investigates model robustness in reinforcement learning (RL) to reduce the sim-to-real gap in practice. We adopt the framework of distributionally robust Markov decision processes (RMDPs), aimed at learning a policy that…

机器学习 · 计算机科学 2025-09-09 Laixi Shi , Gen Li , Yuting Wei , Yuxin Chen , Matthieu Geist , Yuejie Chi

This paper proposes risk-averse and risk-agnostic formulations to robust design in which solutions that satisfy the system requirements for a set of scenarios are pursued. These scenarios, which correspond to realizations of uncertain…

最优化与控制 · 数学 2025-11-07 Luis G. Crespo , Bret Stanford , Natalia Alexandrov

The robustness of legged locomotion is crucial for quadrupedal robots in challenging terrains. Recently, Reinforcement Learning (RL) has shown promising results in legged locomotion and various methods try to integrate privileged…

机器人学 · 计算机科学 2023-09-04 Jiyuan Shi , Chenjia Bai , Haoran He , Lei Han , Dong Wang , Bin Zhao , Mingguo Zhao , Xiu Li , Xuelong Li

Despite remarkable achievements in artificial intelligence, the deployability of learning-enabled systems in high-stakes real-world environments still faces persistent challenges. For example, in safety-critical domains like autonomous…

人工智能 · 计算机科学 2023-12-19 Minjae Cho , Chuangchuang Sun

We develop a new classification framework based on the theory of coherent risk measures and systemic risk. The proposed approach is suitable for multi-class problems when the data is noisy, scarce (relative to the dimension of the problem),…

机器学习 · 统计学 2026-05-29 Darinka Dentcheva , Xiangyu Tian