中文
相关论文

相关论文: Beyond Worst-case Attacks: Robust RL with Adaptive…

200 篇论文

Due to the proliferation of renewable energy and its intrinsic intermittency and stochasticity, current power systems face severe operational challenges. Data-driven decision-making algorithms from reinforcement learning (RL) offer a…

系统与控制 · 电气工程与系统科学 2021-10-20 Alexander Pan , Yongkyun Lee , Huan Zhang , Yize Chen , Yuanyuan Shi

Reinforcement learning (RL) algorithms aim to learn optimal decisions in unknown environments through experience of taking actions and observing the rewards gained. In some cases, the environment is not influenced by the actions of the RL…

Offline reinforcement learning (RL) aims to find performant policies from logged data without further environment interaction. Model-based algorithms, which learn a model of the environment from the dataset and perform conservative policy…

机器学习 · 计算机科学 2022-10-12 Marc Rigter , Bruno Lacerda , Nick Hawes

Offline reinforcement learning (RL) looks at learning how to optimally solve tasks using a fixed dataset of interactions from the environment. Many off-policy algorithms developed for online learning struggle in the offline setting as they…

机器学习 · 计算机科学 2025-03-18 Natinael Solomon Neggatu , Jeremie Houssineau , Giovanni Montana

Fully autonomous vehicles promise enhanced safety and efficiency. However, ensuring reliable operation in challenging corner cases requires control algorithms capable of performing at the vehicle limits. We address this requirement by…

机器人学 · 计算机科学 2025-08-14 Grzegorz Czechmanowski , Jan Węgrzynowski , Piotr Kicki , Krzysztof Walas

Decision making and learning in the presence of uncertainty has attracted significant attention in view of the increasing need to achieve robust and reliable operations. In the case where uncertainty stems from the presence of adversarial…

机器学习 · 计算机科学 2024-03-25 André Bertolace , Konstatinos Gatsis , Kostas Margellos

While reinforcement learning (RL) has achieved notable success in various domains, training effective policies for complex tasks remains challenging. Agents often converge to local optima and fail to maximize long-term rewards. Existing…

人工智能 · 计算机科学 2025-05-28 Heng Tan , Hua Yan , Yu Yang

To improve efficiency and reduce failures in autonomous vehicles, research has focused on developing robust and safe learning methods that take into account disturbances in the environment. Existing literature in robust reinforcement…

机器学习 · 计算机科学 2019-03-12 Xiaobai Ma , Katherine Driggs-Campbell , Mykel J. Kochenderfer

A promising paradigm for offline reinforcement learning (RL) is to constrain the learned policy to stay close to the dataset behaviors, known as policy constraint offline RL. However, existing works heavily rely on the purity of the data,…

机器学习 · 计算机科学 2022-10-20 Chengqian Gao , Ke Xu , Liu Liu , Deheng Ye , Peilin Zhao , Zhiqiang Xu

Constrained reinforcement learning has achieved promising progress in safety-critical fields where both rewards and constraints are considered. However, constrained reinforcement learning methods face challenges in striking the right…

机器学习 · 计算机科学 2024-10-29 Jianmina Ma , Jingtian Ji , Yue Gao

Distributionally robust offline reinforcement learning (RL), which seeks robust policy training against environment perturbation by modeling dynamics uncertainty, calls for function approximations when facing large state-action spaces.…

机器学习 · 计算机科学 2025-11-03 Zhishuai Liu , Pan Xu

Continuous Integration (CI) significantly reduces integration problems, speeds up development time, and shortens release time. However, it also introduces new challenges for quality assurance activities, including regression testing, which…

软件工程 · 计算机科学 2021-03-29 Mojtaba Bagherzadeh , Nafiseh Kahani , Lionel Briand

This paper presents a study of robust policy networks in deep reinforcement learning. We investigate the benefits of policy parameterizations that naturally satisfy constraints on their Lipschitz bound, analyzing their empirical performance…

机器学习 · 计算机科学 2025-02-07 Nicholas H. Barbara , Ruigang Wang , Ian R. Manchester

In this paper, we study the adversarial robustness of subspace learning problems. Different from the assumptions made in existing work on robust subspace learning where data samples are contaminated by gross sparse outliers or small dense…

信号处理 · 电气工程与系统科学 2020-04-22 Fuwei Li , Lifeng Lai , Shuguang Cui

Reinforcement learning (RL) is currently one of the most prominent methods for optimizing dynamical systems, with breakthrough results across various fields. The framework is based on the concept of a Markov decision process (MDP), leading…

最优化与控制 · 数学 2025-11-17 Rene Carmona , Mathieu Lauriere

This study investigates a counterintuitive phenomenon in adversarial machine learning: the potential for noise-based defenses to inadvertently aid evasion attacks in certain scenarios. While randomness is often employed as a defensive…

密码学与安全 · 计算机科学 2024-11-01 Steve Bakos , Pooria Madani , Heidar Davoudi

Training machine learning models that are robust against adversarial inputs poses seemingly insurmountable challenges. To better understand adversarial robustness, we consider the underlying problem of learning robust representations. We…

机器学习 · 计算机科学 2020-07-07 Sicheng Zhu , Xiao Zhang , David Evans

Many sequential decision-making problems that are currently automated, such as those in manufacturing or recommender systems, operate in an environment where there is either little uncertainty, or zero risk of catastrophe. As companies and…

机器学习 · 计算机科学 2023-04-04 Marc Rigter

Strong worst-case performance bounds for episodic reinforcement learning exist but fortunately in practice RL algorithms perform much better than such bounds would predict. Algorithms and theory that provide strong problem-dependent bounds…

机器学习 · 计算机科学 2019-11-05 Andrea Zanette , Emma Brunskill

Existing metrics for reinforcement learning (RL) such as regret, PAC bounds, or uniform-PAC (Dann et al., 2017), typically evaluate the cumulative performance, while allowing the agent to play an arbitrarily bad policy at any finite time t.…

机器学习 · 计算机科学 2024-11-01 Junyan Liu , Yunfan Li , Ruosong Wang , Lin F. Yang