中文
相关论文

相关论文: On Robust Reinforcement Learning with Lipschitz-Bo…

200 篇论文

The advent of deep learning has inspired research into end-to-end learning for a variety of problem domains in robotics. For navigation, the resulting methods may not have the generalization properties desired let alone match the…

机器人学 · 计算机科学 2021-03-03 Haoxin Ma , Justin S. Smith , Patricio A. Vela

We study the infinite-horizon average-reward reinforcement learning (RL) for continuous space Lipschitz MDPs in which an agent can play policies from a given set $\Phi$. The proposed algorithms efficiently explore the policy space by…

机器学习 · 计算机科学 2025-11-18 Avik Kar , Rahul Singh

Safe reinforcement learning (Safe RL) aims to ensure policy performance while satisfying safety constraints. However, most existing Safe RL methods assume benign environments, making them vulnerable to adversarial perturbations commonly…

机器学习 · 计算机科学 2026-02-19 Jialiang Fan , Shixiong Jiang , Mengyu Liu , Fanxin Kong

Reinforcement learning (RL) enables sequential decision-making in complex and high-dimensional environments through interaction with the environment. In most real-world applications, however, a high number of interactions are infeasible. In…

机器学习 · 计算机科学 2024-12-17 Md Ferdous Alam , Parinaz Naghizadeh , David Hoelzle

We investigate the effect of the dimensionality of the representations learned in Deep Neural Networks (DNNs) on their robustness to input perturbations, both adversarial and random. To achieve low dimensionality of learned representations,…

机器学习 · 计算机科学 2020-02-20 Amartya Sanyal , Varun Kanade , Philip H. S. Torr , Puneet K. Dokania

Reinforcement learning (RL) faces substantial challenges when applied to real-life problems, primarily stemming from the scarcity of available data due to limited interactions with the environment. This limitation is exacerbated by the fact…

神经与进化计算 · 计算机科学 2024-04-10 Cristiano Capone , Paolo Muratore

Skilled robot task learning is best implemented by predictive action policies due to the inherent latency of sensorimotor processes. However, training such predictive policies is challenging as it involves finding a trajectory of motor…

机器人学 · 计算机科学 2017-03-03 Ali Ghadirzadeh , Atsuto Maki , Danica Kragic , Mårten Björkman

Adversarial examples have pointed out Deep Neural Networks vulnerability to small local noise. It has been shown that constraining their Lipschitz constant should enhance robustness, but make them harder to learn with classical loss…

Deep Neural Networks, despite their great success in diverse domains, are provably sensitive to small perturbations on correctly classified examples and lead to erroneous predictions. Recently, it was proposed that this behavior can be…

机器学习 · 计算机科学 2020-09-29 Nan Xu , Oluwaseyi Feyisetan , Abhinav Aggarwal , Zekun Xu , Nathanael Teissier

Many of the successes of machine learning are based on minimizing an averaged loss function. However, it is well-known that this paradigm suffers from robustness issues that hinder its applicability in safety-critical domains. These issues…

机器学习 · 计算机科学 2022-06-09 Alexander Robey , Luiz F. O. Chamon , George J. Pappas , Hamed Hassani

Lipschitz bandits is a prominent version of multi-armed bandits that studies large, structured action spaces such as the $[0,1]$ interval, where similar actions are guaranteed to have similar rewards. A central theme here is the adaptive…

机器学习 · 计算机科学 2025-06-13 Chara Podimata , Aleksandrs Slivkins

Deep neural networks are incredibly vulnerable to crafted, human-imperceptible adversarial perturbations. Although adversarial training (AT) has proven to be an effective defense approach, we find that the AT-trained models heavily rely on…

计算机视觉与模式识别 · 计算机科学 2022-12-27 Binxiao Huang , Chaofan Tao , Rui Lin , Ngai Wong

This paper is concerned with the training of neural networks (NNs) under semidefinite constraints, which allows for NN training with robustness and stability guarantees. In particular, we focus on Lipschitz bounds for NNs. Exploiting the…

机器学习 · 计算机科学 2022-09-21 Patricia Pauli , Niklas Funcke , Dennis Gramlich , Mohamed Amine Msalmi , Frank Allgöwer

To minimize or upper-bound the value of a function "robustly", we might instead minimize or upper-bound the "epsilon-robust regularization", defined as the map from a point to the maximum value of the function within an epsilon-radius. This…

最优化与控制 · 数学 2010-06-10 Adrian S. Lewis , C. H. Jeffrey Pang

The growing threat of low-cost kamikaze drone swarms poses a critical challenge to modern defense systems demanding rapid and strategic decision-making to prioritize interceptions across multiple effectors and high-value target zones. In…

机器学习 · 计算机科学 2025-09-23 Alessandro Palmas

In this paper we discuss the stability properties of convolutional neural networks. Convolutional neural networks are widely used in machine learning. In classification they are mainly used as feature extractors. Ideally, we expect similar…

机器学习 · 计算机科学 2017-01-20 Radu Balan , Maneesh Singh , Dongmian Zou

Deep neural networks are vulnerable to adversarial attacks. Recent studies about adversarial robustness focus on the loss landscape in the parameter space since it is related to optimization and generalization performance. These studies…

机器学习 · 计算机科学 2023-03-07 Sekitoshi Kanai , Masanori Yamada , Hiroshi Takahashi , Yuki Yamanaka , Yasutoshi Ida

Real-life applications of deep neural networks are hindered by their unsteady predictions when faced with noisy inputs and adversarial attacks. The certified radius in this context is a crucial indicator of the robustness of models. However…

机器学习 · 计算机科学 2024-03-19 Blaise Delattre , Alexandre Araujo , Quentin Barthélemy , Alexandre Allauzen

A growing body of evidence suggests that neural networks employed in deep reinforcement learning (RL) gradually lose their plasticity, the ability to learn from new data; however, the analysis and mitigation of this phenomenon is hampered…

机器学习 · 计算机科学 2023-10-05 Evgenii Nikishin , Junhyuk Oh , Georg Ostrovski , Clare Lyle , Razvan Pascanu , Will Dabney , André Barreto

Convolutional and Recurrent, deep neural networks have been successful in machine learning systems for computer vision, reinforcement learning, and other allied fields. However, the robustness of such neural networks is seldom apprised,…

神经与进化计算 · 计算机科学 2018-05-01 Biswa Sengupta , Karl J. Friston