English
Related papers

Related papers: Uncertainty-Aware Policy Optimization: A Robust, A…

200 papers

Reinforcement learning offers the promise of automating the acquisition of complex behavioral skills. However, compared to commonly used and well-understood supervised learning methods, reinforcement learning algorithms can be brittle,…

Machine Learning · Computer Science 2020-01-01 Aviral Kumar , Xue Bin Peng , Sergey Levine

In recent years, there has been significant progress in applying deep reinforcement learning (RL) for solving challenging problems across a wide variety of domains. Nevertheless, convergence of various methods has been shown to suffer from…

Machine Learning · Computer Science 2022-08-19 Pranav Khanna , Guy Tennenholtz , Nadav Merlis , Shie Mannor , Chen Tessler

Proximal policy optimization (PPO) is one of the most successful deep reinforcement-learning methods, achieving state-of-the-art performance across a wide range of challenging tasks. However, its optimization behavior is still far from…

Machine Learning · Computer Science 2020-01-15 Yuhui Wang , Hao He , Chao Wen , Xiaoyang Tan

In many contemporary applications such as healthcare, finance, robotics, and recommendation systems, continuous deployment of new policies for data collection and online learning is either cost ineffective or impractical. We consider a…

Machine Learning · Computer Science 2021-06-07 DiJia Su , Jason D. Lee , John M. Mulvey , H. Vincent Poor

In this paper, we develop a two-stage data-driven approach to address the adjustable robust optimization problem, where the uncertainty set is adjustable to manage infeasibility caused by significant or poorly quantified uncertainties. In…

Optimization and Control · Mathematics 2025-05-29 Xiaoxing Ren , Alessio Moreschini , Zhongda Chu , Yulong Gao , Thomas Parisini

Deep reinforcement learning is an increasingly popular technique for synthesising policies to control an agent's interaction with its environment. There is also growing interest in formally verifying that such policies are correct and…

Artificial Intelligence · Computer Science 2022-06-02 Edoardo Bacci , David Parker

Optimal sensor placement enhances the efficiency of a variety of applications for monitoring dynamical systems. It has been established that deterministic solutions to the sensor placement problem are insufficient due to the many…

Systems and Control · Electrical Eng. & Systems 2023-03-20 Amin Jabini , Erik A. Johnson

Robust optimization methods have shown practical advantages in a wide range of decision-making applications under uncertainty. Recently, their efficacy has been extended to multi-period settings. Current approaches model uncertainty either…

Optimization and Control · Mathematics 2022-02-23 Omid Nohadani , Kartikey Sharma

Reinforcement Learning has applications in field of mechatronics, robotics, and other resource-constrained control system. Problem of resource allocation is primarily solved using traditional predefined techniques and modern deep learning…

Machine Learning · Computer Science 2021-06-18 Neel Gandhi , Shakti Mishra

Reinforcement learning for large language models faces a fundamental trade-off between sample efficiency and asymptotic performance: strictly on-policy methods discard trajectories after a single update, while off-policy reuse introduces…

Machine Learning · Computer Science 2026-05-26 Changyu Chen , Xiting Wang , Rui Yan

Reinforcement learning is structurally harder than supervised learning because the policy changes the data distribution it learns from. The resulting fragility is especially visible in large-model training, where the training and rollout…

Machine Learning · Computer Science 2026-05-13 Rasool Fakoor , Murdock Aubry , Nicholas Stranges , Alexander J. Smola

Uncertainty is ubiquitous in games, both in the agents playing games and often in the games themselves. Working with uncertainty is therefore an important component of successful deep reinforcement learning agents. While there has been…

Machine Learning · Computer Science 2022-08-22 Owen Lockwood , Mei Si

Standard reinforcement learning methods aim to master one way of solving a task whereas there may exist multiple near-optimal policies. Being able to identify this collection of near-optimal policies can allow a domain expert to efficiently…

Machine Learning · Computer Science 2019-06-04 Muhammad A. Masood , Finale Doshi-Velez

Deep reinforcement learning (DRL) has emerged as a promising approach for developing more intelligent autonomous vehicles (AVs). A typical DRL application on AVs is to train a neural network-based driving policy. However, the black-box…

Artificial Intelligence · Computer Science 2023-05-15 Weitao Zhou , Zhong Cao , Nanshan Deng , Kun Jiang , Diange Yang

There is growing importance to detecting faults and implementing the best methods in industrial and real-world systems. We are searching for the most trustworthy and practical data-based fault detection methods proposed by artificial…

Systems and Control · Electrical Eng. & Systems 2023-01-11 Mohammad Hossein Modirrousta , Mahdi Aliyari Shoorehdeli , Mostafa Yari , Arash Ghahremani

We consider the problem of uncertainty estimation in the context of (non-Bayesian) deep neural classification. In this context, all known methods are based on extracting uncertainty signals from a trained network optimized to solve the…

Machine Learning · Computer Science 2019-04-25 Yonatan Geifman , Guy Uziel , Ran El-Yaniv

Uncertainty estimation bears the potential to make deep learning (DL) systems more reliable. Standard techniques for uncertainty estimation, however, come along with specific combinations of strengths and weaknesses, e.g., with respect to…

Machine Learning · Computer Science 2022-05-02 Joachim Sicking , Maram Akila , Jan David Schneider , Fabian Hüger , Peter Schlicht , Tim Wirtz , Stefan Wrobel

This paper proposes a robust control design method using reinforcement-learning for controlling partially-unknown dynamical systems under uncertain conditions. The method extends the optimal reinforcement-learning algorithm with a new…

Systems and Control · Electrical Eng. & Systems 2020-04-17 Phuong D. Ngo , Fred Godtliebsen

Neural networks (NNs) can achieved high performance in various fields such as computer vision, and natural language processing. However, deploying NNs in resource-constrained safety-critical systems has challenges due to uncertainty in the…

Machine Learning · Computer Science 2024-01-17 Soyed Tuhin Ahmed

While deep reinforcement learning (RL) agents have showcased strong results across many domains, a major concern is their inherent opaqueness and the safety of such systems in real-world use cases. To overcome these issues, we need agents…

Machine Learning · Computer Science 2022-10-10 Eugene Bykovets , Yannick Metz , Mennatallah El-Assady , Daniel A. Keim , Joachim M. Buhmann