English
Related papers

Related papers: Diverse Projection Ensembles for Distributional Re…

200 papers

In reinforcement learning (RL), the consideration of multivariate reward signals has led to fundamental advancements in multi-objective decision-making, transfer learning, and representation learning. This work introduces the first…

Machine Learning · Computer Science 2024-09-05 Harley Wiltzer , Jesse Farebrother , Arthur Gretton , Mark Rowland

Heterogeneous ensembles built from the predictions of a wide variety and large number of diverse base predictors represent a potent approach to building predictive models for problems where the ideal base/individual predictor may not be…

Machine Learning · Computer Science 2021-03-01 Ana Stanescu , Gaurav Pandey

When performing imitation learning from expert demonstrations, distribution matching is a popular approach, in which one alternates between estimating distribution ratios and then using these ratios as rewards in a standard reinforcement…

Machine Learning · Computer Science 2019-12-12 Ilya Kostrikov , Ofir Nachum , Jonathan Tompson

Deep reinforcement learning (DRL) is a very active research area. However, several technical and scientific issues require to be addressed, amongst which we can mention data inefficiency, exploration-exploitation trade-off, and multi-task…

Machine Learning · Computer Science 2020-11-24 Mohammad Reza Samsami , Hossein Alimadad

Research in machine learning is making progress in fixing its own reproducibility crisis. Reinforcement learning (RL), in particular, faces its own set of unique challenges. Comparison of point estimates, and plots that show successful…

Machine Learning · Computer Science 2024-02-07 Ted Fujimoto , Joshua Suetterlein , Samrat Chatterjee , Auroop Ganguly

Safety in reinforcement learning (RL) is a key property in both training and execution in many domains such as autonomous driving or finance. In this paper, we formalize it with a constrained RL formulation in the distributional RL setting.…

Machine Learning · Computer Science 2021-03-01 Jianyi Zhang , Paul Weng

Reinforcement Learning (RL) is an emerging approach to control many dynamical systems for which classical control approaches are not applicable or insufficient. However, the resultant policies may not generalize to variations in the…

Robotics · Computer Science 2023-11-13 Abdel Gafoor Haddad , Mohammed B. Mohiuddin , Igor Boiko , Yahya Zweiri

Although distributional reinforcement learning (DRL) has been widely examined in the past few years, very few studies investigate the validity of the obtained Q-function estimator in the distributional setting. To fully understand how the…

Machine Learning · Computer Science 2023-08-01 Qi Kuang , Zhoufan Zhu , Liwen Zhang , Fan Zhou

We introduce sparse random projection, an important dimension-reduction tool from machine learning, for the estimation of discrete-choice models with high-dimensional choice sets. Initially, high-dimensional data are compressed into a…

Machine Learning · Statistics 2016-04-21 Khai X. Chiong , Matthew Shum

In this paper we argue for the fundamental importance of the value distribution: the distribution of the random return received by a reinforcement learning agent. This is in contrast to the common approach to reinforcement learning which…

Machine Learning · Computer Science 2017-07-24 Marc G. Bellemare , Will Dabney , Rémi Munos

In dynamic programming (DP) and reinforcement learning (RL), an agent learns to act optimally in terms of expected long-term return by sequentially interacting with its environment modeled by a Markov decision process (MDP). More generally…

Machine Learning · Computer Science 2022-01-03 Mastane Achab , Gergely Neu

Ensembling a neural network is a widely recognized approach to enhance model performance, estimate uncertainty, and improve robustness in deep supervised learning. However, deep ensembles often come with high computational costs and memory…

Reinforcement learning (RL) with sparse and deceptive rewards is challenging because non-zero rewards are rarely obtained. Hence, the gradient calculated by the agent can be stochastic and without valid information. Recent studies that…

Machine Learning · Computer Science 2024-02-08 Guojian Wang , Faguo Wu , Xiao Zhang , Jianxiang Liu

Despite the high performance achieved by deep neural networks on various tasks, extensive studies have demonstrated that small tweaks in the input could fail the model predictions. This issue of deep neural networks has led to a number of…

Machine Learning · Computer Science 2022-02-22 Ming-Chang Chiu , Xuezhe Ma

Ensemble methods have been widely applied in Reinforcement Learning (RL) in order to enhance stability, increase convergence speed, and improve exploration. These methods typically work by employing an aggregation mechanism over actions of…

Artificial Intelligence · Computer Science 2019-10-09 Rishav Chourasia , Adish Singla

Many real-world problems require trading off multiple competing objectives. However, these objectives are often in different units and/or scales, which can make it challenging for practitioners to express numerical preferences over…

Recent advancements have shown that reinforcement learning (RL) can substantially improve the reasoning abilities of large language models (LLMs). The effectiveness of such RL training, however, depends critically on the exploration space…

Computation and Language · Computer Science 2026-03-17 Haoyuan Wu , Hai Wang , Jiajia Wu , Jinxiang Ou , Keyao Wang , Weile Chen , Zihao Zheng , Bei Yu

Diffusion-based models have achieved notable empirical successes in reinforcement learning (RL) due to their expressiveness in modeling complex distributions. Despite existing methods being promising, the key challenge of extending existing…

Machine Learning · Computer Science 2024-11-04 Dmitry Shribak , Chen-Xiao Gao , Yitong Li , Chenjun Xiao , Bo Dai

While most reinforcement learning methods today flatten the distribution of future returns to a single scalar value, distributional RL methods exploit the return distribution to provide stronger learning signals and to enable applications…

Machine Learning · Computer Science 2026-03-05 Perry Dong , Chongyi Zheng , Chelsea Finn , Dorsa Sadigh , Benjamin Eysenbach

Differential equations in general and neural ODEs in particular are an essential technique in continuous-time system identification. While many deterministic learning algorithms have been designed based on numerical integration via the…

Machine Learning · Computer Science 2021-10-18 Lenart Treven , Philippe Wenk , Florian Dörfler , Andreas Krause