English
Related papers

Related papers: Variance Reduced Advantage Estimation with $\delta…

200 papers

We introduce Hindsight Off-policy Options (HO2), a data-efficient option learning algorithm. Given any trajectory, HO2 infers likely option choices and backpropagates through the dynamic programming inference procedure to robustly train all…

Neural networks enjoy widespread use, but many aspects of their training, representation, and operation are poorly understood. In particular, our view into the training process is limited, with a single scalar loss being the most common…

Machine Learning · Computer Science 2020-03-04 Janice Lan , Rosanne Liu , Hattie Zhou , Jason Yosinski

One of the main challenges in reinforcement learning (RL) is generalisation. In typical deep RL methods this is achieved by approximating the optimal value function with a low-dimensional representation using a deep network. While this…

Machine Learning · Computer Science 2017-11-29 Harm van Seijen , Mehdi Fatemi , Joshua Romoff , Romain Laroche , Tavian Barnes , Jeffrey Tsang

Multi-agent proximal policy optimization (MAPPO) has recently demonstrated state-of-the-art performance on challenging multi-agent reinforcement learning tasks. However, MAPPO still struggles with the credit assignment problem, wherein the…

Multiagent Systems · Computer Science 2025-02-10 Aditya Kapoor , Benjamin Freed , Howie Choset , Jeff Schneider

Attribution methods seek to explain language model predictions by quantifying the contribution of input tokens to generated outputs. However, most existing techniques are designed for encoder-based architectures and rely on linear…

Computation and Language · Computer Science 2026-04-16 Vishal Pramanik , Maisha Maliha , Nathaniel D. Bastian , Sumit Kumar Jha

Most reinforcement learning practitioners evaluate their policies with online Monte Carlo estimators for either hyperparameter tuning or testing different algorithmic design choices, where the policy is repeatedly executed in the…

Machine Learning · Computer Science 2024-10-03 Shuze Liu , Shangtong Zhang

The difference-of-convex algorithm (DCA) and its variants are the most popular methods to solve the difference-of-convex optimization problem. Each iteration of them is reduced to a convex optimization problem, which generally needs to be…

Optimization and Control · Mathematics 2025-05-19 Songnian He , Qiao-Li Dong , Michael Th. Rassias

Principal component analysis (PCA) is a classical and ubiquitous method for reducing data dimensionality, but it is suboptimal for heterogeneous data that are increasingly common in modern applications. PCA treats all samples uniformly so…

Statistics Theory · Mathematics 2021-12-02 David Hong , Kyle Gilman , Laura Balzano , Jeffrey A. Fessler

Stochastic Gradient Descent (SGD) has become popular for solving large scale supervised machine learning optimization problems such as SVM, due to their strong theoretical guarantees. While the closely related Dual Coordinate Ascent (DCA)…

Machine Learning · Statistics 2015-03-20 Shai Shalev-Shwartz , Tong Zhang

Most of reinforcement learning algorithms optimize the discounted criterion which is beneficial to accelerate the convergence and reduce the variance of estimates. Although the discounted criterion is appropriate for certain tasks such as…

Machine Learning · Computer Science 2021-11-02 Xiaoteng Ma , Xiaohang Tang , Li Xia , Jun Yang , Qianchuan Zhao

Learning high-performance control policies that remain consistent with expert behavior is a fundamental challenge in robotics. Reinforcement learning can discover high-performing strategies but often departs from desirable human behavior,…

Robotics · Computer Science 2026-04-06 Siwei Ju , Jan Tauberschmidt , Oleg Arenz , Peter van Vliet , Jan Peters

The Boosted Difference of Convex functions Algorithm (BDCA) has been recently introduced to accelerate the performance of the classical Difference of Convex functions Algorithm (DCA). This acceleration is achieved thanks to an extrapolation…

Optimization and Control · Mathematics 2022-08-03 Francisco J. Aragón Artacho , Rubén Campoy , Phan T. Vuong

Reinforcement learning methods have been developed to achieve great success in training control policies in various automation tasks. However, a main challenge of the wider application of reinforcement learning in practical automation is…

Robotics · Computer Science 2020-05-12 Haonan Chang , Zhuo Xu , Masayoshi Tomizuka

Adaptive gradient methods have been increasingly adopted by deep learning community due to their fast convergence and reduced sensitivity to hyper-parameters. However, these methods come with limitations, such as increased memory…

Machine Learning · Computer Science 2024-12-17 Corrado Coppola , Lorenzo Papa , Irene Amerini , Laura Palagi

Value Decomposition (VD) aims to deduce the contributions of agents for decentralized policies in the presence of only global rewards, and has recently emerged as a powerful credit assignment paradigm for tackling cooperative Multi-Agent…

Machine Learning · Computer Science 2023-03-15 Shunyu Liu , Yihe Zhou , Jie Song , Tongya Zheng , Kaixuan Chen , Tongtian Zhu , Zunlei Feng , Mingli Song

While autonomous vehicles (AVs) may perform remarkably well in generic real-life cases, their irrational action in some unforeseen cases leads to critical safety concerns. This paper introduces the concept of collaborative reinforcement…

Machine Learning · Computer Science 2023-05-31 Utku Ayvaz , Chih-Hong Cheng , Hao Shen

Hindsight Experience Replay (HER) is one of the efficient algorithm to solve Reinforcement Learning tasks related to sparse rewarded environments.But due to its reduced sample efficiency and slower convergence HER fails to perform…

Machine Learning · Computer Science 2020-10-14 Dhuruva Priyan G M , Abhik Singla , Shalabh Bhatnagar

Learning to quantify (a.k.a.\ quantification) is a task concerned with training unbiased estimators of class prevalence via supervised learning. This task originated with the observation that "Classify and Count" (CC), the trivial method of…

Machine Learning · Computer Science 2021-09-22 Alejandro Moreo , Fabrizio Sebastiani

Existing approaches for unsupervised domain adaptive object detection perform feature alignment via adversarial training. While these methods achieve reasonable improvements in performance, they typically perform category-agnostic domain…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Vibashan VS , Vikram Gupta , Poojan Oza , Vishwanath A. Sindagi , Vishal M. Patel

The ability to transfer knowledge to novel environments and tasks is a sensible desiderata for general learning agents. Despite the apparent promises, transfer in RL is still an open and little exploited research area. In this paper, we…

Machine Learning · Computer Science 2020-10-13 Johan Ferret , Raphaël Marinier , Matthieu Geist , Olivier Pietquin