English
Related papers

Related papers: A Simpler Alternative to Variational Regularized C…

200 papers

Off-policy learning is a framework for optimizing policies without deploying them, using data collected by another policy. In recommender systems, this is especially challenging due to the imbalance in logged data: some items are…

Machine Learning · Computer Science 2024-10-23 Matej Cief , Branislav Kveton , Michal Kompan

Offline reinforcement learning, which seeks to utilize offline/historical data to optimize sequential decision-making strategies, has gained surging prominence in recent studies. Due to the advantage that appropriate function approximators…

Machine Learning · Computer Science 2022-03-14 Ming Yin , Yaqi Duan , Mengdi Wang , Yu-Xiang Wang

Reinforcement learning (RL) has achieved enormous progress in solving various sequential decision-making problems, such as control tasks in robotics. Since policies are overfitted to training environments, RL methods have often failed to be…

Robotics · Computer Science 2023-03-21 Xiao Wang , Saasha Nair , Matthias Althoff

The ability to generalize under distributional shifts is essential to reliable machine learning, while models optimized with empirical risk minimization usually fail on non-$i.i.d$ testing data. Recently, invariant learning methods for…

Machine Learning · Computer Science 2021-10-26 Jiashuo Liu , Zheyuan Hu , Peng Cui , Bo Li , Zheyan Shen

In numerous reinforcement learning (RL) problems involving safety-critical systems, a key challenge lies in balancing multiple objectives while simultaneously meeting all stringent safety constraints. To tackle this issue, we propose a…

Artificial Intelligence · Computer Science 2024-05-28 Shangding Gu , Bilgehan Sel , Yuhao Ding , Lu Wang , Qingwei Lin , Alois Knoll , Ming Jin

Probabilistic models are often trained by maximum likelihood, which corresponds to minimizing a specific f-divergence between the model and data distribution. In light of recent successes in training Generative Adversarial Networks,…

Machine Learning · Statistics 2024-12-17 Mingtian Zhang , Thomas Bird , Raza Habib , Tianlin Xu , David Barber

The recent remarkable progress of deep reinforcement learning (DRL) stands on regularization of policy for stable and efficient learning. A popular method, named proximal policy optimization (PPO), has been introduced for this purpose. PPO…

Machine Learning · Computer Science 2023-07-04 Taisuke Kobayashi

IRGAN is an information retrieval (IR) modeling approach that uses a theoretical minimax game between a generative and a discriminative model to iteratively optimize both of them, hence unifying the generative and discriminative approaches.…

Information Retrieval · Computer Science 2019-10-02 Moksh Jain , Sowmya Kamath S

Reinforcement Learning (RL) for control has become increasingly popular due to its ability to learn rich feedback policies that take into account uncertainty and complex representations of the environment. When considering safety…

Machine Learning · Computer Science 2024-05-21 Sean Vaskov , Wilko Schwarting , Chris L. Baker

Off-policy learning (OPL) often involves minimizing a risk estimator based on importance weighting to correct bias from the logging policy used to collect data. However, this method can produce an estimator with a high variance. A common…

Machine Learning · Computer Science 2024-06-06 Imad Aouali , Victor-Emmanuel Brunel , David Rohde , Anna Korba

Offline goal-conditioned reinforcement learning (GCRL) aims at solving goal-reaching tasks with sparse rewards from an offline dataset. While prior work has demonstrated various approaches for agents to learn near-optimal policies, these…

Robotics · Computer Science 2024-03-05 Chenyang Cao , Zichen Yan , Renhao Lu , Junbo Tan , Xueqian Wang

We study the variational inference problem of minimizing a regularized R\'enyi divergence over an exponential family. We propose to solve this problem with a Bregman proximal gradient algorithm. We propose a sampling-based algorithm to…

Statistics Theory · Mathematics 2024-10-17 Thomas Guilmeau , Emilie Chouzenoux , Víctor Elvira

In deep reinforcement learning, policy optimization methods need to deal with issues such as function approximation and the reuse of off-policy data. Standard policy gradient methods do not handle off-policy data well, leading to premature…

Machine Learning · Computer Science 2025-01-28 Qing Wang , Yingru Li , Jiechao Xiong , Tong Zhang

Asynchronous reinforcement learning has become increasingly central to scaling LLM post-training, delivering major throughput gains by decoupling rollout generation from policy updates. However, widely used policy-gradient objectives such…

Machine Learning · Computer Science 2026-03-03 Luke J. Huang , Zhuoyang Zhang , Qinghao Hu , Shang Yang , Song Han

Offline reinforcement learning (RL) aims to learn an optimal policy from pre-collected data. However, it faces challenges of distributional shift, where the learned policy may encounter unseen scenarios not covered in the offline data.…

Machine Learning · Computer Science 2025-05-27 Jin Zhu , Xin Zhou , Jiaang Yao , Gholamali Aminian , Omar Rivasplata , Simon Little , Lexin Li , Chengchun Shi

Reinforcement learning algorithms utilizing policy gradients (PG) to optimize Conditional Value at Risk (CVaR) face significant challenges with sample inefficiency, hindering their practical applications. This inefficiency stems from two…

Machine Learning · Computer Science 2024-07-01 Yudong Luo , Yangchen Pan , Han Wang , Philip Torr , Pascal Poupart

Counterfactual regret minimization (CFR) is a family of algorithms for effectively solving imperfect-information games. It decomposes the total regret into counterfactual regrets, utilizing local regret minimization algorithms, such as…

Machine Learning · Computer Science 2024-05-15 Hang Xu , Kai Li , Bingyun Liu , Haobo Fu , Qiang Fu , Junliang Xing , Jian Cheng

Risk-averse Constrained Reinforcement Learning (RaCRL) aims to learn policies that minimise the likelihood of rare and catastrophic constraint violations caused by an environment's inherent randomness. In general, risk-aversion leads to…

Machine Learning · Computer Science 2025-08-28 James McCarthy , Radu Marinescu , Elizabeth Daly , Ivana Dusparic

In many real-world settings, the critical class is rare and a missed detection carries a disproportionately high cost. For example, tumors are rare and a false negative diagnosis could have severe consequences on treatment outcomes;…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Mohammadi Kiarash , Zhao He , Mengyao Zhai , Frederick Tung

Scaling test-time computation with reinforcement learning (RL) has emerged as a reliable path to improve large language models (LLM) reasoning ability. Yet, outcome-based reward often incentivizes models to be overconfident, leading to…

Machine Learning · Computer Science 2026-04-28 Liaoyaqi Wang , Chunsheng Zuo , William Jurayj , Benjamin Van Durme , Anqi Liu