English
Related papers

Related papers: Entropy-Regularized Adjoint Matching for Offline R…

200 papers

We study offline meta-reinforcement learning, a practical reinforcement learning paradigm that learns from offline data to adapt to new tasks. The distribution of offline data is determined jointly by the behavior policy and the task.…

Machine Learning · Computer Science 2022-06-22 Haoqi Yuan , Zongqing Lu

In this paper, we provide two new stable online algorithms for the problem of prediction in reinforcement learning, \emph{i.e.}, estimating the value function of a model-free Markov reward process using the linear function approximation…

Machine Learning · Computer Science 2018-06-19 Ajin George Joseph , Shalabh Bhatnagar

Reinforcement learning algorithms in multi-agent systems deliver highly resilient and adaptable solutions for common problems in telecommunications,aerospace, and industrial robotics. However, achieving an optimal global goal remains a…

Multiagent Systems · Computer Science 2021-05-18 Changgang Zheng , Shufan Yang , Juan Parra-Ullauri , Antonio Garcia-Dominguez , Nelly Bencomo

Model-based offline reinforcement learning methods (RL) have achieved state-of-the-art performance in many decision-making problems thanks to their sample efficiency and generalizability. Despite these advancements, existing model-based…

Machine Learning · Computer Science 2024-01-23 Mao Hong , Zhiyue Zhang , Yue Wu , Yanxun Xu

Parallel data collection has redefined Reinforcement Learning (RL), unlocking unprecedented efficiency and powering breakthroughs in large-scale real-world applications. In this paradigm, $N$ identical agents operate in $N$ replicas of an…

Machine Learning · Computer Science 2025-06-25 Vincenzo De Paola , Riccardo Zamboni , Mirco Mutti , Marcello Restelli

Flow-based generative models can be viewed through a physics lens: sampling transports a particle from noise to data by integrating a time-varying velocity field, and each sample corresponds to a trajectory with its own dynamical effort.…

Machine Learning · Computer Science 2026-02-10 Ziyun Li , Huancheng Hu , Soon Hoe Lim , Xuyu Li , Fei Gao , Enmao Diao , Zezhen Ding , Michalis Vazirgiannis , Henrik Bostrom

Reinforcement Learning (RL) has proven highly effective in addressing complex control and decision-making tasks. However, in most traditional RL algorithms, the policy is typically parameterized as a diagonal Gaussian distribution, which…

Machine Learning · Computer Science 2026-04-02 Ruijie Hao , Longfei Zhang , Yang Dai , Yang Ma , Xingxing Liang , Guangquan Cheng

Popular Maximum Entropy Inverse Reinforcement Learning approaches require the computation of expected state visitation frequencies for the optimal policy under an estimate of the reward function. This usually requires intermediate value…

Machine Learning · Computer Science 2020-08-05 Gabriel Kalweit , Maria Huegle , Moritz Werling , Joschka Boedecker

Model-based methods in reinforcement learning offer a promising approach to enhance data efficiency by facilitating policy exploration within a dynamics model. However, accurately predicting sequential steps in the dynamics model remains a…

Machine Learning · Computer Science 2024-05-28 Haoxin Lin , Yu-Yan Xu , Yihao Sun , Zhilong Zhang , Yi-Chen Li , Chengxing Jia , Junyin Ye , Jiaji Zhang , Yang Yu

Offline reinforcement learning (RL) aims to learn the optimal policy from a fixed dataset generated by behavior policies without additional environment interactions. One common challenge that arises in this setting is the…

Machine Learning · Computer Science 2026-02-06 Songyuan Zhang , Oswin So , H. M. Sabbir Ahmad , Eric Yang Yu , Matthew Cleaveland , Mitchell Black , Chuchu Fan

While reinforcement learning (RL) provides a framework for learning through trial and error, translating RL algorithms into the real world has remained challenging. A major hurdle to real-world application arises from the development of…

Machine Learning · Computer Science 2022-05-12 Archit Sharma , Rehaan Ahmad , Chelsea Finn

Reinforcement learning (RL) has been effective for post-training autoregressive (AR) language models, but extending these methods to diffusion language models (DLMs) is challenging due to intractable sequence-level likelihoods. Existing…

Flow matching has emerged as a powerful framework for generative modeling, offering computational advantages over diffusion models by leveraging deterministic Ordinary Differential Equations (ODEs) instead of stochastic dynamics. While…

Machine Learning · Computer Science 2025-03-13 Chengyue Gong , Xiaoyu Li , Yingyu Liang , Jiangxuan Long , Zhenmei Shi , Zhao Song , Yu Tian

Multimodal data is a precious asset enabling a variety of downstream tasks in machine learning. However, real-world data collected across different modalities is often not paired, which is a significant challenge to learn a joint…

Machine Learning · Computer Science 2025-08-11 Mustapha Bounoua , Giulio Franzese , Pietro Michiardi

Online map matching is a fundamental problem in location-based services, aiming to incrementally match trajectory data step-by-step onto a road network. However, existing methods fail to meet the needs for efficiency, robustness, and…

Machine Learning · Computer Science 2025-03-21 Minxiao Chen , Haitao Yuan , Nan Jiang , Zhihan Zheng , Sai Wu , Ao Zhou , Shangguang Wang

Maximum Entropy (MaxEnt) reinforcement learning is a powerful learning paradigm which seeks to maximize return under entropy regularization. However, action entropy does not necessarily coincide with state entropy, e.g., when multiple…

Machine Learning · Computer Science 2021-07-27 Nir Baram , Guy Tennenholtz , Shie Mannor

Offline reinforcement learning (RL) methods aim to learn optimal policies with access only to trajectories in a fixed dataset. Policy constraint methods formulate policy learning as an optimization problem that balances maximizing reward…

Machine Learning · Computer Science 2025-03-04 Padmanaba Srinivasan , William Knottenbelt

State-of-the-art reinforcement learning algorithms mostly rely on being allowed to directly interact with their environment to collect millions of observations. This makes it hard to transfer their success to industrial control problems,…

Machine Learning · Computer Science 2021-07-23 Phillip Swazinna , Steffen Udluft , Thomas Runkler

Discrete diffusion and flow matching models capture complex, non-additive and non-autoregressive structure in high-dimensional objective landscapes through parallel, iterative refinement. However, their implicit generative nature precludes…

Machine Learning · Computer Science 2026-03-03 Yashvir S. Grewal , Daniel M. Steinberg , Thang D. Bui , Cheng Soon Ong , Edwin V. Bonilla

Reward models are critical for reinforcement learning from human feedback, as they determine the alignment quality and reliability of generative models. For complex tasks such as image editing, reward models are required to capture global…