English
Related papers

Related papers: Entropy-Regularized Adjoint Matching for Offline R…

200 papers

We explore a method of statistical estimation called Maximum Entropy on the Mean (MEM) which is based on an information-driven criterion that quantifies the compliance of a given point with a reference prior probability measure. At the core…

Statistics Theory · Mathematics 2022-12-20 Yakov Vaisbourd , Rustum Choksi , Ariel Goodwin , Tim Hoheisel , Carola-Bibiane Schönlieb

Drawing upon recent advances in language model alignment, we formulate offline Reinforcement Learning as a two-stage optimization problem: First pretraining expressive generative policies on reward-free behavior datasets, then fine-tuning…

Machine Learning · Computer Science 2024-10-31 Huayu Chen , Kaiwen Zheng , Hang Su , Jun Zhu

Self-evaluation, a model's ability to assess the correctness of its own output, is crucial for Large Multimodal Models (LMMs) to achieve self-improvement in multi-turn conversations, yet largely absent in foundation models. Recent work has…

Machine Learning · Computer Science 2025-08-14 Wenkai Wang , Hongcan Guo , Zheqi Lv , Shengyu Zhang

Calibrating agent-based models (ABMs) in economics and finance typically involves a derivative-free search in a very large parameter space. In this work, we benchmark a number of search methods in the calibration of a well-known…

Machine Learning · Computer Science 2023-12-08 Aldo Glielmo , Marco Favorito , Debmallya Chanda , Domenico Delli Gatti

Offline reinforcement learning aims to train a policy on a pre-recorded and fixed dataset without any additional environment interactions. There are two major challenges in this setting: (1) extrapolation error caused by approximating the…

Machine Learning · Computer Science 2023-01-31 Dmitriy Akimov , Vladislav Kurenkov , Alexander Nikulin , Denis Tarasov , Sergey Kolesnikov

Reinforcement Learning (RL) agents often struggle with inefficient exploration, particularly in environments with sparse rewards. Traditional exploration strategies can lead to slow learning and suboptimal performance because agents fail to…

Machine Learning · Computer Science 2026-03-31 Gaurav Chaudhary , Laxmidhar Behera , Washim Uddin Mondal

It is challenging for reinforcement learning (RL) algorithms to succeed in real-world applications like financial trading and logistic system due to the noisy observation and environment shifting between training and evaluation. Thus, it…

Machine Learning · Computer Science 2022-05-20 Zhengyu Yang , Kan Ren , Xufang Luo , Minghuan Liu , Weiqing Liu , Jiang Bian , Weinan Zhang , Dongsheng Li

This work focuses on off-policy evaluation (OPE) with function approximation in infinite-horizon undiscounted Markov decision processes (MDPs). For MDPs that are ergodic and linear (i.e. where rewards and dynamics are linear in some known…

Machine Learning · Computer Science 2020-06-24 Nevena Lazic , Dong Yin , Mehrdad Farajtabar , Nir Levine , Dilan Gorur , Chris Harris , Dale Schuurmans

Traffic allocation is a process of redistributing natural traffic to products by adjusting their positions in the post-search phase, aimed at effectively fostering merchant growth, precisely meeting customer demands, and ensuring the…

Machine Learning · Computer Science 2024-07-23 Peng Cheng , Huimu Wang , Jinyuan Zhao , Yihao Wang , Enqiang Xu , Yu Zhao , Zhuojian Xiao , Songlin Wang , Guoyu Tang , Lin Liu , Sulong Xu

Meta-reinforcement learning enables artificial agents to learn from related training tasks and adapt to new tasks efficiently with minimal interaction data. However, most existing research is still limited to narrow task distributions that…

Machine Learning · Computer Science 2023-05-02 Mingyang Wang , Zhenshan Bing , Xiangtong Yao , Shuai Wang , Hang Su , Chenguang Yang , Kai Huang , Alois Knoll

Active network management (ANM) of electricity distribution networks include many complex stochastic sequential optimization problems. These problems need to be solved for integrating renewable energies and distributed storage into future…

Machine Learning · Computer Science 2021-07-01 Robin Henry , Damien Ernst

Offline reinforcement learning (RL) suffers from extrapolation errors induced by out-of-distribution (OOD) actions. To address this, offline RL algorithms typically impose constraints on action selection, which can be systematically…

Machine Learning · Computer Science 2025-11-05 Yixiu Mao , Yun Qu , Qi Wang , Xiangyang Ji

We propose ERA, a new paradigm that constrains the sampling entropy above given thresholds by applying specially designed activations to the outputs of models. Our approach demonstrates broad effectiveness across different domains: 1) for…

Machine Learning · Computer Science 2025-10-13 Zilin Kang , Chonghua Liao , Tingqiang Xu , Huazhe Xu

Incorporating pre-collected offline data can substantially improve the sample efficiency of reinforcement learning (RL), but its benefits can break down when the transition dynamics in the offline dataset differ from those encountered…

Machine Learning · Computer Science 2026-01-22 Lingkai Kong , Haichuan Wang , Tonghan Wang , Guojun Xiong , Milind Tambe

We propose a method for learning expressive energy-based policies for continuous states and actions, which has been feasible only in tabular domains before. We apply our method to learning maximum entropy policies, resulting into a new…

Machine Learning · Computer Science 2017-07-25 Tuomas Haarnoja , Haoran Tang , Pieter Abbeel , Sergey Levine

A novel non-orthogonal multiple access (NOMA) based cache-aided mobile edge computing (MEC) framework is proposed. For the purpose of efficiently allocating communication and computation resources to users' computation tasks requests, we…

Signal Processing · Electrical Eng. & Systems 2019-06-24 Zhong Yang , Yuanwei Liu , Yue Chen , Naofal Al-Dhahir

Model-based offline reinforcement learning (RL), which builds a supervised transition model with logging dataset to avoid costly interactions with the online environment, has been a promising approach for offline policy optimization. As the…

Machine Learning · Computer Science 2023-09-06 Junming Yang , Xingguo Chen , Shengyuan Wang , Bolei Zhang

Flow Matching has limited ability in achieving one-step generation due to its reliance on learned curved trajectories. Previous studies have attempted to address this limitation by either modifying the coupling distribution to prevent…

Machine Learning · Computer Science 2025-11-25 Chenrui Ma , Xi Xiao , Tianyang Wang , Xiao Wang , Yanning Shen

We study online learning with bandit feedback across multiple tasks, with the goal of improving average performance across tasks if they are similar according to some natural task-similarity measure. As the first to target the adversarial…

Machine Learning · Computer Science 2022-05-30 Maria-Florina Balcan , Keegan Harris , Mikhail Khodak , Zhiwei Steven Wu

With recent breakthroughs in large language models (LLMs) for reasoning, planning, and complex task generation, artificial intelligence systems are transitioning from isolated single-agent architectures to multi-agent systems with…

Artificial Intelligence · Computer Science 2026-02-17 Linlin Wang , Tianqing Zhu , Laiqiao Qin , Longxiang Gao , Wanlei Zhou