English
Related papers

Related papers: Fisher Decorator: Refining Flow Policy via a Local…

200 papers

We develop a theory for image restoration with a learned regularizer that is analogous to that of Meyer's characterization of solutions of the classical variational method of Rudin-Osher-Fatemi (ROF). The learned regularizer we use is a…

Optimization and Control · Mathematics 2023-05-02 Tristan Milne , Adrian Nachman

Offline reinforcement learning (RL) enables the agent to effectively learn from logged data, which significantly extends the applicability of RL algorithms in real-world scenarios where exploration can be expensive or unsafe. Previous works…

Machine Learning · Computer Science 2022-12-05 Yiqin Yang , Hao Hu , Wenzhe Li , Siyuan Li , Jun Yang , Qianchuan Zhao , Chongjie Zhang

Estimating Wasserstein distances between two high-dimensional densities suffers from the curse of dimensionality: one needs an exponential (wrt dimension) number of samples to ensure that the distance between two empirical measures is…

Machine Learning · Statistics 2020-07-13 François-Pierre Paty , Alexandre d'Aspremont , Marco Cuturi

Offline Reinforcement Learning (RL) has emerged as a powerful alternative to imitation learning for behavior modeling in various domains, particularly in complex navigation tasks. An existing challenge with Offline RL is the signal-to-noise…

Machine Learning · Computer Science 2024-11-13 Alexi Canesse , Mathieu Petitbois , Ludovic Denoyer , Sylvain Lamprier , Rémy Portelas

Balancing exploration and exploitation during reinforcement learning fine-tuning of generative models presents a critical challenge, as existing approaches rely on fixed divergence regularization that creates an inherent dilemma: strong…

Machine Learning · Computer Science 2025-10-22 Jiajun Fan , Tong Wei , Chaoran Cheng , Yuxin Chen , Ge Liu

To obtain a near-optimal policy with fewer interactions in Reinforcement Learning (RL), a promising approach involves the combination of offline RL, which enhances sample efficiency by leveraging offline datasets, and online RL, which…

Machine Learning · Computer Science 2024-11-18 Xiaoyu Wen , Xudong Yu , Rui Yang , Haoyuan Chen , Chenjia Bai , Zhen Wang

This paper studies satisfaction of temporal properties on unknown stochastic processes that have continuous state spaces. We show how reinforcement learning (RL) can be applied for computing policies that are finite-memory and deterministic…

Systems and Control · Electrical Eng. & Systems 2020-09-29 Milad Kazemi , Sadegh Soudjani

Reinforcement learning (RL) algorithms based on high-dimensional function approximation have achieved tremendous empirical success in large-scale problems with an enormous number of states. However, most analysis of such algorithms gives…

Machine Learning · Computer Science 2022-02-17 Jihao Long , Jiequn Han , Weinan E

We present a geometric framework for Reinforcement Learning (RL) that views policies as maps into the Wasserstein space of action probabilities. First, we define a Riemannian structure induced by stationary distributions, proving its…

Machine Learning · Computer Science 2026-04-17 Mathias Dus

In the realm of computer vision and graphics, accurately establishing correspondences between geometric 3D shapes is pivotal for applications like object tracking, registration, texture transfer, and statistical shape analysis. Moving…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Tung Le , Khai Nguyen , Shanlin Sun , Nhat Ho , Xiaohui Xie

The high costs and risks involved in extensive environment interactions hinder the practical application of current online safe reinforcement learning (RL) methods. While offline safe RL addresses this by learning policies from static…

Machine Learning · Computer Science 2026-01-26 Keru Chen , Honghao Wei , Zhigang Deng , Sen Lin

We present theoretical and numerical results concerning the problem to find the path that minimizes the time to navigate between two given points in a complex fluid under realistic navigation constraints. We contrast deterministic Optimal…

Systems and Control · Electrical Eng. & Systems 2021-03-02 Michele Buzzicotti , Luca Biferale , Fabio Bonaccorso , Patricio Clark di Leoni , Kristian Gustavsson

Off-policy evaluation and learning are concerned with assessing a given policy and learning an optimal policy from offline data without direct interaction with the environment. Often, the environment in which the data are collected differs…

Machine Learning · Computer Science 2024-01-18 Yi Shen , Pan Xu , Michael M. Zavlanos

We present an algorithm for local, regularized, policy improvement in reinforcement learning (RL) that allows us to formulate model-based and model-free variants in a single framework. Our algorithm can be interpreted as a natural extension…

Offline Safe Reinforcement Learning (RL) seeks to address safety constraints by learning from static datasets and restricting exploration. However, these approaches heavily rely on the dataset and struggle to generalize to unseen scenarios…

Robotics · Computer Science 2025-03-04 Chenyang Cao , Yucheng Xin , Silang Wu , Longxiang He , Zichen Yan , Junbo Tan , Xueqian Wang

Deep Reinforcement Learning (DRL) has experienced significant advancements in recent years and has been widely used in many fields. In DRL-based robotic policy learning, however, current de facto policy parameterization is still…

Robotics · Computer Science 2026-03-13 Diyuan Shi , Yiqi Tang , Zifeng Zhuang , Donglin Wang

This paper proposes a realistic modularized framework for controlling autonomous surface vehicles (ASVs) on inland waterways (IWs) based on deep reinforcement learning (DRL). The framework improves operational safety and comprises two…

Systems and Control · Electrical Eng. & Systems 2024-08-22 Martin Waltz , Niklas Paulig , Ostap Okhrin

Reinforcement learning (RL) has shown significant promise for sequential portfolio optimization tasks, such as stock trading, where the objective is to maximize cumulative returns while minimizing risks using historical data. However,…

Machine Learning · Computer Science 2025-05-20 Haochen Yuan , Minting Pan , Yunbo Wang , Siyu Gao , Philip S. Yu , Xiaokang Yang

Uncertainty propagation and filtering can be interpreted as gradient flows with respect to suitable metrics in the infinite dimensional manifold of probability density functions. Such a viewpoint has been put forth in recent literature, and…

Optimization and Control · Mathematics 2017-10-31 Abhishek Halder , Tryphon T. Georgiou

Offline policy learning is aimed at learning decision-making policies using existing datasets of trajectories without collecting additional data. The primary motivation for using reinforcement learning (RL) instead of supervised learning…