English
Related papers

Related papers: Unsupervised Behavioral Compression: Learning Low-…

200 papers

In offline reinforcement learning, weighted regression is a common method to ensure the learned policy stays close to the behavior policy and to prevent selecting out-of-sample actions. In this work, we show that due to the limited…

Machine Learning · Computer Science 2023-03-01 Huayu Chen , Cheng Lu , Chengyang Ying , Hang Su , Jun Zhu

Deep reinforcement learning (DRL) has led to a wide range of advances in sequential decision-making tasks. However, the complexity of neural network policies makes it difficult to understand and deploy with limited computational resources.…

Machine Learning · Computer Science 2023-11-07 Jiaming Guo , Rui Zhang , Shaohui Peng , Qi Yi , Xing Hu , Ruizhi Chen , Zidong Du , Xishan Zhang , Ling Li , Qi Guo , Yunji Chen

Reinforcement learning (RL) under changing environment models many real-world applications via nonstationary Markov Decision Processes (MDPs), and hence gains considerable interest. However, theoretical studies on nonstationary MDPs in the…

Machine Learning · Computer Science 2023-08-11 Yuan Cheng , Jing Yang , Yingbin Liang

This paper implements deep reinforcement learning (DRL) for spacecraft reorientation control with a single pointing keep-out zone. The Soft Actor-Critic (SAC) algorithm is adopted to handle continuous state and action space. A new state…

Systems and Control · Electrical Eng. & Systems 2025-11-19 Juntang Yang , Mohamed Khalil Ben-Larbi

Deep Reinforcement Learning (DRL) has made considerable advances in simulated and physical robot control tasks, especially when problems admit a fully observed Markov Decision Process (MDP) formulation. When observations only partially…

Robotics · Computer Science 2026-03-24 Lingheng Meng , Rob Gorbet , Michael Burke , Dana Kulić

The goal of offline reinforcement learning is to learn a policy from a fixed dataset, without further interactions with the environment. This setting will be an increasingly more important paradigm for real-world applications of…

Robotics · Computer Science 2020-11-17 Wenxuan Zhou , Sujay Bajracharya , David Held

State-of-the-art model-based Reinforcement Learning (RL) approaches either use gradient-free, population-based methods for planning, learned policy networks, or a combination of policy networks and planning. Hybrid approaches that combine…

Machine Learning · Computer Science 2026-05-25 Jonathan Spieler , Sven Behnke

Text embedding and generative tasks are usually trained separately based on large language models (LLMs) nowadays. This causes a large amount of training cost and deployment effort. Context compression is also a challenging and pressing…

Computation and Language · Computer Science 2026-05-13 Zhongtao Miao , Qiyu Wu , Yoshimasa Tsuruoka

Offline reinforcement learning (RL) defines a sample-efficient learning paradigm, where a policy is learned from static and previously collected datasets without additional interaction with the environment. The major obstacle to offline RL…

Machine Learning · Computer Science 2022-11-16 Yunfan Zhou , Xijun Li , Qingyu Qu

Many real-world sequential decision making problems are partially observable by nature, and the environment model is typically unknown. Consequently, there is great need for reinforcement learning methods that can tackle such problems given…

Machine Learning · Computer Science 2018-06-08 Maximilian Igl , Luisa Zintgraf , Tuan Anh Le , Frank Wood , Shimon Whiteson

Offline reinforcement learning (RL), also known as batch RL, offers the prospect of policy optimization from large pre-recorded datasets without online environment interaction. It addresses challenges with regard to the cost of data…

Recently, deep reinforcement learning (DRL) frameworks have shown potential for solving NP-hard routing problems such as the traveling salesman problem (TSP) without problem-specific expert knowledge. Although DRL can be used to solve…

Machine Learning · Computer Science 2021-10-28 Minsu Kim , Jinkyoo Park , Joungho Kim

In constrained reinforcement learning (C-RL), an agent seeks to learn from the environment a policy that maximizes the expected cumulative reward while satisfying minimum requirements in secondary cumulative reward constraints. Several…

Machine Learning · Computer Science 2022-12-06 Tianqi Zheng , Pengcheng You , Enrique Mallada

We study reinforcement learning with function approximation for large-scale Partially Observable Markov Decision Processes (POMDPs) where the state space and observation space are large or even continuous. Particularly, we consider Hilbert…

Machine Learning · Computer Science 2022-06-27 Masatoshi Uehara , Ayush Sekhari , Jason D. Lee , Nathan Kallus , Wen Sun

The purpose of multi-task reinforcement learning (MTRL) is to train a single policy that can be applied to a set of different tasks. Sharing parameters allows us to take advantage of the similarities among tasks. However, the gaps between…

Machine Learning · Computer Science 2022-10-24 Lingfeng Sun , Haichao Zhang , Wei Xu , Masayoshi Tomizuka

Learning a disentangled representation of the latent space has become one of the most fundamental problems studied in computer vision. Recently, many Generative Adversarial Networks (GANs) have shown promising results in generating high…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Kumar Shubham , Gopalakrishnan Venkatesh , Reijul Sachdev , Akshi , Dinesh Babu Jayagopi , G. Srinivasaraghavan

Offline reinforcement learning (RL) heavily relies on the coverage of pre-collected data over the target policy's distribution. Existing studies aim to improve data-policy coverage to mitigate distributional shifts, but overlook security…

Machine Learning · Computer Science 2025-06-16 Xue Zhou , Dapeng Man , Chen Xu , Fanyi Zeng , Tao Liu , Huan Wang , Shucheng He , Chaoyang Gao , Wu Yang

Prior authorization (PA) requires interpretation of complex and fragmented coverage policies, yet existing retrieval-augmented systems rely on static top-$K$ strategies with fixed numbers of retrieved sections. Such fixed retrieval can be…

Information Retrieval · Computer Science 2026-04-08 Ruslan Sharifullin , Maxim Gorshkov , Hannah Clay

Cooperative control of groups of autonomous vehicles (AVs), i.e., platoons, is a promising direction to improving the efficiency of autonomous transportation systems. In this context, distributed co-optimization of both vehicle speed and…

Systems and Control · Electrical Eng. & Systems 2026-01-27 Samuel Mallick , Gianpietro Battocletti , Dimitris Boskos , Azita Dabiri , Bart De Schutter

Deep reinforcement learning (DRL) has achieved significant breakthroughs in various tasks. However, most DRL algorithms suffer a problem of generalizing the learned policy which makes the learning performance largely affected even by minor…

Machine Learning · Computer Science 2019-07-11 Zhengyao Jiang , Shan Luo