English
Related papers

Related papers: TrajDeleter: Enabling Trajectory Forgetting in Off…

200 papers

Consider the following instance of the Offline Meta Reinforcement Learning (OMRL) problem: given the complete training logs of $N$ conventional RL agents, trained on $N$ different tasks, design a meta-agent that can quickly maximize reward…

Machine Learning · Computer Science 2021-02-15 Ron Dorfman , Idan Shenfeld , Aviv Tamar

In online advertising, advertisers participate in ad auctions to acquire ad opportunities, often by utilizing auto-bidding tools provided by demand-side platforms (DSPs). The current auto-bidding algorithms typically employ reinforcement…

Machine Learning · Computer Science 2024-04-09 Haoming Li , Yusen Huo , Shuai Dou , Zhenzhe Zheng , Zhilin Zhang , Chuan Yu , Jian Xu , Fan Wu

Reinforcement learning (RL) agents improve through trial-and-error, but when reward is sparse and the agent cannot discover successful action sequences, learning stagnates. This has been a notable problem in training deep RL agents to…

Artificial Intelligence · Computer Science 2018-02-27 Evan Zheran Liu , Kelvin Guu , Panupong Pasupat , Tianlin Shi , Percy Liang

Offline reinforcement learning (RL) enables the agent to effectively learn from logged data, which significantly extends the applicability of RL algorithms in real-world scenarios where exploration can be expensive or unsafe. Previous works…

Machine Learning · Computer Science 2022-12-05 Yiqin Yang , Hao Hu , Wenzhe Li , Siyuan Li , Jun Yang , Qianchuan Zhao , Chongjie Zhang

This work investigates the reproducibility of the paper 'Explaining RL decisions with trajectories'. The original paper introduces a novel approach in explainable reinforcement learning based on the attribution decisions of an agent to…

Artificial Intelligence · Computer Science 2024-11-12 Karim Abdel Sadek , Matteo Nulli , Joan Velja , Jort Vincenti

Autonomous spacecraft control for mission phases such as launch, ascent, stage separation, and orbit insertion remains a critical challenge due to the need for adaptive policies that generalize across dynamically distinct regimes. While…

Machine Learning · Computer Science 2025-11-17 Amit Jain , Victor Rodriguez-Fernandez , Richard Linares

Offline reinforcement learning (RL) offers an appealing approach to real-world tasks by learning policies from pre-collected datasets without interacting with the environment. However, the performance of existing offline RL algorithms…

Machine Learning · Computer Science 2023-11-14 Peng Cheng , Xianyuan Zhan , Zhihao Wu , Wenjia Zhang , Shoucheng Song , Han Wang , Youfang Lin , Li Jiang

Real-world autonomous decision-making systems, from robots to recommendation engines, must operate in environments that change over time. While deep reinforcement learning (RL) has shown an impressive ability to learn optimal policies in…

Machine Learning · Computer Science 2025-05-16 Jonathan Clifford Balloch

Reinforcement learning (RL) is a framework to optimize a control policy using rewards that are revealed by the system as a response to a control action. In its standard form, RL involves a single agent that uses its policy to accomplish a…

Systems and Control · Electrical Eng. & Systems 2021-11-24 Juan Cervino , Juan Andres Bazerque , Miguel Calvo-Fullana , Alejandro Ribeiro

The growing complexity and capacity demands for mobile networks necessitate innovative techniques for optimizing resource usage. Meanwhile, recent breakthroughs have brought Reinforcement Learning (RL) into the domain of continuous control…

Networking and Internet Architecture · Computer Science 2022-10-28 Vegard Edvardsen , Gard Spreemann , Jeriek Van den Abeele

Reinforcement Learning (RL) is a learning paradigm concerned with learning to control a system so as to maximize an objective over the long term. This approach to learning has received immense interest in recent times and success manifests…

Artificial Intelligence · Computer Science 2018-07-26 Sanyam Kapoor

Recommender systems (RecSys) have become critical tools for enhancing user engagement by delivering personalized content across diverse digital platforms. Recent advancements in large language models (LLMs) demonstrate significant potential…

Information Retrieval · Computer Science 2025-10-16 Yi Zhang , Lili Xie , Ruihong Qiu , Jiajun Liu , Sen Wang

With the growing need to reduce energy consumption and greenhouse gas emissions, Eco-driving strategies provide a significant opportunity for additional fuel savings on top of other technological solutions being pursued in the…

Systems and Control · Electrical Eng. & Systems 2022-12-16 Lindsey Kerbel , Beshah Ayalew , Andrej Ivanco , Keith Loiselle

Large language models (LLMs) are increasingly used as interactive agents, but optimizing them for long-horizon decision making remains difficult because current methods are largely purely reactive, which weakens both exploration and credit…

Computation and Language · Computer Science 2026-05-08 Xiangyuan Xue , Yifan Zhou , Zidong Wang , Shengji Tang , Philip Torr , Wanli Ouyang , Lei Bai , Zhenfei Yin

Diffusion models have shown strong competitiveness in offline reinforcement learning tasks by formulating decision-making as sequential generation. However, the practicality of these methods is limited due to the lengthy inference processes…

Machine Learning · Computer Science 2024-07-24 Renming Huang , Yunqiang Pei , Guoqing Wang , Yangming Zhang , Yang Yang , Peng Wang , Hengtao Shen

This work studies offline Reinforcement Learning (RL) in a class of non-Markovian environments called Regular Decision Processes (RDPs). In RDPs, the unknown dependency of future observations and rewards from the past interactions can be…

Machine Learning · Computer Science 2024-09-05 Ahana Deb , Roberto Cipollone , Anders Jonsson , Alessandro Ronca , Mohammad Sadegh Talebi

Learning a reward function from human preferences is challenging as it typically requires having a high-fidelity simulator or using expensive and potentially unsafe actual physical rollouts in the environment. However, in many tasks the…

Machine Learning · Computer Science 2022-02-18 Daniel Shin , Daniel S. Brown , Anca D. Dragan

We consider reinforcement learning (RL) methods in offline domains without additional online data collection, such as mobile health applications. Most of existing policy optimization algorithms in the computer science literature are…

Machine Learning · Statistics 2022-07-28 Chengchun Shi , Shikai Luo , Yuan Le , Hongtu Zhu , Rui Song

Adapting a Reinforcement Learning (RL) agent to an unseen environment is a difficult task due to typical over-fitting on the training environment. RL agents are often capable of solving environments very close to the trained environment,…

Artificial Intelligence · Computer Science 2022-07-04 Olivier Moulin , Vincent Francois-Lavet , Paul Elbers , Mark Hoogendoorn

Offline reinforcement learning (RL) looks at learning how to optimally solve tasks using a fixed dataset of interactions from the environment. Many off-policy algorithms developed for online learning struggle in the offline setting as they…

Machine Learning · Computer Science 2025-03-18 Natinael Solomon Neggatu , Jeremie Houssineau , Giovanni Montana