English
Related papers

Related papers: Online Pre-Training for Offline-to-Online Reinforc…

200 papers

Offline-to-online deployment of reinforcement-learning (RL) agents must bridge two gaps: (1) the sim-to-real gap, where real systems add latency and other imperfections not present in simulation, and (2) the interaction gap, where policies…

Machine Learning · Computer Science 2026-02-12 Simon Sinong Zhan , Qingyuan Wu , Philip Wang , Frank Yang , Xiangyu Shi , Chao Huang , Qi Zhu

Reinforcement learning (RL) has shown significant promise for sequential portfolio optimization tasks, such as stock trading, where the objective is to maximize cumulative returns while minimizing risks using historical data. However,…

Machine Learning · Computer Science 2025-05-20 Haochen Yuan , Minting Pan , Yunbo Wang , Siyu Gao , Philip S. Yu , Xiaokang Yang

Reinforcement learning (RL) has drawn increasing interests in recent years due to its tremendous success in various applications. However, standard RL algorithms can only be applied for single reward function, and cannot adapt to an unseen…

Machine Learning · Computer Science 2022-01-04 Ziyang Tang , Yihao Feng , Qiang Liu

Offline Reinforcement Learning (RL) aims to learn policies from previously collected datasets without exploring the environment. Directly applying off-policy algorithms to offline RL usually fails due to the extrapolation error caused by…

Machine Learning · Computer Science 2022-02-24 Chenjia Bai , Lingxiao Wang , Zhuoran Yang , Zhihong Deng , Animesh Garg , Peng Liu , Zhaoran Wang

Offline reinforcement learning (ORL) holds great promise for robot learning due to its ability to learn from arbitrary pre-generated experience. However, current ORL benchmarks are almost entirely in simulation and utilize contrived…

Robotics · Computer Science 2022-10-14 Gaoyue Zhou , Liyiming Ke , Siddhartha Srinivasa , Abhinav Gupta , Aravind Rajeswaran , Vikash Kumar

Offline reinforcement learning (RL) is a compelling paradigm to extend RL's practical utility by leveraging pre-collected, static datasets, thereby avoiding the limitations associated with collecting online interactions. The major…

Machine Learning · Computer Science 2024-06-10 Yutaka Shimizu , Joey Hong , Sergey Levine , Masayoshi Tomizuka

In this work we revisit the Mobility Robustness Optimisation (MRO) algorithm and study the possibility of learning the optimal Cell Individual Offset tuning using offline Reinforcement Learning. Such methods make use of collected offline…

Networking and Internet Architecture · Computer Science 2025-07-01 Pegah Alizadeh , Anastasios Giovanidis , Pradeepa Ramachandra , Vasileios Koutsoukis , Osama Arouk

Expanding reinforcement learning (RL) to offline domains generates promising prospects, particularly in sectors where data collection poses substantial challenges or risks. Pivotal to the success of transferring RL offline is mitigating…

Machine Learning · Statistics 2024-11-19 Alex Beeson , David Ireland , Giovanni Montana

Traditional offline reinforcement learning (RL) methods predominantly operate in a batch-constrained setting. This confines the algorithms to a specific state-action distribution present in the dataset, reducing the effects of…

Machine Learning · Statistics 2025-07-16 Charles A. Hepburn , Yue Jin , Giovanni Montana

In this paper, we consider the problem of predicting unknown targets from data. We propose Online Residual Learning (ORL), a method that combines online adaptation with offline-trained predictions. At a lower level, we employ multiple…

Systems and Control · Electrical Eng. & Systems 2024-09-10 Anastasios Vlachos , Anastasios Tsiamis , Aren Karapetyan , Efe C. Balta , John Lygeros

Offline reinforcement learning (RL) learns policies from fixed datasets without online interactions, but suffers from distribution shift, causing inaccurate evaluation and overestimation of out-of-distribution (OOD) actions. Existing…

Machine Learning · Computer Science 2025-10-07 Xuyang Chen , Keyu Yan , Wenhan Cao , Lin Zhao

Studying how to fine-tune offline reinforcement learning (RL) pre-trained policy is profoundly significant for enhancing the sample efficiency of RL algorithms. However, directly fine-tuning pre-trained policies often results in sub-optimal…

Machine Learning · Computer Science 2024-05-29 Ziqi Zhang , Xiao Xiong , Zifeng Zhuang , Jinxin Liu , Donglin Wang

Graphical User Interface (GUI) agents have demonstrated remarkable progress in automating complex user interface interactions through reinforcement learning. However, current approaches face a fundamental dilemma: offline RL enables stable…

Machine Learning · Computer Science 2025-09-25 Zhengxi Lu , Jiabo Ye , Fei Tang , Yongliang Shen , Haiyang Xu , Ziwei Zheng , Weiming Lu , Ming Yan , Fei Huang , Jun Xiao , Yueting Zhuang

Reinforcement learning (RL) has shown promise for decision-making tasks in real-world applications. One practical framework involves training parameterized policy models from an offline dataset and subsequently deploying them in an online…

Machine Learning · Computer Science 2023-03-14 Ziniu Li , Ke Xu , Liu Liu , Lanqing Li , Deheng Ye , Peilin Zhao

In a recent study, Reinforcement Learning (RL) used in combination with many-objective search, has been shown to outperform alternative techniques (random search and many-objective search) for online testing of Deep Neural Network-enabled…

Software Engineering · Computer Science 2024-03-21 Luca Giamattei , Matteo Biagiola , Roberto Pietrantuono , Stefano Russo , Paolo Tonella

Reinforcement learning (RL) can in principle let robots automatically adapt to new tasks, but current RL methods require a large number of trials to accomplish this. In this paper, we tackle rapid adaptation to new tasks through the…

Offline reinforcement learning leverages previously-collected offline datasets to learn optimal policies with no necessity to access the real environment. Such a paradigm is also desirable for multi-agent reinforcement learning (MARL)…

Machine Learning · Computer Science 2022-06-13 Linghui Meng , Muning Wen , Yaodong Yang , Chenyang Le , Xiyun Li , Weinan Zhang , Ying Wen , Haifeng Zhang , Jun Wang , Bo Xu

Reinforcement learning (RL) is central to improving reasoning in large language models (LLMs) but typically requires ground-truth rewards. Test-Time Reinforcement Learning (TTRL) removes this need by using majority-vote rewards, but relies…

Machine Learning · Computer Science 2025-10-06 Aleksei Arzhantsev , Otmane Sakhi , Flavian Vasile

Inverse reinforcement learning (IRL) is the problem of learning the preferences of an agent from the observations of its behavior on a task. While this problem has been well investigated, the related problem of {\em online} IRL---where the…

Machine Learning · Computer Science 2020-11-19 Saurabh Arora , Prashant Doshi , Bikramjit Banerjee

When interacting with people, AI agents do not just influence the state of the world -- they also influence the actions people take in response to the agent, and even their underlying intentions and strategies. Accounting for and leveraging…

Artificial Intelligence · Computer Science 2023-10-31 Joey Hong , Sergey Levine , Anca Dragan
‹ Prev 1 8 9 10 Next ›