English
Related papers

Related papers: Bridging Domain Gaps with Target-Aligned Generatio…

200 papers

Recent advances in large language models (LLMs) have demonstrated remarkable capabilities in reasoning and tool utilization. However, the generalization of tool-augmented reinforcement learning (RL) across diverse domains remains a…

Machine Learning · Computer Science 2026-01-08 Zhengyu Chen , Jinluan Yang , Teng Xiao , Ruochen Zhou , Luan Zhang , Xiangyu Xi , Xiaowei Shi , Wei Wang , Jinggang Wang

Offline-to-online reinforcement learning (O2O RL) faces a central challenge between retaining offline conservatism and adapting to online feedback under distribution shift. This challenge arises because data behavior evolves during…

Machine Learning · Computer Science 2026-05-19 Lipeng Zu , Yu Qian , Shayok Chakraborty , Xiaonan Zhang

Offline reinforcement learning (RL) aims to learn a policy that maximizes the expected return using a given static dataset of transitions. However, offline RL faces the distribution shift problem. The policy constraint offline RL method is…

Machine Learning · Computer Science 2025-12-24 Yuanhao Chen , Qi Liu , Pengbin Chen , Zhongjian Qiao , Yanjie Li

In this paper, we study the Tiered Reinforcement Learning setting, a parallel transfer learning framework, where the goal is to transfer knowledge from the low-tier (source) task to the high-tier (target) task to reduce the exploration risk…

Machine Learning · Computer Science 2024-06-14 Jiawei Huang , Niao He

Due to the difficulty of obtaining ground-truth labels, learning from virtual-world datasets is of great interest for real-world applications like semantic segmentation. From domain adaptation perspective, the key challenge is to learn…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Fengyi Shen , Akhil Gurram , Ahmet Faruk Tuna , Onay Urfalioglu , Alois Knoll

In offline reinforcement learning (RL), we seek to utilize offline data to evaluate (or learn) policies in scenarios where the data are collected from a distribution that substantially differs from that of the target policy to be evaluated.…

Machine Learning · Computer Science 2021-03-09 Ruosong Wang , Yifan Wu , Ruslan Salakhutdinov , Sham M. Kakade

Offline reinforcement learning (RL) tries to learn the near-optimal policy with recorded offline experience without online exploration. Current offline RL research includes: 1) generative modeling, i.e., approximating a policy using fixed…

Machine Learning · Computer Science 2021-06-23 Hua Wei , Deheng Ye , Zhao Liu , Hao Wu , Bo Yuan , Qiang Fu , Wei Yang , Zhenhui Li

Offline reinforcement learning (RL) aims at learning policies from previously collected static trajectory data without interacting with the real environment. Recent works provide a novel perspective by viewing offline RL as a generic…

Machine Learning · Computer Science 2022-10-19 Kerong Wang , Hanye Zhao , Xufang Luo , Kan Ren , Weinan Zhang , Dongsheng Li

Unsupervised domain adaptation facilitates the unlabeled target domain relying on well-established source domain information. The conventional methods forcefully reducing the domain discrepancy in the latent space will result in the…

Computer Vision and Pattern Recognition · Computer Science 2020-02-13 Guanglei Yang , Haifeng Xia , Mingli Ding , Zhengming Ding

Offline meta-reinforcement learning (OMRL) proficiently allows an agent to tackle novel tasks while solely relying on a static dataset. For precise and efficient task identification, existing OMRL research suggests learning separate task…

Machine Learning · Computer Science 2024-03-13 Chengxing Jia , Fuxiang Zhang , Yi-Chen Li , Chen-Xiao Gao , Xu-Hui Liu , Lei Yuan , Zongzhang Zhang , Yang Yu

Semantic segmentation requires a lot of training data, which necessitates costly annotation. There have been many studies on unsupervised domain adaptation (UDA) from one domain to another, e.g., from computer graphics to real images.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Zhijie Wang , Xing Liu , Masanori Suganuma , Takayuki Okatani

Conventional reinforcement learning (RL) needs an environment to collect fresh data, which is impractical when online interactions are costly. Offline RL provides an alternative solution by directly learning from the previously collected…

Machine Learning · Computer Science 2023-03-15 Han Zheng , Xufang Luo , Pengfei Wei , Xuan Song , Dongsheng Li , Jing Jiang

A practical approach to robot reinforcement learning is to first collect a large batch of real or simulated robot interaction data, using some data collection policy, and then learn from this data to perform various tasks, using offline…

Robotics · Computer Science 2021-06-02 Shadi Endrawis , Gal Leibovich , Guy Jacob , Gal Novik , Aviv Tamar

Currently, cross-scene hyperspectral image (HSI) classification has drawn increasing attention. It is necessary to train a model only on source domain (SD) and directly transferring the model to target domain (TD), when TD needs to be…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Yuxiang Zhang , Wei Li , Weidong Sun , Ran Tao , Qian Du

Offline reinforcement learning (RL) recently gains growing interests from RL researchers. However, the performance of offline RL suffers from the out-of-distribution problem, which can be corrected by feedback in online RL. Previous offline…

Machine Learning · Computer Science 2025-06-25 Shuncheng He , Hongchang Zhang , Jianzhun Shao , Yuhang Jiang , Xiangyang Ji

Recommendation model performance is intrinsically tied to the quality, volume, and relevance of their training data. To address common challenges like data sparsity and cold start, recent researchs have leveraged data from multiple…

Artificial Intelligence · Computer Science 2026-04-01 Jiaqing Zhang , Mingjia Yin , Hao Wang , Yuxin Tian , Yuyang Ye , Yawen Li , Wei Guo , Yong Liu , Enhong Chen

Offline reinforcement learning (RL) optimizes the policy on a previously collected dataset without any interactions with the environment, yet usually suffers from the distributional shift problem. To mitigate this issue, a typical solution…

Machine Learning · Computer Science 2023-09-06 Qisen Yang , Shenzhi Wang , Qihang Zhang , Gao Huang , Shiji Song

Traditional domain adaptive semantic segmentation addresses the task of adapting a model to a novel target domain under limited or no additional supervision. While tackling the input domain gap, the standard domain adaptation settings…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Rui Gong , Martin Danelljan , Dengxin Dai , Danda Pani Paudel , Ajad Chhatkuli , Fisher Yu , Luc Van Gool

Studying how to fine-tune offline reinforcement learning (RL) pre-trained policy is profoundly significant for enhancing the sample efficiency of RL algorithms. However, directly fine-tuning pre-trained policies often results in sub-optimal…

Machine Learning · Computer Science 2024-05-29 Ziqi Zhang , Xiao Xiong , Zifeng Zhuang , Jinxin Liu , Donglin Wang

Domain adaptation is one of the most crucial techniques to mitigate the domain shift problem, which exists when transferring knowledge from an abundant labeled sourced domain to a target domain with few or no labels. Partial domain…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Youshan Zhang , Brian D. Davison