English
Related papers

Related papers: Localized Dynamics-Aware Domain Adaption for Off-D…

200 papers

Domain adaptation methods for object detection (OD) strive to mitigate the impact of distribution shifts by promoting feature alignment across source and target domains. Multi-source domain adaptation (MSDA) allows leveraging multiple…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Atif Belal , Akhil Meethal , Francisco Perdigon Romero , Marco Pedersoli , Eric Granger

Unsupervised domain adaptation aims to leverage labeled data from a source domain to learn a classifier for an unlabeled target domain. Among its many variants, open set domain adaptation (OSDA) is perhaps the most challenging, as it…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 Dongliang Chang , Aneeshan Sain , Zhanyu Ma , Yi-Zhe Song , Jun Guo

Transfer learning aims to learn robust classifiers for the target domain by leveraging knowledge from a source domain. Since the source and the target domains are usually from different distributions, existing methods mainly focus on…

Machine Learning · Computer Science 2019-09-19 Jindong Wang , Yiqiang Chen , Wenjie Feng , Han Yu , Meiyu Huang , Qiang Yang

Open compound domain adaptation (OCDA) is a domain adaptation setting, where target domain is modeled as a compound of multiple unknown homogeneous domains, which brings the advantage of improved generalization to unseen domains. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-12-16 Rui Gong , Yuhua Chen , Danda Pani Paudel , Yawei Li , Ajad Chhatkuli , Wen Li , Dengxin Dai , Luc Van Gool

Model-based offline reinforcement learning (RL) aims to find highly rewarding policy, by leveraging a previously collected static dataset and a dynamics model. While the dynamics model learned through reuse of the static dataset, its…

Machine Learning · Computer Science 2022-11-01 Kaiyang Guo , Yunfeng Shao , Yanhui Geng

Many reinforcement learning (RL) problems in practice are offline, learning purely from observational data. A key challenge is how to ensure the learned policy is safe, which requires quantifying the risk associated with different actions.…

Machine Learning · Computer Science 2021-10-28 Yecheng Jason Ma , Dinesh Jayaraman , Osbert Bastani

A long-standing goal in AI is to develop agents capable of solving diverse tasks across a range of environments, including those never seen during training. Two dominant paradigms address this challenge: (i) reinforcement learning (RL),…

Machine Learning · Computer Science 2025-10-30 Vlad Sobal , Wancong Zhang , Kyunghyun Cho , Randall Balestriero , Tim G. J. Rudner , Yann LeCun

Offline reinforcement learning (RL) refers to the problem of learning policies entirely from a large batch of previously collected data. This problem setting offers the promise of utilizing such datasets to acquire policies without any…

Machine Learning · Computer Science 2020-11-24 Tianhe Yu , Garrett Thomas , Lantao Yu , Stefano Ermon , James Zou , Sergey Levine , Chelsea Finn , Tengyu Ma

Domain adaptation in reinforcement learning (RL) mainly deals with the changes of observation when transferring the policy to a new environment. Many traditional approaches of domain adaptation in RL manage to learn a mapping function…

Machine Learning · Computer Science 2023-06-14 Qi Yi , Rui Zhang , Shaohui Peng , Jiaming Guo , Yunkai Gao , Kaizhao Yuan , Ruizhi Chen , Siming Lan , Xing Hu , Zidong Du , Xishan Zhang , Qi Guo , Yunji Chen

Unsupervised domain adaptation has recently emerged as an effective paradigm for generalizing deep neural networks to new target domains. However, there is still enormous potential to be tapped to reach the fully supervised performance. In…

Machine Learning · Computer Science 2022-03-10 Binhui Xie , Longhui Yuan , Shuang Li , Chi Harold Liu , Xinjing Cheng , Guoren Wang

Domain Adaptation (DA) facilitates knowledge transfer from a source domain to a related target domain. This paper investigates a practical DA paradigm, namely Source data-Free Active Domain Adaptation (SFADA), where source data becomes…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Mengyao Lyu , Tianxiang Hao , Xinhao Xu , Hui Chen , Zijia Lin , Jungong Han , Guiguang Ding

Cross-domain offline reinforcement learning leverages source domain data with diverse transition dynamics to alleviate the data requirement for the target domain. However, simply merging the data of two domains leads to performance…

Machine Learning · Computer Science 2024-05-13 Xiaoyu Wen , Chenjia Bai , Kang Xu , Xudong Yu , Yang Zhang , Xuelong Li , Zhen Wang

Model-based offline reinforcement learning (RL), which builds a supervised transition model with logging dataset to avoid costly interactions with the online environment, has been a promising approach for offline policy optimization. As the…

Machine Learning · Computer Science 2023-09-06 Junming Yang , Xingguo Chen , Shengyuan Wang , Bolei Zhang

We study offline off-dynamics reinforcement learning (RL) to utilize data from an easily accessible source domain to enhance policy learning in a target domain with limited data. Our approach centers on return-conditioned supervised…

Machine Learning · Computer Science 2026-03-03 Ruhan Wang , Yu Yang , Zhishuai Liu , Dongruo Zhou , Pan Xu

Federated Learning (FL) has recently emerged as a possible way to tackle the domain shift in real-world Semantic Segmentation (SS) without compromising the private nature of the collected data. However, most of the existing works on FL…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Donald Shenaj , Eros Fanì , Marco Toldo , Debora Caldarola , Antonio Tavera , Umberto Michieli , Marco Ciccone , Pietro Zanuttigh , Barbara Caputo

Offline reinforcement learning (RL) presents distinct challenges as it relies solely on observational data. A central concern in this context is ensuring the safety of the learned policy by quantifying uncertainties associated with various…

Machine Learning · Computer Science 2025-07-03 Xiaocong Chen , Siyu Wang , Tong Yu , Lina Yao

Learning models on one labeled dataset that generalize well on another domain is a difficult task, as several shifts might happen between the data domains. This is notably the case for lidar data, for which models can exhibit large…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Björn Michele , Alexandre Boulch , Gilles Puy , Tuan-Hung Vu , Renaud Marlet , Nicolas Courty

We consider the offline constrained reinforcement learning (RL) problem, in which the agent aims to compute a policy that maximizes expected return while satisfying given cost constraints, learning only from a pre-collected dataset. This…

Machine Learning · Computer Science 2022-04-20 Jongmin Lee , Cosmin Paduraru , Daniel J. Mankowitz , Nicolas Heess , Doina Precup , Kee-Eung Kim , Arthur Guez

Given labeled instances on a source domain and unlabeled ones on a target domain, unsupervised domain adaptation aims to learn a task classifier that can well classify target instances. Recent advances rely on domain-adversarial training of…

Computer Vision and Pattern Recognition · Computer Science 2019-12-18 Hui Tang , Kui Jia

Cross-domain offline reinforcement learning (RL) seeks to enhance sample efficiency in offline RL by utilizing additional offline source datasets. A key challenge is to identify and utilize source samples that are most relevant to the…

Machine Learning · Computer Science 2025-10-28 Linh Le Pham Van , Minh Hoang Nguyen , Duc Kieu , Hung Le , Hung The Tran , Sunil Gupta