English
Related papers

Related papers: Localized Dynamics-Aware Domain Adaption for Off-D…

200 papers

Offline reinforcement learning (RL) aims to learn an effective policy from a pre-collected dataset. Most existing works are to develop sophisticated learning algorithms, with less emphasis on improving the data collection process. Moreover,…

Machine Learning · Computer Science 2023-12-20 Chenyu Sun , Hangwei Qian , Chunyan Miao

Recent works on domain adaptation exploit adversarial training to obtain domain-invariant feature representations from the joint learning of feature extractor and domain discriminator networks. However, domain adversarial methods render…

Computer Vision and Pattern Recognition · Computer Science 2019-10-15 Seungmin Lee , Dongwan Kim , Namil Kim , Seong-Gyun Jeong

Offline reinforcement learning (RL) aims at learning policies from previously collected static trajectory data without interacting with the real environment. Recent works provide a novel perspective by viewing offline RL as a generic…

Machine Learning · Computer Science 2022-10-19 Kerong Wang , Hanye Zhao , Xufang Luo , Kan Ren , Weinan Zhang , Dongsheng Li

Domain adaptation targets at knowledge acquisition and dissemination from a labeled source domain to an unlabeled target domain under distribution shift. Still, the common requirement of identical class space shared across domains hinders…

Machine Learning · Computer Science 2022-03-16 Zhangjie Cao , Kaichao You , Ziyang Zhang , Jianmin Wang , Mingsheng Long

Offline-to-online reinforcement learning (O2O RL) faces a central challenge between retaining offline conservatism and adapting to online feedback under distribution shift. This challenge arises because data behavior evolves during…

Machine Learning · Computer Science 2026-05-19 Lipeng Zu , Yu Qian , Shayok Chakraborty , Xiaonan Zhang

Learning effective reinforcement learning (RL) policies to solve real-world complex tasks can be quite challenging without a high-fidelity simulation environment. In most cases, we are only given imperfect simulators with simplified…

Machine Learning · Computer Science 2025-10-16 Haoyi Niu , Shubham Sharma , Yiwen Qiu , Ming Li , Guyue Zhou , Jianming Hu , Xianyuan Zhan

Multi-Source Unsupervised Domain Adaptation (multi-source UDA) aims to learn a model from several labeled source domains while performing well on a different target domain where only unlabeled data are available at training time. To align…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Marin Scalbert , Maria Vakalopoulou , Florent Couzinié-Devy

Deep reinforcement learning algorithms have succeeded in several challenging domains. Classic Online RL job schedulers can learn efficient scheduling strategies but often takes thousands of timesteps to explore the environment and adapt…

Machine Learning · Computer Science 2022-12-05 Vanamala Venkataswamy , Jake Grigsby , Andrew Grimshaw , Yanjun Qi

Offline reinforcement learning (RL) is vital in areas where active data collection is expensive or infeasible, such as robotics or healthcare. In the real world, offline datasets often involve multiple domains that share the same state and…

Machine Learning · Computer Science 2025-03-04 Soichiro Nishimori , Xin-Qiang Cai , Johannes Ackermann , Masashi Sugiyama

Offline reinforcement learning (RL) provides a promising direction to exploit massive amount of offline data for complex decision-making tasks. Due to the distribution shift issue, current offline RL algorithms are generally designed to be…

Machine Learning · Computer Science 2022-10-25 Rui Yang , Chenjia Bai , Xiaoteng Ma , Zhaoran Wang , Chongjie Zhang , Lei Han

Domain adaptation (DA) is the topical problem of adapting models from labelled source datasets so that they perform well on target datasets where only unlabelled or partially labelled data is available. Many methods have been proposed to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Da Li , Timothy Hospedales

Source-free domain adaptation (SFDA) involves adapting a model originally trained using a labeled dataset ({\em source domain}) to perform effectively on an unlabeled dataset ({\em target domain}) without relying on any source data during…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Jing Wang , Wonho Bae , Jiahong Chen , Kuangen Zhang , Leonid Sigal , Clarence W. de Silva

Conventional reinforcement learning (RL) needs an environment to collect fresh data, which is impractical when online interactions are costly. Offline RL provides an alternative solution by directly learning from the previously collected…

Machine Learning · Computer Science 2023-03-15 Han Zheng , Xufang Luo , Pengfei Wei , Xuan Song , Dongsheng Li , Jing Jiang

Active Domain Adaptation (ADA) aims to maximally boost model adaptation in a new target domain by actively selecting a limited number of target data to annotate.This setting neglects the more practical scenario where training data are…

Artificial Intelligence · Computer Science 2023-11-23 Wenqiao Zhang , Zheqi Lv , Hao Zhou , Jia-Wei Liu , Juncheng Li , Mengze Li , Siliang Tang , Yueting Zhuang

Most existing studies on unsupervised domain adaptation (UDA) assume that each domain's training samples come with domain labels (e.g., painting, photo). Samples from each domain are assumed to follow the same distribution and the domain…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Zhongying Deng , Kaiyang Zhou , Da Li , Junjun He , Yi-Zhe Song , Tao Xiang

Multimedia applications are often associated with cross-domain knowledge transfer, where Unsupervised Domain Adaptation (UDA) can be used to reduce the domain shifts. Open Set Domain Adaptation (OSDA) aims to transfer knowledge from a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Jinghan Ru , Jun Tian , Zhekai Du , Chengwei Xiao , Jingjing Li , Heng Tao Shen

Offline reinforcement learning (offline RL), which aims to find an optimal policy from a previously collected static dataset, bears algorithmic difficulties due to function approximation errors from out-of-distribution (OOD) data points. To…

Machine Learning · Computer Science 2021-10-06 Gaon An , Seungyong Moon , Jang-Hyun Kim , Hyun Oh Song

Autonomous Mobility-on-Demand (AMoD) systems are an evolving mode of transportation in which a centrally coordinated fleet of self-driving vehicles dynamically serves travel requests. The control of these systems is typically formulated as…

Systems and Control · Electrical Eng. & Systems 2023-08-28 Carolin Schmidt , Daniele Gammelli , Francisco Camara Pereira , Filipe Rodrigues

Offline policy learning is aimed at learning decision-making policies using existing datasets of trajectories without collecting additional data. The primary motivation for using reinforcement learning (RL) instead of supervised learning…

High-speed off-road autonomous driving presents unique challenges due to complex, evolving terrain characteristics and the difficulty of accurately modeling terrain-vehicle interactions. While dynamics models used in model-based control can…