English
Related papers

Related papers: Cross-Domain Policy Adaptation via Value-Guided Da…

200 papers

Deep learning models such as convolutional neural networks and transformers have been widely applied to solve 3D object detection problems in the domain of autonomous driving. While existing models have achieved outstanding performance on…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Ruixiao Zhang , Juheon Lee , Xiaohao Cai , Adam Prugel-Bennett

Model-based reinforcement learning (MBRL) provides a way to learn a transition model of the environment, which can then be used to plan personalized policies for different patient cohorts and to understand the dynamics involved in the…

Machine Learning · Computer Science 2024-11-22 Abhishek Sharma , Sonali Parbhoo , Omer Gottesman , Finale Doshi-Velez

Domain adaptation is crucial in many real-world applications where the distribution of the training data differs from the distribution of the test data. Previous Deep Learning-based approaches to domain adaptation need to be trained jointly…

Computation and Language · Computer Science 2017-02-08 Sebastian Ruder , Parsa Ghaffari , John G. Breslin

In many machine learning tasks, input features with varying degrees of predictive capability are acquired at varying costs. In order to optimize the performance-cost trade-off, one would select features to observe a priori. However, given…

Machine Learning · Computer Science 2022-04-04 Randy Ardywibowo , Shahin Boluki , Zhangyang Wang , Bobak Mortazavi , Shuai Huang , Xiaoning Qian

Deep Reinforcement Learning (RL) is successful in solving many complex Markov Decision Processes (MDPs) problems. However, agents often face unanticipated environmental changes after deployment in the real world. These changes are often…

Machine Learning · Computer Science 2021-10-29 Beining Han , Chongyi Zheng , Harris Chan , Keiran Paster , Michael R. Zhang , Jimmy Ba

Generative Flow Networks (GFlowNets) are a class of generative models that sample objects in proportion to a specified reward function through a learned policy. They can be trained either on-policy or off-policy, needing a balance between…

Machine Learning · Computer Science 2025-03-04 Dominic Phillips , Flaviu Cipcigan

Off-policy learning refers to the problem of learning the value function of a way of behaving, or policy, while following a different policy. Gradient-based off-policy learning algorithms, such as GTD and TDC/GQ, converge even when using…

Artificial Intelligence · Computer Science 2015-12-15 Lucas Lehnert , Doina Precup

This paper presents a novel multi-task learning-based method for unsupervised domain adaptation. Specifically, the source and target domain classifiers are jointly learned by considering the geometry of target domain and the divergence…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Jing Zhang , Wanqing Li , Philip Ogunbona

To date, various neural methods have been proposed for causal effect estimation based on observational data, where a default assumption is the same distribution and availability of variables at both training and inference (i.e., runtime)…

Machine Learning · Computer Science 2023-06-26 Hechuan Wen , Tong Chen , Li Kheng Chai , Shazia Sadiq , Junbin Gao , Hongzhi Yin

The single domain generalization(SDG) based on meta-learning has emerged as an effective technique for solving the domain-shift problem. However, the inadequate match of data distribution between source and augmented domains and difficult…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Can Sun , Hao Zheng , Zhigang Hu , Liu Yang , Meiguang Zheng , Bo Xu

Domain adaptation enables the learner to safely generalize into novel environments by mitigating domain shifts across distributions. Previous works may not effectively uncover the underlying reasons that would lead to the drastic model…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 Ruijia Xu , Guanbin Li , Jihan Yang , Liang Lin

In this paper, we aim to adapt a model at test-time using a few unlabeled data to address distribution shifts. To tackle the challenges of extracting domain knowledge from a limited amount of data, it is crucial to utilize correlated…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Zhixiang Chi , Li Gu , Tao Zhong , Huan Liu , Yuanhao Yu , Konstantinos N Plataniotis , Yang Wang

In the settings of conventional domain adaptation, categories of the source dataset are from the same domain (or domains for multi-source domain adaptation), which is not always true in reality. In this paper, we propose…

Machine Learning · Computer Science 2020-11-06 Sitong Mao , Keli Zhang , Fu-lai Chung

The concept of the value-gradient is introduced and developed in the context of reinforcement learning. It is shown that by learning the value-gradients exploration or stochastic behaviour is no longer needed to find locally optimal…

Neural and Evolutionary Computing · Computer Science 2008-03-26 Michael Fairbank

We consider off-dynamics reinforcement learning (RL) where one needs to transfer policies across different domains with dynamics mismatch. Despite the focus on developing dynamics-aware algorithms, this field is hindered due to the lack of…

Machine Learning · Computer Science 2024-10-29 Jiafei Lyu , Kang Xu , Jiacheng Xu , Mengbei Yan , Jingwen Yang , Zongzhang Zhang , Chenjia Bai , Zongqing Lu , Xiu Li

Domain adaptation aims to transfer knowledge of labeled instances obtained from a source domain to a target domain to fill the gap between the domains. Most domain adaptation methods assume that the source and target domains have the same…

Machine Learning · Computer Science 2022-09-13 Toshimitsu Aritake , Hideitsu Hino

Over the past decade, domain adaptation has become a widely studied branch of transfer learning that aims to improve performance on target domains by leveraging knowledge from the source domain. Conventional domain adaptation methods often…

Machine Learning · Computer Science 2023-02-24 Zhiqi Yu , Jingjing Li , Zhekai Du , Lei Zhu , Heng Tao Shen

A typical multi-source domain adaptation (MSDA) approach aims to transfer knowledge learned from a set of labeled source domains, to an unlabeled target domain. Nevertheless, prior works strictly assume that each source domain shares the…

Machine Learning · Computer Science 2022-07-13 Zixin Wang , Yadan Luo , Peng-Fei Zhang , Sen Wang , Zi Huang

We propose world value functions (WVFs), a type of goal-oriented general value function that represents how to solve not just a given task, but any other goal-reaching task in an agent's environment. This is achieved by equipping an agent…

Artificial Intelligence · Computer Science 2022-06-27 Geraud Nangue Tasse , Benjamin Rosman , Steven James

Diffusion-based robot navigation policies trained on large-scale imitation learning datasets, can generate multi-modal trajectories directly from the robot's visual observations, bypassing the traditional localization-mapping-planning…

Robotics · Computer Science 2026-03-16 Junhe Sheng , Ruofei Bai , Kuan Xu , Ruimeng Liu , Jie Chen , Shenghai Yuan , Wei-Yun Yau , Lihua Xie