English
Related papers

Related papers: State-Conditional Adversarial Learning: An Off-Pol…

200 papers

Domain adaptation refers to the problem of leveraging labeled data in a source domain to learn an accurate model in a target domain where labels are scarce or unavailable. A recent approach for finding a common representation of the two…

Machine Learning · Statistics 2018-03-20 Rui Shu , Hung H. Bui , Hirokazu Narui , Stefano Ermon

Reinforcement learning in partially observable domains is challenging due to the lack of observable state information. Thankfully, learning offline in a simulator with such state information is often possible. In particular, we propose a…

Robotics · Computer Science 2022-11-11 Hai Nguyen , Andrea Baisero , Dian Wang , Christopher Amato , Robert Platt

Learning a goal-oriented dialog policy is generally performed offline with supervised learning algorithms or online with reinforcement learning (RL). Additionally, as companies accumulate massive quantities of dialog transcripts between…

Artificial Intelligence · Computer Science 2017-12-11 Li Zhou , Kevin Small , Oleg Rokhlenko , Charles Elkan

The goal of imitation learning is to mimic expert behavior without access to an explicit reward signal. Expert demonstrations provided by humans, however, often show significant variability due to latent factors that are typically not…

Machine Learning · Computer Science 2017-11-16 Yunzhu Li , Jiaming Song , Stefano Ermon

This work leverages adaptive social learning to estimate partially observable global states in multi-agent reinforcement learning (MARL) problems. Unlike existing methods, the proposed approach enables the concurrent operation of social…

Multiagent Systems · Computer Science 2025-08-11 Ainur Zhaikhan , Malek Khammassi , Ali H. Sayed

Autonomous driving systems need to handle complex scenarios such as lane following, avoiding collisions, taking turns, and responding to traffic signals. In recent years, approaches based on end-to-end behavioral cloning have demonstrated…

Robotics · Computer Science 2021-04-23 Keishi Ishihara , Anssi Kanervisto , Jun Miura , Ville Hautamäki

In this paper, we focus on unsupervised domain adaptation for Machine Reading Comprehension (MRC), where the source domain has a large amount of labeled data, while only unlabeled passages are available in the target domain. To this end, we…

Computation and Language · Computer Science 2019-08-27 Huazheng Wang , Zhe Gan , Xiaodong Liu , Jingjing Liu , Jianfeng Gao , Hongning Wang

Learning robust driving policies from large-scale, real-world datasets is a central challenge in autonomous driving, as online data collection is often unsafe and impractical. While Behavioral Cloning (BC) offers a straightforward approach…

Machine Learning · Computer Science 2025-08-28 Antonio Guillen-Perez

Unwanted samples from private source categories in the learning objective of a partial domain adaptation setup can lead to negative transfer and reduce classification performance. Existing methods, such as re-weighting or aggregating target…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Sandipan Choudhuri , Arunabha Sen

Transferring knowledge across domains is one of the most fundamental problems in machine learning, but doing so effectively in the context of reinforcement learning remains largely an open problem. Current methods make strong assumptions on…

Machine Learning · Computer Science 2022-11-29 Abhi Gupta , Ted Moskovitz , David Alvarez-Melis , Aldo Pacchiano

Offline reinforcement learning (RL) looks at learning how to optimally solve tasks using a fixed dataset of interactions from the environment. Many off-policy algorithms developed for online learning struggle in the offline setting as they…

Machine Learning · Computer Science 2025-03-18 Natinael Solomon Neggatu , Jeremie Houssineau , Giovanni Montana

Domain adaptation is transfer learning which aims to generalize a learning model across training and testing data with different distributions. Most previous research tackle this problem in seeking a shared feature representation between…

Machine Learning · Computer Science 2017-04-17 Lingkun Luo , Xiaofang Wang , Shiqiang Hu , Chao Wang , Yuxing Tang , Liming Chen

Semi-supervised domain adaptation (SSDA) adapts a learner to a new domain by effectively utilizing source domain data and a few labeled target samples. It is a practical yet under-investigated research topic. In this paper, we analyze the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Wenqiao Zhang , Changshuo Liu , Can Cui , Beng Chin Ooi

Sequential decision making algorithms often struggle to leverage different sources of unstructured offline interaction data. Imitation learning (IL) methods based on supervised learning are robust, but require optimal demonstrations, which…

Machine Learning · Computer Science 2023-04-28 Joey Hejna , Jensen Gao , Dorsa Sadigh

This work considers two distinct settings: imitation learning and goal-conditioned reinforcement learning. In either case, effective solutions require the agent to reliably reach a specified state (a goal), or set of states (a…

Machine Learning · Computer Science 2020-02-18 Yannick Schroecker , Charles Isbell

Offline reinforcement learning can enable policy learning from pre-collected, sub-optimal datasets without online interactions. This makes it ideal for real-world robots and safety-critical scenarios, where collecting online data or expert…

Robotics · Computer Science 2025-08-07 Sreyas Venkataraman , Yufei Wang , Ziyu Wang , Navin Sriram Ravie , Zackory Erickson , David Held

This paper proposes a new unsupervised domain adaptation approach called Collaborative and Adversarial Network (CAN), which uses the domain-collaborative and domain-adversarial learning strategy for training the neural network. The…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Weichen Zhang , Dong Xu , Wanli Ouyang , Wen Li

Offline reinforcement learning (RL) learns effective policies from a static target dataset. The performance of state-of-the-art offline RL algorithms notwithstanding, it relies on the size of the target dataset, and it degrades if limited…

Machine Learning · Computer Science 2026-02-10 Weiqin Chen , Xinjie Zhang , Sandipan Mishra , Santiago Paternain

Motion forecasting in highly interactive scenarios is a challenging problem in autonomous driving. In such scenarios, we need to accurately predict the joint behavior of interacting agents to ensure the safe and efficient navigation of…

Robotics · Computer Science 2022-08-15 Lingfeng Sun , Chen Tang , Yaru Niu , Enna Sachdeva , Chiho Choi , Teruhisa Misu , Masayoshi Tomizuka , Wei Zhan

We consider the problem of tracking an adversarial state sequence in a linear dynamical system subject to adversarial disturbances and loss functions, generalizing earlier settings in the literature. To this end, we develop three…

Machine Learning · Computer Science 2022-02-23 Zhiyu Zhang , Ashok Cutkosky , Ioannis Ch. Paschalidis