English
Related papers

Related papers: Learning Representations that Support Robust Trans…

200 papers

Reinforcement learning (RL) enables sequential decision-making in complex and high-dimensional environments through interaction with the environment. In most real-world applications, however, a high number of interactions are infeasible. In…

Machine Learning · Computer Science 2024-12-17 Md Ferdous Alam , Parinaz Naghizadeh , David Hoelzle

In this paper, we present a new approach to Transfer Learning (TL) in Reinforcement Learning (RL) for cross-domain tasks. Many of the available techniques approach the transfer architecture as a method of speeding up the target task…

Artificial Intelligence · Computer Science 2018-01-23 Girish Joshi , Girish Chowdhary

Transfer learning enables to re-use knowledge learned on a source task to help learning a target task. A simple form of transfer learning is common in current state-of-the-art computer vision models, i.e. pre-training a model for image…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Thomas Mensink , Jasper Uijlings , Alina Kuznetsova , Michael Gygli , Vittorio Ferrari

Regression prediction plays a crucial role in practical applications and strongly relies on data annotation. However, due to prohibitive annotation costs or domain-specific constraints, labeled data in the target domain is often scarce,…

Methodology · Statistics 2025-09-25 Bingbing Wang , Jiaqi Wang , Yu Tang

We propose a new framework for binary classification in transfer learning settings where both covariate and label distributions may shift between source and target domains. Unlike traditional covariate shift or label shift assumptions, we…

Methodology · Statistics 2025-09-29 Manli Cheng , Subha Maity , Qinglong Tian , Pengfei Li

Efficient and robust policy transfer remains a key challenge for reinforcement learning to become viable for real-wold robotics. Policy transfer through warm initialization, imitation, or interacting over a large set of agents with…

Machine Learning · Computer Science 2021-05-12 Girish Joshi , Girish Chowdhary

Out-of-distribution (OOD) generalisation is challenging because it involves not only learning from empirical data, but also deciding among various notions of generalisation, e.g., optimising the average-case risk, worst-case risk, or…

Machine Learning · Computer Science 2024-05-31 Anurag Singh , Siu Lun Chau , Shahine Bouabid , Krikamol Muandet

We propose a framework that learns a representation transferable across different domains and tasks in a label efficient manner. Our approach battles domain shift with a domain adversarial loss, and generalizes the embedding to novel task…

Machine Learning · Statistics 2017-12-04 Zelun Luo , Yuliang Zou , Judy Hoffman , Li Fei-Fei

Many real-world domains require safe decision making in uncertain environments. In this work, we introduce a deep reinforcement learning framework for approaching this important problem. We consider a distribution over transition models,…

Machine Learning · Computer Science 2023-10-27 James Queeney , Mouhacine Benosman

Transfer learning has become an essential technique to exploit information from the source domain to boost performance of the target task. Despite the prevalence in high-dimensional data, heterogeneity and heavy tails are insufficiently…

Machine Learning · Statistics 2023-11-07 Jiayu Huang , Mingqiu Wang , Yuanshan Wu

Due to limited resources and public safety concerns, deep reinforcement learning (RL) agents for many cyber-physical systems (e.g., autonomous vehicles) are first trained in simulators. However, when deployed in real world environments,…

Machine Learning · Computer Science 2026-05-28 Gengyue Han , Yiheng Feng

The dominating NLP paradigm of training a strong neural predictor to perform one task on a specific dataset has led to state-of-the-art performance in a variety of applications (eg. sentiment classification, span-prediction based question…

Computation and Language · Computer Science 2021-09-06 Paul Michel

Theoretical studies on transfer learning or domain adaptation have so far focused on situations with a known hypothesis class or model; however in practice, some amount of model selection is usually involved, often appearing under the…

Machine Learning · Statistics 2023-10-13 Steve Hanneke , Samory Kpotufe , Yasaman Mahdaviyeh

Understanding how information propagates in real-life complex networks yields a better understanding of dynamic processes such as misinformation or epidemic spreading. The recently introduced branch of machine learning methods for learning…

Social and Information Networks · Computer Science 2023-02-21 Sebastian Mežnar , Nada Lavrač , Blaž Škrlj

Domain randomization (DR) is a successful technique for learning robust policies for robot systems, when the dynamics of the target robot system are unknown. The success of policies trained with domain randomization however, is highly…

Machine Learning · Computer Science 2019-09-18 Melissa Mozifian , Juan Camilo Gamboa Higuera , David Meger , Gregory Dudek

Transferability estimation identifies the best pre-trained models for downstream tasks without incurring the high computational cost of full fine-tuning. This capability facilitates deployment and advances the pre-training and fine-tuning…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Yaoyan Zheng , Huiqun Wang , Nan Zhou , Di Huang

Traditional place categorization approaches in robot vision assume that training and test images have similar visual appearance. Therefore, any seasonal, illumination and environmental changes typically lead to severe degradation in…

Robotics · Computer Science 2018-05-31 Massimiliano Mancini , Samuel Rota Bulò , Barbara Caputo , Elisa Ricci

Practitioners often face the challenge of deploying prediction models in new environments with shifted distributions of covariates and responses. With observational data, such shifts are often driven by unobserved confounding, and can in…

Machine Learning · Computer Science 2026-04-02 Kulunu Dharmakeerthi , YoonHaeng Hur , Tengyuan Liang

Performative prediction is a framework accounting for the shift in the data distribution induced by the prediction of a model deployed in the real world. Ensuring rapid convergence to a stable solution where the data distribution remains…

Machine Learning · Computer Science 2026-01-30 Pedram Khorsandi , Rushil Gupta , Mehrnaz Mofakhami , Simon Lacoste-Julien , Gauthier Gidel

The similarity of feature representations plays a pivotal role in the success of problems related to domain adaptation. Feature similarity includes both the invariance of marginal distributions and the closeness of conditional distributions…

Machine Learning · Computer Science 2022-01-10 Ammar Shaker , Shujian Yu , Daniel Oñoro-Rubio