English
Related papers

Related papers: OTCE: A Transferability Metric for Cross-Domain Cr…

200 papers

Consider the problem of improving the estimation of conditional average treatment effects (CATE) for a target domain of interest by leveraging related information from a source domain with a different feature space. This heterogeneous…

Machine Learning · Computer Science 2022-10-13 Ioana Bica , Mihaela van der Schaar

Comparing datasets is a fundamental task in machine learning, essential for various learning paradigms-from evaluating train and test datasets for model generalization to using dataset similarity for detecting data drift. While traditional…

Machine Learning · Computer Science 2025-06-18 Paula Rodriguez-Diaz , Lingkai Kong , Kai Wang , David Alvarez-Melis , Milind Tambe

Transferability metrics is a maturing field with increasing interest, which aims at providing heuristics for selecting the most suitable source models to transfer to a given target dataset, without fine-tuning them all. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Andrea Agostinelli , Michal Pándy , Jasper Uijlings , Thomas Mensink , Vittorio Ferrari

We address the problem of ensemble selection in transfer learning: Given a large pool of source models we want to select an ensemble of models which, after fine-tuning on the target training set, yields the best performance on the target…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Andrea Agostinelli , Jasper Uijlings , Thomas Mensink , Vittorio Ferrari

Transfer learning enables to re-use knowledge learned on a source task to help learning a target task. A simple form of transfer learning is common in current state-of-the-art computer vision models, i.e. pre-training a model for image…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Thomas Mensink , Jasper Uijlings , Alina Kuznetsova , Michael Gygli , Vittorio Ferrari

We address the computational and theoretical limitations of current distributional alignment methods for source-free unsupervised domain adaptation (SFUDA) using source class-mean features. In particular, we focus on estimating…

Machine Learning · Computer Science 2026-04-30 Yiming Zhang , Sitong Liu , Alex Cloninger

Memory-based self-evolution has emerged as a promising paradigm for coding agents. However, existing approaches typically restrict memory utilization to homogeneous task domains, failing to leverage the shared infrastructural foundations,…

Artificial Intelligence · Computer Science 2026-04-16 Kangsan Kim , Minki Kang , Taeil Kim , Yanlai Yang , Mengye Ren , Sung Ju Hwang

Multi-agent trajectory prediction is crucial for various practical applications, spurring the construction of many large-scale trajectory datasets, including vehicles and pedestrians. However, discrepancies exist among datasets due to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Daehee Park , Jaewoo Jeong , Kuk-Jin Yoon

In this paper, we present a new approach to Transfer Learning (TL) in Reinforcement Learning (RL) for cross-domain tasks. Many of the available techniques approach the transfer architecture as a method of speeding up the target task…

Artificial Intelligence · Computer Science 2018-01-23 Girish Joshi , Girish Chowdhary

Transfer learning has become an essential technique to exploit information from the source domain to boost performance of the target task. Despite the prevalence in high-dimensional data, heterogeneity and heavy tails are insufficiently…

Machine Learning · Statistics 2023-11-07 Jiayu Huang , Mingqiu Wang , Yuanshan Wu

Transfer Learning (TL) offers the potential to accelerate learning by transferring knowledge across tasks. However, it faces critical challenges such as negative transfer, domain adaptation and inefficiency in selecting solid source…

Machine Learning · Computer Science 2025-07-29 Alessandro Capurso , Elia Piccoli , Davide Bacciu

Previous transfer learning methods based on deep network assume the knowledge should be transferred between the same hidden layers of the source domain and the target domains. This assumption doesn't always hold true, especially when the…

Machine Learning · Computer Science 2018-09-25 Jianzhe Lin , Qi Wang , Rabab Ward , Z. Jane Wang

Transferability estimation has been an essential tool in selecting a pre-trained model and the layers in it for transfer learning, to transfer, so as to maximize the performance on a target task and prevent negative transfer. Existing…

Machine Learning · Computer Science 2022-07-07 Long-Kai Huang , Ying Wei , Yu Rong , Qiang Yang , Junzhou Huang

Identifying beneficial tasks to transfer from is a critical step toward successful intermediate-task transfer learning. In this work, we experiment with 130 source-target task combinations and demonstrate that the transfer performance…

Computation and Language · Computer Science 2024-07-24 Pin-Jie Lin , Miaoran Zhang , Marius Mosbach , Dietrich Klakow

Constructing valid and informative conformal prediction regions for multi-dimensional outputs remains a fundamental challenge. While conformal prediction provides finite-sample, distribution-free coverage guarantees, its practical…

Machine Learning · Statistics 2026-05-11 Zhenhan Fang , Aixin Tan , Jian Huang

This paper addresses the problem of ranking pre-trained models for object detection and image classification. Selecting the best pre-trained model by fine-tuning is an expensive and time-consuming task. Previous works have proposed…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Mohsen Gholami , Mohammad Akbari , Xinglu Wang , Behnam Kamranian , Yong Zhang

In this paper, we propose to tackle the problem of reducing discrepancies between multiple domains referred to as multi-source domain adaptation and consider it under the target shift assumption: in all domains we aim to solve a…

Machine Learning · Statistics 2019-03-15 Ievgen Redko , Nicolas Courty , Rémi Flamary , Devis Tuia

Vehicle GPS trajectories provide valuable movement information that supports various downstream tasks and applications. A desirable trajectory learning model should be able to transfer across regions and tasks without retraining, avoiding…

Machine Learning · Computer Science 2025-05-20 Tonglong Wei , Yan Lin , Zeyu Zhou , Haomin Wen , Jilin Hu , Shengnan Guo , Youfang Lin , Gao Cong , Huaiyu Wan

Transfer learning aims to make the most of existing pre-trained models to achieve better performance on a new task in limited data scenarios. However, it is unclear which models will perform best on which task, and it is prohibitively…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Louis Fouquet , Simona Maggio , Léo Dreyfus-Schmidt

We propose a framework that learns a representation transferable across different domains and tasks in a label efficient manner. Our approach battles domain shift with a domain adversarial loss, and generalizes the embedding to novel task…

Machine Learning · Statistics 2017-12-04 Zelun Luo , Yuliang Zou , Judy Hoffman , Li Fei-Fei