English
Related papers

Related papers: Transferability Estimation using Bhattacharyya Cla…

200 papers

In the realm of statistical learning, the increasing volume of accessible data and increasing model complexity necessitate robust methodologies. This paper explores two branches of robust Bayesian methods in response to this trend. The…

Methodology · Statistics 2024-12-02 Masahiro Tanaka

Transfer learning across heterogeneous data distributions (a.k.a. domains) and distinct tasks is a more general and challenging problem than conventional transfer learning, where either domains or tasks are assumed to be the same. While…

Machine Learning · Computer Science 2021-03-26 Yang Tan , Yang Li , Shao-Lun Huang

This paper investigates the accuracy of generative models and the impact of knowledge transfer on their generation precision. Specifically, we examine a generative model for a target task, fine-tuned using a pre-trained model from a source…

Machine Learning · Statistics 2025-06-03 Xinyu Tian , Xiaotong Shen

Meta-learning methods perform well on new within-distribution tasks but often fail when adapting to out-of-distribution target tasks, where transfer from source tasks can induce negative transfer. We propose a causally-aware Bayesian…

Machine Learning · Computer Science 2026-02-24 Lotta Mäkinen , Jorge Loría , Samuel Kaski

Automatic segmentation methods based on deep learning have recently demonstrated state-of-the-art performance, outperforming the ordinary methods. Nevertheless, these methods are inapplicable for small datasets, which are very common in…

Image and Video Processing · Electrical Eng. & Systems 2020-05-29 Anna Kuzina , Evgenii Egorov , Evgeny Burnaev

Automatic segmentation methods based on deep learning have recently demonstrated state-of-the-art performance, outperforming the ordinary methods. Nevertheless, these methods are inapplicable for small datasets, which are very common in…

Image and Video Processing · Electrical Eng. & Systems 2019-08-16 Anna Kuzina , Evgenii Egorov , Evgeny Burnaev

Continual Generalized Category Discovery (C-GCD) faces a critical challenge: incrementally learning new classes from unlabeled data streams while preserving knowledge of old classes. Existing methods struggle with catastrophic forgetting,…

Machine Learning · Computer Science 2025-07-24 Hao Dai , Jagmohan Chauhan

Transfer learning has recently attracted significant research attention, as it simultaneously learns from different source domains, which have plenty of labeled data, and transfers the relevant knowledge to the target domain with limited…

Machine Learning · Statistics 2018-06-14 Alireza Karbalayghareh , Xiaoning Qian , Edward R. Dougherty

Color transfer, which plays a key role in image editing, has attracted noticeable attention recently. It has remained a challenge to date due to various issues such as time-consuming manual adjustments and prior segmentation issues. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-01-07 Chunzhi Gu , Xuequan Lu , Chao Zhang

Identifying beneficial tasks to transfer from is a critical step toward successful intermediate-task transfer learning. In this work, we experiment with 130 source-target task combinations and demonstrate that the transfer performance…

Computation and Language · Computer Science 2024-07-24 Pin-Jie Lin , Miaoran Zhang , Marius Mosbach , Dietrich Klakow

In low-resource settings, model transfer can help to overcome a lack of labeled data for many tasks and domains. However, predicting useful transfer sources is a challenging problem, as even the most similar sources might lead to unexpected…

Computation and Language · Computer Science 2021-11-01 Lukas Lange , Jannik Strötgen , Heike Adel , Dietrich Klakow

The existing contrastive learning methods mainly focus on single-grained representation learning, e.g., part-level, object-level or scene-level ones, thus inevitably neglecting the transferability of representations on other granularity…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Chengchao Shen , Jianzhong Chen , Jianxin Wang

Transfer learning for high-dimensional Gaussian graphical models (GGMs) is studied with the goal of estimating the target GGM by utilizing the data from similar and related auxiliary studies. The similarity between the target graph and each…

Methodology · Statistics 2020-10-22 Sai Li , T. Tony Cai , Hongzhe Li

Classifiers trained solely on labeled source data may yield misleading results when applied to unlabeled target data drawn from a different distribution. Transfer learning can rectify this by transferring knowledge from source to target…

Statistics Theory · Mathematics 2025-02-19 Junjun Lang , Yukun Liu

Semantic segmentation, which aims to acquire a detailed understanding of images, is an essential issue in computer vision. However, in practical scenarios, new categories that are different from the categories in training usually appear.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-02 Haiyang Liu , Yichen Wang , Jiayi Zhao , Guowu Yang , Fengmao Lv

Transferring the knowledge learned from large scale datasets (e.g., ImageNet) via fine-tuning offers an effective solution for domain-specific fine-grained visual categorization (FGVC) tasks (e.g., recognizing bird species or car make and…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Yin Cui , Yang Song , Chen Sun , Andrew Howard , Serge Belongie

Semantic segmentation in a supervised learning manner has achieved significant progress in recent years. However, its performance usually drops dramatically due to the data-distribution discrepancy between seen and unseen domains when we…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Jian Zhang , Lei Qi , Yinghuan Shi , Yang Gao

Fine-tuning models that have been pre-trained on large datasets has become a cornerstone of modern machine learning workflows. With the widespread availability of online model repositories, such as Hugging Face, it is now easier than ever…

Machine Learning · Computer Science 2025-02-12 Prabhant Singh , Sibylle Hess , Joaquin Vanschoren

Transfer learning makes it possible to use large vision networks on a variety of domains, by specializing their models' general filters to new tasks. However, these networks assume the input images to have 3 input channels, making them…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Mariette Schönfeld , Laurens Devos , Wannes Meert , Hendrik Blockeel

Particle competition and cooperation (PCC) is a graph-based semi-supervised learning approach. When PCC is applied to interactive image segmentation tasks, pixels are converted into network nodes, and each node is connected to its k-nearest…

Computer Vision and Pattern Recognition · Computer Science 2020-02-17 Fabricio Breve