English
Related papers

Related papers: Transferability Estimation using Bhattacharyya Cla…

200 papers

Deep clustering as an important branch of unsupervised representation learning focuses on embedding semantically similar samples into the identical feature space. This core demand inspires the exploration of contrastive learning and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Haifeng Xia , Hai Huang , Zhengming Ding

The medical image processing field often encounters the critical issue of scarce annotated data. Transfer learning has emerged as a solution, yet how to select an adequate source task and effectively transfer the knowledge to the target…

Image and Video Processing · Electrical Eng. & Systems 2024-10-10 Jingyun Yang , Jingge Wang , Guoqing Zhang , Yang Li

Generative adversarial network (GAN) has greatly improved the quality of unsupervised image generation. Previous GAN-based methods often require a large amount of high-quality training data while producing a small number (e.g., tens) of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Chunpeng Wu , Wei Wen , Yiran Chen , Hai Li

Recent years have witnessed the prevailing progress of Generative Adversarial Networks (GANs) in image-to-image translation. However, the success of these GAN models hinges on ponderous computational costs and labor-expensive training data.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Yuxi Ren , Jie Wu , Peng Zhang , Manlin Zhang , Xuefeng Xiao , Qian He , Rui Wang , Min Zheng , Xin Pan

Transferability metrics is a maturing field with increasing interest, which aims at providing heuristics for selecting the most suitable source models to transfer to a given target dataset, without fine-tuning them all. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Andrea Agostinelli , Michal Pándy , Jasper Uijlings , Thomas Mensink , Vittorio Ferrari

Domain similarity measures can be used to gauge adaptability and select suitable data for transfer learning, but existing approaches define ad hoc measures that are deemed suitable for respective tasks. Inspired by work on curriculum…

Computation and Language · Computer Science 2017-07-18 Sebastian Ruder , Barbara Plank

This paper introduces a novel Bayesian approach to detect changes in the variance of a Gaussian sequence model, focusing on quantifying the uncertainty in the change point locations and providing a scalable algorithm for inference. Such a…

Methodology · Statistics 2025-03-04 Lorenzo Cappello , Oscar Hernan Madrid Padilla

In networks of independent entities that face similar predictive tasks, transfer machine learning enables to re-use and improve neural nets using distributed data sets without the exposure of raw data. As the number of data sets in business…

Machine Learning · Computer Science 2020-03-31 Robin Hirt , Akash Srivastava , Carlos Berg , Niklas Kühl

Adversarial examples for neural network image classifiers are known to be transferable: examples optimized to be misclassified by a source classifier are often misclassified as well by classifiers with different architectures. However,…

Machine Learning · Computer Science 2021-10-27 Jacob M. Springer , Melanie Mitchell , Garrett T. Kenyon

Models trained on datasets with texture bias usually perform poorly on out-of-distribution samples since biased representations are embedded into the model. Recently, various image translation and debiasing methods have attempted to…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Myeongkyun Kang , Dongkyu Won , Miguel Luna , Philip Chikontwe , Kyung Soo Hong , June Hong Ahn , Sang Hyun Park

As one of the fundamental tasks in computer vision, semantic segmentation plays an important role in real world applications. Although numerous deep learning models have made notable progress on several mainstream datasets with the rapid…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Bin Zhang , Shengjie Zhao , Rongqing Zhang

For many applications, an ensemble of base classifiers is an effective solution. The tuning of its parameters(number of classes, amount of data on which each classifier is to be trained on, etc.) requires G, the generalization error of a…

Bayesian network structure learning algorithms with limited data are being used in domains such as systems biology and neuroscience to gain insight into the underlying processes that produce observed data. Learning reliable networks from…

Machine Learning · Statistics 2013-07-10 Diane Oyen , Terran Lane

The similarity of feature representations plays a pivotal role in the success of problems related to domain adaptation. Feature similarity includes both the invariance of marginal distributions and the closeness of conditional distributions…

Machine Learning · Computer Science 2022-01-10 Ammar Shaker , Shujian Yu , Daniel Oñoro-Rubio

Deep transfer learning recently has acquired significant research interest. It makes use of pre-trained models that are learned from a source domain, and utilizes these models for the tasks in a target domain. Model-based deep transfer…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Tianyang Wang , Jun Huan , Michelle Zhu

We propose a data-efficient Gaussian process-based Bayesian approach to the semi-supervised learning problem on graphs. The proposed model shows extremely competitive performance when compared to the state-of-the-art graph neural networks…

Machine Learning · Computer Science 2018-10-15 Yin Cheng Ng , Nicolo Colombo , Ricardo Silva

The problem of sequentially transferring from a source object track and a model to another Bayesian filter has become ubiquitous. Due to the lack of a structural model that can capture the dependence among different models, the transfer may…

Machine Learning · Computer Science 2022-10-25 Bahman Moraffah , Antonia Papandreou-Suppappola

Quantile regression is increasingly encountered in modern big data applications due to its robustness and flexibility. We consider the scenario of learning the conditional quantiles of a specific target population when the available data…

Statistics Theory · Mathematics 2024-02-27 Jun Jin , Jun Yan , Robert H. Aseltine , Kun Chen

In this paper, we explore transferability in learning between different attack classes in a network intrusion detection setup. We evaluate transferability of attack classes by training a deep learning model with a specific attack class and…

Cryptography and Security · Computer Science 2023-12-20 Shreya Ghosh , Abu Shafin Mohammad Mahdee Jameel , Aly El Gamal

Transferability estimation has been an essential tool in selecting a pre-trained model and the layers in it for transfer learning, to transfer, so as to maximize the performance on a target task and prevent negative transfer. Existing…

Machine Learning · Computer Science 2022-07-07 Long-Kai Huang , Ying Wei , Yu Rong , Qiang Yang , Junzhou Huang