English
Related papers

Related papers: Unsupervised optimal deep transfer learning for cl…

200 papers

Distribution shift, a change in the statistical properties of data over time, poses a critical challenge for deep learning anomaly detection systems. Existing anomaly detection systems often struggle to adapt to these shifts. Specifically,…

Cryptography and Security · Computer Science 2026-05-19 Ehssan Mousavipour , Andrey Dimanchev , Majid Ghaderi

Due to label scarcity and covariate shift happening frequently in real-world studies, transfer learning has become an essential technique to train models generalizable to some target populations using existing labeled source data. Most…

Methodology · Statistics 2022-11-09 Doudou Zhou , Molei Liu , Mengyan Li , Tianxi Cai

Generalized Category Discovery is a crucial real-world task. Despite the improved performance on known categories, current methods perform poorly on novel categories. We attribute the poor performance to two reasons: biased knowledge…

Computation and Language · Computer Science 2023-12-29 Wenbin An , Feng Tian , Wenkai Shi , Yan Chen , Yaqiang Wu , Qianying Wang , Ping Chen

We revisit the fundamental problem of learning with distribution shift, in which a learner is given labeled samples from training distribution $D$, unlabeled samples from test distribution $D'$ and is asked to output a classifier with low…

Data Structures and Algorithms · Computer Science 2024-05-22 Adam R. Klivans , Konstantinos Stavropoulos , Arsen Vasilyan

Recent work on deep learning for tabular data demonstrates the strong performance of deep tabular models, often bridging the gap between gradient boosted decision trees and neural networks. Accuracy aside, a major advantage of neural models…

Graph Convolutional Networks (GCNs) show promising results for semi-supervised learning tasks on graphs, thus become favorable comparing with other approaches. Despite the remarkable success of GCNs, it is difficult to train GCNs with…

Machine Learning · Computer Science 2020-08-14 Xianfeng Tang , Huaxiu Yao , Yiwei Sun , Yiqi Wang , Jiliang Tang , Charu Aggarwal , Prasenjit Mitra , Suhang Wang

Domain adaptation is transfer learning which aims to generalize a learning model across training and testing data with different distributions. Most previous research tackle this problem in seeking a shared feature representation between…

Machine Learning · Computer Science 2017-04-17 Lingkun Luo , Xiaofang Wang , Shiqiang Hu , Chao Wang , Yuxing Tang , Liming Chen

Because large, human-annotated datasets suffer from labeling errors, it is crucial to be able to train deep neural networks in the presence of label noise. While training image classification models with label noise have received much…

Machine Learning · Computer Science 2019-03-19 Ishan Jindal , Daniel Pressel , Brian Lester , Matthew Nokleby

Node classification using Graph Neural Networks (GNNs) has been widely applied in various real-world scenarios. However, in recent years, compelling evidence emerges that the performance of GNN-based node classification may deteriorate…

Machine Learning · Computer Science 2022-08-23 Jun Zhuang , Mohammad Al Hasan

In label-noise learning, estimating the transition matrix is a hot topic as the matrix plays an important role in building statistically consistent classifiers. Traditionally, the transition from clean labels to noisy labels (i.e.,…

Machine Learning · Computer Science 2022-07-15 Shuo Yang , Erkun Yang , Bo Han , Yang Liu , Min Xu , Gang Niu , Tongliang Liu

We propose a new approach, called as functional deep neural network (FDNN), for classifying multi-dimensional functional data. Specifically, a deep neural network is trained based on the principle components of the training data which shall…

Machine Learning · Statistics 2022-05-19 Shuoyang Wang , Guanqun Cao , Zuofeng Shang

We are interested in representation learning from labeled or unlabeled data. Inspired by recent success of self-supervised learning (SSL), we develop a non-contrastive representation learning method that can exploit additional knowledge.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Ajinkya Tejankar , Soroush Abbasi Koohpayegani , Hamed Pirsiavash

In this paper, we are concerned with image classification with deep convolutional neural networks (CNNs). We focus on the following question: given a set of candidate CNN models, how to select the right one with the best generalization…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Bin Liu

The phenomenon of data distribution evolving over time has been observed in a range of applications, calling the needs of adaptive learning algorithms. We thus study the problem of supervised gradual domain adaptation, where labeled data…

Machine Learning · Computer Science 2022-11-15 Jing Dong , Shiji Zhou , Baoxiang Wang , Han Zhao

Given data with label noise (i.e., incorrect data), deep neural networks would gradually memorize the label noise and impair model performance. To relieve this issue, curriculum learning is proposed to improve model performance and…

Machine Learning · Computer Science 2022-08-23 Tingting Wu , Xiao Ding , Hao Zhang , Jinglong Gao , Li Du , Bing Qin , Ting Liu

Objective: Classifier transfers usually come with dataset shifts. To overcome them, online strategies have to be applied. For practical applications, limitations in the computational resources for the adaptation of batch learning…

Machine Learning · Computer Science 2022-08-11 Mario Michael Krell , Nils Wilshusen , Anett Seeland , Su Kyoung Kim

Limited transferability hinders the performance of deep learning models when applied to new application scenarios. Recently, unsupervised domain adaptation (UDA) has achieved significant progress in addressing this issue via learning…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Yulong Zhang , Shuhao Chen , Yu Zhang , Jiangang Lu

Generalized category discovery (GCD) is an important and challenging task in open-world learning. Specifically, given some labeled data of known classes, GCD aims to cluster unlabeled data that contain both known and unknown classes.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Zhimao Peng , Enguang Wang , Fei Yang , Xialei Liu , Ming-Ming Cheng

Transfer learning has achieved promising results by leveraging knowledge from the source domain to annotate the target domain which has few or none labels. Existing methods often seek to minimize the distribution divergence between domains,…

Machine Learning · Computer Science 2018-07-03 Jindong Wang , Yiqiang Chen , Shuji Hao , Wenjie Feng , Zhiqi Shen

The development of highly accurate deep learning methods for indoor localization is often hindered by the unavailability of sufficient data measurements in the desired environment to perform model training. To overcome the challenge of…

Signal Processing · Electrical Eng. & Systems 2021-08-06 Mohamed I. AlHajri , Raed M. Shubair , Marwa Chafii