English
Related papers

Related papers: Generalizing Few Data to Unseen Domains Flexibly B…

200 papers

Graph Neural Networks (GNNs) have become widely-used models for semi-supervised learning. However, the robustness of GNNs in the presence of label noise remains a largely under-explored problem. In this paper, we consider an important yet…

Machine Learning · Computer Science 2023-02-28 Siyi Qian , Haochao Ying , Renjun Hu , Jingbo Zhou , Jintai Chen , Danny Z. Chen , Jian Wu

We investigate the effect of the dimensionality of the representations learned in Deep Neural Networks (DNNs) on their robustness to input perturbations, both adversarial and random. To achieve low dimensionality of learned representations,…

Machine Learning · Computer Science 2020-02-20 Amartya Sanyal , Varun Kanade , Philip H. S. Torr , Puneet K. Dokania

Most deep metric learning (DML) methods employ a strategy that forces all positive samples to be close in the embedding space while keeping them away from negative ones. However, such a strategy ignores the internal relationships of…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Zelong Zeng , Fan Yang , Zheng Wang , Shin'ichi Satoh

Label Distribution Learning (LDL) assigns soft labels, a.k.a. degrees, to a sample. In reality, it is always laborious to obtain complete degrees, giving birth to the Incomplete LDL (InLDL). However, InLDL often suffers from performance…

Machine Learning · Computer Science 2024-06-11 Xiang Li , Songcan Chen

A fundamental challenge for machine learning models is how to generalize learned models for out-of-distribution (OOD) data. Among various approaches, exploiting invariant features by Domain Adversarial Training (DAT) received widespread…

Machine Learning · Computer Science 2023-02-02 YiFan Zhang , Xue Wang , Jian Liang , Zhang Zhang , Liang Wang , Rong Jin , Tieniu Tan

In modern scientific applications, large volumes of covariate data are readily available, while outcome labels are costly, sparse, and often subject to distribution shift. This asymmetry has spurred interest in semi-supervised (SS)…

Statistics Theory · Mathematics 2026-05-12 Lorenzo Testa , Qi Xu , Jing Lei , Kathryn Roeder

A critical bottleneck in supervised machine learning is the need for large amounts of labeled data which is expensive and time consuming to obtain. However, it has been shown that a small amount of labeled data, while insufficient to…

Deep neural networks are highly susceptible to overfitting noisy labels, which leads to degraded performance. Existing methods address this issue by employing manually defined criteria, aiming to achieve optimal partitioning in each…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Wenzhen Zhang , Debo Cheng , Guangquan Lu , Bo Zhou , Jiaye Li , Shichao Zhang

Despite the rapid development of machine learning algorithms for domain generalization (DG), there is no clear empirical evidence that the existing DG algorithms outperform the classic empirical risk minimization (ERM) across standard…

Machine Learning · Computer Science 2024-03-19 Rui Qiao , Bryan Kian Hsiang Low

Recently, we have witnessed great progress in the field of medical imaging classification by adopting deep neural networks. However, the recent advanced models still require accessing sufficiently large and representative datasets for…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Haoliang Li , YuFei Wang , Renjie Wan , Shiqi Wang , Tie-Qiang Li , Alex C. Kot

Domain Generalization (DG) aims to learn models whose performance remains high on unseen domains encountered at test-time by using data from multiple related source domains. Many existing DG algorithms reduce the divergence between source…

Machine Learning · Computer Science 2022-06-27 Akshay Mehra , Bhavya Kailkhura , Pin-Yu Chen , Jihun Hamm

Both limited annotation and domain shift are significant challenges frequently encountered in medical image segmentation, leading to derivative scenarios like semi-supervised medical (SSMIS), semi-supervised medical domain generalization…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Wei Li , Pengcheng Zhou , Linye Ma , Wenyi Zhao , Huihua Yang , Yuchen Guo

Deep neural networks (DNNs) have been shown to over-fit a dataset when being trained with noisy labels for a long enough time. To overcome this problem, we present a simple and effective method self-ensemble label filtering (SELF) to…

Computer Vision and Pattern Recognition · Computer Science 2019-10-07 Duc Tam Nguyen , Chaithanya Kumar Mummadi , Thi Phuong Nhung Ngo , Thi Hoai Phuong Nguyen , Laura Beggel , Thomas Brox

Label smoothing is a regularization technique for neural networks. Normally neural models are trained to an output distribution that is a vector with a single 1 for the correct prediction, and 0 for all other elements. Label smoothing…

Software Engineering · Computer Science 2023-03-29 Sakib Haque , Aakash Bansal , Collin McMillan

Out-of-distribution (OOD) generalization poses a serious challenge for modern deep learning (DL). OOD data consists of test data that is significantly different from the model's training data. DL models that perform well on in-domain test…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Skylar E. Stolte , Kyle Volle , Aprinda Indahlastari , Alejandro Albizu , Adam J. Woods , Kevin Brink , Matthew Hale , Ruogu Fang

The success of Graph Neural Networks (GNN) in learning on non-Euclidean data arouses many subtopics, such as Label-inputted GNN (LGNN) and Implicit GNN (IGNN). LGNN, explicitly inputting supervising information (a.k.a. labels) in GNN,…

Machine Learning · Computer Science 2023-06-01 Yi Luo , Guiduo Duan , Guangchun Luo , Aiguo Chen

There are inevitably many mislabeled data in real-world datasets. Because deep neural networks (DNNs) have an enormous capacity to memorize noisy labels, a robust training scheme is required to prevent labeling errors from degrading the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Jun Ho Lee , Jae Soon Baik , Tae Hwan Hwang , Jun Won Choi

Long-tailed learning has attracted much attention recently, with the goal of improving generalisation for tail classes. Most existing works use supervised learning without considering the prevailing noise in the training dataset. To move…

Machine Learning · Computer Science 2021-08-27 Tong Wei , Jiang-Xin Shi , Wei-Wei Tu , Yu-Feng Li

Unsupervised domain adaptation is effective in leveraging the rich information from the source domain to the unsupervised target domain. Though deep learning and adversarial strategy make an important breakthrough in the adaptability of…

Machine Learning · Computer Science 2020-03-02 You-Wei Luo , Chuan-Xian Ren , Pengfei Ge , Ke-Kun Huang , Yu-Feng Yu

Deep learning in computer vision has achieved great success with the price of large-scale labeled training data. However, exhaustive data annotation is impracticable for each task of all domains of interest, due to high labor costs and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Hui Tang , Kui Jia