English
Related papers

Related papers: Frequency-Aware Self-Supervised Long-Tailed Learni…

200 papers

Anomaly detection is crucial in industrial applications for identifying rare and unseen patterns to ensure system reliability. Traditional models, trained on a single class of normal data, struggle with real-world distributions where normal…

Machine Learning · Statistics 2026-01-07 Jungi Lee , Jungkwon Kim , Chi Zhang , Sangmin Kim , Kwangsun Yoo , Seok-Joo Byun

The natural world often follows a long-tailed data distribution where only a few classes account for most of the examples. This long-tail causes classifiers to overfit to the majority class. To mitigate this, prior solutions commonly adopt…

Machine Learning · Computer Science 2020-09-15 Rahul Duggal , Scott Freitas , Sunny Dhamnani , Duen Horng Chau , Jimeng Sun

Deep learning is pushing the state-of-the-art in many computer vision applications. However, it relies on large annotated data repositories, and capturing the unconstrained nature of the real-world data is yet to be solved. Semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Mamshad Nayeem Rizve , Navid Kardan , Mubarak Shah

While semi-supervised learning (SSL) has received tremendous attentions in many machine learning tasks due to its successful use of unlabeled data, existing SSL algorithms use either all unlabeled examples or the unlabeled examples with a…

Machine Learning · Computer Science 2021-09-03 Yi Xu , Lei Shang , Jinxing Ye , Qi Qian , Yu-Feng Li , Baigui Sun , Hao Li , Rong Jin

Benchmark datasets for visual recognition assume that data is uniformly distributed, while real-world datasets obey long-tailed distribution. Current approaches handle the long-tailed problem to transform the long-tailed dataset to uniform…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Renhui Zhang , Tiancheng Lin , Rui Zhang , Yi Xu

In the real world, medical datasets often exhibit a long-tailed data distribution (i.e., a few classes occupy most of the data, while most classes have rarely few samples), which results in a challenging imbalance learning scenario. For…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Lie Ju , Xin Wang , Lin Wang , Tongliang Liu , Xin Zhao , Tom Drummond , Dwarikanath Mahapatra , Zongyuan Ge

Simplicity Bias (SB) is a phenomenon that deep neural networks tend to rely favorably on simpler predictive patterns but ignore some complex features when applied to supervised discriminative tasks. In this work, we investigate SB in…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Xiu-Shen Wei , Xuhao Sun , Yang Shen , Anqi Xu , Peng Wang , Faen Zhang

Federated Learning (FL) has become a popular distributed learning paradigm that involves multiple clients training a global model collaboratively in a data privacy-preserving manner. However, the data samples usually follow a long-tailed…

Machine Learning · Computer Science 2023-01-27 Wenkai Yang , Deli Chen , Hao Zhou , Fandong Meng , Jie Zhou , Xu Sun

Collecting large-scale medical datasets with fine-grained annotations is time-consuming and requires experts. For this reason, weakly supervised learning aims at optimising machine learning models using weaker forms of annotations, such as…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Gabriele Valvano , Andrea Leo , Sotirios A. Tsaftaris

Real-world data is often unbalanced and long-tailed, but deep models struggle to recognize rare classes in the presence of frequent classes. To address unbalanced data, most studies try balancing the data, the loss, or the classifier to…

Machine Learning · Computer Science 2021-11-02 Dvir Samuel , Gal Chechik

Humans are capable of learning new concepts from only a few (labeled) exemplars, incrementally and continually. This happens within the context that we can differentiate among the exemplars, and between the exemplars and large amounts of…

Machine Learning · Computer Science 2022-02-08 Daniel T. Chang

Self supervised learning (SSL) has become a very successful technique to harness the power of unlabeled data, with no annotation effort. A number of developed approaches are evolving with the goal of outperforming supervised alternatives,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Salman Mohamadi , Gianfranco Doretto , Donald A. Adjeroh

Federated Semi-supervised Learning (FSSL) combines techniques from both fields of federated and semi-supervised learning to improve the accuracy and performance of models in a distributed environment by using a small fraction of labeled…

Machine Learning · Computer Science 2023-11-27 Zehui Dong , Wenjing Liu , Siyuan Liu , Xingzhi Chen

The rise of Large Language Models (LLMs) has boosted the use of Few-Shot Learning (FSL) methods in natural language processing, achieving acceptable performance even when working with limited training data. The goal of FSL is to effectively…

We propose a distance supervised relation extraction approach for long-tailed, imbalanced data which is prevalent in real-world settings. Here, the challenge is to learn accurate "few-shot" models for classes existing at the tail of the…

Information Retrieval · Computer Science 2023-01-26 Ningyu Zhang , Shumin Deng , Zhanlin Sun , Guanying Wang , Xi Chen , Wei Zhang , Huajun Chen

Machine learning analysis of longitudinal neuroimaging data is typically based on supervised learning, which requires a large number of ground-truth labels to be informative. As ground-truth labels are often missing or expensive to obtain…

Machine Learning · Computer Science 2021-06-29 Qingyu Zhao , Zixuan Liu , Ehsan Adeli , Kilian M. Pohl

Federated learning (FL) is a distributed learning paradigm that facilitates collaborative training of a shared global model across devices while keeping data localized. The deployment of FL in numerous real-world applications faces delays,…

Machine Learning · Computer Science 2024-02-16 Xinchi Qiu , Yan Gao , Lorenzo Sani , Heng Pan , Wanru Zhao , Pedro P. B. Gusmao , Mina Alibeigi , Alex Iacob , Nicholas D. Lane

Label noise is one of the key factors that lead to the poor generalization of deep learning models. Existing label-noise learning methods usually assume that the ground-truth classes of the training data are balanced. However, the…

Machine Learning · Computer Science 2023-08-15 Yang Lu , Yiliang Zhang , Bo Han , Yiu-ming Cheung , Hanzi Wang

Semi-supervised few-shot learning consists in training a classifier to adapt to new tasks with limited labeled data and a fixed quantity of unlabeled data. Many sophisticated methods have been developed to address the challenges this…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Xiu-Shen Wei , He-Yang Xu , Faen Zhang , Yuxin Peng , Wei Zhou

Open-world semi-supervised learning (OWSSL) extends conventional semi-supervised learning to open-world scenarios by taking account of novel categories in unlabeled datasets. Despite the recent advancements in OWSSL, the success often…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Seongheon Park , Hyuk Kwon , Kwanghoon Sohn , Kibok Lee