English
Related papers

Related papers: Learning from Limited and Imperfect Data

200 papers

Training data for class-conditional image synthesis often exhibit a long-tailed distribution with limited images for tail classes. Such an imbalance causes mode collapse and reduces the diversity of synthesized images for tail classes. For…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Fang Chen , Alex Villa , Gongbo Liang , Xiaoyi Lu , Meng Tang

Conventional multi-label classification (MLC) methods assume that all samples are fully labeled and identically distributed. Unfortunately, this assumption is unrealistic in large-scale MLC data that has long-tailed (LT) distribution and…

Machine Learning · Computer Science 2023-04-24 Wenqiao Zhang , Changshuo Liu , Lingze Zeng , Beng Chin Ooi , Siliang Tang , Yueting Zhuang

In the real open world, data tends to follow long-tailed class distributions, motivating the well-studied long-tailed recognition (LTR) problem. Naive training produces models that are biased toward common classes in terms of higher…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Shaden Alshammari , Yu-Xiong Wang , Deva Ramanan , Shu Kong

Data is the foundation for the development of computer vision, and the establishment of datasets plays an important role in advancing the techniques of fine-grained visual categorization~(FGVC). In the existing FGVC datasets used in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Shuo Ye , Shiming Chen , Ruxin Wang , Tianxu Wu , Jiamiao Xu , Salman Khan , Fahad Shahbaz Khan , Ling Shao

Oftentimes, machine learning applications using neural networks involve solving discrete optimization problems, such as in pruning, parameter-isolation-based continual learning and training of binary networks. Still, these discrete problems…

Machine Learning · Computer Science 2024-02-19 Hugo Silva , Martha White

When we can not assume a large amount of annotated data , active learning is a good strategy. It consists in learning a model on a small amount of annotated data (annotation budget) and in choosing the best set of points to annotate in…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Umang Aggarwal , Adrian Popescu , Céline Hudelot

The natural world is long-tailed: rare classes are observed orders of magnitudes less frequently than common ones, leading to highly-imbalanced data where rare classes can have only handfuls of examples. Learning from few examples is a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Edoardo Lanzini , Sara Beery

Real-world data often exhibit imbalanced label distributions. Existing studies on data imbalance focus on single-domain settings, i.e., samples are from the same data distribution. However, natural data can originate from distinct domains,…

Machine Learning · Computer Science 2022-08-02 Yuzhe Yang , Hao Wang , Dina Katabi

Most existing methods that cope with noisy labels usually assume that the class distributions are well balanced, which has insufficient capacity to deal with the practical scenarios where training samples have imbalanced distributions. To…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Chaowei Fang , Lechao Cheng , Huiyan Qi , Dingwen Zhang

Real-world training data usually exhibits long-tailed distribution, where several majority classes have a significantly larger number of samples than the remaining minority classes. This imbalance degrades the performance of typical…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Shuang Li , Kaixiong Gong , Chi Harold Liu , Yulin Wang , Feng Qiao , Xinjing Cheng

The intrinsic difficulty in adapting deep learning models to non-stationary environments limits the applicability of neural networks to real-world tasks. This issue is critical in practical supervised learning settings, such as the ones in…

Machine Learning · Computer Science 2023-06-09 Simone Marullo , Matteo Tiezzi , Marco Gori , Stefano Melacci , Tinne Tuytelaars

The fine-tuning paradigm in addressing long-tail learning tasks has sparked significant interest since the emergence of foundation models. Nonetheless, how fine-tuning impacts performance in long-tail learning was not explicitly quantified.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Jiang-Xin Shi , Tong Wei , Zhi Zhou , Jie-Jing Shao , Xin-Yan Han , Yu-Feng Li

Main challenges in long-tailed recognition come from the imbalanced data distribution and sample scarcity in its tail classes. While techniques have been proposed to achieve a more balanced training loss and to improve tail classes data…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Bo Liu , Haoxiang Li , Hao Kang , Nuno Vasconcelos , Gang Hua

Deep Neural Networks are well known for efficiently fitting training data, yet experiencing poor generalization capabilities whenever some kind of bias dominates over the actual task labels, resulting in models learning "shortcuts". In…

Machine Learning · Computer Science 2024-08-12 Pietro Morerio , Ruggero Ragonesi , Vittorio Murino

Fine-grained image recognition is a longstanding computer vision challenge that focuses on differentiating objects belonging to multiple subordinate categories within the same meta-category. Since images belonging to the same meta-category…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Yifan Pu , Yizeng Han , Yulin Wang , Junlan Feng , Chao Deng , Gao Huang

Real-world imagery is often characterized by a significant imbalance of the number of images per class, leading to long-tailed distributions. An effective and simple approach to long-tailed visual recognition is to learn feature…

Computer Vision and Pattern Recognition · Computer Science 2022-01-14 Ahmet Iscen , André Araujo , Boqing Gong , Cordelia Schmid

Assisted by the availability of data and high performance computing, deep learning techniques have achieved breakthroughs and surpassed human performance empirically in difficult tasks, including object recognition, speech recognition, and…

Machine Learning · Computer Science 2019-01-23 Shaeke Salman , Xiuwen Liu

Employing deep neural networks as natural image priors to solve inverse problems either requires large amounts of data to sufficiently train expressive generative models or can succeed with no data via untrained neural networks. However,…

Machine Learning · Computer Science 2019-10-25 Oscar Leong , Wesam Sakla

Training deep neural networks is a highly nontrivial task, involving carefully selecting appropriate training algorithms, scheduling step sizes and tuning other hyperparameters. Trying different combinations can be quite labor-intensive and…

Machine Learning · Computer Science 2017-06-13 Kaifeng Lv , Shunhua Jiang , Jian Li

Real-world visual recognition requires handling the extreme sample imbalance in large-scale long-tailed data. We propose a "divide&conquer" strategy for the challenging LVIS task: divide the whole data into balanced parts and then apply…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Xinting Hu , Yi Jiang , Kaihua Tang , Jingyuan Chen , Chunyan Miao , Hanwang Zhang