English
Related papers

Related papers: Balanced Activation for Long-tailed Visual Recogni…

200 papers

The current evaluation protocol of long-tailed visual recognition trains the classification model on the long-tailed source label distribution and evaluates its performance on the uniform target label distribution. Such protocol has…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Youngkyu Hong , Seungju Han , Kwanghee Choi , Seokjun Seo , Beomsu Kim , Buru Chang

In recent years, deep neural networks (DNNs) have been found very successful for multi-label classification (MLC) of remote sensing (RS) images. Self-supervised pre-training combined with fine-tuning on a randomly selected small training…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Lars Möllenbrok , Begüm Demir

This paper presents simple and efficient methods to mitigate sampling bias in active learning while achieving state-of-the-art accuracy and model robustness. We introduce supervised contrastive active learning by leveraging the contrastive…

Machine Learning · Computer Science 2021-09-15 Ranganath Krishnan , Alok Sinha , Nilesh Ahuja , Mahesh Subedar , Omesh Tickoo , Ravi Iyer

Deep-learning-based models are increasingly used to emulate scientific simulations to accelerate scientific research. However, accurate, supervised deep learning models require huge amount of labelled data, and that often becomes the…

Machine Learning · Computer Science 2022-01-11 Yi Heng Lim , Muhammad Firmansyah Kasim

Active learning strategies aim to train high-performance models with minimal labeled data by selecting the most informative instances for labeling. However, existing methods for assessing data informativeness often fail to align directly…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Zhixuan Liang , Xingyu Zeng , Rui Zhao , Ping Luo

Semantic segmentation usually suffers from a long-tail data distribution. Due to the imbalanced number of samples across categories, the features of those tail classes may get squeezed into a narrow area in the feature space. Towards a…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Yuchao Wang , Jingjing Fei , Haochen Wang , Wei Li , Tianpeng Bao , Liwei Wu , Rui Zhao , Yujun Shen

Real-world data often follow a long-tailed distribution as the frequency of each class is typically different. For example, a dataset can have a large number of under-represented classes and a few classes with more than sufficient data.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Peng Chu , Xiao Bian , Shaopeng Liu , Haibin Ling

Training on datasets with long-tailed distributions has been challenging for major recognition tasks such as classification and detection. To deal with this challenge, image resampling is typically introduced as a simple but effective…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Nadine Chang , Zhiding Yu , Yu-Xiong Wang , Anima Anandkumar , Sanja Fidler , Jose M. Alvarez

Semantic segmentation requires pixel-level annotation, which is time-consuming. Active Learning (AL) is a promising method for reducing data annotation costs. Due to the gap between aerial and natural images, the previous AL methods are not…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Lianlei Shan , Weiqiang Wang , Ke Lv , Bin Luo

Real-world data usually couples the label ambiguity and heavy imbalance, challenging the algorithmic robustness of partial label learning (PLL) and long-tailed learning (LT). The straightforward combination of LT and PLL, i.e., LT-PLL,…

Machine Learning · Computer Science 2023-02-13 Feng Hong , Jiangchao Yao , Zhihan Zhou , Ya Zhang , Yanfeng Wang

Real world data often exhibits a long-tailed and open-ended (with unseen classes) distribution. A practical recognition system must balance between majority (head) and minority (tail) classes, generalize across the distribution, and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Ziwei Liu , Zhongqi Miao , Xiaohang Zhan , Jiayun Wang , Boqing Gong , Stella X. Yu

Large amounts of labeled training data are one of the main contributors to the great success that deep models have achieved in the past. Label acquisition for tasks other than benchmarks can pose a challenge due to requirements of both…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Clemens-Alexander Brust , Christoph Käding , Joachim Denzler

In the real-world setting, data often follows a long-tailed distribution, where head classes contain significantly more training samples than tail classes. Consequently, models trained on such data tend to be biased toward head classes. The…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Fan Zhang , Wei Qin , Weijieying Ren , Lei Wang , Zetong Chen , Richang Hong

This paper proposes $\mathrm{dynActivation}$, a per-layer trainable activation defined as $f_i(x) = \mathrm{BaseAct}(x)(\alpha_i - \beta_i) + \beta_i x$, where $\alpha_i$ and $\beta_i$ are lightweight learned scalars that interpolate…

Machine Learning · Computer Science 2026-03-24 Alois Bachmann

A common practice in most of deep convolutional neural architectures is to employ fully-connected layers followed by Softmax activation to minimize cross-entropy loss for the sake of classification. Recent studies show that substitution or…

Machine Learning · Computer Science 2017-10-23 Arash Shahriari

We study the theoretical advantages of active learning over passive learning. Specifically, we prove that, in noise-free classifier learning for VC classes, any passive learning algorithm can be transformed into an active learning algorithm…

Machine Learning · Statistics 2011-08-09 Steve Hanneke

While the novel class discovery has recently made great progress, existing methods typically focus on improving algorithms on class-balanced benchmarks. However, in real-world recognition tasks, the class distributions of their…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Chuyu Zhang , Ruijie Xu , Xuming He

Activation functions play a central role in neural networks by shaping internal representations. Recently, learning binary activation representations has attracted significant attention due to their advantages in computational and memory…

Machine Learning · Computer Science 2026-05-13 Seokhun Park , Choeun Kim , Kwanho Lee , Sehyun Park , Insung Kong , Yongdai Kim

Long-tailed multi-label visual recognition poses a significant challenge, as images typically contain multiple labels with highly imbalanced class distributions, leading to biased models that favor head classes while underperforming on tail…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Wei Tang , Zuo-Zheng Wang , Kun Zhang , Tong Wei , Min-Ling Zhang

Semi-supervised learning (SSL) is an efficient framework that can train models with both labeled and unlabeled data, but may generate ambiguous and non-distinguishable representations when lacking adequate labeled samples. With…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Xinkai Yuan , Zilinghan Li , Gaoang Wang