中文
相关论文

相关论文: Delving Deep into Simplicity Bias for Long-Tailed …

200 篇论文

Do we need active learning? The rise of strong deep semi-supervised methods raises doubt about the usability of active learning in limited labeled data settings. This is caused by results showing that combining semi-supervised learning…

机器学习 · 计算机科学 2023-08-17 Sandra Gilhuber , Rasmus Hvingelby , Mang Ling Ada Fok , Thomas Seidl

Long-tailed data is prevalent in real-world classification tasks and heavily relies on supervised information, which makes the annotation process exceptionally labor-intensive and time-consuming. Unfortunately, despite being a common…

机器学习 · 计算机科学 2024-12-04 Meng Wei , Zhongnian Li , Yong Zhou , Xinzheng Xu

Main challenges in long-tailed recognition come from the imbalanced data distribution and sample scarcity in its tail classes. While techniques have been proposed to achieve a more balanced training loss and to improve tail classes data…

计算机视觉与模式识别 · 计算机科学 2021-05-04 Bo Liu , Haoxiang Li , Hao Kang , Nuno Vasconcelos , Gang Hua

Recent advancements in self-supervised learning (SSL) made it possible to learn generalizable visual representations from unlabeled data. The performance of Deep Learning models fine-tuned on pretrained SSL representations is on par with…

机器学习 · 计算机科学 2021-09-21 Atharva Tendle , Mohammad Rashedul Hasan

It is not uncommon that real-world data are distributed with a long tail. For such data, the learning of deep neural networks becomes challenging because it is hard to classify tail classes correctly. In the literature, several existing…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Mengke Li , Yiu-ming Cheung , Yang Lu , Zhikai Hu , Weichao Lan , Hui Huang

Fine-grained image classification involves identifying different subcategories of a class which possess very subtle discriminatory features. Fine-grained datasets usually provide bounding box annotations along with class labels to aid the…

计算机视觉与模式识别 · 计算机科学 2021-07-30 Farha Al Breiki , Muhammad Ridzuan , Rushali Grandhe

Self-Supervised Learning (SSL) models rely on a pretext task to learn representations. Because this pretext task differs from the downstream tasks used to evaluate the performance of these models, there is an inherent misalignment or…

机器学习 · 计算机科学 2023-04-12 Florian Bordes , Samuel Lavoie , Randall Balestriero , Nicolas Ballas , Pascal Vincent

Self-supervised learning (SSL), in particular contrastive learning, has made great progress in recent years. However, a common theme in these methods is that they inherit the learning paradigm from the supervised deep learning scenario.…

计算机视觉与模式识别 · 计算机科学 2021-03-26 Yun-Hao Cao , Jianxin Wu

With the development of deep learning, supervised learning methods perform well in remote sensing images (RSIs) scene classification. However, supervised learning requires a huge number of annotated data for training. When labeled samples…

计算机视觉与模式识别 · 计算机科学 2020-10-05 Chao Tao , Ji Qi , Weipeng Lu , Hao Wang , Haifeng Li

Image-level weak-to-strong consistency serves as the predominant paradigm in semi-supervised learning~(SSL) due to its simplicity and impressive performance. Nonetheless, this approach confines all perturbations to the image level and…

计算机视觉与模式识别 · 计算机科学 2024-08-26 Zhiyu Wu , Jinshi Cui

Learning discriminative image representations plays a vital role in long-tailed image classification because it can ease the classifier learning in imbalanced cases. Given the promising performance contrastive learning has shown recently in…

计算机视觉与模式识别 · 计算机科学 2021-03-29 Peng Wang , Kai Han , Xiu-Shen Wei , Lei Zhang , Lei Wang

Self-supervised learning (SSL) is an efficient approach that addresses the issue of limited training data and annotation shortage. The key part in SSL is its proxy task that defines the supervisory signals and drives the learning toward…

计算机视觉与模式识别 · 计算机科学 2021-03-26 Jiuwen Zhu , Yuexiang Li , S. Kevin Zhou

Self-supervised learning (SSL) has become the de facto training paradigm of large models where pre-training is followed by supervised fine-tuning using domain-specific data and labels. Hypothesizing that SSL models would learn more generic,…

Deep Neural Networks are known to be brittle to even minor distribution shifts compared to the training distribution. While one line of work has demonstrated that Simplicity Bias (SB) of DNNs - bias towards learning only the simplest…

机器学习 · 计算机科学 2022-10-05 Sravanti Addepalli , Anshul Nasery , R. Venkatesh Babu , Praneeth Netrapalli , Prateek Jain

Self-supervised learning (SSL) has become the de facto training paradigm of large models, where pre-training is followed by supervised fine-tuning using domain-specific data and labels. Despite demonstrating comparable performance with…

Self-supervised learning (SSL) is an emerging paradigm that exploits supervisory signals generated from the data itself, and many recent studies have leveraged SSL to conduct graph anomaly detection. However, we empirically found that three…

机器学习 · 计算机科学 2025-07-01 Zhong Li , Yuhang Wang , Matthijs van Leeuwen

Text Recognition (TR) refers to the research area that focuses on retrieving textual information from images, a topic that has seen significant advancements in the last decade due to the use of Deep Neural Networks (DNN). However, these…

计算机视觉与模式识别 · 计算机科学 2025-06-06 Carlos Penarrubia , Jose J. Valero-Mas , Jorge Calvo-Zaragoza

Semi-supervised learning (SSL) can reduce the need for large labelled datasets by incorporating unlabelled data into the training. This is particularly interesting for semantic segmentation, where labelling data is very costly and…

计算机视觉与模式识别 · 计算机科学 2022-10-20 Sebastian Scherer , Robin Schön , Rainer Lienhart

As the data scale grows, deep recognition models often suffer from long-tailed data distributions due to the heavy imbalanced sample number across categories. Indeed, real-world data usually exhibit some similarity relation among different…

计算机视觉与模式识别 · 计算机科学 2022-08-18 Lei Liu , Li Liu

Real-world data typically follow a long-tailed distribution, where a few majority categories occupy most of the data while most minority categories contain a limited number of samples. Classification models minimizing cross-entropy struggle…

计算机视觉与模式识别 · 计算机科学 2022-09-13 Jianggang Zhu , Zheng Wang , Jingjing Chen , Yi-Ping Phoebe Chen , Yu-Gang Jiang