中文
相关论文

相关论文: Targeted Supervised Contrastive Learning for Long-…

200 篇论文

Real-world data is often unbalanced and long-tailed, but deep models struggle to recognize rare classes in the presence of frequent classes. To address unbalanced data, most studies try balancing the data, the loss, or the classifier to…

机器学习 · 计算机科学 2021-11-02 Dvir Samuel , Gal Chechik

Pre-training plays a vital role in various vision tasks, such as object recognition and detection. Commonly used pre-training methods, which typically rely on randomized approaches like uniform or Gaussian distributions to initialize model…

计算机视觉与模式识别 · 计算机科学 2024-11-15 Chen-Long Duan , Yong Li , Xiu-Shen Wei , Lin Zhao

Real-world visual data often exhibits a long-tailed distribution, where some ''head'' classes have a large number of samples, yet only a few samples are available for ''tail'' classes. Such imbalanced distribution causes a great challenge…

计算机视觉与模式识别 · 计算机科学 2020-03-11 Junjie Zhang , Lingqiao Liu , Peng Wang , Chunhua Shen

Diffusion models have made significant advances recently in high-quality image synthesis and related tasks. However, diffusion models trained on real-world datasets, which often follow long-tailed distributions, yield inferior fidelity for…

计算机视觉与模式识别 · 计算机科学 2024-02-19 Divin Yan , Lu Qi , Vincent Tao Hu , Ming-Hsuan Yang , Meng Tang

Semi-supervised learning has demonstrated great potential in medical image segmentation by utilizing knowledge from unlabeled data. However, most existing approaches do not explicitly capture high-level semantic relations between distant…

计算机视觉与模式识别 · 计算机科学 2023-12-07 Qianying Liu , Xiao Gu , Paul Henderson , Fani Deligianni

Graph Convolutional Networks (GCNs) has demonstrated promising results for recommender systems, as they can effectively leverage high-order relationship. However, these methods usually encounter data sparsity issue in real-world scenarios.…

信息检索 · 计算机科学 2023-09-21 Qian Zhao , Zhengwei Wu , Zhiqiang Zhang , Jun Zhou

Clustering of hyperspectral images is a fundamental but challenging task. The recent development of hyperspectral image clustering has evolved from shallow models to deep and achieved promising results in many benchmark datasets. However,…

计算机视觉与模式识别 · 计算机科学 2021-11-16 Yaoming Cai , Zijia Zhang , Yan Liu , Pedram Ghamisi , Kun Li , Xiaobo Liu , Zhihua Cai

Modern image classifiers perform well on populated classes, while degrading considerably on tail classes with only a few instances. Humans, by contrast, effortlessly handle the long-tailed recognition challenge, since they can learn the…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Yingjun Du , Jiayi Shen , Xiantong Zhen , Cees G. M. Snoek

Existing out-of-distribution (OOD) detection methods are typically benchmarked on training sets with balanced class distributions. However, in real-world applications, it is common for the training sets to have long-tailed distributions. In…

计算机视觉与模式识别 · 计算机科学 2022-07-05 Haotao Wang , Aston Zhang , Yi Zhu , Shuai Zheng , Mu Li , Alex Smola , Zhangyang Wang

Long-tailed data is a special type of multi-class imbalanced data with a very large amount of minority/tail classes that have a very significant combined influence. Long-tailed learning aims to build high-performance models on datasets with…

Distribution shifts are problems where the distribution of data changes between training and testing, which can significantly degrade the performance of a model deployed in the real world. Recent studies suggest that one reason for the…

机器学习 · 计算机科学 2023-04-10 Takuro Kutsuna

Self-supervised learning (SSL) as an effective paradigm of representation learning has achieved tremendous success on various curated datasets in diverse scenarios. Nevertheless, when facing the long-tailed distribution in real-world…

机器学习 · 计算机科学 2023-10-27 Zhihan Zhou , Jiangchao Yao , Feng Hong , Ya Zhang , Bo Han , Yanfeng Wang

Contrastive representation learning has been outstandingly successful in practice. In this work, we identify two key properties related to the contrastive loss: (1) alignment (closeness) of features from positive pairs, and (2) uniformity…

机器学习 · 计算机科学 2022-08-17 Tongzhou Wang , Phillip Isola

Though Self-supervised learning (SSL) has been widely studied as a promising technique for representation learning, it doesn't generalize well on long-tailed datasets due to the majority classes dominating the feature space. Recent work…

计算机视觉与模式识别 · 计算机科学 2023-07-13 Jianhong Bai , Zuozhu Liu , Hualiang Wang , Jin Hao , Yang Feng , Huanpeng Chu , Haoji Hu

Real-world visual recognition problems often exhibit long-tailed distributions, where the amount of data for learning in different categories shows significant imbalance. Standard classification models learned on such data distribution…

计算机视觉与模式识别 · 计算机科学 2021-08-31 Chi Zhang , Guosheng Lin , Lvlong Lai , Henghui Ding , Qingyao Wu

Class imbalance has been extensively studied in single-view scenarios; however, addressing this challenge in multi-view contexts remains an open problem, with even scarcer research focusing on trustworthy solutions. In this paper, we tackle…

机器学习 · 计算机科学 2025-11-13 Chuanqing Tang , Yifei Shi , Guanghao Lin , Lei Xing , Long Shi

In recent times, contrastive learning based loss functions have become increasingly popular for visual self-supervised representation learning owing to their state-of-the-art (SOTA) performance. Most of the modern contrastive learning…

计算机视觉与模式识别 · 计算机科学 2024-10-31 Chaitanya Animesh , Manmohan Chandraker

Training data for class-conditional image synthesis often exhibit a long-tailed distribution with limited images for tail classes. Such an imbalance causes mode collapse and reduces the diversity of synthesized images for tail classes. For…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Fang Chen , Alex Villa , Gongbo Liang , Xiaoyi Lu , Meng Tang

Contrastive learning is a well-established paradigm in representation learning. The standard framework of contrastive learning minimizes the distance between "similar" instances and maximizes the distance between dissimilar ones in the…

机器学习 · 计算机科学 2025-02-06 Naghmeh Ghanooni , Barbod Pajoum , Harshit Rawal , Sophie Fellenz , Vo Nguyen Le Duy , Marius Kloft

Contrastive learning is among the most popular and powerful approaches for self-supervised representation learning, where the goal is to map semantically similar samples close together while separating dissimilar ones in the latent space.…

机器学习 · 统计学 2025-12-03 Ali Alvandi , Mina Rezaei