中文
相关论文

相关论文: Exploring Contrastive Learning for Long-Tailed Mul…

200 篇论文

In this paper, we propose an Aligned Contrastive Learning (ACL) algorithm to address the long-tailed recognition problem. Our findings indicate that while multi-view training boosts the performance, contrastive learning does not…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Jiali Ma , Jiequan Cui , Maeno Kazuki , Lakshmi Subramanian , Karlekar Jayashree , Sugiri Pranata , Hanwang Zhang

Semantic overlap among land-cover categories, highly imbalanced label distributions, and complex inter-class co-occurrence patterns constitute significant challenges for multi-label remote-sensing image retrieval. In this article,…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Amna Amir , Erchan Aptoula

We present a new loss function called Distribution-Balanced Loss for the multi-label recognition problems that exhibit long-tailed class distributions. Compared to conventional single-label classification problem, multi-label recognition…

计算机视觉与模式识别 · 计算机科学 2021-12-07 Tong Wu , Qingqiu Huang , Ziwei Liu , Yu Wang , Dahua Lin

Trained classification models can unintentionally lead to biased representations and predictions, which can reinforce societal preconceptions and stereotypes. Existing debiasing methods for classification models, such as adversarial…

计算与语言 · 计算机科学 2021-09-23 Aili Shen , Xudong Han , Trevor Cohn , Timothy Baldwin , Lea Frermann

Contrastive learning (CL) has shown impressive advances in image representation learning in whichever supervised multi-class classification or unsupervised learning. However, these CL methods fail to be directly adapted to multi-label image…

计算机视觉与模式识别 · 计算机科学 2022-09-07 Zhongchen Ma , Lisha Li , Qirong Mao , Songcan Chen

Existed pre-trained models have achieved state-of-the-art performance on various text classification tasks. These models have proven to be useful in learning universal language representations. However, the semantic discrepancy between…

机器学习 · 计算机科学 2022-01-07 Jinhe Lan , Qingyuan Zhan , Chenhao Jiang , Kunping Yuan , Desheng Wang

Fine-grained classification involves dealing with datasets with larger number of classes with subtle differences between them. Guiding the model to focus on differentiating dimensions between these commonly confusable classes is key to…

计算与语言 · 计算机科学 2021-09-14 Varsha Suresh , Desmond C. Ong

Contrastive self-supervised learning has become a prominent technique in representation learning. The main step in these methods is to contrast semantically similar and dissimilar pairs of samples. However, in the domain of Natural Language…

计算与语言 · 计算机科学 2022-06-07 Amrita Bhattacharjee , Mansooreh Karami , Huan Liu

The long-tail distribution of the visual world poses great challenges for deep learning based classification models on how to handle the class imbalance problem. Existing solutions usually involve class-balancing strategies, e.g., by loss…

计算机视觉与模式识别 · 计算机科学 2020-02-20 Bingyi Kang , Saining Xie , Marcus Rohrbach , Zhicheng Yan , Albert Gordo , Jiashi Feng , Yannis Kalantidis

Contrastive representation learning has gained much attention due to its superior performance in learning representations from both image and sequential data. However, the learned representations could potentially lead to performance…

计算与语言 · 计算机科学 2022-11-01 Jianfeng Chi , William Shand , Yaodong Yu , Kai-Wei Chang , Han Zhao , Yuan Tian

Multi-label text classification (MLTC) aims to annotate documents with the most relevant labels from a number of candidate labels. In real applications, the distribution of label frequency often exhibits a long tail, i.e., a few labels are…

计算与语言 · 计算机科学 2021-01-26 Lin Xiao , Xiangliang Zhang , Liping Jing , Chi Huang , Mingyang Song

Supervised Contrastive Loss (SCL) is popular in visual representation learning. Given an anchor image, SCL pulls two types of positive samples, i.e., its augmentation and other images from the same class together, while pushes negative…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Shiyu Xuan , Shiliang Zhang

Self-supervised Contrastive Learning (CL) has been recently shown to be very effective in preventing deep networks from overfitting noisy labels. Despite its empirical success, the theoretical understanding of the effect of contrastive…

机器学习 · 计算机科学 2022-07-06 Yihao Xue , Kyle Whitecross , Baharan Mirzasoleiman

Long-tailed distributions frequently emerge in real-world data, where a large number of minority categories contain a limited number of samples. Such imbalance issue considerably impairs the performance of standard supervised learning…

机器学习 · 计算机科学 2024-03-15 Chaoqun Du , Yulin Wang , Shiji Song , Gao Huang

Contrastive learning has achieved remarkable success in representation learning via self-supervision in unsupervised settings. However, effectively adapting contrastive learning to supervised learning tasks remains as a challenge in…

计算与语言 · 计算机科学 2022-01-24 Qianben Chen , Richong Zhang , Yaowei Zheng , Yongyi Mao

In multi-label text classification (MLTC), each given document is associated with a set of correlated labels. To capture label correlations, previous classifier-chain and sequence-to-sequence models transform MLTC to a sequence prediction…

计算与语言 · 计算机科学 2021-06-08 Ximing Zhang , Qian-Wen Zhang , Zhao Yan , Ruifang Liu , Yunbo Cao

Self-supervised contrastive learning is an effective approach for addressing the challenge of limited labelled data. This study builds upon the previously established two-stage patch-level, multi-label classification method for…

计算机视觉与模式识别 · 计算机科学 2026-02-09 Salma Haidar , José Oramas

Contrastive representation learning has been recently proved to be very efficient for self-supervised training. These methods have been successfully used to train encoders which perform comparably to supervised training on downstream…

机器学习 · 计算机科学 2020-12-03 Ibrahim Merad , Yiyang Yu , Emmanuel Bacry , Stéphane Gaïffas

In real-world scenarios, where knowledge distributions exhibit long-tail. Humans manage to master knowledge uniformly across imbalanced distributions, a feat attributed to their diligent practices of reviewing, summarizing, and correcting…

计算机视觉与模式识别 · 计算机科学 2024-09-16 Qihao Zhao , Yalun Dai , Shen Lin , Wei Hu , Fan Zhang , Jun Liu

Multi-label text classification (MLTC) is the task of assigning multiple labels to a given text, and has a wide range of application domains. Most existing approaches require an enormous amount of annotated data to learn a classifier and/or…

计算与语言 · 计算机科学 2023-09-26 Muberra Ozmen , Joseph Cotnareanu , Mark Coates