中文
相关论文

相关论文: Exploring Contrastive Learning for Long-Tailed Mul…

200 篇论文

Continual learning from a sequential stream of data is a crucial challenge for machine learning research. Most studies have been conducted on this topic under the single-label classification setting along with an assumption of balanced…

机器学习 · 计算机科学 2020-09-09 Chris Dongjoo Kim , Jinseo Jeong , Gunhee Kim

The goal in extreme multi-label classification is to learn a classifier which can assign a small subset of relevant labels to an instance from an extremely large set of target labels. Datasets in extreme classification exhibit a long tail…

机器学习 · 统计学 2018-03-06 Rohit Babbar , Bernhard Schölkopf

Learning semantic-rich representations from raw unlabeled time series data is critical for downstream tasks such as classification and forecasting. Contrastive learning has recently shown its promising representation learning capability in…

机器学习 · 计算机科学 2023-03-31 Qianwen Meng , Hangwei Qian , Yong Liu , Lizhen Cui , Yonghui Xu , Zhiqi Shen

In Multi-Label Text Classification (MLTC), one sample can belong to more than one class. It is observed that most MLTC tasks, there are dependencies or correlations among labels. Existing methods tend to ignore the relationship among…

计算与语言 · 计算机科学 2020-03-27 Ankit Pal , Muru Selvakumar , Malaikannan Sankarasubbu

In business analysis, providing effective recommendations is essential for enhancing company profits. The utilization of graph-based structures, such as bipartite graphs, has gained popularity for their ability to analyze complex data…

信息检索 · 计算机科学 2025-01-14 Jiayang Wu , Wensheng Gan , Huashen Lu , Philip S. Yu

In recent times, contrastive learning based loss functions have become increasingly popular for visual self-supervised representation learning owing to their state-of-the-art (SOTA) performance. Most of the modern contrastive learning…

计算机视觉与模式识别 · 计算机科学 2024-10-31 Chaitanya Animesh , Manmohan Chandraker

Long-tailed visual recognition has received increasing attention in recent years. Due to the extremely imbalanced data distribution in long-tailed learning, the learning process shows great uncertainties. For example, the predictions of…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Zichang Tan , Jun Li , Jinhao Du , Jun Wan , Zhen Lei , Guodong Guo

Data in real-world object detection often exhibits the long-tailed distribution. Existing solutions tackle this problem by mitigating the competition between the head and tail categories. However, due to the scarcity of training samples,…

计算机视觉与模式识别 · 计算机科学 2022-10-12 Bo Li , Yongqiang Yao , Jingru Tan , Xin Lu , Fengwei Yu , Ye Luo , Jianwei Lu

Class imbalance, which is also called long-tailed distribution, is a common problem in classification tasks based on machine learning. If it happens, the minority data will be overwhelmed by the majority, which presents quite a challenge…

机器学习 · 计算机科学 2023-03-29 Jia-Chen Zhao

In information retrieval, training reranking models mainly focuses on two types of objectives: metric learning (e.g. contrastive loss to increase the predicted scores on relevant query-document pairs) and classification (binary label…

计算与语言 · 计算机科学 2025-10-17 Ziqi Dai , Xin Zhang , Mingxin Li , Yanzhao Zhang , Dingkun Long , Pengjun Xie , Meishan Zhang , Wenjie Li , Min Zhang

Contrastive learning has achieved remarkable success in learning effective representations, with supervised contrastive learning often outperforming self-supervised approaches. However, in real-world scenarios, data annotations are often…

机器学习 · 计算机科学 2025-05-29 Zi-Hao Zhou , Jun-Jie Wang , Tong Wei , Min-Ling Zhang

The top-k recommendation is a fundamental task in recommendation systems which is generally learned by comparing positive and negative pairs. The Contrastive Loss (CL) is the key in contrastive learning that has received more attention…

信息检索 · 计算机科学 2021-09-02 Hao Tang , Guoshuai Zhao , Yuxia Wu , Xueming Qian

Modern image classifiers perform well on populated classes, while degrading considerably on tail classes with only a few instances. Humans, by contrast, effortlessly handle the long-tailed recognition challenge, since they can learn the…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Yingjun Du , Jiayi Shen , Xiantong Zhen , Cees G. M. Snoek

Supervised contrastive learning (SupCon) has proven to be a powerful alternative to the standard cross-entropy loss for classification of multi-class balanced datasets. However, it struggles to learn well-conditioned representations of…

机器学习 · 计算机科学 2025-03-24 David Mildenberger , Paul Hager , Daniel Rueckert , Martin J Menten

Recent empirical works have successfully used unlabeled data to learn feature representations that are broadly useful in downstream classification tasks. Several of these methods are reminiscent of the well-known word2vec embedding…

机器学习 · 计算机科学 2019-02-26 Sanjeev Arora , Hrishikesh Khandeparkar , Mikhail Khodak , Orestis Plevrakis , Nikunj Saunshi

Most existing methods that cope with noisy labels usually assume that the class distributions are well balanced, which has insufficient capacity to deal with the practical scenarios where training samples have imbalanced distributions. To…

计算机视觉与模式识别 · 计算机科学 2022-09-27 Chaowei Fang , Lechao Cheng , Huiyan Qi , Dingwen Zhang

Contrastive Learning (CL) performances as a rising approach to address the challenge of sparse and noisy recommendation data. Although having achieved promising results, most existing CL methods only perform either hand-crafted data or…

信息检索 · 计算机科学 2023-11-22 Xiuyuan Qin , Huanhuan Yuan , Pengpeng Zhao , Junhua Fang , Fuzhen Zhuang , Guanfeng Liu , Victor Sheng

Despite the success of contrastive learning (CL) in vision and language, its theoretical foundations and mechanisms for building representations remain poorly understood. In this work, we build connections between noise contrastive…

机器学习 · 计算机科学 2025-02-28 Zihao Chen , Chi-Heng Lin , Ran Liu , Jingyun Xiao , Eva L Dyer

Graph Convolutional Networks (GCNs) has demonstrated promising results for recommender systems, as they can effectively leverage high-order relationship. However, these methods usually encounter data sparsity issue in real-world scenarios.…

信息检索 · 计算机科学 2023-09-21 Qian Zhao , Zhengwei Wu , Zhiqiang Zhang , Jun Zhou

Contrastive learning has emerged as an essential approach for self-supervised learning in visual representation learning. The central objective of contrastive learning is to maximize the similarities between two augmented versions of an…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Hengkui Dong , Xianzhong Long , Yun Li , Lei Chen