English
Related papers

Related papers: Rebalanced Siamese Contrastive Mining for Long-Tai…

200 papers

Contrastive loss has significantly improved performance in supervised classification tasks by using a multi-viewed framework that leverages augmentation and label information. The augmentation enables contrast with another view of a single…

Machine Learning · Computer Science 2022-11-28 Sangmin Bae , Sungnyun Kim , Jongwoo Ko , Gihun Lee , Seungjong Noh , Se-Young Yun

Recommender systems (RecSys) play a vital role in online platforms, offering users personalized suggestions amidst vast information. Graph contrastive learning aims to learn from high-order collaborative filtering signals with unsupervised…

Information Retrieval · Computer Science 2024-04-29 Weizhi Zhang , Liangwei Yang , Zihe Song , Henry Peng Zou , Ke Xu , Yuanjie Zhu , Philip S. Yu

Supervised contrastive learning (SupCon) is widely used to shape representations, but has seen limited targeted study for audio deepfake detection. Existing work typically combines contrastive terms with broader pipelines; however, the…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-30 Jaskirat Sudan , Hashim Ali , Surya Subramani , Hafiz Malik

Though offering amazing contextualized token-level representations, current pre-trained language models actually take less attention on acquiring sentence-level representation during its self-supervised pre-training. If self-supervised…

Computation and Language · Computer Science 2022-10-24 Bohong Wu , Hai Zhao

Classification on long-tailed distributed data is a challenging problem, which suffers from serious class-imbalance and hence poor performance on tail classes with only a few samples. Owing to this paucity of samples, learning on the tail…

Computation and Language · Computer Science 2022-07-25 Taha ValizadehAslani , Yiwen Shi , Jing Wang , Ping Ren , Yi Zhang , Meng Hu , Liang Zhao , Hualou Liang

Recently, long-tailed image classification harvests lots of research attention, since the data distribution is long-tailed in many real-world situations. Piles of algorithms are devised to address the data imbalance problem by biasing the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Chaowei Fang , Dingwen Zhang , Wen Zheng , Xue Li , Le Yang , Lechao Cheng , Junwei Han

Long-tailed datasets are very frequently encountered in real-world use cases where few classes or categories (known as majority or head classes) have higher number of data samples compared to the other classes (known as minority or tail…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Saptarshi Sinha , Hiroki Ohashi , Katsuyuki Nakamura

Weakly-supervised image segmentation (WSIS) is a critical task in computer vision that relies on image-level class labels. Multi-stage training procedures have been widely used in existing WSIS approaches to obtain high-quality pseudo-masks…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Chunyan Wang , Dong Zhang , Rui Yan

Recently, deep convolutional neural networks (DCNN) that leverage the adversarial training framework for image restoration and enhancement have significantly improved the processed images' sharpness. Surprisingly, although these DCNNs…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Seyed Mehdi Ayyoubzadeh , Ali Royat

Recent contrastive methods show significant improvement in self-supervised learning in several domains. In particular, contrastive methods are most effective where data augmentation can be easily constructed e.g. in computer vision.…

Machine Learning · Computer Science 2021-12-09 Konstantinos Kallidromitis , Denis Gudovskiy , Kazuki Kozuka , Iku Ohama , Luca Rigazio

Class imbalance is a common challenge in real-world recognition tasks, where the majority of classes have few samples, also known as tail classes. We address this challenge with the perspective of generalization and empirically find that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yixuan Zhou , Yi Qu , Xing Xu , Hengtao Shen

Real-world datasets often exhibit a long-tailed distribution, where vast majority of classes known as tail classes have only few samples. Traditional methods tend to overfit on these tail classes. Recently, a new approach called Imbalanced…

Machine Learning · Computer Science 2024-12-23 Xingyu Lyu , Qianqian Xu , Zhiyong Yang , Shaojie Lyu , Qingming Huang

Large and rich data is a prerequisite for effective training of deep neural networks. However, the irregularity of point cloud data makes manual annotation time-consuming and laborious. Self-supervised representation learning, which…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Xin Cao , Xinxin Han , Yifan Wang , Mengna Yang , Kang Li

In contrast to fully-supervised models, self-supervised representation learning only needs a fraction of data to be labeled and often achieves the same or even higher downstream performance. The goal is to pre-train deep neural networks on…

Machine Learning · Computer Science 2025-04-09 Friederike Baier , Sebastian Mair , Samuel G. Fadel

Recent self-supervised contrastive learning methods greatly benefit from the Siamese structure that aims to minimizing distances between positive pairs. These methods usually apply random data augmentation to input images, expecting the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Sheng Wang , Zixu Zhuang , Xi Ouyang , Lichi Zhang , Zheren Li , Chong Ma , Tianming Liu , Dinggang Shen , Qian Wang

This paper focuses on long-tailed object detection in the semi-supervised learning setting, which poses realistic challenges, but has rarely been studied in the literature. We propose a novel pseudo-labeling-based detector called…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Yuhang Zang , Kaiyang Zhou , Chen Huang , Chen Change Loy

Deep neural networks often inherit social and demographic biases from annotated data during model training, leading to unfair predictions, especially in the presence of sensitive attributes like race, age, gender etc. Existing methods fall…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Anay Majee , Rishabh Iyer

Contrastive learning has become a key component of self-supervised learning approaches for computer vision. By learning to embed two augmented versions of the same image close to each other and to push the embeddings of different images…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Yannis Kalantidis , Mert Bulent Sariyildiz , Noe Pion , Philippe Weinzaepfel , Diane Larlus

The problem of long-tailed recognition, where the number of examples per class is highly unbalanced, is considered. While training with class-balanced sampling has been shown effective for this problem, it is known to over-fit to few-shot…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Bo Liu , Haoxiang Li , Hao Kang , Gang Hua , Nuno Vasconcelos

In vision domain, large-scale natural datasets typically exhibit long-tailed distribution which has large class imbalance between head and tail classes. This distribution poses difficulty in learning good representations for tail classes.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Anthony Meng Huat Tiong , Junnan Li , Guosheng Lin , Boyang Li , Caiming Xiong , Steven C. H. Hoi