English
Related papers

Related papers: Rebalanced Siamese Contrastive Mining for Long-Tai…

200 papers

Deep learning enables impressive performance in image recognition using large-scale artificially-balanced datasets. However, real-world datasets exhibit highly class-imbalanced distributions, yielding two main challenges: relative imbalance…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Saurabh Sharma , Ning Yu , Mario Fritz , Bernt Schiele

Real-world data typically follow a long-tailed distribution, where a few majority categories occupy most of the data while most minority categories contain a limited number of samples. Classification models minimizing cross-entropy struggle…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Jianggang Zhu , Zheng Wang , Jingjing Chen , Yi-Ping Phoebe Chen , Yu-Gang Jiang

Deep learning has achieved remarkable success in bearing fault diagnosis. However, its performance oftentimes deteriorates when dealing with highly imbalanced or long-tailed data, while such cases are prevalent in industrial settings…

Signal Processing · Electrical Eng. & Systems 2023-09-22 Wei-En Yu , Jinwei Sun , Shiping Zhang , Xiaoge Zhang , Jing-Xiao Liao

Graph representation learning plays a vital role in processing graph-structured data. However, prior arts on graph representation learning heavily rely on labeling information. To overcome this problem, inspired by the recent success of…

Machine Learning · Computer Science 2021-07-19 Ming Jin , Yizhen Zheng , Yuan-Fang Li , Chen Gong , Chuan Zhou , Shirui Pan

Contrastive learning applied to self-supervised representation learning has seen a resurgence in recent years, leading to state of the art performance in the unsupervised training of deep image models. Modern batch contrastive approaches…

Machine Learning · Computer Science 2021-03-12 Prannay Khosla , Piotr Teterwak , Chen Wang , Aaron Sarna , Yonglong Tian , Phillip Isola , Aaron Maschinot , Ce Liu , Dilip Krishnan

In this paper, we propose an Aligned Contrastive Learning (ACL) algorithm to address the long-tailed recognition problem. Our findings indicate that while multi-view training boosts the performance, contrastive learning does not…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Jiali Ma , Jiequan Cui , Maeno Kazuki , Lakshmi Subramanian , Karlekar Jayashree , Sugiri Pranata , Hanwang Zhang

Weakly supervised person search aims to perform joint pedestrian detection and re-identification (re-id) with only person bounding-box annotations. Recently, the idea of contrastive learning is initially applied to weakly supervised person…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Jiabei Wang , Yanwei Pang , Jiale Cao , Hanqing Sun , Zhuang Shao , Xuelong Li

Contrastive losses have long been a key ingredient of deep metric learning and are now becoming more popular due to the success of self-supervised learning. Recent research has shown the benefit of decomposing such losses into two…

Machine Learning · Computer Science 2021-12-23 Arnaud Sors , Rafael Sampaio de Rezende , Sarah Ibrahimi , Jean-Marc Andreoli

The long-tail distribution of the visual world poses great challenges for deep learning based classification models on how to handle the class imbalance problem. Existing solutions usually involve class-balancing strategies, e.g., by loss…

Computer Vision and Pattern Recognition · Computer Science 2020-02-20 Bingyi Kang , Saining Xie , Marcus Rohrbach , Zhicheng Yan , Albert Gordo , Jiashi Feng , Yannis Kalantidis

Class imbalance is a fundamental problem in computer vision applications such as semantic segmentation. Specifically, uneven class distributions in a training dataset often result in unsatisfactory performance on under-represented classes.…

Computer Vision and Pattern Recognition · Computer Science 2022-02-07 Junjiao Tian , Niluthpol Mithun , Zach Seymour , Han-Pang Chiu , Zsolt Kira

Medical image classification has been widely adopted in medical image analysis. However, due to the difficulty of collecting and labeling data in the medical area, medical image datasets are usually highly-imbalanced. To address this…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Zhixiong Yang , Junwen Pan , Yanzhan Yang , Xiaozhou Shi , Hong-Yu Zhou , Zhicheng Zhang , Cheng Bian

Real-world data is extremely imbalanced and presents a long-tailed distribution, resulting in models that are biased towards classes with sufficient samples and perform poorly on rare classes. Recent methods propose to rebalance classes but…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Weiqi Li , Fan Lyu , Fanhua Shang , Liang Wan , Wei Feng

Class imbalance is a problem of significant importance in applied deep learning where trained models are exploited for decision support and automated decisions in critical areas such as health and medicine, transportation, and finance. The…

Machine Learning · Computer Science 2020-12-07 Colin Bellinger , Roberto Corizzo , Nathalie Japkowicz

Real-world data often follows a long-tailed distribution, where a few head classes occupy most of the data and a large number of tail classes only contain very limited samples. In practice, deep models often show poor generalization…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Haolin Pan , Yong Guo , Mianjie Yu , Jian Chen

Long-tailed image recognition presents massive challenges to deep learning systems since the imbalance between majority (head) classes and minority (tail) classes severely skews the data-driven deep neural networks. Previous methods tackle…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yue Xu , Yong-Lu Li , Jiefeng Li , Cewu Lu

Object frequency in the real world often follows a power law, leading to a mismatch between datasets with long-tailed class distributions seen by a machine learning model and our expectation of the model to perform well on all classes. We…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Muhammad Abdullah Jamal , Matthew Brown , Ming-Hsuan Yang , Liqiang Wang , Boqing Gong

Chromosome recognition is an essential task in karyotyping, which plays a vital role in birth defect diagnosis and biomedical research. However, existing classification methods face significant challenges due to the inter-class similarity…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Ruijia Chang , Suncheng Xiang , Chengyu Zhou , Kui Su , Dahong Qian , Jun Wang

While contrastive learning is proven to be an effective training strategy in computer vision, Natural Language Processing (NLP) is only recently adopting it as a self-supervised alternative to Masked Language Modeling (MLM) for improving…

Computation and Language · Computer Science 2021-09-16 Hooman Sedghamiz , Shivam Raval , Enrico Santus , Tuka Alhanai , Mohammad Ghassemi

The recent breakthrough achieved by contrastive learning accelerates the pace for deploying unsupervised training on real-world data applications. However, unlabeled data in reality is commonly imbalanced and shows a long-tail distribution,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Ziyu Jiang , Tianlong Chen , Bobak Mortazavi , Zhangyang Wang

Training data for class-conditional image synthesis often exhibit a long-tailed distribution with limited images for tail classes. Such an imbalance causes mode collapse and reduces the diversity of synthesized images for tail classes. For…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Fang Chen , Alex Villa , Gongbo Liang , Xiaoyi Lu , Meng Tang