English
Related papers

Related papers: ProCo: Prototype-aware Contrastive Learning for Lo…

200 papers

Lesion detection is a fundamental problem in the computer-aided diagnosis scheme for mammography. The advance of deep learning techniques have made a remarkable progress for this task, provided that the training data are large and…

Image and Video Processing · Electrical Eng. & Systems 2021-11-23 Zheren Li , Zhiming Cui , Sheng Wang , Yuji Qi , Xi Ouyang , Qitian Chen , Yuezhi Yang , Zhong Xue , Dinggang Shen , Jie-Zhi Cheng

Recognition problems in long-tailed data, in which the sample size per class is heavily skewed, have gained importance because the distribution of the sample size per class in a dataset is generally exponential unless the sample size is…

Machine Learning · Computer Science 2024-04-30 Naoya Hasegawa , Issei Sato

The visual world naturally exhibits a long-tailed distribution of open classes, which poses great challenges to modern visual systems. Existing approaches either perform class re-balancing strategies or directly improve network modules to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Teli Ma , Shijie Geng , Mengmeng Wang , Jing Shao , Jiasen Lu , Hongsheng Li , Peng Gao , Yu Qiao

The discriminability of feature representation is the key to open-set face recognition. Previous methods rely on the learnable weights of the classification layer that represent the identities. However, the evaluation process learns no…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Youzhe Song , Feng Wang

Food classification serves as the basic step of image-based dietary assessment to predict the types of foods in each input image. However, food image predictions in a real world scenario are usually long-tail distributed among different…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Jiangpeng He , Luotao Lin , Heather Eicher-Miller , Fengqing Zhu

Long-tailed problems in healthcare emerge from data imbalance due to variability in the prevalence and representation of different medical conditions, warranting the requirement of precise and dependable classification methods. Traditional…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Pankhi Kashyap , Pavni Tandon , Sunny Gupta , Abhishek Tiwari , Ritwik Kulkarni , Kshitij Sharad Jadhav

Contrastive learning based vision-language joint pre-training has emerged as a successful representation learning strategy. In this paper, we present a prototype representation learning framework incorporating both global and local…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Pujin Cheng , Li Lin , Junyan Lyu , Yijin Huang , Wenhan Luo , Xiaoying Tang

Learning an effective representation in multi-label text classification (MLTC) is a significant challenge in NLP. This challenge arises from the inherent complexity of the task, which is shaped by two key factors: the intricate connections…

Machine Learning · Computer Science 2024-04-16 Alexandre Audibert , Aurélien Gauffre , Massih-Reza Amini

Pre-training plays a vital role in various vision tasks, such as object recognition and detection. Commonly used pre-training methods, which typically rely on randomized approaches like uniform or Gaussian distributions to initialize model…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Chen-Long Duan , Yong Li , Xiu-Shen Wei , Lin Zhao

Benchmark datasets for visual recognition assume that data is uniformly distributed, while real-world datasets obey long-tailed distribution. Current approaches handle the long-tailed problem to transform the long-tailed dataset to uniform…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Renhui Zhang , Tiancheng Lin , Rui Zhang , Yi Xu

Real-world data often exhibits long tail distributions with heavy class imbalance, where the majority classes can dominate the training process and alter the decision boundaries of the minority classes. Recently, researchers have…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Tianhong Li , Peng Cao , Yuan Yuan , Lijie Fan , Yuzhe Yang , Rogerio Feris , Piotr Indyk , Dina Katabi

Chromosome recognition is an essential task in karyotyping, which plays a vital role in birth defect diagnosis and biomedical research. However, existing classification methods face significant challenges due to the inter-class similarity…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Ruijia Chang , Suncheng Xiang , Chengyu Zhou , Kui Su , Dahong Qian , Jun Wang

Although contrastive learning methods have shown prevailing performance on a variety of representation learning tasks, they encounter difficulty when the training dataset is long-tailed. Many researchers have combined contrastive learning…

Machine Learning · Computer Science 2023-08-09 Min-Kook Suh , Seung-Woo Seo

Contrastive learning is a representation learning method performed by contrasting a sample to other similar samples so that they are brought closely together, forming clusters in the feature space. The learning process is typically…

Machine Learning · Computer Science 2022-09-28 Valentino Vito , Lim Yohanes Stefanus

Contrastive learning has become pivotal in unsupervised representation learning, with frameworks like Momentum Contrast (MoCo) effectively utilizing large negative sample sets to extract discriminative features. However, traditional…

Machine Learning · Computer Science 2025-01-29 Duy Hoang , Huy Ngo , Khoi Pham , Tri Nguyen , Gia Bao , Huy Phan

Real-world data consistently exhibits a long-tailed distribution, often spanning multiple categories. This complexity underscores the challenge of content comprehension, particularly in scenarios requiring Long-Tailed Multi-Label image…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Jiexuan Yan , Sheng Huang , Nankun Mu , Luwen Huangfu , Bo Liu

The long-tailed recognition (LTR) is the task of learning high-performance classifiers given extremely imbalanced training samples between categories. Most of the existing works address the problem by either enhancing the features of tail…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Haixu Long , Xiaolin Zhang , Yanbin Liu , Zongtai Luo , Jianbo Liu

The self-supervised ultrasound (US) video model pretraining can use a small amount of labeled data to achieve one of the most promising results on US diagnosis. However, it does not take full advantage of multi-level knowledge for learning…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Chunhui Zhang , Yixiong Chen , Li Liu , Qiong Liu , Xi Zhou

Self-supervised pre-training of deep learning models with contrastive learning is a widely used technique in image analysis. Current findings indicate a strong potential for contrastive pre-training on medical images. However, further…

Image and Video Processing · Electrical Eng. & Systems 2024-10-21 Daniel Wolf , Tristan Payer , Catharina Silvia Lisson , Christoph Gerhard Lisson , Meinrad Beer , Michael Götz , Timo Ropinski

The foundation models based on pre-training technology have significantly advanced artificial intelligence from theoretical to practical applications. These models have facilitated the feasibility of computer-aided diagnosis for widespread…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Xiaofei Chen , Yuting He , Cheng Xue , Rongjun Ge , Shuo Li , Guanyu Yang