中文
相关论文

相关论文: Parametric Contrastive Learning

200 篇论文

Real-world data tends to follow a long-tailed distribution, where the class imbalance results in dominance of the head classes during training. In this paper, we propose a frustratingly simple but effective step-wise learning framework to…

计算机视觉与模式识别 · 计算机科学 2023-05-23 Na Dong , Yongqiang Zhang , Mingli Ding , Gim Hee Lee

As a safety critical task, autonomous driving requires accurate predictions of road users' future trajectories for safe motion planning, particularly under challenging conditions. Yet, many recent deep learning methods suffer from a…

计算机视觉与模式识别 · 计算机科学 2024-05-01 Junrui Zhang , Mozhgan Pourkeshavarz , Amir Rasouli

Contrastive learning has become a dominant approach in self-supervised visual representation learning, but efficiently leveraging hard negatives, which are samples closely resembling the anchor, remains challenging. We introduce SynCo…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Nikolaos Giakoumoglou , Tania Stathaki

We present Momentum Contrast (MoCo) for unsupervised visual representation learning. From a perspective on contrastive learning as dictionary look-up, we build a dynamic dictionary with a queue and a moving-averaged encoder. This enables…

计算机视觉与模式识别 · 计算机科学 2020-03-25 Kaiming He , Haoqi Fan , Yuxin Wu , Saining Xie , Ross Girshick

Label distributions in camera-trap images are highly imbalanced and long-tailed, resulting in neural networks tending to be biased towards head-classes that appear frequently. Although long-tail learning has been extremely explored to…

计算机视觉与模式识别 · 计算机科学 2022-02-17 Byeongjun Park , Jeongsoo Kim , Seungju Cho , Heeseon Kim , Changick Kim

In this work, we tackle the challenging problem of long-tailed image recognition. Previous long-tailed recognition approaches mainly focus on data augmentation or re-balancing strategies for the tail classes to give them more attention…

计算机视觉与模式识别 · 计算机科学 2023-09-15 Weide Liu , Zhonghua Wu , Yiming Wang , Henghui Ding , Fayao Liu , Jie Lin , Guosheng Lin

Accurately predicting the future trajectories of traffic agents is essential in autonomous driving. However, due to the inherent imbalance in trajectory distributions, tail data in natural datasets often represents more complex and…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Bin Rao , Haicheng Liao , Yanchen Guan , Chengyue Wang , Bonan Wang , Jiaxun Zhang , Zhenning Li

How can you sample good negative examples for contrastive learning? We argue that, as with metric learning, contrastive learning of representations benefits from hard negative samples (i.e., points that are difficult to distinguish from an…

机器学习 · 计算机科学 2021-01-26 Joshua Robinson , Ching-Yao Chuang , Suvrit Sra , Stefanie Jegelka

Chromosome recognition is an essential task in karyotyping, which plays a vital role in birth defect diagnosis and biomedical research. However, existing classification methods face significant challenges due to the inter-class similarity…

计算机视觉与模式识别 · 计算机科学 2023-12-14 Ruijia Chang , Suncheng Xiang , Chengyu Zhou , Kui Su , Dahong Qian , Jun Wang

Real-world data are long-tailed, the lack of tail samples leads to a significant limitation in the generalization ability of the model. Although numerous approaches of class re-balancing perform well for moderate class imbalance problems,…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Yanbiao Ma , Licheng Jiao , Fang Liu , Shuyuan Yang , Xu Liu , Puhua Chen

To address the problem of long-tail distribution for the large vocabulary object detection task, existing methods usually divide the whole categories into several groups and treat each group with different strategies. These methods bring…

计算机视觉与模式识别 · 计算机科学 2021-04-05 Tong Wang , Yousong Zhu , Chaoyang Zhao , Wei Zeng , Jinqiao Wang , Ming Tang

Multi-label classification, which involves assigning multiple labels to a single input, has emerged as a key area in both research and industry due to its wide-ranging applications. Designing effective loss functions is crucial for…

机器学习 · 计算机科学 2025-01-06 Alexandre Audibert , Aurélien Gauffre , Massih-Reza Amini

We study contrastive learning under the PAC learning framework. While a series of recent works have shown statistical results for learning under contrastive loss, based either on the VC-dimension or Rademacher complexity, their algorithms…

机器学习 · 计算机科学 2025-07-08 Jie Shen

Real-world imagery is often characterized by a significant imbalance of the number of images per class, leading to long-tailed distributions. An effective and simple approach to long-tailed visual recognition is to learn feature…

计算机视觉与模式识别 · 计算机科学 2022-01-14 Ahmet Iscen , André Araujo , Boqing Gong , Cordelia Schmid

Learning-based solutions for long-tailed recognition face difficulties in generalizing on balanced test datasets. Due to imbalanced data prior, the learned \textit{a posteriori} distribution is biased toward the most frequent (head)…

计算机视觉与模式识别 · 计算机科学 2024-12-24 S Divakar Bhat , Amit More , Mudit Soni , Surbhi Agrawal

Long-tailed datasets, where head classes comprise much more training samples than tail classes, cause recognition models to get biased towards the head classes. Weighted loss is one of the most popular ways of mitigating this issue, and a…

计算机视觉与模式识别 · 计算机科学 2022-09-08 Saptarshi Sinha , Hiroki Ohashi

Contrastive learning is one of the fastest growing research areas in machine learning due to its ability to learn useful representations without labeled data. However, contrastive learning is susceptible to feature suppression, i.e., it may…

机器学习 · 计算机科学 2021-11-30 Tianhong Li , Lijie Fan , Yuan Yuan , Hao He , Yonglong Tian , Rogerio Feris , Piotr Indyk , Dina Katabi

Contrastive learning is commonly used as a method of self-supervised learning with the "anchor" and "positive" being two random augmentations of a given input image, and the "negative" is the set of all other images. However, the…

计算机视觉与模式识别 · 计算机科学 2022-08-16 Rishab Balasubramanian , Kunal Rathore

Contrastive learning has become an important tool in learning representations from unlabeled data mainly relying on the idea of minimizing distance between positive data pairs, e.g., views from the same images, and maximizing distance…

计算机视觉与模式识别 · 计算机科学 2023-08-22 Nina Shvetsova , Felix Petersen , Anna Kukleva , Bernt Schiele , Hilde Kuehne

Contrastive learning is among the most successful methods for visual representation learning, and its performance can be further improved by jointly performing clustering on the learned representations. However, existing methods for joint…

计算机视觉与模式识别 · 计算机科学 2022-09-16 Shunjie-Fabian Zheng , JaeEun Nam , Emilio Dorigatti , Bernd Bischl , Shekoofeh Azizi , Mina Rezaei