English
Related papers

Related papers: Dense Contrastive Learning for Self-Supervised Vis…

200 papers

A prominent technique for self-supervised representation learning has been to contrast semantically similar and dissimilar pairs of samples. Without access to labels, dissimilar (negative) points are typically taken to be randomly sampled…

Machine Learning · Computer Science 2020-10-22 Ching-Yao Chuang , Joshua Robinson , Lin Yen-Chen , Antonio Torralba , Stefanie Jegelka

Learning semantic segmentation models under image-level supervision is far more challenging than under fully supervised setting. Without knowing the exact pixel-label correspondence, most weakly-supervised methods rely on external models to…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Zi-Yi Ke , Chiou-Ting Hsu

Feature representation via self-supervised learning has reached remarkable success in image-level contrastive learning, which brings impressive performances on image classification tasks. While image-level feature representation mainly…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Junwei Yang , Ke Zhang , Zhaolin Cui , Jinming Su , Junfeng Luo , Xiaolin Wei

Point clouds have attracted increasing attention. Significant progress has been made in methods for point cloud analysis, which often requires costly human annotation as supervision. To address this issue, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Bi'an Du , Xiang Gao , Wei Hu , Xin Li

In this work we present point-level region contrast, a self-supervised pre-training approach for the task of object detection. This approach is motivated by the two key factors in detection: localization and recognition. While accurate…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Yutong Bai , Xinlei Chen , Alexander Kirillov , Alan Yuille , Alexander C. Berg

Self-supervised representation learning is a fundamental problem in computer vision with many useful applications (e.g., image search, instance level recognition, copy detection). In this paper we present a new contrastive self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 David Wu , Yunnan Wu

Dense Self-Supervised Learning (SSL) methods address the limitations of using image-level feature representations when handling images with multiple objects. Although the dense features extracted by employing segmentation maps and bounding…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Congpei Qiu , Tong Zhang , Wei Ke , Mathieu Salzmann , Sabine Süsstrunk

Unpaired image-to-image translation involves learning mappings between source domain and target domain in the absence of aligned or corresponding samples. Score based diffusion models have demonstrated state-of-the-art performance in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Venkata Narendra Kotyada , Revanth Eranki , Nagesh Bhattu Sristy

Contrastive self-supervised learning has shown impressive results in learning visual representations from unlabeled images by enforcing invariance against different data augmentations. However, the learned representations are often…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Sangwoo Mo , Hyunwoo Kang , Kihyuk Sohn , Chun-Liang Li , Jinwoo Shin

Semi-supervised learning is a sound measure to relieve the strict demand of abundant annotated datasets, especially for challenging multi-organ segmentation . However, most existing SSL methods predict pixels in a single image…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Lu Wen , Zhenghao Feng , Yun Hou , Peng Wang , Xi Wu , Jiliu Zhou , Yan Wang

Contrastive learning has emerged as a powerful method in deep learning, excelling at learning effective representations through contrasting samples from different distributions. However, dimensional collapse, where embeddings converge into…

Machine Learning · Computer Science 2025-12-10 Huanran Li , Manh Nguyen , Daniel Pimentel-Alarcón

In recent years, knowledge distillation methods based on contrastive learning have achieved promising results on image classification and object detection tasks. However, in this line of research, we note that less attention is paid to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Jiawei Fan , Chao Li , Xiaolong Liu , Meina Song , Anbang Yao

Contrastive learning is commonly applied to self-supervised learning, and has been shown to outperform traditional approaches such as the triplet loss and N-pair loss. However, the requirement of large batch sizes and memory banks has made…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Rishab Balasubramanian , Rupashree Dey , Kunal Rathore

Weakly supervised learning of object detection is an important problem in image understanding that still does not have a satisfactory solution. In this paper, we address this problem by exploiting the power of deep convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2016-12-20 Hakan Bilen , Andrea Vedaldi

Human observers can learn to recognize new categories of images from a handful of examples, yet doing so with artificial ones remains an open challenge. We hypothesize that data-efficient recognition is enabled by representations which make…

Computer Vision and Pattern Recognition · Computer Science 2020-07-02 Olivier J. Hénaff , Aravind Srinivas , Jeffrey De Fauw , Ali Razavi , Carl Doersch , S. M. Ali Eslami , Aaron van den Oord

Recently, self-supervised representation learning gives further development in multimedia technology. Most existing self-supervised learning methods are applicable to packaged data. However, when it comes to streamed data, they are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Zhiwei Lin , Yongtao Wang , Hongxiang Lin

Current semantic segmentation methods focus only on mining "local" context, i.e., dependencies between pixels within individual images, by context-aggregation modules (e.g., dilated convolution, neural attention) or structure-aware…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Wenguan Wang , Tianfei Zhou , Fisher Yu , Jifeng Dai , Ender Konukoglu , Luc Van Gool

Learning view-invariant representation is a key to improving feature discrimination power for skeleton-based action recognition. Existing approaches cannot effectively remove the impact of viewpoint due to the implicit view-dependent…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Qianhui Men , Edmond S. L. Ho , Hubert P. H. Shum , Howard Leung

The success of deep learning is usually accompanied by the growth in neural network depth. However, the traditional training method only supervises the neural network at its last layer and propagates the supervision layer-by-layer, which…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Linfeng Zhang , Xin Chen , Junbo Zhang , Runpei Dong , Kaisheng Ma

While supervised object detection methods achieve impressive accuracy, they generalize poorly to images whose appearance significantly differs from the data they have been trained on. To address this in scenarios where annotating data is…

Computer Vision and Pattern Recognition · Computer Science 2019-07-19 Isinsu Katircioglu , Helge Rhodin , Victor Constantin , Jörg Spörri , Mathieu Salzmann , Pascal Fua