English
Related papers

Related papers: Aligning Pretraining for Detection via Object-Leve…

200 papers

Current multimodal models leveraging contrastive learning often face limitations in developing fine-grained conceptual understanding. This is due to random negative samples during pretraining, causing almost exclusively very dissimilar…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Philipp J. Rösch , Norbert Oswald , Michaela Geierhos , Jindřich Libovický

Supervised learning for semantic segmentation requires a large number of labeled samples, which is difficult to obtain in the field of remote sensing. Self-supervised learning (SSL), can be used to solve such problems by pre-training a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Haifeng Li , Yi Li , Guo Zhang , Ruoyun Liu , Haozhe Huang , Qing Zhu , Chao Tao

The foundation models based on pre-training technology have significantly advanced artificial intelligence from theoretical to practical applications. These models have facilitated the feasibility of computer-aided diagnosis for widespread…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Xiaofei Chen , Yuting He , Cheng Xue , Rongjun Ge , Shuo Li , Guanyu Yang

Unsupervised representation learning has recently received lots of interest due to its powerful generalizability through effectively leveraging large-scale unlabeled data. There are two prevalent approaches for this, contrastive learning…

Machine Learning · Computer Science 2021-06-14 Saehoon Kim , Sungwoong Kim , Juho Lee

In response to an object presentation, supervised learning schemes generally respond with a parsimonious label. Upon a similar presentation we humans respond again with a label, but are flooded, in addition, by a myriad of associations. A…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Daniel N. Nissani

Self-supervised representation learning based on Contrastive Learning (CL) has been the subject of much attention in recent years. This is due to the excellent results obtained on a variety of subsequent tasks (in particular…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Ahmed Ben Saad , Kristina Prokopetc , Josselin Kherroubi , Axel Davy , Adrien Courtois , Gabriele Facciolo

Recent years have witnessed great progress in deep learning based object detection. However, due to the domain shift problem, applying off-the-shelf detectors to an unseen domain leads to significant performance drop. To address such an…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Yangtao Zheng , Di Huang , Songtao Liu , Yunhong Wang

Weakly supervised image segmentation trained with image-level labels usually suffers from inaccurate coverage of object areas during the generation of the pseudo groundtruth. This is because the object activation maps are trained with the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-30 Weide Liu , Xiangfei Kong , Tzu-Yi Hung , Guosheng Lin

We show that bringing intermediate layers' representations of two augmented versions of an image closer together in self-supervised learning helps to improve the momentum contrastive (MoCo) method. To this end, in addition to the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Aakash Kaku , Sahana Upadhya , Narges Razavian

Transformers have become the dominant model in natural language processing, owing to their ability to pretrain on massive amounts of data, then transfer to smaller, more specific tasks via fine-tuning. The Vision Transformer was the first…

Computer Vision and Pattern Recognition · Computer Science 2020-12-21 Josh Beal , Eric Kim , Eric Tzeng , Dong Huk Park , Andrew Zhai , Dmitry Kislyuk

In recent years, vision language pre-training frameworks have made significant progress in natural language processing and computer vision, achieving remarkable performance improvement on various downstream tasks. However, when extended to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Taolin Zhang , Sunan He , Dai Tao , Bin Chen , Zhi Wang , Shu-Tao Xia

This paper presents Contrastive Reconstruction, ConRec - a self-supervised learning algorithm that obtains image representations by jointly optimizing a contrastive and a self-reconstruction loss. We showcase that state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Jonas Dippel , Steffen Vogler , Johannes Höhne

We present a self-supervised learning framework, COCO-LM, that pretrains Language Models by COrrecting and COntrasting corrupted text sequences. Following ELECTRA-style pretraining, COCO-LM employs an auxiliary language model to corrupt…

Computation and Language · Computer Science 2021-10-28 Yu Meng , Chenyan Xiong , Payal Bajaj , Saurabh Tiwary , Paul Bennett , Jiawei Han , Xia Song

Video salient object detection aims to find the most visually distinctive objects in a video. To explore the temporal dependencies, existing methods usually resort to recurrent neural networks or optical flow. However, these approaches…

Computer Vision and Pattern Recognition · Computer Science 2021-11-04 Yi-Wen Chen , Xiaojie Jin , Xiaohui Shen , Ming-Hsuan Yang

Object-centric representation learning has recently been successfully applied to real-world datasets. This success can be attributed to pretrained non-object-centric foundation models, whose features serve as reconstruction targets for slot…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Nikola Đukić , Tim Lebailly , Tinne Tuytelaars

Medical image segmentation, or computing voxelwise semantic masks, is a fundamental yet challenging task to compute a voxel-level semantic mask. To increase the ability of encoder-decoder neural networks to perform this task across large…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Ho Hin Lee , Yucheng Tang , Qi Yang , Xin Yu , Shunxing Bao , Leon Y. Cai , Lucas W. Remedios , Bennett A. Landman , Yuankai Huo

Automated animal censuses with aerial imagery are a vital ingredient towards wildlife conservation. Recent models are generally based on supervised learning and thus require vast amounts of training data. Due to their scarcity and minuscule…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Xiaochen Zheng

Recently the problem of cross-domain object detection has started drawing attention in the computer vision community. In this paper, we propose a novel unsupervised cross-domain detection model that exploits the annotated data in a source…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Zhen Zhao , Yuhong Guo , Jieping Ye

Learning an egocentric action recognition model from video data is challenging due to distractors (e.g., irrelevant objects) in the background. Further integrating object information into an action model is hence beneficial. Existing…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Victor Escorcia , Ricardo Guerrero , Xiatian Zhu , Brais Martinez

Self-supervised contrastive learning is an effective approach for addressing the challenge of limited labelled data. This study builds upon the previously established two-stage patch-level, multi-label classification method for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Salma Haidar , José Oramas