English
Related papers

Related papers: CoDo: Contrastive Learning with Downstream Backgro…

200 papers

Contrastively trained vision-language models have achieved remarkable progress in vision and language representation learning, leading to state-of-the-art models for various downstream multimodal tasks. However, recent research has…

Computation and Language · Computer Science 2023-10-26 Harman Singh , Pengchuan Zhang , Qifan Wang , Mengjiao Wang , Wenhan Xiong , Jingfei Du , Yu Chen

We propose a unified point cloud video self-supervised learning framework for object-centric and scene-centric data. Previous methods commonly conduct representation learning at the clip or frame level and cannot well capture fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Xiaoxiao Sheng , Zhiqiang Shen , Gang Xiao , Longguang Wang , Yulan Guo , Hehe Fan

Supervised learning methods have been suffering from the fact that a large-scale labeled dataset is mandatory, which is difficult to obtain. This has been a more significant issue for fashion compatibility prediction because compatibility…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Ling Xiao , Toshihiko Yamasaki

Recent unsupervised multi-object detection models have shown impressive performance improvements, largely attributed to novel architectural inductive biases. Unfortunately, they may produce suboptimal object encodings for downstream tasks.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Quentin Delfosse , Wolfgang Stammer , Thomas Rothenbacher , Dwarak Vittal , Kristian Kersting

Few-shot text classification has recently been promoted by the meta-learning paradigm which aims to identify target classes with knowledge transferred from source classes with sets of small tasks named episodes. Despite their success,…

Computation and Language · Computer Science 2023-05-17 Junfan Chen , Richong Zhang , Yongyi Mao , Jie Xu

Deep neural nets typically perform end-to-end backpropagation to learn the weights, a procedure that creates synchronization constraints in the weight update step across layers and is not biologically plausible. Recent advances in…

Machine Learning · Computer Science 2020-12-01 Yuwen Xiong , Mengye Ren , Raquel Urtasun

Unsupervised object-centric learning from videos is a promising approach to extract structured representations from large, unlabeled collections of videos. To support downstream tasks like autonomous control, these representations must be…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Anna Manasyan , Maximilian Seitzer , Filip Radovic , Georg Martius , Andrii Zadaianchuk

Although graph neural networks (GNNs) have achieved impressive achievements in graph classification, they often need abundant task-specific labels, which could be extensively costly to acquire. A credible solution is to explore additional…

Machine Learning · Computer Science 2025-07-15 Nan Yin , Li Shen , Mengzhu Wang , Long Lan , Zeyu Ma , Chong Chen , Xian-Sheng Hua , Xiao Luo

Instance-level Image Retrieval (IIR), or simply Instance Retrieval, deals with the problem of finding all the images within an dataset that contain a query instance (e.g. an object). This paper makes the first attempt that tackles this…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Tao Wu , Tie Luo , Donald Wunsch

The superior performance of some of today's state-of-the-art deep learning models is to some extent owed to extensive (self-)supervised contrastive pretraining on large-scale datasets. In contrastive learning, the network is presented with…

Machine Learning · Computer Science 2022-07-20 Shervin Ardeshir , Navid Azizan

Deep convolutional neural networks have become a key element in the recent breakthrough of salient object detection. However, existing CNN-based methods are based on either patch-wise (region-wise) training and inference or fully…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Guanbin Li , Yizhou Yu

Contrastive learning, which aims at minimizing the distance between positive pairs while maximizing that of negative ones, has been widely and successfully applied in unsupervised feature learning, where the design of positive and negative…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Rui Zhu , Bingchen Zhao , Jingen Liu , Zhenglong Sun , Chang Wen Chen

This paper considers arbitrary document detection performed on a mobile device. The classical contour-based approach often fails in cases featuring occlusion, complex background, or blur. The region-based approach, which relies on the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Daniil V. Tropin , Sergey A. Ilyuhin , Dmitry P. Nikolaev , Vladimir V. Arlazarov

Self-supervised learning has recently shown great potential in vision tasks through contrastive learning, which aims to discriminate each image, or instance, in the dataset. However, such instance-level learning ignores the semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Tsai-Shien Chen , Wei-Chih Hung , Hung-Yu Tseng , Shao-Yi Chien , Ming-Hsuan Yang

Contrastive learning has demonstrated great success in representation learning, especially for image classification tasks. However, there is still a shortage in studies targeting regression tasks, and more specifically applications on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Mohamad Dhaini , Paul Honeine , Maxime Berar , Antonin Van Exem

Salient objects attract human attention and usually stand out clearly from their surroundings. In contrast, camouflaged objects share similar colors or textures with the environment. In this case, salient objects are typically…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Aixuan Li , Jing Zhang , Yunqiu Lv , Tong Zhang , Yiran Zhong , Mingyi He , Yuchao Dai

We present Domain Contrast (DC), a simple yet effective approach inspired by contrastive learning for training domain adaptive detectors. DC is deduced from the error bound minimization perspective of a transferred model, and is implemented…

Computer Vision and Pattern Recognition · Computer Science 2020-06-29 Feng Liu , Xiaoxong Zhang , Fang Wan , Xiangyang Ji , Qixiang Ye

Contrastive, self-supervised learning of object representations recently emerged as an attractive alternative to reconstruction-based training. Prior approaches focus on contrasting individual object representations (slots) against one…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Sindy Löwe , Klaus Greff , Rico Jonschkowski , Alexey Dosovitskiy , Thomas Kipf

Time-series representation learning can extract representations from data with temporal dynamics and sparse labels. When labeled data are sparse but unlabeled data are abundant, contrastive learning, i.e., a framework to learn a latent…

Machine Learning · Computer Science 2023-03-03 Heejeong Choi , Pilsung Kang

As the field of deep learning steadily transitions from the realm of academic research to practical application, the significance of self-supervised pretraining methods has become increasingly prominent. These methods, particularly in the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Toni Albert , Bjoern Eskofier , Dario Zanca