English
Related papers

Related papers: Patch-Level Contrasting without Patch Corresponden…

200 papers

Place recognition is an essential and challenging task in loop closing and global localization for robotics and autonomous driving applications. Benefiting from the recent advances in deep learning techniques, the performance of LiDAR place…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Jiafeng Cui , Xieyuanli Chen

Knowledge distillation enhances the performance of compact student networks by transferring knowledge from more powerful teacher networks without introducing additional parameters. In the feature space, local regions within an individual…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Cuipeng Wang , Haipeng Wang

High-quality instance segmentation has shown emerging importance in computer vision. Without any refinement, DCT-Mask directly generates high-resolution masks by compressed vectors. To further refine masks obtained by compressed vectors, we…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Qinrou Wen , Jirui Yang , Xue Yang , Kewei Liang

Image-Text Retrieval (ITR) is challenging in bridging visual and lingual modalities. Contrastive learning has been adopted by most prior arts. Except for limited amount of negative image-text pairs, the capability of constrastive learning…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Haoran Wang , Dongliang He , Wenhao Wu , Boyang Xia , Min Yang , Fu Li , Yunlong Yu , Zhong Ji , Errui Ding , Jingdong Wang

Sparse and noisy images (SNIs), like those in spatial gene expression data, pose significant challenges for effective representation learning and clustering, which are essential for thorough data analysis and interpretation. In response to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Wenlin Li , Yucheng Xu , Xiaoqing Zheng , Suoya Han , Jun Wang , Xiaobo Sun

In recent years, a variety of contrastive learning based unsupervised visual representation learning methods have been designed and achieved great success in many visual tasks. Generally, these methods can be roughly classified into four…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Wenbin Li , Meihao Kong , Xuesong Yang , Lei Wang , Jing Huo , Yang Gao , Jiebo Luo

Unsupervised learning algorithms are beginning to achieve accuracies comparable to their supervised counterparts on benchmark computer vision tasks, but their utility for practical applications has not yet been demonstrated. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Jeremiah W. Johnson , Swathi Hari , Donald Hampton , Hyunju K. Connor , Amy Keesee

Satellite imagery is being leveraged for many societally critical tasks across climate, economics, and public health. Yet, because of heterogeneity in landscapes (e.g. how a road looks in different places), models can show disparate…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Miao Zhang , Rumi Chunara

Recent advances in contrastive representation learning over paired image-text data have led to models such as CLIP that achieve state-of-the-art performance for zero-shot classification and distributional robustness. Such models typically…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Shashank Goel , Hritik Bansal , Sumit Bhatia , Ryan A. Rossi , Vishwa Vinay , Aditya Grover

Self-supervised learning algorithms based on instance discrimination train encoders to be invariant to pre-defined transformations of the same instance. While most methods treat different views of the same image as positives for a…

Computer Vision and Pattern Recognition · Computer Science 2021-10-08 Debidatta Dwibedi , Yusuf Aytar , Jonathan Tompson , Pierre Sermanet , Andrew Zisserman

Contrastive learning has revolutionized self-supervised image representation learning field, and recently been adapted to video domain. One of the greatest advantages of contrastive learning is that it allows us to flexibly define powerful…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Haofei Kuang , Yi Zhu , Zhi Zhang , Xinyu Li , Joseph Tighe , Sören Schwertfeger , Cyrill Stachniss , Mu Li

Learning discriminative representations of unlabelled data is a challenging task. Contrastive self-supervised learning provides a framework to learn meaningful representations using learned notions of similarity measures from simple pretext…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Nicklas Boserup , Raghavendra Selvan

We describe a method for unpaired realistic depth synthesis that learns diverse variations from the real-world depth scans and ensures geometric consistency between the synthetic and synthesized depth. The synthesized realistic depth can…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yuefan Shen , Yanchao Yang , Youyi Zheng , C. Karen Liu , Leonidas Guibas

Learning a deep model from small data is yet an opening and challenging problem. We focus on one-shot classification by deep learning approach based on a small quantity of training samples. We proposed a novel deep learning approach named…

Machine Learning · Computer Science 2018-02-13 Chuanyun Xu , Yang Zhang , Xin Feng , YongXing Ge , Yihao Zhang , Jianwu Long

Masked image modelling (e.g., Masked AutoEncoder) and contrastive learning (e.g., Momentum Contrast) have shown impressive performance on unsupervised visual representation learning. This work presents Masked Contrastive Representation…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Yuchong Yao , Nandakishor Desai , Marimuthu Palaniswami

This study introduces the Multi-Scale Weight-Based Pairwise Coarsening and Contrastive Learning (MPCCL) model, a novel approach for attributed graph clustering that effectively bridges critical gaps in existing methods, including long-range…

Machine Learning · Computer Science 2025-07-29 Binxiong Li , Yuefei Wang , Binyu Zhao , Heyang Gao , Benhan Yang , Quanzhou Luo , Xue Li , Xu Xiang , Yujie Liu , Huijie Tang

Dense prediction tasks such as segmentation and detection of pathological entities hold crucial clinical value in computational pathology workflows. However, obtaining dense annotations on large cohorts is usually tedious and expensive.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Jingwei Zhang , Saarthak Kapse , Ke Ma , Prateek Prasanna , Maria Vakalopoulou , Joel Saltz , Dimitris Samaras

The learning objective of vision-language approach of CLIP does not effectively account for the noisy many-to-many correspondences found in web-harvested image captioning datasets, which contributes to its compute and data inefficiency. To…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Alex Andonian , Shixing Chen , Raffay Hamid

Contrastive learning is a well-established paradigm in representation learning. The standard framework of contrastive learning minimizes the distance between "similar" instances and maximizes the distance between dissimilar ones in the…

Machine Learning · Computer Science 2025-02-06 Naghmeh Ghanooni , Barbod Pajoum , Harshit Rawal , Sophie Fellenz , Vo Nguyen Le Duy , Marius Kloft

Clustering continues to be a significant and challenging task. Recent studies have demonstrated impressive results by applying clustering to feature representations acquired through self-supervised learning, particularly on small datasets.…

Machine Learning · Computer Science 2023-07-19 Fei Ding , Dan Zhang , Yin Yang , Venkat Krovi , Feng Luo