English
Related papers

Related papers: Stable Single-Pixel Contrastive Learning for Seman…

200 papers

Classical machine learners are designed only to tackle one task without capability of adopting new emerging tasks or classes whereas such capacity is more practical and human-like in the real world. To address this shortcoming, continual…

Machine Learning · Computer Science 2021-12-06 Xuejun Han , Yuhong Guo

In this paper, we propose a novel learning scheme for self-supervised video representation learning. Motivated by how humans understand videos, we propose to first learn general visual concepts then attend to discriminative local areas for…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Rui Qian , Shuangrui Ding , Xian Liu , Dahua Lin

Contrastive learning methods have significantly narrowed the gap between supervised and unsupervised learning on computer vision tasks. In this paper, we explore their application to geo-located datasets, e.g. remote sensing, where…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Kumar Ayush , Burak Uzkent , Chenlin Meng , Kumar Tanmay , Marshall Burke , David Lobell , Stefano Ermon

Recent self-supervised contrastive methods have been able to produce impressive transferable visual representations by learning to be invariant to different data augmentations. However, these methods implicitly assume a particular set of…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Tete Xiao , Xiaolong Wang , Alexei A. Efros , Trevor Darrell

Learning representations of stochastic processes is an emerging problem in machine learning with applications from meta-learning to physical object models to time series. Typical methods rely on exact reconstruction of observations, but…

Machine Learning · Statistics 2021-11-01 Emile Mathieu , Adam Foster , Yee Whye Teh

Unpaired image-to-image translation aims to find a mapping between the source domain and the target domain. To alleviate the problem of the lack of supervised labels for the source images, cycle-consistency based methods have been proposed…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Yupei Lin , Sen Zhang , Tianshui Chen , Yongyi Lu , Guangping Li , Yukai Shi

Contrastive representation learning has been recently proved to be very efficient for self-supervised training. These methods have been successfully used to train encoders which perform comparably to supervised training on downstream…

Machine Learning · Computer Science 2020-12-03 Ibrahim Merad , Yiyang Yu , Emmanuel Bacry , Stéphane Gaïffas

Finding semantic correspondences is a challenging problem. With the breakthrough of CNNs stronger features are available for tasks like classification but not specifically for the requirements of semantic matching. In the following we…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Nikolai Ufer , Kam To Lui , Katja Schwarz , Paul Warkentin , Björn Ommer

Self-supervised pretraining has been shown to yield powerful representations for transfer learning. These performance gains come at a large computational cost however, with state-of-the-art methods requiring an order of magnitude more…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Olivier J. Hénaff , Skanda Koppula , Jean-Baptiste Alayrac , Aaron van den Oord , Oriol Vinyals , João Carreira

Self-supervised methods have shown tremendous success in the field of computer vision, including applications in remote sensing and medical imaging. Most popular contrastive-loss based methods like SimCLR, MoCo, MoCo-v2 use multiple views…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Umangi Jain , Alex Wilson , Varun Gulshan

A prominent technique for self-supervised representation learning has been to contrast semantically similar and dissimilar pairs of samples. Without access to labels, dissimilar (negative) points are typically taken to be randomly sampled…

Machine Learning · Computer Science 2020-10-22 Ching-Yao Chuang , Joshua Robinson , Lin Yen-Chen , Antonio Torralba , Stefanie Jegelka

Learning good image representations that are beneficial to downstream tasks is a challenging task in computer vision. As such, a wide variety of self-supervised learning approaches have been proposed. Among them, contrastive learning has…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Yun Yue , Fangzhou Lin , Kazunori D Yamada , Ziming Zhang

Since the meaning representations are detailed and accurate annotations which express fine-grained sequence-level semtantics, it is usually hard to train discriminative semantic parsers via Maximum Likelihood Estimation (MLE) in an…

Computation and Language · Computer Science 2023-01-20 Shan Wu , Chunlei Xin , Bo Chen , Xianpei Han , Le Sun

State-of-the-art methods in generative representation learning yield semantic disentanglement, but typically do not consider physical scene parameters, such as geometry, albedo, lighting, or camera. We posit that inverse rendering, a way to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Tzofi Klinghoffer , Kushagra Tiwary , Arkadiusz Balata , Vivek Sharma , Ramesh Raskar

Self-supervised learning enables networks to learn discriminative features from massive data itself. Most state-of-the-art methods maximize the similarity between two augmentations of one image based on contrastive learning. By utilizing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-05 Jidong Ge , Yuxiang Liu , Jie Gui , Lanting Fang , Ming Lin , James Tin-Yau Kwok , LiGuo Huang , Bin Luo

Humans can recognize an image as an instance of a general concept, beyond simply identifying its objects and their relationships. In this paper, we investigate 1. The extent to which VLMs have this concept abstraction capacity, and 2.…

Computation and Language · Computer Science 2025-09-17 Omri Suissa , Muhiim Ali , Shengmai Chen , Yinuo Cai , Shekhar Pradhan

Self-supervised representation learning on image-text data facilitates crucial medical applications, such as image classification, visual grounding, and cross-modal retrieval. One common approach involves contrasting semantically similar…

Machine Learning · Computer Science 2023-08-15 Peiqi Wang , Yingcheng Liu , Ching-Yun Ko , William M. Wells , Seth Berkowitz , Steven Horng , Polina Golland

We introduce a novel framework for representation learning in head pose estimation (HPE). Previously such a scheme was difficult due to head pose data sparsity, making triplet sampling infeasible. Recent progress in 3D generative…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Ting-Ruen Wei , Haowei Liu , Huei-Chung Hu , Xuyang Wu , Yi Fang , Hsin-Tai Wu

In this work, we present a novel learning-based framework that combines the local accuracy of contrastive learning with the global consistency of geometric approaches, for robust non-rigid matching. We first observe that while contrastive…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Lei Li , Souhaib Attaiki , Maks Ovsjanikov

Self-supervised learning based on instance discrimination has shown remarkable progress. In particular, contrastive learning, which regards each image as well as its augmentations as an individual class and tries to distinguish them from…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Haohang Xu , Xiaopeng Zhang , Hao Li , Lingxi Xie , Hongkai Xiong , Qi Tian