English
Related papers

Related papers: Learning Object-Centric Video Models by Contrastin…

200 papers

Contrastive learning has emerged as a competitive pretraining method for object detection. Despite this progress, there has been minimal investigation into the robustness of contrastively pretrained detectors when faced with domain shifts.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Kyle Buettner , Adriana Kovashka

A robot performing multi-object grasping needs to sense the number of objects in the hand after grasping. The count plays an important role in determining the robot's next move and the outcome and efficiency of the whole pick-place process.…

Robotics · Computer Science 2024-04-11 Francis Tsow , Tianze Chen , Yu Sun

Unsupervised object-centric learning aims to represent the modular, compositional, and causal structure of a scene as a set of object representations and thereby promises to resolve many critical limitations of traditional single-vector…

Computer Vision and Pattern Recognition · Computer Science 2022-05-30 Gautam Singh , Yi-Fu Wu , Sungjin Ahn

Contrastive learning has achieved great success in self-supervised visual representation learning, but existing approaches mostly ignored spatial information which is often crucial for visual representation. This paper presents…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Xinyue Huo , Lingxi Xie , Longhui Wei , Xiaopeng Zhang , Hao Li , Zijie Yang , Wengang Zhou , Houqiang Li , Qi Tian

Contrastive learning produces coherent semantic feature embeddings by encouraging positive samples to cluster closely while separating negative samples. However, existing contrastive learning methods lack principled guarantees on coverage…

Machine Learning · Computer Science 2026-03-30 Yahya Alkhatib , Wee Peng Tay

Neural network based speech recognition systems suffer from performance degradation due to accented speech, especially unfamiliar accents. In this paper, we study the supervised contrastive learning framework for accented speech…

Sound · Computer Science 2021-07-05 Tao Han , Hantao Huang , Ziang Yang , Wei Han

Self-supervised learning enables networks to learn discriminative features from massive data itself. Most state-of-the-art methods maximize the similarity between two augmentations of one image based on contrastive learning. By utilizing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-05 Jidong Ge , Yuxiang Liu , Jie Gui , Lanting Fang , Ming Lin , James Tin-Yau Kwok , LiGuo Huang , Bin Luo

Slot-based object-centric learning represents an image as a set of latent slots with a decoder that combines them into an image or features. The decoder specifies how slots are combined into an output, but the slot set is typically fixed:…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Christos Chatzisavvas , Panagiotis Rigas , George Ioannakis , Vassilis Katsouros , Nikolaos Mitianoudis

The dominant paradigm for learning video-text representations -- noise contrastive learning -- increases the similarity of the representations of pairs of samples that are known to be related, such as text and video from the same sample,…

Computer Vision and Pattern Recognition · Computer Science 2021-01-15 Mandela Patrick , Po-Yao Huang , Yuki Asano , Florian Metze , Alexander Hauptmann , João Henriques , Andrea Vedaldi

Vision-language models (VLMs) mainly rely on contrastive training to learn general-purpose representations of images and captions. We focus on the situation when one image is associated with several captions, each caption containing both…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Maurits Bleeker , Mariya Hendriksen , Andrew Yates , Maarten de Rijke

This paper presents Contrastive Reconstruction, ConRec - a self-supervised learning algorithm that obtains image representations by jointly optimizing a contrastive and a self-reconstruction loss. We showcase that state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Jonas Dippel , Steffen Vogler , Johannes Höhne

As a pioneering work, PointContrast conducts unsupervised 3D representation learning via leveraging contrastive learning over raw RGB-D frames and proves its effectiveness on various downstream tasks. However, the trend of large-scale…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Xiaoyang Wu , Xin Wen , Xihui Liu , Hengshuang Zhao

Contrastive learning has revolutionized the field of computer vision, learning rich representations from unlabeled data, which generalize well to diverse vision tasks. Consequently, it has become increasingly important to explain these…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Fawaz Sammani , Boris Joukovsky , Nikos Deligiannis

We present a self-supervised learning (SSL) method suitable for semi-global tasks such as object detection and semantic segmentation. We enforce local consistency between self-learned features, representing corresponding image locations of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Ashraful Islam , Ben Lundell , Harpreet Sawhney , Sudipta Sinha , Peter Morales , Richard J. Radke

Object-centric learning (OCL) extracts the representation of objects with slots, offering an exceptional blend of flexibility and interpretability for abstracting low-level perceptual features. A widely adopted method within OCL is slot…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Ke Fan , Zechen Bai , Tianjun Xiao , Tong He , Max Horn , Yanwei Fu , Francesco Locatello , Zheng Zhang

We introduce the task of weakly supervised learning for detecting human and object interactions in videos. Our task poses unique challenges as a system does not know what types of human-object interactions are present in a video or the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-08 Shuang Li , Yilun Du , Antonio Torralba , Josef Sivic , Bryan Russell

Distance-based anomaly detection methods rely on compact in-distribution (ID) embeddings that are well separated from anomalies. However, conventional contrastive learning strategies often struggle to achieve this balance, either promoting…

Machine Learning · Computer Science 2026-02-02 Willian T. Lunardi , Abdulrahman Banabila , Dania Herzalla , Martin Andreoni

Recently, self-supervised vision transformers have attracted unprecedented attention for their impressive representation learning ability. However, the dominant method, contrastive learning, mainly relies on an instance discrimination…

Computer Vision and Pattern Recognition · Computer Science 2022-01-20 Luya Wang , Feng Liang , Yangguang Li , Honggang Zhang , Wanli Ouyang , Jing Shao

Trained classification models can unintentionally lead to biased representations and predictions, which can reinforce societal preconceptions and stereotypes. Existing debiasing methods for classification models, such as adversarial…

Computation and Language · Computer Science 2021-09-23 Aili Shen , Xudong Han , Trevor Cohn , Timothy Baldwin , Lea Frermann

Keypoint detection and description play a central role in computer vision. Most existing methods are in the form of scene-level prediction, without returning the object classes of different keypoints. In this paper, we propose the…

Computer Vision and Pattern Recognition · Computer Science 2022-02-04 Chengliang Zhong , Chao Yang , Jinshan Qi , Fuchun Sun , Huaping Liu , Xiaodong Mu , Wenbing Huang