English
Related papers

Related papers: Learning Cross-modal Contrastive Features for Vide…

200 papers

Contrastive learning is a highly effective method for learning representations from unlabeled data. Recent works show that contrastive representations can transfer across domains, leading to simple state-of-the-art algorithms for…

Machine Learning · Computer Science 2022-05-25 Jeff Z. HaoChen , Colin Wei , Ananya Kumar , Tengyu Ma

One central question for video action recognition is how to model motion. In this paper, we present hierarchical contrastive motion learning, a new self-supervised learning framework to extract effective motion representations from raw…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Xitong Yang , Xiaodong Yang , Sifei Liu , Deqing Sun , Larry Davis , Jan Kautz

Deep learning based object detectors require thousands of diversified bounding box and class annotated examples. Though image object detectors have shown rapid progress in recent years with the release of multiple large-scale static image…

Computer Vision and Pattern Recognition · Computer Science 2018-10-05 Avisek Lahiri , Charan Reddy , Prabir Kumar Biswas

Scene recognition is one of the basic problems in computer vision research with extensive applications in robotics. When available, depth images provide helpful geometric cues that complement the RGB texture information and help to identify…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Andrea Ferreri , Silvia Bucci , Tatiana Tommasi

Typically a classifier trained on a given dataset (source domain) does not performs well if it is tested on data acquired in a different setting (target domain). This is the problem that domain adaptation (DA) tries to overcome and, while…

Machine Learning · Computer Science 2018-08-01 Silvia Bucci , Mohammad Reza Loghmani , Barbara Caputo

First person action recognition is an increasingly researched topic because of the growing popularity of wearable cameras. This is bringing to light cross-domain issues that are yet to be addressed in this context. Indeed, the information…

Computer Vision and Pattern Recognition · Computer Science 2021-06-04 Mirco Planamente , Chiara Plizzari , Emanuele Alberti , Barbara Caputo

This paper introduces a novel approach named CrossVideo, which aims to enhance self-supervised cross-modal contrastive learning in the field of point cloud video understanding. Traditional supervised learning methods encounter limitations…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Yunze Liu , Changxi Chen , Zifan Wang , Li Yi

Robotic tasks such as manipulation with visual inputs require image features that capture the physical properties of the scene, e.g., the position and configuration of objects. Recently, it has been suggested to learn such features in an…

Machine Learning · Computer Science 2021-06-09 Carmel Rabinovitz , Niko Grupen , Aviv Tamar

Over the last few years, Unsupervised Domain Adaptation (UDA) techniques have acquired remarkable importance and popularity in computer vision. However, when compared to the extensive literature available for images, the field of videos is…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Victor G. Turrisi da Costa , Giacomo Zara , Paolo Rota , Thiago Oliveira-Santos , Nicu Sebe , Vittorio Murino , Elisa Ricci

Contrastive learning has revolutionized self-supervised image representation learning field, and recently been adapted to video domain. One of the greatest advantages of contrastive learning is that it allows us to flexibly define powerful…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Haofei Kuang , Yi Zhu , Zhi Zhang , Xinyu Li , Joseph Tighe , Sören Schwertfeger , Cyrill Stachniss , Mu Li

Unsupervised domain adaptation algorithms aim to transfer the knowledge learned from one domain to another (e.g., synthetic to real images). The adapted representations often do not capture pixel-level domain shifts that are crucial for…

Computer Vision and Pattern Recognition · Computer Science 2020-01-13 Yun-Chun Chen , Yen-Yu Lin , Ming-Hsuan Yang , Jia-Bin Huang

Fine-grained action recognition datasets exhibit environmental bias, where multiple video sequences are captured from a limited number of environments. Training a model in one environment and deploying in another results in a drop in…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Jonathan Munro , Dima Damen

As one of the fundamental functions of autonomous driving system, freespace detection aims at classifying each pixel of the image captured by the camera as drivable or non-drivable. Current works of freespace detection heavily rely on large…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Yuanbin Wang , Leyan Zhu , Shaofei Huang , Tianrui Hui , Xiaojie Li , Fei Wang , Si Liu

Recently, considerable effort has been devoted to deep domain adaptation in computer vision and machine learning communities. However, most of existing work only concentrates on learning shared feature representation by minimizing the…

Machine Learning · Computer Science 2019-04-24 Chao Chen , Zhihong Chen , Boyuan Jiang , Xinyu Jin

Spatio-temporal action localization is an important problem in computer vision that involves detecting where and when activities occur, and therefore requires modeling of both spatial and temporal features. This problem is typically…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Nakul Agarwal , Yi-Ting Chen , Behzad Dariush , Ming-Hsuan Yang

We present a novel approach to perform the unsupervised domain adaptation for object detection through forward-backward cyclic (FBC) training. Recent adversarial training based domain adaptation methods have shown their effectiveness on…

Computer Vision and Pattern Recognition · Computer Science 2020-02-04 Siqi Yang , Lin Wu , Arnold Wiliem , Brian C. Lovell

Learning representations of images that are invariant to sensitive or unwanted attributes is important for many tasks including bias removal and cross domain retrieval. Here, our objective is to learn representations that are invariant to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Jonathan Kahana , Yedid Hoshen

Cross-domain offline reinforcement learning leverages source domain data with diverse transition dynamics to alleviate the data requirement for the target domain. However, simply merging the data of two domains leads to performance…

Machine Learning · Computer Science 2024-05-13 Xiaoyu Wen , Chenjia Bai , Kang Xu , Xudong Yu , Yang Zhang , Xuelong Li , Zhen Wang

Semantic segmentation models struggle to generalize in the presence of domain shift. In this paper, we introduce contrastive learning for feature alignment in cross-domain adaptation. We assemble both in-domain contrastive pairs and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Feihu Zhang , Vladlen Koltun , Philip Torr , René Ranftl , Stephan R. Richter

Multimodal learning from document data has achieved great success lately as it allows to pre-train semantically meaningful features as a prior into a learnable downstream task. In this paper, we approach the document classification problem…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Souhail Bakkali , Zuheng Ming , Mickael Coustaty , Marçal Rusiñol , Oriol Ramos Terrades