English
Related papers

Related papers: Learning Cross-modal Contrastive Features for Vide…

200 papers

Contrastive learning is a powerful way of learning multimodal representations across various domains such as image-caption retrieval and audio-visual representation learning. In this work, we investigate if these findings generalize to the…

Information Retrieval · Computer Science 2023-09-04 Karel Veldkamp , Mariya Hendriksen , Zoltán Szlávik , Alexander Keijser

Recently, cross domain transfer has been applied for unsupervised image restoration tasks. However, directly applying existing frameworks would lead to domain-shift problems in translated images due to lack of effective supervision.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Wenchao Du , Hu Chen , Hongyu Yang

Given a gallery of uncaptioned video sequences, this paper considers the task of retrieving videos based on their relevance to an unseen text query. To compensate for the lack of annotations, we rely instead on a related video gallery…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Jonathan Munro , Michael Wray , Diane Larlus , Gabriela Csurka , Dima Damen

We propose a self-supervised learning approach for videos that learns representations of both the RGB frames and the accompanying audio without human supervision. In contrast to images that capture the static scene appearance, videos also…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Simon Jenni , Alexander Black , John Collomosse

Foundational game-image encoders often overfit to game-specific visual styles, undermining performance on downstream tasks when applied to new games. We present a method that combines contrastive learning and domain-adversarial training to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Dylan Kline

Deep learning has raised hopes and expectations as a general solution for many applications; indeed it has proven effective, but it also showed a strong dependence on large quantities of data. Luckily, it has been shown that, even when data…

Computer Vision and Pattern Recognition · Computer Science 2019-02-14 Fabio Maria Carlucci

Domain Adaptation aiming to learn a transferable feature between different but related domains has been well investigated and has shown excellent empirical performances. Previous works mainly focused on matching the marginal feature…

Machine Learning · Computer Science 2020-05-26 Fan Zhou , Changjian Shui , Bincheng Huang , Boyu Wang , Brahim Chaib-draa

We present a novel unsupervised domain adaptation method for semantic segmentation that generalizes a model trained with source images and corresponding ground-truth labels to a target domain. A key to domain adaptive semantic segmentation…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Geon Lee , Chanho Eom , Wonkyung Lee , Hyekang Park , Bumsub Ham

The aim of this paper is to give an overview of domain adaptation and transfer learning with a specific view on visual applications. After a general motivation, we first position domain adaptation in the larger transfer learning problem.…

Computer Vision and Pattern Recognition · Computer Science 2017-03-31 Gabriela Csurka

We consider unsupervised domain adaptation (UDA), where labeled data from a source domain (e.g., photographs) and unlabeled data from a target domain (e.g., sketches) are used to learn a classifier for the target domain. Conventional UDA…

Machine Learning · Computer Science 2022-12-05 Kendrick Shen , Robbie Jones , Ananya Kumar , Sang Michael Xie , Jeff Z. HaoChen , Tengyu Ma , Percy Liang

Although action recognition has achieved impressive results over recent years, both collection and annotation of video training data are still time-consuming and cost intensive. Therefore, image-to-video adaptation has been proposed to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Wei Lin , Anna Kukleva , Kunyang Sun , Horst Possegger , Hilde Kuehne , Horst Bischof

Event-based cameras offer reliable measurements for preforming computer vision tasks in high-dynamic range environments and during fast motion maneuvers. However, adopting deep learning in event-based vision faces the challenge of annotated…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Dayuan Jian , Mohammad Rostami

With the advent of media streaming, video action recognition has become progressively important for various applications, yet at the high expense of requiring large-scale data labelling. To overcome the problem of expensive data labelling,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Zhuoxiao Chen , Yadan Luo , Mahsa Baktashmotlagh

Semantic segmentation requires a lot of training data, which necessitates costly annotation. There have been many studies on unsupervised domain adaptation (UDA) from one domain to another, e.g., from computer graphics to real images.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Zhijie Wang , Xing Liu , Masanori Suganuma , Takayuki Okatani

In this paper, we tackle the domain adaptive object detection problem, where the main challenge lies in significant domain gaps between source and target domains. Previous work seeks to plainly align image-level and instance-level shifts to…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Chang-Dong Xu , Xing-Ran Zhao , Xin Jin , Xiu-Shen Wei

Cross-modal MRI segmentation is of great value for computer-aided medical diagnosis, enabling flexible data acquisition and model generalization. However, most existing methods have difficulty in handling local variations in domain shift…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Bingnan Li , Zhitong Gao , Xuming He

Learning generalizable visual representations across different embodied environments is essential for effective robotic manipulation in real-world scenarios. However, the limited scale and diversity of robot demonstration data pose a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Jiaming Zhou , Teli Ma , Kun-Yu Lin , Zifan Wang , Ronghe Qiu , Junwei Liang

This paper focuses on self-supervised video representation learning. Most existing approaches follow the contrastive learning pipeline to construct positive and negative pairs by sampling different clips. However, this formulation tends to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Rui Qian , Weiyao Lin , John See , Dian Li

Domain-invariant representation learning is a powerful method for domain generalization. Previous approaches face challenges such as high computational demands, training instability, and limited effectiveness with high-dimensional data,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Yuheng Xu , Taiping Zhang

Visual domain gaps often impact object detection performance. Image-to-image translation can mitigate this effect, where contrastive approaches enable learning of the image-to-image mapping under unsupervised regimes. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Danai Triantafyllidou , Sarah Parisot , Ales Leonardis , Steven McDonagh