English
Related papers

Related papers: Suppressing Static Visual Cues via Normalizing Flo…

200 papers

In video action recognition, shortcut static features can interfere with the learning of motion features, resulting in poor out-of-distribution (OOD) generalization. The video background is clearly a source of static bias, but the video…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Haoxin Li , Yuan Liu , Hanwang Zhang , Boyang Li

Natural videos provide rich visual contents for self-supervised learning. Yet most existing approaches for learning spatio-temporal representations rely on manually trimmed videos, leading to limited diversity in visual patterns and limited…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Zhiwu Qing , Shiwei Zhang , Ziyuan Huang , Yi Xu , Xiang Wang , Mingqian Tang , Changxin Gao , Rong Jin , Nong Sang

Contrastive representation learning has proven to be an effective self-supervised learning method for images and videos. Most successful approaches are based on Noise Contrastive Estimation (NCE) and use different views of an instance as…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Julien Denize , Jaonary Rabarisoa , Astrid Orcesi , Romain Hérault

The computer vision and image processing research community has been involved in standardizing video data communications for the past many decades, leading to standards such as AVC, HEVC, VVC, AV1, AV2, etc. However, recent groundbreaking…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Lakshya Gupta , Imran N. Junejo

Recently, self-supervised representation learning gives further development in multimedia technology. Most existing self-supervised learning methods are applicable to packaged data. However, when it comes to streamed data, they are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Zhiwei Lin , Yongtao Wang , Hongxiang Lin

A key challenge in self-supervised video representation learning is how to effectively capture motion information besides context bias. While most existing works implicitly achieve this with video-specific pretext tasks (e.g., predicting…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Lianghua Huang , Yu Liu , Bin Wang , Pan Pan , Yinghui Xu , Rong Jin

Contrastive learning has shown promising potential in self-supervised spatio-temporal representation learning. Most works naively sample different clips to construct positive and negative pairs. However, we observe that this formulation…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Shuangrui Ding , Rui Qian , Hongkai Xiong

Robust frame-wise embeddings are essential to perform video analysis and understanding tasks. We present a self-supervised method for representation learning based on aligning temporal video sequences. Our framework uses a transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Keyne Oei , Amr Gomaa , Anna Maria Feit , João Belo

Temporal cues in videos provide important information for recognizing actions accurately. However, temporal-discriminative features can hardly be extracted without using an annotated large-scale video action dataset for training. This paper…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Jinpeng Wang , Yiqi Lin , Andy J. Ma , Pong C. Yuen

We propose a supervised contrastive learning framework for video representation learning that leverages temporally global context. We introduce a video to image aggregation strategy that spatially arranges multiple frames from each video…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Shaif Chowdhury , Mushfika Rahman , Greg Hamerly

Surface normal estimation serves as a cornerstone for a spectrum of computer vision applications. While numerous efforts have been devoted to static image scenarios, ensuring temporal coherence in video-based normal estimation remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Yanrui Bin , Wenbo Hu , Haoyuan Wang , Xinya Chen , Bing Wang

The use of latent variable models has shown to be a powerful tool for modeling probability distributions over sequences. In this paper, we introduce a new variational model that extends the recurrent network in two ways for the task of…

Computer Vision and Pattern Recognition · Computer Science 2020-12-14 Haziq Razali , Basura Fernando

We propose a general framework for self-supervised learning of transferable visual representations based on Video-Induced Visual Invariances (VIVI). We consider the implicit hierarchy present in the videos and make use of (i) frame-level…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Michael Tschannen , Josip Djolonga , Marvin Ritter , Aravindh Mahendran , Xiaohua Zhai , Neil Houlsby , Sylvain Gelly , Mario Lucic

The sampling of probability distributions specified up to a normalization constant is an important problem in both machine learning and statistical mechanics. While classical stochastic sampling methods such as Markov Chain Monte Carlo…

Machine Learning · Statistics 2020-10-27 Hao Wu , Jonas Köhler , Frank Noé

Disentangled representation learning aims to capture the underlying explanatory factors of observed data, enabling a principled understanding of the data-generating process. Recent advances in generative modeling have introduced new…

Machine Learning · Computer Science 2026-05-12 Jinjin Chi , Taoping Liu , Mengtao Yin , Ximing Li , Yongcheng Jing , Jialie Shen , Leszek Rutkowski , Dacheng Tao

Recent single image unsupervised representation learning techniques show remarkable success on a variety of tasks. The basic principle in these works is instance discrimination: learning to differentiate between two augmented versions of…

Computer Vision and Pattern Recognition · Computer Science 2020-05-08 Daniel Gordon , Kiana Ehsani , Dieter Fox , Ali Farhadi

Large Vision-Language Models (VLMs) have been extended to understand both images and videos. Visual token compression is leveraged to reduce the considerable token length of visual inputs. To meet the needs of different tasks, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Chenyu Yang , Xuan Dong , Xizhou Zhu , Weijie Su , Jiahao Wang , Hao Tian , Zhe Chen , Wenhai Wang , Lewei Lu , Jifeng Dai

One of the fundamental representation learning tasks is unsupervised sequential disentanglement, where latent codes of inputs are decomposed to a single static factor and a sequence of dynamic factors. To extract this latent information,…

Machine Learning · Computer Science 2025-10-09 Nimrod Berman , Ilan Naiman , Idan Arbiv , Gal Fadlon , Omri Azencot

Conventional video compression approaches use the predictive coding architecture and encode the corresponding motion information and residual information. In this paper, taking advantage of both classical architecture in the conventional…

Image and Video Processing · Electrical Eng. & Systems 2019-04-09 Guo Lu , Wanli Ouyang , Dong Xu , Xiaoyun Zhang , Chunlei Cai , Zhiyong Gao

Contrastive learning applied to self-supervised representation learning has seen a resurgence in deep models. In this paper, we find that existing contrastive learning based solutions for self-supervised video recognition focus on…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Lin Zhang , Qi She , Zhengyang Shen , Changhu Wang