English
Related papers

Related papers: Frequency Selective Augmentation for Video Represe…

200 papers

Deep neural networks have achieved remarkable success in computer vision tasks. Existing neural networks mainly operate in the spatial domain with fixed input sizes. For practical applications, images are usually large and have to be…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Kai Xu , Minghai Qin , Fei Sun , Yuhao Wang , Yen-Kuang Chen , Fengbo Ren

We propose a method for generating a temporally remapped video that matches the desired target duration while maximally preserving natural video dynamics. Our approach trains a neural network through self-supervision to recognize and…

Computer Vision and Pattern Recognition · Computer Science 2022-05-12 Simon Jenni , Markus Woodson , Fabian Caba Heilbron

Semantic image segmentation aims to obtain object labels with precise boundaries, which usually suffers from overfitting. Recently, various data augmentation strategies like regional dropout and mix strategies have been proposed to address…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Jiawei Zhang , Yanchun Zhang , Xiaowei Xu

We present a self-supervised approach for learning video representations using temporal video alignment as a pretext task, while exploiting both frame-level and video-level information. We leverage a novel combination of temporal alignment…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Sanjay Haresh , Sateesh Kumar , Huseyin Coskun , Shahram Najam Syed , Andrey Konin , Muhammad Zeeshan Zia , Quoc-Huy Tran

Camouflaged object detection has attracted a lot of attention in computer vision. The main challenge lies in the high degree of similarity between camouflaged objects and their surroundings in the spatial domain, making identification…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Yanguang Sun , Chunyan Xu , Jian Yang , Hanyu Xuan , Lei Luo

Unsupervised node representations learnt using contrastive learning-based methods have shown good performance on downstream tasks. However, these methods rely on augmentations that mimic low-pass filters, limiting their performance on tasks…

Machine Learning · Computer Science 2023-12-05 Chanakya Ekbote , Ajinkya Pankaj Deshpande , Arun Iyer , Ramakrishna Bairi , Sundararajan Sellamanickam

Transformers, particularly Vision Transformers (ViTs), have achieved state-of-the-art performance in large-scale image classification. However, they often require large amounts of data and can exhibit biases, such as center or size bias,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Tobias Christian Nauen , Brian Moser , Federico Raue , Stanislav Frolov , Andreas Dengel

We present a large-scale study on unsupervised spatiotemporal representation learning from videos. With a unified perspective on four recent image-based frameworks, we study a simple objective that can easily generalize all these methods to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Christoph Feichtenhofer , Haoqi Fan , Bo Xiong , Ross Girshick , Kaiming He

Existing video recognition algorithms always conduct different training pipelines for inputs with different frame numbers, which requires repetitive training operations and multiplying storage costs. If we evaluate the model using other…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yitian Zhang , Yue Bai , Chang Liu , Huan Wang , Sheng Li , Yun Fu

We study self-supervised video representation learning, which is a challenging task due to 1) lack of labels for explicit supervision; 2) unstructured and noisy visual information. Existing methods mainly use contrastive loss with video…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Deng Huang , Wenhao Wu , Weiwen Hu , Xu Liu , Dongliang He , Zhihua Wu , Xiangmiao Wu , Mingkui Tan , Errui Ding

This work aims to improve unsupervised audio-visual pre-training. Inspired by the efficacy of data augmentation in visual contrastive learning, we propose a novel speed co-augmentation method that randomly changes the playback speeds of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Jiangliu Wang , Jianbo Jiao , Yibing Song , Stephen James , Zhan Tong , Chongjian Ge , Pieter Abbeel , Yun-hui Liu

We propose a novel framework for video inpainting by adopting an internal learning strategy. Unlike previous methods that use optical flow for cross-frame context propagation to inpaint unknown regions, we show that this can be achieved…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Hao Ouyang , Tengfei Wang , Qifeng Chen

Existing person video generation methods either lack the flexibility in controlling both the appearance and motion, or fail to preserve detailed appearance and temporal consistency. In this paper, we tackle the problem of motion transfer…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Kun Cheng , Hao-Zhi Huang , Chun Yuan , Lingyiqing Zhou , Wei Liu

Self-supervised prediction is a powerful mechanism to learn representations that capture the underlying structure of the data. Despite recent progress, the self-supervised video prediction task is still challenging. One of the critical…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Hafez Farazi , Sven Behnke

This paper introduces a novel self-supervised method that leverages incoherence detection for video representation learning. It roots from the observation that visual systems of human beings can easily identify video incoherence based on…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Haozhi Cao , Yuecong Xu , Jianfei Yang , Kezhi Mao , Lihua Xie , Jianxiong Yin , Simon See

Temporal cues in videos provide important information for recognizing actions accurately. However, temporal-discriminative features can hardly be extracted without using an annotated large-scale video action dataset for training. This paper…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Jinpeng Wang , Yiqi Lin , Andy J. Ma , Pong C. Yuen

Deep neural networks have become popular in many supervised learning tasks, but they may suffer from overfitting when the training dataset is limited. To mitigate this, many researchers use data augmentation, which is a widely used and…

Machine Learning · Computer Science 2022-05-27 Jianhan Wu , Shijing Si , Jianzong Wang , Jing Xiao

Human beings can recognize new objects with only a few labeled examples, however, few-shot learning remains a challenging problem for machine learning systems. Most previous algorithms in few-shot learning only utilize spatial information…

Computer Vision and Pattern Recognition · Computer Science 2021-07-08 Xiangyu Chen , Guanghui Wang

This research addresses the challenge of developing a universal deepfake detector that can effectively identify unseen deepfake images despite limited training data. Existing frequency-based paradigms have relied on frequency-level…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Chuangchuang Tan , Yao Zhao , Shikui Wei , Guanghua Gu , Ping Liu , Yunchao Wei

Data augmentation methods enrich datasets with augmented data to improve the performance of neural networks. Recently, automated data augmentation methods have emerged, which automatically design augmentation strategies. Existing work…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Misgana Negassi , Diane Wagner , Alexander Reiterer