English
Related papers

Related papers: Learn2Augment: Learning to Composite Videos for Da…

200 papers

Video motion magnification is a technique to capture and amplify subtle motion in a video that is invisible to the naked eye. The deep learning-based prior work successfully demonstrates the modelling of the motion magnification problem…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Hyunwoo Ha , Oh Hyun-Bin , Kim Jun-Seong , Kwon Byung-Ki , Kim Sung-Bin , Linh-Tam Tran , Ji-Yun Kim , Sung-Ho Bae , Tae-Hyun Oh

Action recognition is computationally expensive. In this paper, we address the problem of frame selection to improve the accuracy of action recognition. In particular, we show that selecting good frames helps in action recognition…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Shreyank N Gowda , Marcus Rohrbach , Laura Sevilla-Lara

Motion is a salient cue to recognize actions in video. Modern action recognition models leverage motion information either explicitly by using optical flow as input or implicitly by means of 3D convolutional filters that simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Heng Wang , Du Tran , Lorenzo Torresani , Matt Feiszli

Visual recognition in a low-data regime is challenging and often prone to overfitting. To mitigate this issue, several data augmentation strategies have been proposed. However, standard transformations, e.g., rotation, cropping, and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Aniket Roy , Anshul Shah , Ketul Shah , Anirban Roy , Rama Chellappa

We study self-supervised video representation learning, which is a challenging task due to 1) lack of labels for explicit supervision; 2) unstructured and noisy visual information. Existing methods mainly use contrastive loss with video…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Deng Huang , Wenhao Wu , Weiwen Hu , Xu Liu , Dongliang He , Zhihua Wu , Xiangmiao Wu , Mingkui Tan , Errui Ding

Considering audio and image data as having quantum nature (data are represented by density matrices), we achieved better results on training architectures such as 3-layer stacked LSTM and HMM by mixing training samples using superposition…

Machine Learning · Computer Science 2019-10-25 Akilesh Sivaswamy , Evgeny Pavlovskiy

Data augmentation is becoming essential for improving regression performance in critical applications including manufacturing, climate prediction, and finance. Existing techniques for data augmentation largely focus on classification tasks…

Machine Learning · Computer Science 2022-08-18 Seong-Hyeon Hwang , Steven Euijong Whang

This paper introduces an unsupervised framework to extract semantically rich features for video representation. Inspired by how the human visual system groups objects based on motion cues, we propose a deep convolutional neural network that…

Computer Vision and Pattern Recognition · Computer Science 2017-07-18 Xunyu Lin , Victor Campos , Xavier Giro-i-Nieto , Jordi Torres , Cristian Canton Ferrer

Deep Learning has seen an unprecedented increase in vision applications since the publication of large-scale object recognition datasets and introduction of scalable compute hardware. State-of-the-art methods for most vision tasks for…

Computer Vision and Pattern Recognition · Computer Science 2020-04-30 Nikita Jaipuria , Xianling Zhang , Rohan Bhasin , Mayar Arafa , Punarjay Chakravarty , Shubham Shrivastava , Sagar Manglani , Vidya N. Murali

Data augmentation (DA) has been widely investigated to facilitate model optimization in many tasks. However, in most cases, data augmentation is randomly performed for each training sample with a certain probability, which might incur…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Shiqi Lin , Zhizheng Zhang , Xin Li , Wenjun Zeng , Zhibo Chen

Data augmentation methods have been shown to be a fundamental technique to improve generalization in tasks such as image, text and audio classification. Recently, automated augmentation methods have led to further improvements on image…

Machine Learning · Computer Science 2021-02-17 Elizabeth Fons , Paula Dawson , Xiao-jun Zeng , John Keane , Alexandros Iosifidis

Deep reinforcement learning (RL) agents often fail to generalize to unseen scenarios, even when they are trained on many instances of semantically similar environments. Data augmentation has recently been shown to improve the sample…

Machine Learning · Computer Science 2021-02-23 Roberta Raileanu , Max Goldstein , Denis Yarats , Ilya Kostrikov , Rob Fergus

While deep neural networks have achieved remarkable performance, data augmentation has emerged as a crucial strategy to mitigate overfitting and enhance network performance. These techniques hold particular significance in industrial…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Hyungmin Kim , Donghun Kim , Pyunghwan Ahn , Sungho Suh , Hansang Cho , Junmo Kim

Data augmentation has been highly effective in narrowing the data gap and reducing the cost for human annotation, especially for tasks where ground truth labels are difficult and expensive to acquire. In face recognition, large pose and…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Yifan Xing , Yuanjun Xiong , Wei Xia

Grounding-based vision and language models have been successfully applied to low-level vision tasks, aiming to precisely locate objects referred in captions. The effectiveness of grounding representation learning heavily relies on the scale…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Jingru Yi , Burak Uzkent , Oana Ignat , Zili Li , Amanmeet Garg , Xiang Yu , Linda Liu

Deep learning models have a large number of freeparameters that need to be calculated by effective trainingof the models on a great deal of training data to improvetheir generalization performance. However, data obtaining andlabeling is…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Benlin Hu , Cheng Lei , Dong Wang , Shu Zhang , Zhenyu Chen

We propose a self-supervised learning method to jointly reason about spatial and temporal context for video recognition. Recent self-supervised approaches have used spatial context [9, 34] as well as temporal coherency [32] but a…

Computer Vision and Pattern Recognition · Computer Science 2018-08-24 Unaiza Ahsan , Rishi Madhok , Irfan Essa

In the face of the video data deluge, today's expensive clip-level classifiers are increasingly impractical. We propose a framework for efficient action recognition in untrimmed video that uses audio as a preview mechanism to eliminate both…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Ruohan Gao , Tae-Hyun Oh , Kristen Grauman , Lorenzo Torresani

Visual content has become the primary source of information, as evident in the billions of images and videos, shared and uploaded on the Internet every single day. This has led to an increase in alterations in images and videos to make them…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Prabhat Kumar , Mayank Vatsa , Richa Singh

Current fully-supervised video datasets consist of only a few hundred thousand videos and fewer than a thousand domain-specific labels. This hinders the progress towards advanced video architectures. This paper presents an in-depth study of…

Computer Vision and Pattern Recognition · Computer Science 2019-05-03 Deepti Ghadiyaram , Matt Feiszli , Du Tran , Xueting Yan , Heng Wang , Dhruv Mahajan