English
Related papers

Related papers: Improve Video Representation with Temporal Adversa…

200 papers

Computer vision models normally witness degraded performance when deployed in real-world scenarios, due to unexpected changes in inputs that were not accounted for during training. Data augmentation is commonly used to address this issue,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Puru Vaish , Shunxin Wang , Nicola Strisciuglio

Spatial convolutions are extensively used in numerous deep video models. It fundamentally assumes spatio-temporal invariance, i.e., using shared weights for every location in different frames. This work presents Temporally-Adaptive…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Ziyuan Huang , Shiwei Zhang , Liang Pan , Zhiwu Qing , Yingya Zhang , Ziwei Liu , Marcelo H. Ang

Self-attention learns pairwise interactions to model long-range dependencies, yielding great improvements for video action recognition. In this paper, we seek a deeper understanding of self-attention for temporal modeling in videos. We…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Bo He , Xitong Yang , Zuxuan Wu , Hao Chen , Ser-Nam Lim , Abhinav Shrivastava

Although Deep Neural Networks (DNNs) achieve excellent performance on many real-world tasks, they are highly vulnerable to adversarial attacks. A leading defense against such attacks is adversarial training, a technique in which a DNN is…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Gilad Cohen , Raja Giryes

Despite recent advances in video action recognition achieving strong performance on existing benchmarks, these models often lack robustness when faced with natural distribution shifts between training and test data. We propose two novel…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Kiyoon Kim , Shreyank N Gowda , Panagiotis Eustratiadis , Antreas Antoniou , Robert B Fisher

Generalizing to unseen image domains is a challenging problem primarily due to the lack of diverse training data, inaccessible target data, and the large domain shift that may exist in many real-world settings. As such data augmentation is…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Sheng Cheng , Tejas Gokhale , Yezhou Yang

Virtual Adversarial Training has recently seen a lot of success in semi-supervised learning, as well as unsupervised Domain Adaptation. However, so far it has been used on input samples in the pixel space, whereas we propose to apply it…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Artjoms Gorpincenko , Geoffrey French , Michal Mackiewicz

The goal of this paper is to enhance face recognition performance by augmenting head poses during the testing phase. Existing methods often rely on training on frontalised images or learning pose-invariant representations, yet both…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Jaemin Jung , Youngjoon Jang , Joon Son Chung

Adversarial training is a method for enhancing neural networks to improve the robustness against adversarial examples. Besides the security concerns of potential adversarial examples, adversarial training can also improve the generalization…

Machine Learning · Computer Science 2022-12-21 Zhiyuan Zhang , Wei Li , Ruihan Bao , Keiko Harimoto , Yunfang Wu , Xu Sun

Data augmentation is a major component of many machine learning methods with state-of-the-art performance. Common augmentation strategies work by drawing random samples from a space of transformations. Unfortunately, such sampling…

Machine Learning · Computer Science 2020-11-06 Calvin Luo , Hossein Mobahi , Samy Bengio

Deep neural networks are vulnerable to adversarial examples that exhibit transferability across various models. Numerous approaches are proposed to enhance the transferability of adversarial examples, including advanced optimization, data…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Zhaoyu Chen , Haijing Guo , Kaixun Jiang , Jiyuan Fu , Xinyu Zhou , Dingkang Yang , Hao Tang , Bo Li , Wenqiang Zhang

Temporal Action Detection (TAD) is an essential and challenging topic in video understanding, aiming to localize the temporal segments containing human action instances and predict the action categories. The previous works greatly rely upon…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Jiannan Wu , Peize Sun , Shoufa Chen , Jiewen Yang , Zihao Qi , Lan Ma , Ping Luo

Recent video reasoning models have shown strong results on temporal and multimodal understanding, yet they depend on large-scale supervised data and multi-stage training pipelines, making them costly to train and difficult to adapt to new…

Convolutional Neural Networks (CNNs) can play a key role in Medical Image Analysis under large-scale annotated datasets. However, preparing such massive dataset is demanding. In this context, Generative Adversarial Networks (GANs) can…

Image and Video Processing · Electrical Eng. & Systems 2021-06-04 Changhee Han

Temporal sentence grounding in videos (TSGV) faces challenges due to public TSGV datasets containing significant temporal biases, which are attributed to the uneven temporal distributions of target moments. Existing methods generate…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Junlong Ren , Gangjian Zhang , Haifeng Sun , Hao Wang

Motivated by the previous success of Two-Dimensional Convolutional Neural Network (2D CNN) on image recognition, researchers endeavor to leverage it to characterize videos. However, one limitation of applying 2D CNN to analyze videos is…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Junwu Weng , Donghao Luo , Yabiao Wang , Ying Tai , Chengjie Wang , Jilin Li , Feiyue Huang , Xudong Jiang , Junsong Yuan

Generative adversarial networks (GANs) have demonstrated impressive image generation quality and semantic editing capability of real images, e.g., changing object classes, modifying attributes, or transferring styles. However, applying…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Yiran Xu , Badour AlBahar , Jia-Bin Huang

Image retrieval is a crucial research topic in computer vision, with broad application prospects ranging from online product searches to security surveillance systems. In recent years, the accuracy and efficiency of image retrieval have…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Kim Jinwoo

We introduce Tangent Attention Fine-Tuning (TAFT), a method for fine-tuning linearized transformers obtained by computing a First-order Taylor Expansion around a pre-trained initialization. We show that the Jacobian-Vector Product resulting…

Machine Learning · Computer Science 2024-05-16 Tian Yu Liu , Aditya Golatkar , Stefano Soatto

Dynamic graph augmentation is used to improve the performance of dynamic GNNs. Most methods assume temporal locality, meaning that recent edges are more influential than earlier edges. However, for temporal changes in edges caused by random…

Machine Learning · Computer Science 2025-01-20 Xu Chu , Hanlin Xue , Bingce Wang , Xiaoyang Liu , Weiping Li , Tong Mo , Tuoyu Feng , Zhijie Tan