English
Related papers

Related papers: Large-scale Robustness Analysis of Video Action Re…

200 papers

Evaluating the robustness of Video classification models is very challenging, specifically when compared to image-based models. With their increased temporal dimension, there is a significant increase in complexity and computational cost.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Ashwin Ramesh Babu , Sajad Mousavi , Vineet Gundecha , Sahand Ghorbanpour , Avisek Naug , Antonio Guillen , Ricardo Luna Gutierrez , Soumyendu Sarkar

Despite recent advances in video action recognition achieving strong performance on existing benchmarks, these models often lack robustness when faced with natural distribution shifts between training and test data. We propose two novel…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Kiyoon Kim , Shreyank N Gowda , Panagiotis Eustratiadis , Antreas Antoniou , Robert B Fisher

Human action recognition in videos is a critical task with significant implications for numerous applications, including surveillance, sports analytics, and healthcare. The challenge lies in creating models that are both precise in their…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Yufei Xie

In vision-based action recognition, spatio-temporal features from different modalities are used for recognizing activities. Temporal modeling is a long challenge of action recognition. However, there are limited methods such as pre-computed…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Elham Shabaninia , Hossein Nezamabadi-pour , Fatemeh Shafizadegan

In video action recognition, transformers consistently reach state-of-the-art accuracy. However, many models are too heavyweight for the average researcher with limited hardware resources. In this work, we explore the limitations of video…

Computer Vision and Pattern Recognition · Computer Science 2021-12-09 Raivo Koot , Markus Hennerbichler , Haiping Lu

Transformer emerges as a powerful tool for visual recognition. In addition to demonstrating competitive performance on a broad range of visual benchmarks, recent works also argue that Transformers are much more robust than Convolutions…

Computer Vision and Pattern Recognition · Computer Science 2021-11-11 Yutong Bai , Jieru Mei , Alan Yuille , Cihang Xie

In recent years, a number of approaches based on 2D or 3D convolutional neural networks (CNN) have emerged for video action recognition, achieving state-of-the-art results on several large-scale benchmark datasets. In this paper, we carry…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Chun-Fu Chen , Rameswar Panda , Kandan Ramakrishnan , Rogerio Feris , John Cohn , Aude Oliva , Quanfu Fan

Recently, video-based action recognition methods using convolutional neural networks (CNNs) achieve remarkable recognition performance. However, there is still lack of understanding about the generalization mechanism of action recognition…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Jaehui Hwang , Huan Zhang , Jun-Ho Choi , Cho-Jui Hsieh , Jong-Seok Lee

Modern deep convolutional networks (CNNs) are often criticized for not generalizing under distributional shifts. However, several recent breakthroughs in transfer learning suggest that these networks can cope with severe distribution shifts…

The vision transformer (ViT) has advanced to the cutting edge in the visual recognition task. Transformers are more robust than CNN, according to the latest research. ViT's self-attention mechanism, according to the claim, makes it more…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Salman Rahman , Wonkwon Lee

The recent success of Vision Transformers is shaking the long dominance of Convolutional Neural Networks (CNNs) in image recognition for a decade. Specifically, in terms of robustness on out-of-distribution samples, recent research finds…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Zeyu Wang , Yutong Bai , Yuyin Zhou , Cihang Xie

Continued advances in self-supervised learning have led to significant progress in video representation learning, offering a scalable alternative to supervised approaches by removing the need for manual annotations. Despite strong…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Fida Mohammad Thoker , Letian Jiang , Chen Zhao , Piyush Bagad , Hazel Doughty , Bernard Ghanem , Cees G. M. Snoek

There has been huge progress on video action recognition in recent years. However, many works focus on tweaking existing 2D backbones due to the reliance of ImageNet pretraining, which restrains the models from achieving higher efficiency…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Zhe Wang , Xulei Yang

Video action recognition is one of the representative tasks for video understanding. Over the last decade, we have witnessed great advancements in video action recognition thanks to the emergence of deep learning. But we also encountered…

Computer Vision and Pattern Recognition · Computer Science 2020-12-14 Yi Zhu , Xinyu Li , Chunhui Liu , Mohammadreza Zolfaghari , Yuanjun Xiong , Chongruo Wu , Zhi Zhang , Joseph Tighe , R. Manmatha , Mu Li

This thesis focuses on video understanding for human action and interaction recognition. We start by identifying the main challenges related to action recognition from videos and review how they have been addressed by current methods. Based…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Alexandros Stergiou

Deep neural networks have been shown to perform poorly on adversarial examples. To address this, several techniques have been proposed to increase robustness of a model for image classification tasks. However, in video understanding tasks,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Divya Choudhary , Palash Goyal , Saurabh Sahu

Most existing Convolutional Neural Networks(CNNs) used for action recognition are either difficult to optimize or underuse crucial temporal information. Inspired by the fact that the recurrent model consistently makes breakthroughs in the…

Computer Vision and Pattern Recognition · Computer Science 2018-01-04 Zhenxing Zheng , Gaoyun An , Qiuqi Ruan

Deep Convolutional Neural Networks (CNNs) have long been the architecture of choice for computer vision tasks. Recently, Transformer-based architectures like Vision Transformer (ViT) have matched or even surpassed ResNets for image…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Srinadh Bhojanapalli , Ayan Chakrabarti , Daniel Glasner , Daliang Li , Thomas Unterthiner , Andreas Veit

Video violence recognition based on deep learning concerns accurate yet scalable human violence recognition. Currently, most state-of-the-art video violence recognition studies use CNN-based models to represent and categorize videos.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Hamid Mohammadi , Ehsan Nazerfard , Tahereh Firoozi

While convolutional neural networks (CNNs) have found wide adoption as state-of-the-art models for image-related tasks, their predictions are often highly sensitive to small input perturbations, which the human vision is robust against.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Stefan Sietzen , Mathias Lechner , Judy Borowski , Ramin Hasani , Manuela Waldner
‹ Prev 1 2 3 10 Next ›