English
Related papers

Related papers: Class Feature Pyramids for Video Explanation

200 papers

Feature pyramids have been proven powerful in image understanding tasks that require multi-scale features. State-of-the-art methods for multi-scale feature learning focus on performing feature interactions across space and scales using…

Computer Vision and Pattern Recognition · Computer Science 2022-01-12 Gangming Zhao , Weifeng Ge , Yizhou Yu

Convolutional neural networks with spatio-temporal 3D kernels (3D CNNs) have an ability to directly extract spatio-temporal features from videos for action recognition. Although the 3D kernels tend to overfit because of a large number of…

Computer Vision and Pattern Recognition · Computer Science 2017-08-28 Kensho Hara , Hirokatsu Kataoka , Yutaka Satoh

Recently, three dimensional (3D) convolutional neural networks (CNNs) have emerged as dominant methods to capture spatiotemporal representations in videos, by adding to pre-existing 2D CNNs a third, temporal dimension. Such 3D CNNs,…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Gurkirt Singh , Fabio Cuzzolin

Understanding the computations of convolutional neural networks requires effective visualization of their kernels. While maximal activation methods have proven successful in highlighting the preferred features of 2D convolutional kernels,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Chunpeng Li , Ya-tang Li

Videos are inherently multimodal. This paper studies the problem of how to fully exploit the abundant multimodal clues for improved video categorization. We introduce a hybrid deep learning framework that integrates useful clues from…

Multimedia · Computer Science 2017-06-15 Yu-Gang Jiang , Zuxuan Wu , Jinhui Tang , Zechao Li , Xiangyang Xue , Shih-Fu Chang

High accuracy video label prediction (classification) models are attributed to large scale data. These data could be frame feature sequences extracted by a pre-trained convolutional-neural-network, which promote the efficiency for creating…

Computer Vision and Pattern Recognition · Computer Science 2019-06-04 Feng Mao , Xiang Wu , Hui Xue , Rong Zhang

Recognizing human actions in untrimmed videos is an important challenging task. An effective 3D motion representation and a powerful learning model are two key factors influencing recognition performance. In this paper we introduce a new…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Huy-Hieu Pham , Louahdi Khoudour , Alain Crouzil , Pablo Zegers , Sergio A. Velastin

We propose a novel scheme for human action recognition in videos, using a 3-dimensional Convolutional Neural Network (3D CNN) based classifier. Traditionally in deep learning based human activity recognition approaches, either a few random…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 S. H. Shabbeer Basha , Viswanath Pulabaigari , Snehasis Mukherjee

Convolutional Neural Networks (CNNs) can provide accurate object classification. They can be extended to perform object detection by iterating over dense or selected proposed object regions. However, the runtime of such detectors scales as…

Computer Vision and Pattern Recognition · Computer Science 2014-04-08 Forrest Iandola , Matt Moskewicz , Sergey Karayev , Ross Girshick , Trevor Darrell , Kurt Keutzer

Visual tempo characterizes the dynamics and the temporal scale of an action. Modeling such visual tempos of different actions facilitates their recognition. Previous works often capture the visual tempo through sampling raw videos at…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Ceyuan Yang , Yinghao Xu , Jianping Shi , Bo Dai , Bolei Zhou

Motion is a salient cue to recognize actions in video. Modern action recognition models leverage motion information either explicitly by using optical flow as input or implicitly by means of 3D convolutional filters that simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Heng Wang , Du Tran , Lorenzo Torresani , Matt Feiszli

Deep convolutional neural networks (CNN) brought revolution without any doubt to various challenging tasks, mainly in computer vision. However, their model designing still requires attention to reduce number of learnable parameters, with no…

Computer Vision and Pattern Recognition · Computer Science 2016-08-16 Ihsan Ullah , Alfredo Petrosino

Face representation is a crucial step of face recognition systems. An optimal face representation should be discriminative, robust, compact, and very easy-to-implement. While numerous hand-crafted and learning-based representations have…

Computer Vision and Pattern Recognition · Computer Science 2014-03-13 Haoqiang Fan , Zhimin Cao , Yuning Jiang , Qi Yin , Chinchilla Doudou

This paper presents a new state-of-the-art for document image classification and retrieval, using features learned by deep convolutional neural networks (CNNs). In object and scene analysis, deep neural nets are capable of learning a…

Computer Vision and Pattern Recognition · Computer Science 2015-02-26 Adam W. Harley , Alex Ufkes , Konstantinos G. Derpanis

Deep learning models suffer from opaqueness. For Convolutional Neural Networks (CNNs), current research strategies for explaining models focus on the target classes within the associated training dataset. As a result, the understanding of…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Xuehao Liu , Sarah Jane Delany , Susan McKeever

This paper presents a new method for 3D action recognition with skeleton sequences (i.e., 3D trajectories of human skeleton joints). The proposed method first transforms each skeleton sequence into three clips each consisting of several…

Computer Vision and Pattern Recognition · Computer Science 2017-11-21 Qiuhong Ke , Mohammed Bennamoun , Senjian An , Ferdous Sohel , Farid Boussaid

Video content classification is an important research content in computer vision, which is widely used in many fields, such as image and video retrieval, computer vision. This paper presents a model that is a combination of Convolutional…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Pradyumn Patil , Vishwajeet Pawar , Yashraj Pawar , Shruti Pisal

Motivation: Recognizing human actions in a video is a challenging task which has applications in various fields. Previous works in this area have either used images from a 2D or 3D camera. Few have used the idea that human actions can be…

Computer Vision and Pattern Recognition · Computer Science 2016-12-21 Adhavan Jayabalan , Harish Karunakaran , Shravan Murlidharan , Tesia Shizume

Action recognition greatly benefits motion understanding in video analysis. Recurrent networks such as long short-term memory (LSTM) networks are a popular choice for motion-aware sequence learning tasks. Recently, a convolutional extension…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Sebastian Agethen , Winston H. Hsu

In today's digital age, Convolutional Neural Networks (CNNs), a subset of Deep Learning (DL), are widely used for various computer vision tasks such as image classification, object detection, and image segmentation. There are numerous types…

Machine Learning · Computer Science 2024-02-29 Abolfazl Younesi , Mohsen Ansari , MohammadAmin Fazli , Alireza Ejlali , Muhammad Shafique , Jörg Henkel