English
Related papers

Related papers: Exploiting Feature and Class Relationships in Vide…

200 papers

Videos are inherently multimodal. This paper studies the problem of how to fully exploit the abundant multimodal clues for improved video categorization. We introduce a hybrid deep learning framework that integrates useful clues from…

Multimedia · Computer Science 2017-06-15 Yu-Gang Jiang , Zuxuan Wu , Jinhui Tang , Zechao Li , Xiangyang Xue , Shih-Fu Chang

This paper studies deep network architectures to address the problem of video classification. A multi-stream framework is proposed to fully utilize the rich multimodal information in videos. Specifically, we first train three Convolutional…

Computer Vision and Pattern Recognition · Computer Science 2015-11-12 Zuxuan Wu , Yu-Gang Jiang , Xi Wang , Hao Ye , Xiangyang Xue , Jun Wang

Scene classification is a fundamental perception task for environmental understanding in today's robotics. In this paper, we have attempted to exploit the use of popular machine learning technique of deep learning to enhance scene…

Computer Vision and Pattern Recognition · Computer Science 2015-09-23 Yiyi Liao , Sarath Kodagoda , Yue Wang , Lei Shi , Yong Liu

Deep Recurrent Neural Network (RNN) has gained popularity in many sequence classification tasks. Beyond predicting a correct class for each data instance, data scientists also want to understand what differentiating factors in the data have…

Machine Learning · Computer Science 2019-01-18 Chuan Wang , Takeshi Onishi , Keiichi Nemoto , Kwan-Liu Ma

The Meta Video Dataset (MetaVD) provides annotated relations between action classes in major datasets for human action recognition in videos. Although these annotated relations enable dataset augmentation, it is only applicable to those…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yuya Yoshikawa , Yutaro Shigeto , Masashi Shimbo , Akikazu Takeuchi

The recognition of actions from video sequences has many applications in health monitoring, assisted living, surveillance, and smart homes. Despite advances in sensing, in particular related to 3D video, the methodologies to process the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-03 Rui Zhao , Haider Ali , Patrick van der Smagt

Deep Neural Networks (DNNs) have obtained impressive performance across tasks, however they still remain as black boxes, e.g., hard to theoretically analyze. At the same time, Polynomial Networks (PNs) have emerged as an alternative method…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Grigorios G Chrysos , Bohan Wang , Jiankang Deng , Volkan Cevher

Visual recognition is currently one of the most important and active research areas in computer vision, pattern recognition, and even the general field of artificial intelligence. It has great fundamental importance and strong industrial…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Yang Wu , Dingheng Wang , Xiaotong Lu , Fan Yang , Guoqi Li , Weisheng Dong , Jianbo Shi

Deep Neural Networks (DNN) have been successfully used to perform classification and regression tasks, particularly in computer vision based applications. Recently, owing to the widespread deployment of Internet of Things (IoT), we identify…

Signal Processing · Electrical Eng. & Systems 2020-07-15 Arijit Ukil , Antonio Jara , Leandro Marin

In videos, the human's actions are of three-dimensional (3D) signals. These videos investigate the spatiotemporal knowledge of human behavior. The promising ability is investigated using 3D convolution neural networks (CNNs). The 3D CNNs…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Arslan Syed , Eman A. Aldhahri , Muhammad Munawar Iqbal , Abid Ali , Ammar Muthanna , Harun Jamil , Faisal Jamil

Predicting the relevance between two given videos with respect to their visual content is a key component for content-based video recommendation and retrieval. Thanks to the increasing availability of pre-trained image and video…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Jianfeng Dong , Xun Wang , Leimin Zhang , Chaoxi Xu , Gang Yang , Xirong Li

Interpretability of deep neural networks (DNNs) is essential since it enables users to understand the overall strengths and weaknesses of the models, conveys an understanding of how the models will behave in the future, and how to diagnose…

Computer Vision and Pattern Recognition · Computer Science 2017-03-31 Yinpeng Dong , Hang Su , Jun Zhu , Bo Zhang

Most existing video summarisation methods are based on either supervised or unsupervised learning. In this paper, we propose a reinforcement learning-based weakly supervised method that exploits easy-to-obtain, video-level category labels…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Kaiyang Zhou , Tao Xiang , Andrea Cavallaro

Deep learning has been demonstrated to achieve excellent results for image classification and object detection. However, the impact of deep learning on video analysis (e.g. action detection and recognition) has been limited due to…

Computer Vision and Pattern Recognition · Computer Science 2017-08-03 Rui Hou , Chen Chen , Mubarak Shah

Video summarization technologies aim to create a concise and complete synopsis by selecting the most informative parts of the video content. Several approaches have been developed over the last couple of decades and the current state of the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Evlampios Apostolidis , Eleni Adamantidou , Alexandros I. Metsai , Vasileios Mezaris , Ioannis Patras

This paper proposes a new framework for semantic segmentation of objects in videos. We address the label inconsistency problem of deep convolutional neural networks (DCNNs) by exploiting the fact that videos have multiple frames; in a few…

Computer Vision and Pattern Recognition · Computer Science 2017-11-23 Seong-Jin Park , Ki-Sang Hong

Classifying videos according to content semantics is an important problem with a wide range of applications. In this paper, we propose a hybrid deep learning framework for video classification, which is able to model static spatial…

Computer Vision and Pattern Recognition · Computer Science 2015-04-08 Zuxuan Wu , Xi Wang , Yu-Gang Jiang , Hao Ye , Xiangyang Xue

Standard deep neural networks (DNNs) are commonly trained in an end-to-end fashion for specific tasks such as object recognition, face identification, or character recognition, among many examples. This specificity often leads to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Raphaël Achddou , J. Matias di Martino , Guillermo Sapiro

Following the rapidly growing digital image usage, automatic image categorization has become preeminent research area. It has broaden and adopted many algorithms from time to time, whereby multi-feature (generally, hand-engineered features)…

Computer Vision and Pattern Recognition · Computer Science 2017-05-12 Thangarajah Akilan , Q. M. Jonathan Wu , Wei Jiang

While deep convolutional neural networks (CNNs) have shown a great success in single-label image classification, it is important to note that real world images generally contain multiple labels, which could correspond to different objects,…

Computer Vision and Pattern Recognition · Computer Science 2016-04-18 Jiang Wang , Yi Yang , Junhua Mao , Zhiheng Huang , Chang Huang , Wei Xu