English
Related papers

Related papers: A Framework Combining 3D CNN and Transformer for V…

200 papers

Temporal convolutions have been the paradigm of choice in action segmentation, which enhances long-term receptive fields by increasing convolution layers. However, high layers cause the loss of local information necessary for frame…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Jiahui Wang , Zhenyou Wang , Shanna Zhuang , Hui Wang

Automated Facial Expression Recognition (FER) has been a challenging task for decades. Many of the existing works use hand-crafted features such as LBP, HOG, LPQ, and Histogram of Optical Flow (HOF) combined with classifiers such as Support…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Behzad Hasani , Mohammad H. Mahoor

Phoneme recognition is a very important part of speech recognition that requires the ability to extract phonetic features from multiple frames. In this paper, we compare and analyze CNN, RNN, Transformer, and Conformer models using phoneme…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-04 Kyuhong Shim , Wonyong Sung

Electrocardiogram (ECG)-based biometric recognition has emerged as a promising solution for secure authentication and liveness detection. However, most existing methods rely on unimodal deep learning architectures that independently process…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Arioua , Islameddine , Benzaoui , Amir , Zeroual , Abdelhafid , Houam , Lotfi

Remote sensing change detection is vital for monitoring environmental and urban transformations but faces challenges like manual feature extraction and sensitivity to noise. Traditional methods and early deep learning models, such as…

Multimodal medical image fusion is a crucial task that combines complementary information from different imaging modalities into a unified representation, thereby enhancing diagnostic accuracy and treatment planning. While deep learning…

Image and Video Processing · Electrical Eng. & Systems 2024-11-19 Meng Zhou , Yuxuan Zhang , Xiaolan Xu , Jiayi Wang , Farzad Khalvati

This paper presents a module, Spatial Cross-scale Convolution (SCSC), which is verified to be effective in improving both CNNs and Transformers. Nowadays, CNNs and Transformers have been successful in a variety of tasks. Especially for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Xijun Wang , Xiaojie Chu , Chunrui Han , Xiangyu Zhang

We conduct an in-depth exploration of different strategies for doing event detection in videos using convolutional neural networks (CNNs) trained for image classification. We study different ways of performing spatial and temporal pooling,…

Computer Vision and Pattern Recognition · Computer Science 2015-05-11 Shengxin Zha , Florian Luisier , Walter Andrews , Nitish Srivastava , Ruslan Salakhutdinov

Joint segmentation and classification of fine-grained actions is important for applications of human-robot interaction, video surveillance, and human skill evaluation. However, despite substantial recent progress in large-scale action…

Computer Vision and Pattern Recognition · Computer Science 2016-10-03 Colin Lea , Austin Reiter , Rene Vidal , Gregory D. Hager

Latent fingerprint identification remains a challenging task due to low image quality, background noise, and partial impressions. In this work, we propose a novel identification approach called LatentPrintFormer. The proposed model…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Arnab Maity , Manasa , Pavan Kumar C , Raghavendra Ramachandra

Convolutional neural networks (CNNs) are ubiquitous in computer vision, with a myriad of effective and efficient variations. Recently, Transformers -- originally introduced in natural language processing -- have been increasingly adopted in…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Peng Gao , Jiasen Lu , Hongsheng Li , Roozbeh Mottaghi , Aniruddha Kembhavi

The landscape of video recognition has evolved significantly, shifting from traditional Convolutional Neural Networks (CNNs) to Transformer-based architectures for improved accuracy. While 3D CNNs have been effective at capturing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Hayat Ullah , Muhammad Ali Shafique , Abbas Khan , Arslan Munir

Vision transformers are effective deep learning models for vision tasks, including medical image segmentation. However, they lack efficiency and translational invariance, unlike convolutional neural networks (CNNs). To model long-range…

Image and Video Processing · Electrical Eng. & Systems 2023-08-15 Liam Chalcroft , Ruben Lourenço Pereira , Mikael Brudfors , Andrew S. Kayser , Mark D'Esposito , Cathy J. Price , Ioannis Pappas , John Ashburner

Traffic forecasting is an indispensable part of Intelligent transportation systems (ITS), and long-term network-wide accurate traffic speed forecasting is one of the most challenging tasks. Recently, deep learning methods have become…

Artificial Intelligence · Computer Science 2021-04-13 Haoyang Yan , Xiaolei Ma

High level understanding of sequential visual input is important for safe and stable autonomy, especially in localization and object detection. While traditional object classification and tracking approaches are specifically designed to…

Computer Vision and Pattern Recognition · Computer Science 2017-07-25 Mo Shan , Nikolay Atanasov

Detectors with high coverage have direct and far-reaching benefits for road users in route planning and avoiding traffic congestion, but utilizing these data presents unique challenges including: the dynamic temporal correlation, and the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 He Li , Shiyu Zhang , Xuejiao Li , Liangcai Su , Hongjie Huang , Duo Jin , Linghao Chen , Jianbing Huang , Jaesoo Yoo

While state-of-the-art 3D Convolutional Neural Networks (CNN) achieve very good results on action recognition datasets, they are computationally very expensive and require many GFLOPs. While the GFLOPs of a 3D CNN can be decreased by…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Mohsen Fayyaz , Emad Bahrami , Ali Diba , Mehdi Noroozi , Ehsan Adeli , Luc Van Gool , Juergen Gall

Deep learning techniques are being used in skeleton based action recognition tasks and outstanding performance has been reported. Compared with RNN based methods which tend to overemphasize temporal information, CNN-based approaches can…

Computer Vision and Pattern Recognition · Computer Science 2017-05-03 Zewei Ding , Pichao Wang , Philip O. Ogunbona , Wanqing Li

Standard methods for video recognition use large CNNs designed to capture spatio-temporal data. However, training these models requires a large amount of labeled training data, containing a wide variety of actions, scenes, settings and…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 AJ Piergiovanni , Michael S. Ryoo

We introduce Continual 3D Convolutional Neural Networks (Co3D CNNs), a new computational formulation of spatio-temporal 3D CNNs, in which videos are processed frame-by-frame rather than by clip. In online tasks demanding frame-wise…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Lukas Hedegaard , Alexandros Iosifidis