English
Related papers

Related papers: MSSTNet: A Multi-Scale Spatio-Temporal CNN-Transfo…

200 papers

Transformers have emerged as viable alternatives to convolutional neural networks owing to their ability to learn non-local region relationships in the spatial domain. The self-attention mechanism of the transformer enables transformers to…

Image and Video Processing · Electrical Eng. & Systems 2023-08-09 Rahul G. S. , Sriprabha Ramnarayanan , Mohammad Al Fahim , Keerthi Ram , Preejith S. P , Mohanasankar Sivaprakasam

Vision Transformer and its variants have demonstrated great potential in various computer vision tasks. But conventional vision transformers often focus on global dependency at a coarse level, which suffer from a learning challenge on…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Yunhao Wang , Huixin Sun , Xiaodi Wang , Bin Zhang , Chao Li , Ying Xin , Baochang Zhang , Errui Ding , Shumin Han

The performance of a convolutional neural network (CNN) based face recognition model largely relies on the richness of labelled training data. Collecting a training set with large variations of a face identity under different poses and…

Computer Vision and Pattern Recognition · Computer Science 2020-02-25 Hao-Chiang Shao , Kang-Yu Liu , Chia-Wen Lin , Jiwen Lu

Learning the spatial-temporal representation of motion information is crucial to human action recognition. Nevertheless, most of the existing features or descriptors cannot capture motion information effectively, especially for long-term…

Computer Vision and Pattern Recognition · Computer Science 2017-02-13 Yemin Shi , Yonghong Tian , Yaowei Wang , Tiejun Huang

High level understanding of sequential visual input is important for safe and stable autonomy, especially in localization and object detection. While traditional object classification and tracking approaches are specifically designed to…

Computer Vision and Pattern Recognition · Computer Science 2017-07-25 Mo Shan , Nikolay Atanasov

Facial expression recognition (FER) has emerged as an important component of human-computer interaction systems. Despite recent advancements in FER, performance often drops significantly for non-frontal facial images. We propose Contrastive…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Shuvendu Roy , Ali Etemad

Triggered by the success of transformers in various visual tasks, the spatial self-attention mechanism has recently attracted more and more attention in the computer vision community. However, we empirically found that a typical vision…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Jiayin Sun , Hong Wang , Qiulei Dong

Face images appeared in multimedia applications, e.g., social networks and digital entertainment, usually exhibit dramatic pose, illumination, and expression variations, resulting in considerable performance degradation for traditional face…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Changxing Ding , Dacheng Tao

Facial expression spotting is a significant but challenging task in facial expression analysis. The accuracy of expression spotting is affected not only by irrelevant facial movements but also by the difficulty of perceiving subtle motions…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yicheng Deng , Hideaki Hayashi , Hajime Nagahara

Current state-of-the-art models for automatic Facial Expression Recognition (FER) are based on very deep neural networks that are effective but rather expensive to train. Given the dynamic conditions of FER, this characteristic hinders such…

Computer Vision and Pattern Recognition · Computer Science 2020-09-17 Pablo Barros , Nikhil Churamani , Alessandra Sciutti

With the continuous research on Deepfake forensics, recent studies have attempted to provide the fine-grained localization of forgeries, in addition to the coarse classification at the video-level. However, the detection and localization…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Wu Haiwei , Zhou Jiantao , Zhang Shile , Tian Jinyu

Facial Expression Recognition (FER) is an active research domain that has shown great progress recently, notably thanks to the use of large deep learning models. However, such approaches are particularly energy intensive, which makes their…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Sami Barchid , Benjamin Allaert , Amel Aissaoui , José Mennesson , Chaabane Djéraba

Skeleton-based action recognition, which classifies human actions based on the coordinates of joints and their connectivity within skeleton data, is widely utilized in various scenarios. While Graph Convolutional Networks (GCNs) have been…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Jeonghyeok Do , Munchurl Kim

The study of Dynamic Facial Expression Recognition (DFER) is a nascent field of research that involves the automated recognition of facial expressions in video data. Although existing research has primarily focused on learning…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Feng Liu , Hanyang Wang , Siyuan Shen

In the recent year, state-of-the-art for facial micro-expression recognition have been significantly advanced by deep neural networks. The robustness of deep learning has yielded promising performance beyond that of traditional handcrafted…

Computer Vision and Pattern Recognition · Computer Science 2019-08-22 Sze-Teng Liong , Y. S. Gan , John See , Huai-Qian Khor , Yen-Chang Huang

Deep neural networks have been widely used for feature learning in facial expression recognition systems. However, small datasets and large intra-class variability can lead to overfitting. In this paper, we propose a method which learns an…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Negar Heidari , Alexandros Iosifidis

Clustering high-dimensional spatiotemporal data using an unsupervised approach is a challenging problem for many data-driven applications. Existing state-of-the-art methods for unsupervised clustering use different similarity and distance…

Machine Learning · Computer Science 2023-09-15 Omar Faruque , Francis Ndikum Nji , Mostafa Cham , Rohan Mandar Salvi , Xue Zheng , Jianwu Wang

This paper proposes an unsupervised address event representation (AER) object recognition approach. The proposed approach consists of a novel multiscale spatio-temporal feature (MuST) representation of input AER events and a spiking neural…

Neural and Evolutionary Computing · Computer Science 2019-11-20 Qianhui Liu , Gang Pan , Haibo Ruan , Dong Xing , Qi Xu , Huajin Tang

Despite the fact that notable improvements have been made recently in the field of feature extraction and classification, human action recognition is still challenging, especially in images, in which, unlike videos, there is no motion.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Sina Mohammadi , Sina Ghofrani Majelan , Shahriar B. Shokouhi

We study the problem of human action recognition using motion capture (MoCap) sequences. Unlike existing techniques that take multiple manual steps to derive standardized skeleton representations as model input, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Xiaoyu Zhu , Po-Yao Huang , Junwei Liang , Celso M. de Melo , Alexander Hauptmann