English
Related papers

Related papers: MSSTNet: A Multi-Scale Spatio-Temporal CNN-Transfo…

200 papers

While deep learning, particularly convolutional neural networks (CNNs), has revolutionized remote sensing (RS) change detection (CD), existing approaches often miss crucial features due to neglecting global context and incomplete change…

Multimedia · Computer Science 2024-07-04 Yuhao Gao , Gensheng Pei , Mengmeng Sheng , Zeren Sun , Tao Chen , Yazhou Yao

Deep neural network is an effective choice to automatically recognize human actions utilizing data from various wearable sensors. These networks automate the process of feature extraction relying completely on data. However, various noises…

Signal Processing · Electrical Eng. & Systems 2021-01-05 Tanvir Mahmud , A. Q. M. Sazzad Sayyed , Shaikh Anowarul Fattah , Sun-Yuan Kung

Recent works achieve excellent results in defocus deblurring task based on dual-pixel data using convolutional neural network (CNN), while the scarcity of data limits the exploration and attempt of vision transformer in this task. In…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Dafeng Zhang , Xiaobing Wang

This paper presents FSNet, a deep generative model for image-based face swapping. Traditionally, face-swapping methods are based on three-dimensional morphable models (3DMMs), and facial textures are replaced between the estimated…

Computer Vision and Pattern Recognition · Computer Science 2022-07-04 Ryota Natsume , Tatsuya Yatagawa , Shigeo Morishima

Transformer-based models for anomaly detection in multivariate time series can benefit from the self-attention mechanism due to its advantage in modeling long-term dependencies. However, Transformer-based anomaly detection models have…

Machine Learning · Computer Science 2023-12-05 Jie Liu , Qilin Li , Senjian An , Bradley Ezard , Ling Li

Semantic segmentation has achieved great accuracy in understanding spatial layout. For real-time tasks based on dynamic scenes, we extend semantic segmentation in temporal domain to enhance the spatial accuracy with motion. We utilize a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-18 Guo Cheng , Jiang Yu Zheng

Deep convolutional neural networks (CNNs) are the backbone of state-of-art semantic image segmentation systems. Recent work has shown that complementing CNNs with fully-connected conditional random fields (CRFs) can significantly enhance…

Computer Vision and Pattern Recognition · Computer Science 2016-06-03 Liang-Chieh Chen , Jonathan T. Barron , George Papandreou , Kevin Murphy , Alan L. Yuille

Continuous sign language recognition (cSLR) is a public significant task that transcribes a sign language video into an ordered gloss sequence. It is important to capture the fine-grained gloss-level details, since there is no explicit…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Pan Xie , Zhi Cui , Yao Du , Mengyi Zhao , Jianwei Cui , Bin Wang , Xiaohui Hu

Facial expressions have essential cues to infer the humans state of mind, that conveys adequate information to understand individuals actual feelings. Thus, automatic facial expression recognition is an interesting and crucial task to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Monu Verma , Jaspreet Kaur Bhui , Santosh Vipparthi , Girdhari Singh

In recent years, monocular depth estimation is applied to understand the surrounding 3D environment and has made great progress. However, there is an ill-posed problem on how to gain depth information directly from a single image. With the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Meiqi Pei

Deep neural networks, especially transformer-based architectures, have achieved remarkable success in semantic segmentation for environmental perception. However, existing models process video frames independently, thus failing to leverage…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Serin Varghese , Kevin Ross , Fabian Hueger , Kira Maag

Convolutional neural networks (CNNs) and their variations have shown effectiveness in facial expression recognition (FER). However, they face challenges when dealing with high computational complexity and multi-view head poses in real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Ali Ezati , Mohammadreza Dezyani , Rajib Rana , Roozbeh Rajabi , Ahmad Ayatollahi

This paper introduces StutterNet, a novel deep learning based stuttering detection capable of detecting and identifying various types of disfluencies. Most of the existing work in this domain uses automatic speech recognition (ASR) combined…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-09 Shakeel A. Sheikh , Md Sahidullah , Fabrice Hirsch , Slim Ouni

Spatiotemporal and motion features are two complementary and crucial information for video action recognition. Recent state-of-the-art methods adopt a 3D CNN stream to learn spatiotemporal features and another flow stream to learn motion…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Boyuan Jiang , Mengmeng Wang , Weihao Gan , Wei Wu , Junjie Yan

Speech Emotion Recognition (SER) has become a growing focus of research in human-computer interaction. Spatiotemporal features play a crucial role in SER, yet current research lacks comprehensive spatiotemporal feature learning. This paper…

Sound · Computer Science 2023-12-29 Mengbo Li , Yuanzhong Zheng , Dichucheng Li , Yulun Wu , Yaoxuan Wang , Haojun Fei

We propose a novel recurrent encoder-decoder network model for real-time video-based face alignment. Our proposed model predicts 2D facial point maps regularized by a regression loss, while uniquely exploiting recurrent learning at both…

Computer Vision and Pattern Recognition · Computer Science 2016-08-24 Xi Peng , Rogerio S. Feris , Xiaoyu Wang , Dimitris N. Metaxas

Detecting manipulated media has now become a pressing issue with the recent rise of deepfakes. Most existing approaches fail to generalize across diverse datasets and generation techniques. We thus propose a novel ensemble framework,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Vrushank Ahire , Aniruddh Muley , Shivam Zample , Siddharth Verma , Pranav Menon , Surbhi Madan , Abhinav Dhall

The video-based facial expression recognition aims to classify a given video into several basic emotions. How to integrate facial features of individual frames is crucial for this task. In this paper, we propose the Frame Attention Networks…

Computer Vision and Pattern Recognition · Computer Science 2019-09-13 Debin Meng , Xiaojiang Peng , Kai Wang , Yu Qiao

Facial expressions are important cues to observe human emotions. Facial expression recognition has attracted many researchers for years, but it is still a challenging topic since expression features vary greatly with the head poses,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 S. D. Lalitha , K. K. Thyagharajan

Video-based emotion recognition is a challenging task because it requires to distinguish the small deformations of the human face that represent emotions, while being invariant to stronger visual differences due to different identities.…

Machine Learning · Computer Science 2019-10-07 Masih Aminbeidokhti , Marco Pedersoli , Patrick Cardinal , Eric Granger