English
Related papers

Related papers: Spatio-Temporal Transformer for Dynamic Facial Exp…

200 papers

Facial Expression Recognition (FER) in the wild is an extremely challenging task in computer vision due to variant backgrounds, low-quality facial images, and the subjectiveness of annotators. These uncertainties make it difficult for…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Hanting Li , Mingzhe Sui , Feng Zhao , Zhengjun Zha , Feng Wu

Human action recognition is an important task in computer vision. Extracting discriminative spatial and temporal features to model the spatial and temporal evolutions of different actions plays a key role in accomplishing this task. In this…

Computer Vision and Pattern Recognition · Computer Science 2016-11-21 Sijie Song , Cuiling Lan , Junliang Xing , Wenjun Zeng , Jiaying Liu

Space-time video super-resolution (STVSR) is the task of interpolating videos with both Low Frame Rate (LFR) and Low Resolution (LR) to produce High-Frame-Rate (HFR) and also High-Resolution (HR) counterparts. The existing methods based on…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Zhicheng Geng , Luming Liang , Tianyu Ding , Ilya Zharkov

In the age of AI-driven generative technologies, traditional biometric recognition systems face unprecedented challenges, particularly from sophisticated deepfake and face reenactment techniques. In this study, we propose a Two-Stream…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Masoumeh Chapariniya , Hossein Ranjbar , Teodora Vukovic , Sarah Ebling , Volker Dellwo

Reconstructing dynamic humans interacting with real-world environments from monocular videos is an important and challenging task. Despite considerable progress in 4D neural rendering, existing approaches either model dynamic scenes…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Wenqing Wang , Haosen Yang , Josef Kittler , Xiatian Zhu

This paper presents a novel mid-level representation for action recognition, named spatio-temporal aware non-negative component representation (STANNCR). The proposed STANNCR is based on action component and incorporates the…

Computer Vision and Pattern Recognition · Computer Science 2016-08-30 Jianhong Wang , Tian Lan , Xu Zhang , Limin Luo

A classical problem in computer vision is to infer a 3D scene representation from few images that can be used to render novel views at interactive rates. Previous work focuses on reconstructing pre-defined 3D representations, e.g. textured…

Self-supervised video representation learning aimed at maximizing similarity between different temporal segments of one video, in order to enforce feature persistence over time. This leads to loss of pertinent information related to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Di Yang , Yaohui Wang , Quan Kong , Antitza Dantcheva , Lorenzo Garattoni , Gianpiero Francesca , Francois Bremond

Recently, skeleton-based human action has become a hot research topic because the compact representation of human skeletons brings new blood to this research domain. As a result, researchers began to notice the importance of using RGB or…

Computer Vision and Pattern Recognition · Computer Science 2023-07-26 Yifan Jiang , Han Chen , Hanseok Ko

Recent advances in transformer-based lightweight object tracking have established new standards across benchmarks, leveraging the global receptive field and powerful feature extraction capabilities of attention mechanisms. Despite these…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Junze Shi , Yang Yu , Jian Shi , Haibo Luo

Dynamic representation learning plays a pivotal role in understanding the evolution of linguistic content over time. On this front both context and time dynamics as well as their interplay are of prime importance. Current approaches model…

Computation and Language · Computer Science 2024-10-23 Talia Tseriotou , Adam Tsakalidis , Maria Liakata

In this report, we introduce a novel self-supervised learning method for extracting latent embeddings from behaviors of larval zebrafish. Drawing inspiration from Masked Modeling techniquesutilized in image processing with Masked…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Lanxin Xu , Shuo Wang

Sign language is the preferred method of communication of deaf or mute people, but similar to any language, it is difficult to learn and represents a significant barrier for those who are hard of hearing or unable to speak. A person's…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Neil Song , Yu Xiang

Transform and entropy models are the two core components in deep image compression neural networks. Most existing learning-based image compression methods utilize convolutional-based transform, which lacks the ability to model long-range…

Image and Video Processing · Electrical Eng. & Systems 2023-09-20 Atefeh Khoshkhahtinat , Ali Zafari , Piyush M. Mehta , Mohammad Akyash , Hossein Kashiani , Nasser M. Nasrabadi

Vision Transformers (ViTs) have revolutionized computer vision, yet their self-attention mechanism lacks explicit spatial inductive biases, leading to suboptimal performance on spatially-structured tasks. Existing approaches introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Yuxin Mao , Zhen Qin , Jinxing Zhou , Bin Fan , Jing Zhang , Yiran Zhong , Yuchao Dai

For pursuing accurate skeleton-based action recognition, most prior methods use the strategy of combining Graph Convolution Networks (GCNs) with attention-based methods in a serial way. However, they regard the human skeleton as a complete…

Computer Vision and Pattern Recognition · Computer Science 2023-01-30 Chen Pang , Xuequan Lu , Lei Lyu

We propose a self-supervised contrastive learning approach for facial expression recognition (FER) in videos. We propose a novel temporal sampling-based augmentation scheme to be utilized in addition to standard spatial augmentations used…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Shuvendu Roy , Ali Etemad

Generating video descriptions automatically is a challenging task that involves a complex interplay between spatio-temporal visual features and language models. Given that videos consist of spatial (frame-level) features and their temporal…

Computer Vision and Pattern Recognition · Computer Science 2020-01-20 Anoop Cherian , Jue Wang , Chiori Hori , Tim K. Marks

Over the past few years, deep learning methods have shown remarkable results in many face-related tasks including automatic facial expression recognition (FER) in-the-wild. Meanwhile, numerous models describing the human emotional states…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Panagiotis Antoniadis , Panagiotis P. Filntisis , Petros Maragos

Transformer-based methods have recently achieved significant success in 3D human pose estimation, owing to their strong ability to model long-range dependencies. However, relying solely on the global attention mechanism is insufficient for…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Guangsheng Xu , Guoyi Zhang , Lejia Ye , Shuwei Gan , Xiaohu Zhang , Xia Yang