English
Related papers

Related papers: Temporal Attention Unit: Towards Efficient Spatiot…

200 papers

Optical-flow-based and kernel-based approaches have been extensively explored for temporal compensation in satellite Video Super-Resolution (VSR). However, these techniques are less generalized in large-scale or complex scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Yi Xiao , Qiangqiang Yuan , Kui Jiang , Xianyu Jin , Jiang He , Liangpei Zhang , Chia-Wen Lin

Naturalistic driving action recognition is essential for vehicle cabin monitoring systems. However, the complexity of real-world backgrounds presents significant challenges for this task, and previous approaches have struggled with…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Qing Chang , Wei Dai , Zhihao Shuai , Limin Yu , Yutao Yue

Spatio-temporal forecasting is crucial in many domains, such as transportation, meteorology, and energy. However, real-world scenarios frequently present challenges such as signal anomalies, noise, and distributional shifts. Existing…

Machine Learning · Computer Science 2025-10-30 Wei Chen , Yuxuan Liang

Deep learning methods achieve remarkable predictive performance in modeling complex, large-scale data. However, assessing the quality of derived models has become increasingly challenging, as more classical statistical assumptions may no…

Machine Learning · Statistics 2026-03-02 Daniele Zambon , Cesare Alippi

Dynamic graph learning is essential for applications involving temporal networks and requires effective modeling of temporal relationships. Seminal attention-based models like TGAT and DyGFormer rely on sinusoidal time encoders to capture…

Machine Learning · Computer Science 2025-08-05 Hsing-Huan Chung , Shravan Chaudhari , Xing Han , Yoav Wald , Suchi Saria , Joydeep Ghosh

Spatio-temporal feature learning is of central importance for action recognition in videos. Existing deep neural network models either learn spatial and temporal features independently (C2D) or jointly with unconstrained parameters (C3D).…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Chao Li , Qiaoyong Zhong , Di Xie , Shiliang Pu

Previous methods for dynamic facial expression in the wild are mainly based on Convolutional Neural Networks (CNNs), whose local operations ignore the long-range dependencies in videos. To solve this problem, we propose the spatio-temporal…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Fuyan Ma , Bin Sun , Shutao Li

Time series forecasting is an important problem across many domains, playing a crucial role in multiple real-world applications. In this paper, we propose a forecasting architecture that combines deep autoregressive models with a Spectral…

Machine Learning · Statistics 2021-12-28 Fernando Moreno-Pino , Pablo M. Olmos , Antonio Artés-Rodríguez

Video action recognition has made significant strides, but challenges remain in effectively using both spatial and temporal information. While existing methods often focus on either spatial features (e.g., object appearance) or temporal…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Huilin Chen , Lei Wang , Yifan Chen , Tom Gedeon , Piotr Koniusz

While recent large-scale video-language pre-training made great progress in video question answering, the design of spatial modeling of video-language models is less fine-grained than that of image-language models; existing practices of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Hsin-Ying Lee , Hung-Ting Su , Bing-Chen Tsai , Tsung-Han Wu , Jia-Fong Yeh , Winston H. Hsu

Inferring geometrically consistent dense 3D scenes across a tuple of temporally consecutive images remains challenging for self-supervised monocular depth prediction pipelines. This paper explores how the increasingly popular transformer…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Patrick Ruhkamp , Daoyi Gao , Hanzhi Chen , Nassir Navab , Benjamin Busam

Traditional vision-based autonomous driving systems often face difficulties in navigating complex environments when relying solely on single-image inputs. To overcome this limitation, incorporating temporal data such as past image frames or…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Tuong Do , Binh X. Nguyen , Quang D. Tran , Erman Tjiputra , Te-Chuan Chiu , Anh Nguyen

Motion estimation is one of the core challenges in computer vision. With traditional dual-frame approaches, occlusions and out-of-view motions are a limiting factor, especially in the context of environmental perception for vehicles due to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-05 René Schuster , Christian Unger , Didier Stricker

Current artificial neural networks mainly conduct the learning process in the spatial domain but neglect the frequency domain learning. However, the learning course performed in the frequency domain can be more efficient than that in the…

Computer Vision and Pattern Recognition · Computer Science 2022-02-21 Shaocheng Jia , Wei Yao

Finding sustainable and novel solutions to predict city-wide mobility behaviour is an ever-growing problem given increased urban complexity and growing populations. This paper seeks to address this by describing a traffic frame prediction…

Machine Learning · Computer Science 2020-12-01 Jay Santokhi , Pankaj Daga , Joned Sarwar , Anna Jordan , Emil Hewage

Forecasting epileptic seizures from multivariate EEG signals represents a critical challenge in healthcare time series prediction, requiring high sensitivity, low false alarm rates, and subject-specific adaptability. We present STAN, an…

Machine Learning · Computer Science 2026-03-04 Zan Li , Kyongmin Yeo , Wesley Gifford , Lara Marcuse , Madeline Fields , Bülent Yener

Lane detection is a crucial perception task for all levels of automated vehicles (AVs) and Advanced Driver Assistance Systems, particularly in mixed-traffic environments where AVs must interact with human-driven vehicles (HDVs) and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Sandeep Patil , Yongqi Dong , Haneen Farah , Hans Hellendoorn

Self-supervised feature learning enables perception systems to benefit from the vast raw data recorded by vehicle fleets worldwide. While video-level self-supervised learning approaches have shown strong generalizability on classification…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Christopher Lang , Alexander Braun , Lars Schillingmann , Karsten Haug , Abhinav Valada

Self-attention learns pairwise interactions to model long-range dependencies, yielding great improvements for video action recognition. In this paper, we seek a deeper understanding of self-attention for temporal modeling in videos. We…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Bo He , Xitong Yang , Zuxuan Wu , Hao Chen , Ser-Nam Lim , Abhinav Shrivastava

Skeleton-based action recognition (SAR) has achieved impressive progress with transformer architectures. However, existing methods often rely on complex module compositions and heavy designs, leading to increased parameter counts, high…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Wenhan Wu , Zhishuai Guo , Chen Chen , Aidong Lu