English
Related papers

Related papers: Spatially Constrained Transformer with Efficient G…

200 papers

Traffic forecasting is a cornerstone of smart city management, enabling efficient resource allocation and transportation planning. Deep learning, with its ability to capture complex nonlinear patterns in spatiotemporal (ST) data, has…

Machine Learning · Computer Science 2024-10-16 Hongjun Wang , Jiyuan Chen , Tong Pan , Zheng Dong , Lingyu Zhang , Renhe Jiang , Xuan Song

Accurate traffic prediction is essential for optimizing transportation systems, enhancing resource allocation, and improving overall urban administration. Spatio-temporal graph neural networks (GNNs) have achieved state-of-the-art…

Machine Learning · Computer Science 2026-05-12 Qianru Zhang , Xinyi Gao , Alexander Zhou , Reynold Cheng , Siu-Ming Yiu , Hongzhi Yin

Spiking Neural Networks (SNNs) have gained significant attention due to their biological plausibility and energy efficiency, making them promising alternatives to Artificial Neural Networks (ANNs). However, the performance gap between SNNs…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Tianqing Zhang , Kairong Yu , Xian Zhong , Hongwei Wang , Qi Xu , Qiang Zhang

Predicting road traffic speed is a challenging task due to different types of roads, abrupt speed change and spatial dependencies between roads; it requires the modeling of dynamically changing spatial dependencies among roads and temporal…

Machine Learning · Computer Science 2020-10-21 Cheonbok Park , Chunggi Lee , Hyojin Bahng , Yunwon Tae , Kihwan Kim , Seungmin Jin , Sungahn Ko , Jaegul Choo

Several studies have attempted to solve traveling salesman problems (TSPs) using various deep learning techniques. Among them, Transformer-based models show state-of-the-art performance even for large-scale Traveling Salesman Problems…

Machine Learning · Computer Science 2024-03-07 Minseop Jung , Jaeseung Lee , Jibum Kim

Pretraining CNN models (i.e., UNet) through self-supervision has become a powerful approach to facilitate medical image segmentation under low annotation regimes. Recent contrastive learning methods encourage similar global representations…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Zhangsihao Yang , Mengwei Ren , Kaize Ding , Guido Gerig , Yalin Wang

In recent years, traffic flow prediction has played a crucial role in the management of intelligent transportation systems. However, traditional prediction methods are often limited by static spatial modeling, making it difficult to…

Machine Learning · Computer Science 2025-01-09 Mei Wu , Wenchao Weng , Jun Li , Yiqian Lin , Jing Chen , Dewen Seng

Convolutional neural networks (CNN) have demonstrated outstanding Compressed Sensing (CS) performance compared to traditional, hand-crafted methods. However, they are broadly limited in terms of generalisability, inductive bias and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Marlon Bran Lorenzana , Craig Engstrom , Shekhar S. Chandra

Accurate traffic prediction in real time plays an important role in Intelligent Transportation System (ITS) and travel navigation guidance. There have been many attempts to predict short-term traffic status which consider the spatial and…

Machine Learning · Computer Science 2023-02-22 Ruiyuan Jiang , Shangbo Wang , Yuli Zhang

Transformer-based Spiking Neural Networks (SNNs) integrate SNNs with global self-attention and have demonstrated impressive performance. However, existing Transformer-based SNNs suffer from two fundamental limitations. First, they typically…

Neural and Evolutionary Computing · Computer Science 2026-05-15 Lingdong Li , Hangming Zhang , Qiang Yu

Many road accidents occur due to distracted drivers. Today, driver monitoring is essential even for the latest autonomous vehicles to alert distracted drivers in order to take over control of the vehicle in case of emergency. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2019-07-19 Neslihan Kose , Okan Kopuklu , Alexander Unnervik , Gerhard Rigoll

Self-attention networks have proven to be of profound value for its strength of capturing global dependencies. In this work, we propose to model localness for self-attention networks, which enhances the ability of capturing useful local…

Computation and Language · Computer Science 2018-10-25 Baosong Yang , Zhaopeng Tu , Derek F. Wong , Fandong Meng , Lidia S. Chao , Tong Zhang

Effective and Efficient spatio-temporal modeling is essential for action recognition. Existing methods suffer from the trade-off between model performance and model complexity. In this paper, we present a novel Spatio-Temporal Hybrid…

Computer Vision and Pattern Recognition · Computer Science 2020-03-19 Xu Li , Jingwen Wang , Lin Ma , Kaihao Zhang , Fengzong Lian , Zhanhui Kang , Jinjun Wang

Traffic flow forecasting on graphs has real-world applications in many fields, such as transportation system and computer networks. Traffic forecasting can be highly challenging due to complex spatial-temporal correlations and non-linear…

Machine Learning · Computer Science 2022-07-13 Aosong Feng , Leandros Tassiulas

Spatio-temporal forecasting is fundamental to intelligent systems in transportation, climate science, and urban planning. However, training deep learning models on the massive, often redundant, datasets from these domains presents a…

Machine Learning · Computer Science 2026-03-03 Wei Chen , Junle Chen , Yuqian Wu , Yuxuan Liang , Xiaofang Zhou

Transformer-based methods have demonstrated impressive performance in low-level visual tasks such as Image Super-Resolution (SR). However, its computational complexity grows quadratically with the spatial resolution. A series of works…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Xin Liu , Jie Liu , Jie Tang , Gangshan Wu

In the field of medical CT image processing, convolutional neural networks (CNNs) have been the dominant technique.Encoder-decoder CNNs utilise locality for efficiency, but they cannot simulate distant pixel interactions properly.Recent…

Image and Video Processing · Electrical Eng. & Systems 2022-11-03 Hongyang He , Feng Ziliang , Yuanhang Zheng , Shudong Huang , HaoBing Gao

Spatial-temporal graph modeling is an important task to analyze the spatial relations and temporal trends of components in a system. Existing approaches mostly capture the spatial dependency on a fixed graph structure, assuming that the…

Machine Learning · Computer Science 2019-06-04 Zonghan Wu , Shirui Pan , Guodong Long , Jing Jiang , Chengqi Zhang

Previous methods for dynamic facial expression in the wild are mainly based on Convolutional Neural Networks (CNNs), whose local operations ignore the long-range dependencies in videos. To solve this problem, we propose the spatio-temporal…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Fuyan Ma , Bin Sun , Shutao Li

Convolutional neural networks (CNNs) have been shown to be state-of-the-art models for visual cortical neurons. Cortical neurons in the primary visual cortex are sensitive to contextual information mediated by extensive horizontal and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Isaac Lin , Tianye Wang , Shang Gao , Shiming Tang , Tai Sing Lee