English
Related papers

Related papers: HUTFormer: Hierarchical U-Net Transformer for Long…

200 papers

Transient computational fluid dynamics (CFD) remains expensive when long horizons and multi-scale turbulence are involved. Data-driven surrogates promise relief, yet many degrade over multiple steps or drift from physical behavior. This…

Fluid Dynamics · Physics 2025-12-01 Blaise Madiega , Mathieu Olivier

Long-term weather forecasting is critical for socioeconomic planning and disaster preparedness. While recent approaches employ finetuning to extend prediction horizons, they remain constrained by the issues of catastrophic forgetting, error…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Hao Chen , Tao Han , Jie Zhang , Song Guo , Fenghua Ling , Lei Bai

With the process of urbanization and the rapid growth of population, the issue of traffic congestion has become an increasingly critical concern. Intelligent transportation systems heavily rely on real-time and precise prediction algorithms…

Artificial Intelligence · Computer Science 2025-01-03 Zihao Jing

The self-attention mechanism in Transformer architecture, invariant to sequence order, necessitates positional embeddings to encode temporal order in time series prediction. We argue that this reliance on positional embeddings restricts the…

Machine Learning · Computer Science 2024-08-21 Yongbo Yu , Weizhong Yu , Feiping Nie , Xuelong Li

Accurate traffic flow forecasting is a crucial research topic in transportation management. However, it is a challenging problem due to rapidly changing traffic conditions, high nonlinearity of traffic flow, and complex spatial and temporal…

Machine Learning · Computer Science 2024-06-06 Sanghyun Lee , Chanyoung Park

Deep learning approaches have reached a celebrity status in artificial intelligence field, its success have mostly relied on Convolutional Networks (CNN) and Recurrent Networks. By exploiting fundamental spatial properties of images and…

Computer Vision and Pattern Recognition · Computer Science 2016-12-06 Yuankai Wu , Huachun Tan

The computer vision community has witnessed an extensive exploration of vision transformers in the past two years. Drawing inspiration from traditional schemes, numerous works focus on introducing vision-specific inductive biases. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Hao Wang , Shuo Zhang , Biao Leng

Effective traffic prediction is a cornerstone of intelligent transportation systems, enabling precise forecasts of traffic flow, speed, and congestion. While traditional spatio-temporal graph neural networks (ST-GNNs) have achieved notable…

Machine Learning · Computer Science 2025-01-20 Xiaoyang Cao , Dingyi Zhuang , Jinhua Zhao , Shenhao Wang

Graph neural networks based on iterative one-hop message passing have been shown to struggle in harnessing the information from distant nodes effectively. Conversely, graph transformers allow each node to attend to all other nodes directly,…

Machine Learning · Computer Science 2024-06-06 Yuhui Ding , Antonio Orvieto , Bobby He , Thomas Hofmann

Due to the complex and changing interactions in dynamic scenarios, motion forecasting is a challenging problem in autonomous driving. Most existing works exploit static road graphs to characterize scenarios and are limited in modeling…

Artificial Intelligence · Computer Science 2023-03-09 Xing Gao , Xiaogang Jia , Yikang Li , Hongkai Xiong

Accurate traffic flow prediction, a hotspot for intelligent transportation research, is the prerequisite for mastering traffic and making travel plans. The speed of traffic flow can be affected by roads condition, weather, holidays, etc.…

Machine Learning · Computer Science 2022-12-15 Jianlei Kong , Xiaomeng Fan , Xue-Bo Jin , Min Zuo

We present Higher-Order Tensor RNN (HOT-RNN), a novel family of neural sequence architectures for multivariate forecasting in environments with nonlinear dynamics. Long-term forecasting in such systems is highly challenging, since there…

Machine Learning · Computer Science 2019-08-27 Rose Yu , Stephan Zheng , Anima Anandkumar , Yisong Yue

Understanding the traffic scenes and then generating high-definition (HD) maps present significant challenges in autonomous driving. In this paper, we defined a novel Traffic Topology Scene Graph, a unified scene graph explicitly modeling…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Changsheng Lv , Mengshi Qi , Liang Liu , Huadong Ma

Accurate and real-time traffic forecasting plays an important role in the Intelligent Traffic System and is of great significance for urban traffic planning, traffic management, and traffic control. However, traffic forecasting has always…

Machine Learning · Computer Science 2019-08-13 Ling Zhao , Yujiao Song , Chao Zhang , Yu Liu , Pu Wang , Tao Lin , Min Deng , Haifeng Li

We present an innovative framework for traffic dynamics analysis using High-Order Evolving Graphs, designed to improve spatio-temporal representations in autonomous driving contexts. Our approach constructs temporal bidirectional bipartite…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Aditya Humnabadkar , Arindam Sikdar , Benjamin Cave , Huaizhong Zhang , Paul Bakaki , Ardhendu Behera

As an important part of intelligent transportation systems, traffic forecasting has attracted tremendous attention from academia and industry. Despite a lot of methods being proposed for traffic forecasting, it is still difficult to model…

Machine Learning · Computer Science 2022-10-07 Le Zhao , Mingcai Chen , Yuntao Du , Haiyang Yang , Chongjun Wang

Recently, the superiority of Transformer for long-term time series forecasting (LTSF) tasks has been challenged, particularly since recent work has shown that simple models can outperform numerous Transformer-based approaches. This suggests…

Machine Learning · Computer Science 2023-10-10 Shengsheng Lin , Weiwei Lin , Wentai Wu , Songbo Wang , Yongxiang Wang

Traffic speed forecasting is one of the core problems in transportation systems. For a more accurate prediction, recent studies started using not only the temporal speed patterns but also the spatial information on the road network through…

Machine Learning · Computer Science 2022-09-27 Kyungeun Lee , Wonjong Rhee

Unmanned aerial vehicles (UAVs) are pivotal for future 6G non-terrestrial networks, yet their high mobility creates a complex coupled optimization problem for beamforming and trajectory design. Existing numerical methods suffer from…

Signal Processing · Electrical Eng. & Systems 2026-04-20 Ruiqi Wang , Essra M. Ghoura , Omar Alhussein , Yuzhi Yang , Jing Ren , Shizhong Xu , Sami Muhaidat

Transformer architecture has emerged to be successful in a number of natural language processing tasks. However, its applications to medical vision remain largely unexplored. In this study, we present UTNet, a simple yet powerful hybrid…

Computer Vision and Pattern Recognition · Computer Science 2021-09-29 Yunhe Gao , Mu Zhou , Dimitris Metaxas