English
Related papers

Related papers: HUTFormer: Hierarchical U-Net Transformer for Long…

200 papers

Text classification algorithms investigate the intricate relationships between words or phrases and attempt to deduce the document's interpretation. In the last few years, these algorithms have progressed tremendously. Transformer…

Computation and Language · Computer Science 2022-06-28 Snehal Khandve , Vedangi Wagh , Apurva Wani , Isha Joshi , Raviraj Joshi

Long-term time-series forecasting (LTTF) has become a pressing demand in many applications, such as wind power supply planning. Transformer models have been adopted to deliver high prediction capacity because of the high computational…

Machine Learning · Computer Science 2023-01-06 Yan Li , Xinjiang Lu , Haoyi Xiong , Jian Tang , Jiantao Su , Bo Jin , Dejing Dou

To capture spatial relationships and temporal dynamics in traffic data, spatio-temporal models for traffic forecasting have drawn significant attention in recent years. Most of the recent works employed graph neural networks(GNN) with…

Machine Learning · Computer Science 2021-04-02 Amit Roy , Kashob Kumar Roy , Amin Ahsan Ali , M Ashraful Amin , A K M Mahbubur Rahman

Traditional traffic prediction, limited by the scope of sensor data, falls short in comprehensive traffic management. Mobile networks offer a promising alternative using network activity counts, but these lack crucial directionality. Thus,…

Machine Learning · Computer Science 2024-05-29 ChungYi Lin , Shen-Lung Tung , Hung-Ting Su , Winston H. Hsu

Traffic flow forecasting is a crucial first step in intelligent and proactive traffic management. Traffic flow parameters are volatile and uncertain, making traffic flow forecasting a difficult task if the appropriate forecasting model is…

Machine Learning · Computer Science 2024-06-04 Jewel Rana Palit , Osama A Osman

Reducing traffic accidents is a crucial global public safety concern. Accident prediction is key to improving traffic safety, enabling proactive measures to be taken before a crash occurs, and informing safety policies, regulations, and…

Time-evolving traffic flow forecasting are playing a vital role in intelligent transportation systems and smart cities. However, the dynamic traffic flow forecasting is a highly nonlinear problem with complex temporal-spatial dependencies.…

Machine Learning · Computer Science 2025-08-05 Zhenan Lin , Yuni Lai , Wai Lun Lo , Richard Tai-Chiu Hsung , Harris Sik-Ho Tsang , Xiaoyu Xue , Kai Zhou , Yulin Zhu

Traffic prediction is the cornerstone of an intelligent transportation system. Accurate traffic forecasting is essential for the applications of smart cities, i.e., intelligent traffic management and urban planning. Although various methods…

Machine Learning · Computer Science 2021-05-04 Fuxian Li , Jie Feng , Huan Yan , Guangyin Jin , Depeng Jin , Yong Li

Temporal graph classification plays a critical role in applications such as cybersecurity, brain connectivity analysis, social dynamics, and traffic monitoring. Despite its significance, this problem remains underexplored compared to…

Machine Learning · Computer Science 2025-11-26 Md. Joshem Uddin , Soham Changani , Baris Coskunuzer

In this paper, we tackle the challenge of predicting stock movements in financial markets by introducing Higher Order Transformers, a novel architecture designed for processing multivariate time-series data. We extend the self-attention…

Machine Learning · Computer Science 2024-12-17 Soroush Omranpour , Guillaume Rabusseau , Reihaneh Rabbany

How to build an effective large-scale traffic state prediction system is a challenging but highly valuable problem. This study focuses on the construction of an effective solution designed for spatio-temporal data to predict large-scale…

Machine Learning · Computer Science 2019-11-14 Yang Liu , Fanyou Wu , Baosheng Yu , Zhiyuan Liu , Jieping Ye

Graph Transformer is gaining increasing attention in the field of machine learning and has demonstrated state-of-the-art performance on benchmarks for graph representation learning. However, as current implementations of Graph Transformer…

Machine Learning · Computer Science 2023-05-08 Wenhao Zhu , Tianyu Wen , Guojie Song , Xiaojun Ma , Liang Wang

Accurate and timely traffic flow forecasting is crucial for intelligent transportation systems. This paper presents a novel deep learning model, the Spatial-Temporal Unified Graph Attention Network (STGAtt). By leveraging a unified graph…

Machine Learning · Computer Science 2025-08-26 Zhuding Liang , Jianxun Cui , Qingshuang Zeng , Feng Liu , Nenad Filipovic , Tijana Geroski

Traffic flow forecasting has been regarded as a key problem of intelligent transport systems. In this work, we propose a hybrid multimodal deep learning method for short-term traffic flow forecasting, which can jointly and adaptively learn…

Machine Learning · Computer Science 2019-03-20 Shengdong Du , Tianrui Li , Xun Gong , Shi-Jinn Horng

To safely and rationally participate in dense and heterogeneous traffic, autonomous vehicles require to sufficiently analyze the motion patterns of surrounding traffic-agents and accurately predict their future trajectories. This is…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Weihuang Chen , Fangfang Wang , Hongbin Sun

Industrial large-scale recommendation models (LRMs) face the challenge of jointly modeling long-range user behavior sequences and heterogeneous non-sequential features under strict efficiency constraints. However, most existing…

Information Retrieval · Computer Science 2026-01-26 Yunwen Huang , Shiyong Hong , Xijun Xiao , Jinqiu Jin , Xuanyuan Luo , Zhe Wang , Zheng Chai , Shikang Wu , Yuchao Zheng , Jingjian Lin

Convolutional neural network (CNN) based methods have achieved great successes in medical image segmentation, but their capability to learn global representations is still limited due to using small effective receptive fields of convolution…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Pengfei Gu , Yejia Zhang , Chaoli Wang , Danny Z. Chen

Short-term road traffic prediction (STTP) is one of the most important modules in Intelligent Transportation Systems (ITS). However, network-level STTP still remains challenging due to the difficulties both in modeling the diverse traffic…

Machine Learning · Computer Science 2019-02-27 Lingyi Han , Kan Zheng , Long Zhao , Xianbin Wang , Xuemin Shen

Autonomous vehicles operating in complex real-world environments require accurate predictions of interactive behaviors between traffic participants. This paper tackles the interaction prediction problem by formulating it with hierarchical…

Robotics · Computer Science 2023-08-15 Zhiyu Huang , Haochen Liu , Chen Lv

Semantic segmentation has witnessed remarkable advancements with the adaptation of the Transformer architecture. Parallel to the strides made by the Transformer, CNN-based U-Net has seen significant progress, especially in high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Seul-Ki Yeom , Julian von Klitzing