English
Related papers

Related papers: PreMixer: MLP-Based Pre-training Enhanced MLP-Mixe…

200 papers

Pre-trained Large Language Models (LLMs) encapsulate large amounts of knowledge and take enormous amounts of compute to train. We make use of this resource, together with the observation that LLMs are able to transfer knowledge and…

Machine Learning · Computer Science 2025-01-14 Malcolm L. Wolff , Shenghao Yang , Kari Torkkola , Michael W. Mahoney

Modeling multiscale patterns is crucial for long-term time series forecasting (TSF). However, redundancy and noise in time series, together with semantic gaps between non-adjacent scales, make the efficient alignment and integration of…

Machine Learning · Computer Science 2026-02-19 Xu Zhang , Qitong Wang , Peng Wang , Wei Wang

With the progress of the urbanisation process, the urban transportation system is extremely critical to the development of cities and the quality of life of the citizens. Among them, it is one of the most important tasks to judge traffic…

Machine Learning · Computer Science 2023-08-17 Bodong Zhou , Jiahui Liu , Songyi Cui , Yaping Zhao

Time series forecasting (TSF) is crucial in fields like economic forecasting, weather prediction, traffic flow analysis, and public health surveillance. Real-world time series data often include noise, outliers, and missing values, making…

Machine Learning · Computer Science 2024-07-09 Quangao Liu , Ruiqi Li , Maowei Jiang , Wei Yang , Chen Liang , LongLong Pang , Zhuozhang Zou

Accurate Traffic Prediction is a challenging task in intelligent transportation due to the spatial-temporal aspects of road networks. The traffic of a road network can be affected by long-distance or long-term dependencies where existing…

Machine Learning · Computer Science 2024-04-10 Zhengyang Zhao , Haitao Yuan , Nan Jiang , Minxiao Chen , Ning Liu , Zengxiang Li

In this work, multi-step traffic predictions are leveraged to enable multi-period planning in reconfigurable optical networks. The proposed framework aims to achieve spectrum savings by adapting the network to predicted time-varying…

Networking and Internet Architecture · Computer Science 2026-05-26 Giannis Savva , Hafsa Maryam , Venkatesh Chebolu , Tania Panayiotou , Georgios Ellinas

We have developed a new framework using time-series analysis for dynamically assigning mobile network traffic prediction models in previously unseen wireless environments. Our framework selectively employs learned behaviors, outperforming…

Information Theory · Computer Science 2023-12-01 Alexander Downey , Evren Tuna , Alkan Soysal

Recent studies have attempted to refine the Transformer architecture to demonstrate its effectiveness in Long-Term Time Series Forecasting (LTSF) tasks. Despite surpassing many linear forecasting models with ever-improving performance, we…

Machine Learning · Computer Science 2024-12-30 Peiwang Tang , Weitai Zhang

Motion prediction is among the most fundamental tasks in autonomous driving. Traditional methods of motion forecasting primarily encode vector information of maps and historical trajectory data of traffic participants, lacking a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Xiaoji Zheng , Lixiu Wu , Zhijie Yan , Yuanrong Tang , Hao Zhao , Chen Zhong , Bokui Chen , Jiangtao Gong

Traffic flow forecasting is a crucial task in transportation management and planning. The main challenges for traffic flow forecasting are that (1) as the length of prediction time increases, the accuracy of prediction will decrease; (2)…

Artificial Intelligence · Computer Science 2024-05-13 Jianli Xiao , Baichao Long

Time series data, including univariate and multivariate ones, are characterized by unique composition and complex multi-scale temporal variations. They often require special consideration of decomposition and multi-scale modeling to…

Machine Learning · Computer Science 2024-03-26 Shuhan Zhong , Sizhe Song , Weipeng Zhuo , Guanyao Li , Yang Liu , S. -H. Gary Chan

Traffic prediction is a flourishing research field due to its importance in human mobility in the urban space. Despite this, existing studies only focus on short-term prediction of up to few hours in advance, with most being up to one hour…

Machine Learning · Computer Science 2023-03-06 David Alexander Tedjopurnomo , Farhana M. Choudhury , A. K. Qin

Long-term traffic prediction has always been a challenging task due to its dynamic temporal dependencies and complex spatial dependencies. In this paper, we propose a model that combines hybrid Transformer and spatio-temporal…

Machine Learning · Computer Science 2024-01-31 Wang Zhu , Doudou Zhang , Baichao Long , Jianli Xiao

Traffic forecasting is crucial for intelligent transportation systems. It has experienced significant advancements thanks to the power of deep learning in capturing latent patterns of traffic data. However, recent deep-learning…

Machine Learning · Computer Science 2026-01-19 Xusen Guo , Qiming Zhang , Junyue Jiang , Mingxing Peng , Meixin Zhu , Hao , Yang

Traffic flow forecasting aims to predict future traffic flows based on the historical traffic conditions and the road network. It is an important problem in intelligent transportation systems, with a plethora of methods been proposed.…

Machine Learning · Computer Science 2025-08-04 Yusheng Zhao , Xiao Luo , Haomin Wen , Zhiping Xiao , Wei Ju , Ming Zhang

Traffic prediction has long been a focal and pivotal area in research, witnessing both significant strides from city-level to road-level predictions in recent years. With the advancement of Vehicle-to-Everything (V2X) technologies,…

Machine Learning · Computer Science 2025-06-17 Shuhao Li , Yue Cui , Jingyi Xu , Libin Li , Lingkai Meng , Weidong Yang , Fan Zhang , Xiaofang Zhou

Large language models (LLMs) rely on pretraining on massive and heterogeneous corpora, where training data composition has a decisive impact on training efficiency and downstream generalization under realistic compute and data budget…

Computation and Language · Computer Science 2026-04-21 Zhuo Chen , Yuxuan Miao , Supryadi , Deyi Xiong

Accurate traffic prediction plays a vital role in intelligent transportation systems by enabling efficient routing, congestion mitigation, and proactive traffic control. However, forecasting is challenging due to the combined effects of…

Machine Learning · Computer Science 2025-07-08 Mohamed Hamad , Mohamed Mabrok , Nizar Zorba

Timely accurate traffic forecast is crucial for urban traffic control and guidance. Due to the high nonlinearity and complexity of traffic flow, traditional methods cannot satisfy the requirements of mid-and-long term prediction tasks and…

Machine Learning · Computer Science 2018-07-13 Bing Yu , Haoteng Yin , Zhanxing Zhu

Metro Origin-Destination (OD) prediction is a crucial yet challenging spatial-temporal prediction task in urban computing, which aims to accurately forecast cross-station ridership for optimizing metro scheduling and enhancing overall…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Yang Liu , Binglin Chen , Yongsen Zheng , Lechao Cheng , Guanbin Li , Liang Lin