English
Related papers

Related papers: Pathformer: Multi-scale Transformers with Adaptive…

200 papers

Time series forecasting holds significant importance across various industries, including finance, transportation, energy, healthcare, and climate. Despite the widespread use of linear networks due to their low computational cost and…

Machine Learning · Computer Science 2025-05-02 Chengsen Wang , Qi Qi , Jingyu Wang , Haifeng Sun , Zirui Zhuang , Jianxin Liao

Multivariate time series (MTS) forecasting has been extensively applied across diverse domains, such as weather prediction and energy consumption. However, current studies still rely on the vanilla point-wise self-attention mechanism to…

Machine Learning · Computer Science 2024-05-21 Yingnan Yang , Qingling Zhu , Jianyong Chen

Temporal Graph Neural Networks have garnered substantial attention for their capacity to model evolving structural and temporal patterns while exhibiting impressive performance. However, it is known that these architectures are encumbered…

Machine Learning · Computer Science 2024-02-12 Mahdi Biparva , Raika Karimi , Faezeh Faez , Yingxue Zhang

AI-based methods have been widely applied to tourism demand forecasting. However, current AI-based methods are short of the ability to process long-term dependency, and most of them lack interpretability. The Transformer used initially for…

Machine Learning · Computer Science 2021-07-26 Siyuan Yi , Xing Chen , Chuanming Tang

Time series forecasting (TSF) faces challenges in modeling complex intra-channel temporal dependencies and inter-channel correlations. Although recent research has highlighted the efficiency of linear architectures in capturing global…

Machine Learning · Computer Science 2026-01-29 Gawon Lee , Hanbyeol Park , Minseop Kim , Dohee Kim , Hyerim Bae

Time series forecasting plays a crucial role in decision-making across various domains, but it presents significant challenges. Recent studies have explored image-driven approaches using computer vision models to address these challenges,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Zhen Zeng , Rachneet Kaur , Suchetha Siddagangappa , Tucker Balch , Manuela Veloso

Long-term traffic prediction has always been a challenging task due to its dynamic temporal dependencies and complex spatial dependencies. In this paper, we propose a model that combines hybrid Transformer and spatio-temporal…

Machine Learning · Computer Science 2024-01-31 Wang Zhu , Doudou Zhang , Baichao Long , Jianli Xiao

Time series forecasting is extensively applied across diverse domains. Transformer-based models demonstrate significant potential in modeling cross-time and cross-variable interaction. However, we notice that the cross-variable correlation…

Machine Learning · Computer Science 2024-10-08 Ao Hu , Dongkai Wang , Yong Dai , Shiyi Qi , Liangjian Wen , Jun Wang , Zhi Chen , Xun Zhou , Zenglin Xu , Jiang Duan

Time series data is ubiquitous in research as well as in a wide variety of industrial applications. Effectively analyzing the available historical data and providing insights into the far future allows us to make effective decisions. Recent…

Machine Learning · Computer Science 2022-10-24 Kiran Madhusudhanan , Johannes Burchert , Nghia Duong-Trung , Stefan Born , Lars Schmidt-Thieme

Reasoning about vehicle path prediction is an essential and challenging problem for the safe operation of autonomous driving systems. There exist many research works for path prediction. However, most of them do not use lane information and…

Robotics · Computer Science 2022-08-16 Chia Hong Tseng , Jie Zhang , Min-Te Sun , Kazuya Sakai , Wei-Shinn Ku

Long-term time series forecasting (LTSF) is a critical task in computational intelligence. While Transformer-based models effectively capture long-range dependencies, they often suffer from quadratic complexity and overfitting due to data…

Machine Learning · Computer Science 2025-12-03 Li Qianyang , Zhang Xingjun , Wang Shaoxun , Wei Jia

Trajectory prediction is fundamental to various intelligent technologies, such as autonomous driving and robotics. The motion prediction of pedestrians and vehicles helps emergency braking, reduces collisions, and improves traffic safety.…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Yao Liu , Binghao Li , Xianzhi Wang , Claude Sammut , Lina Yao

The Transformer and its variants have been proven to be efficient sequence learners in many different domains. Despite their staggering success, a critical issue has been the enormous number of parameters that must be trained (ranging from…

Machine Learning · Computer Science 2021-10-28 Subhabrata Dutta , Tanya Gautam , Soumen Chakrabarti , Tanmoy Chakraborty

The Transformer model has shown leading performance in time series forecasting. Nevertheless, in some complex scenarios, it tends to learn low-frequency features in the data and overlook high-frequency features, showing a frequency bias.…

Machine Learning · Computer Science 2024-07-04 Xihao Piao , Zheng Chen , Taichi Murayama , Yasuko Matsubara , Yasushi Sakurai

Producing probabilistic forecasts for large collections of similar and/or dependent time series is a practically relevant and challenging task. Classical time series models fail to capture complex patterns in the data, and multivariate…

Machine Learning · Statistics 2019-05-30 Yuyang Wang , Alex Smola , Danielle C. Maddix , Jan Gasthaus , Dean Foster , Tim Januschowski

Time series forecasting requires models that can efficiently capture complex temporal dependencies, especially in large-scale and high-dimensional settings. While Transformer-based architectures excel at modeling long-range dependencies,…

Machine Learning · Computer Science 2025-12-12 Moulik Gupta , Achyut Mani Tripathi

Predicting motion of surrounding agents is critical to real-world applications of tactical path planning for autonomous driving. Due to the complex temporal dependencies and social interactions of agents, on-line trajectory prediction is a…

Computer Vision and Pattern Recognition · Computer Science 2021-02-08 Jingwen Zhao , Xuanpeng Li , Qifan Xue , Weigong Zhang

Due to the powerful ability in capturing the global information, Transformer has become an alternative architecture of CNNs for hyperspectral image classification. However, general Transformer mainly considers the global spectral…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Zhiqiang Gong , Xian Zhou , Wen Yao

Modeling continuous-time dynamics on irregular time series is critical to account for data evolution and correlations that occur continuously. Traditional methods including recurrent neural networks or Transformer models leverage inductive…

Machine Learning · Computer Science 2024-02-19 Yuqi Chen , Kan Ren , Yansen Wang , Yuchen Fang , Weiwei Sun , Dongsheng Li

The real-time crash likelihood prediction model is an essential component of the proactive traffic safety management system. Over the years, numerous studies have attempted to construct a crash likelihood prediction model in order to…

Machine Learning · Computer Science 2023-08-30 B M Tazbiul Hassan Anik , Zubayer Islam , Mohamed Abdel-Aty