English
Related papers

Related papers: A Temporal Kolmogorov-Arnold Transformer for Time …

200 papers

Multi-horizon time series forecasting has many practical applications such as demand forecasting. Accurate demand prediction is critical to help make buying and inventory decisions for supply chain management of e-commerce and physical…

Multivariate time series anomaly detection (MTAD) plays a vital role in a wide variety of real-world application domains. Over the past few years, MTAD has attracted rapidly increasing attention from both academia and industry. Many deep…

Machine Learning · Computer Science 2023-06-13 Feng Xia , Xin Chen , Shuo Yu , Mingliang Hou , Mujie Liu , Linlin You

Time series forecasting is a key component in many industrial and business decision processes and recurrent neural network (RNN) based models have achieved impressive progress on various time series forecasting tasks. However, most of the…

Machine Learning · Computer Science 2021-01-26 Zekai Chen , Jiaze E , Xiao Zhang , Hao Sheng , Xiuzheng Cheng

Climate change stands as one of the most pressing global challenges of the twenty-first century, with far-reaching consequences such as rising sea levels, melting glaciers, and increasingly extreme weather patterns. Accurate forecasting is…

Machine Learning · Computer Science 2025-06-17 Tajamul Ashraf , Janibul Bashir

There has been a recent surge of interest in time series modeling using the Transformer architecture. However, forecasting multivariate time series with Transformer presents a unique challenge as it requires modeling both temporal…

Machine Learning · Computer Science 2025-07-04 Yu-Hsiang Lan , Eric K. Oermann

Clustering high-dimensional multivariate spatiotemporal climate data is challenging due to complex temporal dependencies, evolving spatial interactions, and non-stationary dynamics. Conventional clustering methods, including recurrent and…

Machine Learning · Computer Science 2025-09-17 Francis Ndikum Nji , Vandana Janaja , Jianwu Wang

Kolmogorov-Arnold Network (KAN) is a novel multi-layer neuromorphic network. Many groups worldwide have studied this network, including image processing, time series analysis, solving physical problems, and practical applications such as…

Quantum Physics · Physics 2025-06-05 Hikaru Wakaura , Rahmat Mulyawan , Andriyan B. Suksmono

Transformer-based models have significantly advanced time series forecasting. Recent work, like the Cross-Attention-only Time Series transformer (CATS), shows that removing self-attention can make the model more accurate and efficient.…

Machine Learning · Computer Science 2025-09-08 Jiajun Song , Xiaoou Liu

Time series forecasting is essential for a wide range of real-world applications. Recent studies have shown the superiority of Transformer in dealing with such problems, especially long sequence time series input(LSTI) and long sequence…

Machine Learning · Computer Science 2022-02-15 Li Shen , Yangzhu Wang

Detecting and analyzing complex patterns in multivariate time-series data is crucial for decision-making in urban and environmental system operations. However, challenges arise from the high dimensionality, intricate complexity, and…

Machine Learning · Computer Science 2024-12-25 Haowen Xu , Ali Boyaci , Jianming Lian , Aaron Wilson

Time series classification is a relevant step supporting decision-making processes in various domains, and deep neural models have shown promising performance in this respect. Despite significant advancements in deep learning, the…

Machine Learning · Computer Science 2025-11-04 Irina Barašin , Blaž Bertalanič , Mihael Mohorčič , Carolina Fortuna

While Transformers have revolutionized machine learning on various data, existing Transformers for temporal graphs face limitations in (1) restricted receptive fields, (2) overhead of subgraph extraction, and (3) suboptimal generalization…

Machine Learning · Computer Science 2024-12-03 Kay Liu , Jiahao Ding , MohamadAli Torkamani , Philip S. Yu

Transformer-based time series forecasting has recently gained strong interest due to the ability of transformers to model sequential data. Most of the state-of-the-art architectures exploit either temporal or inter-channel dependencies,…

Machine Learning · Computer Science 2025-03-25 Davide Villaboni , Alberto Castellini , Ivan Luciano Danesi , Alessandro Farinelli

Long-term time series forecasting using transformers is hampered by the quadratic complexity of self-attention and the rigidity of uniform patching, which may be misaligned with the data's semantic structure. In this paper, we introduce the…

Machine Learning · Computer Science 2026-01-05 Maximilian Reinwardt , Michael Eichelbeck , Matthias Althoff

The increasing accessibility and precision of Earth observation satellite data offers considerable opportunities for industrial and state actors alike. This calls however for efficient methods able to process time-series on a global scale.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-09 Vivien Sainte Fare Garnot , Loic Landrieu

Traffic forecasting is an integral part of intelligent transportation systems (ITS). Achieving a high prediction accuracy is a challenging task due to a high level of dynamics and complex spatial-temporal dependency of road networks. For…

Machine Learning · Computer Science 2021-10-28 Sikai Zhang , Hong Zheng , Hongyi Su , Bo Yan , Jiamou Liu , Song Yang

This work introduces Probabilistic Kolmogorov-Arnold Network (P-KAN), a novel probabilistic extension of Kolmogorov-Arnold Networks (KANs) for time series forecasting. By replacing scalar weights with spline-based functional connections and…

Machine Learning · Computer Science 2025-10-21 Cristian J. Vaca-Rubio , Roberto Pereira , Luis Blanco , Engin Zeydan , Màrius Caus

The recent boom of linear forecasting models questions the ongoing passion for architectural modifications of Transformer-based forecasters. These forecasters leverage Transformers to model the global dependencies over temporal tokens of…

Machine Learning · Computer Science 2024-03-15 Yong Liu , Tengge Hu , Haoran Zhang , Haixu Wu , Shiyu Wang , Lintao Ma , Mingsheng Long

Inductive representation learning on temporal graphs is an important step toward salable machine learning on real-world dynamic networks. The evolving nature of temporal dynamic graphs requires handling new nodes as well as capturing…

Machine Learning · Computer Science 2020-02-20 Da Xu , Chuanwei Ruan , Evren Korpeoglu , Sushant Kumar , Kannan Achan

The scope of data-driven fault diagnosis models is greatly extended through deep learning (DL). However, the classical convolution and recurrent structure have their defects in computational efficiency and feature representation, while the…

Artificial Intelligence · Computer Science 2021-12-07 Yifei Ding , Minping Jia , Qiuhua Miao , Yudong Cao