中文
相关论文

相关论文: PhaseFormer: From Patches to Phases for Efficient …

200 篇论文

The stable periodic patterns present in time series data serve as the foundation for conducting long-horizon forecasts. In this paper, we pioneer the exploration of explicitly modeling this periodicity to enhance the performance of models…

机器学习 · 计算机科学 2024-10-16 Shengsheng Lin , Weiwei Lin , Xinyi Hu , Wentai Wu , Ruichao Mo , Haocheng Zhong

Recent studies have attempted to refine the Transformer architecture to demonstrate its effectiveness in Long-Term Time Series Forecasting (LTSF) tasks. Despite surpassing many linear forecasting models with ever-improving performance, we…

机器学习 · 计算机科学 2024-12-30 Peiwang Tang , Weitai Zhang

Time-series forecasting is fundamental in industrial domains like manufacturing and smart factories. As systems evolve toward automation, models must operate on edge devices (e.g., PLCs, microcontrollers) with strict constraints on latency…

机器学习 · 计算机科学 2026-01-19 Jaehoon Lee , Seungwoo Lee , Younghwi Kim , Dohee Kim , Sunghyun Sim

Time series forecasting requires architectures that simultaneously achieve three competing objectives: (1) strict temporal causality for reliable predictions, (2) sub-quadratic complexity for practical scalability, and (3) multi-scale…

机器学习 · 计算机科学 2025-11-25 Qianru Zhang , Honggang Wen , Ming Li , Dong Huang , Siu-Ming Yiu , Christian S. Jensen , Pietro Liò

Bases have become an integral part of modern deep learning-based models for time series forecasting due to their ability to act as feature extractors or future references. To be effective, a basis must be tailored to the specific set of…

机器学习 · 计算机科学 2024-01-19 Zelin Ni , Hang Yu , Shizhan Liu , Jianguo Li , Weiyao Lin

The attention mechanism has demonstrated remarkable potential in sequence modeling, exemplified by its successful application in natural language processing with models such as Bidirectional Encoder Representations from Transformers (BERT)…

机器学习 · 计算机科学 2025-11-26 Bowen Zhao , Huanlai Xing , Zhiwen Xiao , Jincheng Peng , Li Feng , Xinhan Wang , Rong Qu , Hui Li

Transformer-based models, despite their promise for long-term time series forecasting (LTSF), suffer from an inherent low-pass filtering effect that limits their effectiveness. This issue arises due to undifferentiated propagation of…

机器学习 · 计算机科学 2026-01-23 Jingjing Bai , Yoshinobu Kawahara

Modern time series forecasting methods, such as Transformer and its variants, have shown strong ability in sequential data modeling. To achieve high performance, they usually rely on redundant or unexplainable structures to model complex…

机器学习 · 计算机科学 2023-11-30 Jingyi Hou , Zhen Dong , Jiayu Zhou , Zhijie Liu

Among the existing Transformer-based multivariate time series forecasting methods, iTransformer, which treats each variable sequence as a token and only explicitly extracts cross-variable dependencies, and PatchTST, which adopts a…

机器学习 · 计算机科学 2025-01-08 Liyang Qin , Xiaoli Wang , Chunhua Yang , Huaiwen Zou , Haochuan Zhang

We propose an efficient design of Transformer-based models for multivariate time series forecasting and self-supervised representation learning. It is based on two key components: (i) segmentation of time series into subseries-level patches…

机器学习 · 计算机科学 2023-03-07 Yuqi Nie , Nam H. Nguyen , Phanwadee Sinthong , Jayant Kalagnanam

Time series forecasting is crucial for various applications, such as weather forecasting, power load forecasting, and financial analysis. In recent studies, MLP-mixer models for time series forecasting have been shown as a promising…

机器学习 · 计算机科学 2024-12-24 Md Mahmuddun Nabi Murad , Mehmet Aktukmak , Yasin Yilmaz

Time series forecasting (TSF) is crucial in fields like economic forecasting, weather prediction, traffic flow analysis, and public health surveillance. Real-world time series data often include noise, outliers, and missing values, making…

机器学习 · 计算机科学 2024-07-09 Quangao Liu , Ruiqi Li , Maowei Jiang , Wei Yang , Chen Liang , LongLong Pang , Zhuozhang Zou

Time series forecasting at scale presents significant challenges for modern prediction systems, particularly when dealing with large sets of synchronized series, such as in a global payment network. In such systems, three key challenges…

Time series forecasting remains a critical challenge across various domains, often complicated by high-dimensional data and long-term dependencies. This paper presents a novel transformer architecture for time series forecasting,…

机器学习 · 计算机科学 2025-02-12 Yanlong Wang , Jian Xu , Fei Ma , Shao-Lun Huang , Danny Dongning Sun , Xiao-Ping Zhang

With the development of Internet of Things (IoT) systems, precise long-term forecasting method is requisite for decision makers to evaluate current statuses and formulate future policies. Currently, Transformer and MLP are two paradigms for…

机器学习 · 计算机科学 2023-12-12 Li Shen , Yuning Wei , Yangzhu Wang , Hongguang Li

There has been a recent surge of interest in time series modeling using the Transformer architecture. However, forecasting multivariate time series with Transformer presents a unique challenge as it requires modeling both temporal…

机器学习 · 计算机科学 2025-07-04 Yu-Hsiang Lan , Eric K. Oermann

Reliable periodic patterns serve as a fundamental basis for accurate multivariate time series forecasting. However, existing methods either implicitly extract periodicity through complex model architectures (e.g., Transformers) with high…

机器学习 · 计算机科学 2026-05-06 Yingbo Zhou , Yutong Ye , Zhiwei Ling , Shuhao Li , Rui Qian , Jian Xiong , Li Sun , Dejing Dou

Particle accelerators are complex facilities that produce large amounts of structured data and have clear optimization goals as well as precisely defined control requirements. As such they are naturally amenable to data-driven research…

加速器物理 · 物理学 2023-03-01 Sichen Li , Andreas Adelmann

Although Transformer-based methods have significantly improved state-of-the-art results for long-term series forecasting, they are not only computationally expensive but more importantly, are unable to capture the global view of time series…

机器学习 · 计算机科学 2022-06-17 Tian Zhou , Ziqing Ma , Qingsong Wen , Xue Wang , Liang Sun , Rong Jin

Accurate forecasting of multivariate time series remains challenging due to the need to capture both short-term fluctuations and long-range temporal dependencies. Transformer-based models have emerged as a powerful approach, but their…

机器学习 · 计算机科学 2026-03-26 Aymane Harkati , Moncef Garouani , Olivier Teste , Julien Aligon , Mohamed Hamlich