English
Related papers

Related papers: MSMixer: Learned Multi-Scale Temporal Mixing with …

200 papers

Multivariate time series forecasting has seen widely ranging applications in various domains, including finance, traffic, energy, and healthcare. To capture the sophisticated temporal patterns, plenty of research studies designed complex…

Machine Learning · Computer Science 2022-07-05 Tianping Zhang , Yizhuo Zhang , Wei Cao , Jiang Bian , Xiaohan Yi , Shun Zheng , Jian Li

Time series forecasting is a fundamental tool with wide ranging applications, yet recent debates question whether complex nonlinear architectures truly outperform simple linear models. Prior claims of dominance of the linear model often…

Machine Learning · Computer Science 2026-02-13 Md Rakibul Haque , Vishwa Goudar , Shireen Elhabian , Warren Woodrich Pettine

This study presents a novel time series prediction model, FPN-fusion, designed with linear computational complexity, demonstrating superior predictive performance compared to DLiner without increasing parameter count or computational…

Machine Learning · Computer Science 2024-06-12 Chu Li , Pingjia Xiao , Qiping Yuan

Long-term Time Series Forecasting (LTSF) is critical for numerous real-world applications, such as electricity consumption planning, financial forecasting, and disease propagation analysis. LTSF requires capturing long-range dependencies…

Machine Learning · Computer Science 2024-10-04 Aitian Ma , Dongsheng Luo , Mo Sha

Recent lightweight MLP-based models have achieved strong performance in time series forecasting by capturing stable trends and seasonal patterns. However, their effectiveness hinges on an implicit assumption of local stationarity…

Machine Learning · Computer Science 2026-01-29 Zhiyu Chen , Minhao Liu , Yanru Zhang

Parallelism is a ubiquitous method for accelerating machine learning algorithms. However, theoretical analysis of parallel learning is usually done in an algorithm- and protocol-specific setting, giving little insight about how changes in…

Machine Learning · Computer Science 2020-06-09 Yucheng Lu , Jack Nash , Christopher De Sa

Time series analysis plays a critical role in numerous applications, supporting tasks such as forecasting, classification, anomaly detection, and imputation. In this work, we present the time series pattern machine (TSPM), a model designed…

Machine Learning · Computer Science 2025-05-20 Shiyu Wang , Jiawei Li , Xiaoming Shi , Zhou Ye , Baichuan Mo , Wenze Lin , Shengtong Ju , Zhixuan Chu , Ming Jin

Accurate forecasting of long-term time series has important applications for decision making and planning. However, it remains challenging to capture the long-term dependencies in time series data. To better extract long-term dependencies,…

Machine Learning · Computer Science 2024-05-15 Feifei Li , Suhan Guo , Feng Han , Jian Zhao , Furao Shen

Multivariate time series forecasting involves predicting future values based on historical observations. However, existing approaches primarily rely on predefined single-scale patches or lack effective mechanisms for multi-scale feature…

Machine Learning · Computer Science 2025-09-24 Huanyao Zhang , Jiaye Lin , Wentao Zhang , Haitao Yuan , Guoliang Li

Transformer-based models have emerged as promising tools for time series forecasting. However, these model cannot make accurate prediction for long input time series. On the one hand, they failed to capture global dependencies within time…

Machine Learning · Computer Science 2023-08-16 YanJun Zhao , Ziqing Ma , Tian Zhou , Liang Sun , Mengni Ye , Yi Qian

The field of time series forecasting is rapidly advancing, with recent large-scale Transformers and lightweight Multilayer Perceptron (MLP) models showing strong predictive performance. However, conventional Transformer models are often…

Machine Learning · Computer Science 2025-08-13 Zheng Zhou , Yu-Jie Xiong , Jia-Chen Zhang , Chun-Ming Xia , Xi-Jiong Xie

While LLMs have demonstrated remarkable potential in time series forecasting, their practical deployment remains constrained by excessive computational demands and memory footprints. Existing LLM-based approaches typically suffer from three…

Computation and Language · Computer Science 2025-03-11 Haoran Fan , Bin Li , Yixuan Weng , Shoujun Zhou

Time series forecasting (TSF) plays a crucial role in various domains, including web data analysis, energy consumption prediction, and weather forecasting. While Multi-Layer Perceptrons (MLPs) are lightweight and effective for capturing…

Machine Learning · Computer Science 2026-03-05 Zhengnan Li , Haoxuan Li , Hao Wang , Jun Fang , Yuting Tan , Xilong Cheng Yunxiao Qin

Sequential data naturally have different lengths in many domains, with some very long sequences. As an important modeling tool, neural attention should capture long-range interaction in such sequences. However, most existing neural…

Machine Learning · Computer Science 2023-05-09 Ruslan Khalitov , Tong Yu , Lei Cheng , Zhirong Yang

Industrial recommender systems critically depend on high-quality ranking models. However, traditional pipelines still rely on manual feature engineering and scenario-specific architectures, which hinder cross-scenario transfer and…

Information Retrieval · Computer Science 2025-10-20 Xianyang Qi , Yuan Tian , Zhaoyu Hu , Zhirui Kuai , Chang Liu , Hongxiang Lin , Lei Wang

Recent studies have shown that by introducing prior knowledge, multi-scale analysis of complex and non-stationary time series in real environments can achieve good results in the field of long-term forecasting. However, affected by…

Machine Learning · Computer Science 2025-05-26 Bin Wang , Heming Yang , Jinfang Sheng

Multivariate time series forecasting is widely used in various fields. Reasonable prediction results can assist people in planning and decision-making, generate benefits and avoid risks. Normally, there are two characteristics of time…

Machine Learning · Computer Science 2021-03-23 Yifu Zhou , Ziheng Duan , Haoyan Xu , Jie Feng , Anni Ren , Yueyang Wang , Xiaoqian Wang

The performance of transformers for time-series forecasting has improved significantly. Recent architectures learn complex temporal patterns by segmenting a time-series into patches and using the patches as tokens. The patch size controls…

Machine Learning · Computer Science 2024-03-25 Yitian Zhang , Liheng Ma , Soumyasundar Pal , Yingxue Zhang , Mark Coates

As foundational models reshape scientific discovery, a bottleneck persists in dynamical system reconstruction (DSR): the ability to learn across system hierarchies. Many meta-learning approaches have been applied successfully to single…

Machine Learning · Computer Science 2025-06-12 Roussel Desmond Nzoyem , Grant Stevens , Amarpal Sahota , David A. W. Barton , Tom Deakin

TwinFormer is a hierarchical Transformer for long-sequence time-series forecasting. It divides the input into non-overlapping temporal patches and processes them in two stages: (1) a Local Informer with top-$k$ Sparse Attention models…

Machine Learning · Computer Science 2025-12-16 Mahima Kumavat , Aditya Maheshwari