English
Related papers

Related papers: TSMixer: An All-MLP Architecture for Time Series F…

200 papers

Time series analysis plays a critical role in numerous applications, supporting tasks such as forecasting, classification, anomaly detection, and imputation. In this work, we present the time series pattern machine (TSPM), a model designed…

Machine Learning · Computer Science 2025-05-20 Shiyu Wang , Jiawei Li , Xiaoming Shi , Zhou Ye , Baichuan Mo , Wenze Lin , Shengtong Ju , Zhixuan Chu , Ming Jin

Time series, characterized by a sequence of data points organized in a discrete-time order, are ubiquitous in real-world scenarios. Unlike other data modalities, time series present unique challenges in learning and modeling due to their…

Machine Learning · Computer Science 2026-05-05 Yuxuan Wang , Haixu Wu , Jiaxiang Dong , Yong Liu , Chen Wang , Mingsheng Long , Jianmin Wang

While machine learning has witnessed significant advancements, the emphasis has largely been on data acquisition and model creation. However, achieving a comprehensive assessment of machine learning solutions in real-world settings…

Recent studies have attempted to refine the Transformer architecture to demonstrate its effectiveness in Long-Term Time Series Forecasting (LTSF) tasks. Despite surpassing many linear forecasting models with ever-improving performance, we…

Machine Learning · Computer Science 2024-12-30 Peiwang Tang , Weitai Zhang

Time Series Forecasting (TSF) is an important application across many fields. There is a debate about whether Transformers, despite being good at understanding long sequences, struggle with preserving temporal relationships in time series…

Machine Learning · Computer Science 2025-10-20 Syed Tahir Hussain Rizvi , Neel Kanwal , Muddasar Naeem

Multivariate time series data provide a robust framework for future predictions by leveraging information across multiple dimensions, ensuring broad applicability in practical scenarios. However, their high dimensionality and mixing…

Machine Learning · Computer Science 2024-11-28 Xuanbing Zhu , Dunbin Shen , Zhongwen Rao , Huiyi Ma , Yingguang Hao , Hongyu Wang

Multivariate time series forecasting is widely applied in fields such as transportation, energy, and finance. However, the data commonly suffers from issues of multi-scale characteristics, weak correlations, and noise interference, which…

Machine Learning · Computer Science 2026-03-02 Xiang Ao

Spatiotemporal forecasting is critical in applications such as traffic prediction, climate modeling, and environmental monitoring. However, the prevalence of missing data in real-world sensor networks significantly complicates this task. In…

Machine Learning · Computer Science 2025-01-20 Muhammad Bilal , Luis Carretero Lopez

Recently, MLP-like vision models have achieved promising performances on mainstream visual recognition tasks. In contrast with vision transformers and CNNs, the success of MLP-like models shows that simple information fusion operations…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Ziyu Wang , Wenhao Jiang , Yiming Zhu , Li Yuan , Yibing Song , Wei Liu

Multivariate time series forecasting remains a challenge due to the complexity of local temporal dynamics and global dependencies across multiple variables. In this paper, we propose \textbf{N}eighboring \textbf{P}atching \textbf{Mixer}…

Machine Learning · Computer Science 2026-05-11 Jung Min Choi , Vijaya Krishna Yalavarthi , Lars Schmidt-Thieme

Time series classification (TSC) performance depends not only on architectural design but also on the diversity of input representations. In this work, we propose a scalable multi-scale convolutional framework that systematically integrates…

Machine Learning · Computer Science 2026-03-26 Celal Alagöz , Mehmet Kurnaz , Farhan Aadil

Recent advances in deep learning have mainly relied on Transformers due to their data dependency and ability to learn at scale. The attention module in these architectures, however, exhibits quadratic time and space in input size, limiting…

Machine Learning · Computer Science 2024-07-25 Ali Behrouz , Michele Santacatterina , Ramin Zabih

Time series forecasting is a fundamental tool with wide ranging applications, yet recent debates question whether complex nonlinear architectures truly outperform simple linear models. Prior claims of dominance of the linear model often…

Machine Learning · Computer Science 2026-02-13 Md Rakibul Haque , Vishwa Goudar , Shireen Elhabian , Warren Woodrich Pettine

Time series forecasting is a crucial task in various domains. Caused by factors such as trends, seasonality, or irregular fluctuations, time series often exhibits non-stationary. It obstructs stable feature propagation through deep layers,…

Machine Learning · Computer Science 2024-01-05 Xiang Ma , Xuemei Li , Lexin Fang , Tianlong Zhao , Caiming Zhang

Recently, deep learning has driven significant advancements in multivariate time series forecasting (MTSF) tasks. However, much of the current research in MTSF tends to evaluate models from a holistic perspective, which obscures the…

Machine Learning · Computer Science 2025-09-23 Shuang Liang , Chaochuan Hou , Xu Yao , Shiping Wang , Minqi Jiang , Songqiao Han , Hailiang Huang

Large pre-trained models excel in zero/few-shot learning for language and vision tasks but face challenges in multivariate time series (TS) forecasting due to diverse data characteristics. Consequently, recent research efforts have focused…

Time series forecasting is a subject of significant scientific and industrial importance. Despite the widespread utilization of forecasting methods, there is a dearth of research aimed at comprehending the conditions under which these…

Machine Learning · Computer Science 2024-10-23 Moisés Santos , André de Carvalho , Carlos Soares

Transformer-based architectures are the model of choice for natural language understanding, but they come at a significant cost, as they have quadratic complexity in the input length, require a lot of training data, and can be difficult to…

Computation and Language · Computer Science 2023-11-14 Florian Mai , Arnaud Pannatier , Fabio Fehr , Haolin Chen , Francois Marelli , Francois Fleuret , James Henderson

Multivariate time series forecasting has been widely used in various practical scenarios. Recently, Transformer-based models have shown significant potential in forecasting tasks due to the capture of long-range dependencies. However,…

Machine Learning · Computer Science 2023-02-10 Zhe Li , Zhongwen Rao , Lujia Pan , Zenglin Xu

Time series forecasting attempts to predict future events by analyzing past trends and patterns. Although well researched, certain critical aspects pertaining to the use of deep learning in time series forecasting remain ambiguous. Our…

Machine Learning · Computer Science 2024-03-08 Kiran Madhusudhanan , Shayan Jawed , Lars Schmidt-Thieme