English
Related papers

Related papers: XLinear: Frequency-Enhanced MLP with CrossFilter f…

200 papers

Time series forecasting is widely used in extensive applications, such as traffic planning and weather forecasting. However, real-world time series usually present intricate temporal variations, making forecasting extremely challenging.…

Machine Learning · Computer Science 2024-05-24 Shiyu Wang , Haixu Wu , Xiaoming Shi , Tengge Hu , Huakun Luo , Lintao Ma , James Y. Zhang , Jun Zhou

Transformer-based time series forecasting has recently gained strong interest due to the ability of transformers to model sequential data. Most of the state-of-the-art architectures exploit either temporal or inter-channel dependencies,…

Machine Learning · Computer Science 2025-03-25 Davide Villaboni , Alberto Castellini , Ivan Luciano Danesi , Alessandro Farinelli

Real-world time-series datasets are often multivariate with complex dynamics. To capture this complexity, high capacity architectures like recurrent- or attention-based sequential deep learning models have become popular. However, recent…

Machine Learning · Computer Science 2023-09-12 Si-An Chen , Chun-Liang Li , Nate Yoder , Sercan O. Arik , Tomas Pfister

The Transformer architecture yields state-of-the-art results in many tasks such as natural language processing (NLP) and computer vision (CV), since the ability to efficiently capture the precise long-range dependency coupling between input…

Machine Learning · Computer Science 2023-01-06 Peiwang Tang , Xianchao Zhang

Time series forecasting with exogenous variables is a critical emerging paradigm that presents unique challenges in modeling dependencies between variables. Traditional models often struggle to differentiate between endogenous and exogenous…

Machine Learning · Computer Science 2025-05-30 Pengfei Zhou , Yunlong Liu , Junli Liang , Qi Song , Xiangyang Li

Recent advancements in long-term time series forecasting (LTSF) have primarily focused on capturing cross-time and cross-variate (channel) dependencies within historical data. However, a critical aspect often overlooked by many existing…

Machine Learning · Computer Science 2024-12-03 Chaolv Zeng , Yuan Tian , Guanjie Zheng , Yunjun Gao

In long-term multivariate time series forecasting, effectively capturing both periodic patterns and residual dynamics is essential. To address this within standard deep learning benchmark settings, we propose the Hierarchical Patching Mixer…

Machine Learning · Computer Science 2026-02-20 Jung Min Choi , Vijaya Krishna Yalavarthi , Lars Schmidt-Thieme

In this paper, we propose to study four meteorological and seasonal time series coupled with a multi-layer perceptron (MLP) modeling. We chose to combine two transfer functions for the nodes of the hidden layer, and to use a temporal…

Machine Learning · Computer Science 2015-06-19 Cyril Voyant , Marie Laure Nivet , Christophe Paoli , Marc Muselli , Gilles Notton

Multivariate time series forecasting has seen widely ranging applications in various domains, including finance, traffic, energy, and healthcare. To capture the sophisticated temporal patterns, plenty of research studies designed complex…

Machine Learning · Computer Science 2022-07-05 Tianping Zhang , Yizhuo Zhang , Wei Cao , Jiang Bian , Xiaohan Yi , Shun Zheng , Jian Li

This study presents a novel time series prediction model, FPN-fusion, designed with linear computational complexity, demonstrating superior predictive performance compared to DLiner without increasing parameter count or computational…

Machine Learning · Computer Science 2024-06-12 Chu Li , Pingjia Xiao , Qiping Yuan

Research on long-term time series prediction has primarily relied on Transformer and MLP models, while the potential of convolutional networks in this domain remains underexplored. To address this, we propose a novel multi-scale time series…

Machine Learning · Computer Science 2025-10-03 Chenghan Li , Mingchen Li , Yipu Liao , Ruisheng Diao

Real-world time-series data often exhibit non-stationarity, including changing trends, irregular seasonality, and residuals. In terms of changing trends, recently proposed multi-layer perceptron (MLP)-based models have shown excellent…

Machine Learning · Computer Science 2025-09-26 Gawon Lee , Hanbyeol Park , Minseop Kim , Dohee Kim , Hyerim Bae

Short fixed-length inputs are the main bottleneck of deep learning methods in long time-series forecasting tasks. Prolonging input length causes overfitting, rapidly deteriorating accuracy. Our research indicates that the overfitting is a…

Machine Learning · Computer Science 2025-09-05 Chao Ma , Yikai Hou , Xiang Li , Yinggang Sun , Haining Yu

Time series forecasting is a long-standing problem in statistics and machine learning. One of the key challenges is processing sequences with long-range dependencies. To that end, a recent line of work applied the short-time Fourier…

Machine Learning · Computer Science 2025-02-28 Eyal Yakir , Dor Tsur , Haim Permuter

Transformers have gained popularity in time series forecasting for their ability to capture long-sequence interactions. However, their high memory and computing requirements pose a critical bottleneck for long-term forecasting. To address…

Machine Learning · Computer Science 2023-12-12 Vijay Ekambaram , Arindam Jati , Nam Nguyen , Phanwadee Sinthong , Jayant Kalagnanam

Multivariate time series forecasting remains a challenge due to the complexity of local temporal dynamics and global dependencies across multiple variables. In this paper, we propose \textbf{N}eighboring \textbf{P}atching \textbf{Mixer}…

Machine Learning · Computer Science 2026-05-11 Jung Min Choi , Vijaya Krishna Yalavarthi , Lars Schmidt-Thieme

Recurrent Neural Networks were, until recently, one of the best ways to capture the timely dependencies in sequences. However, with the introduction of the Transformer, it has been proven that an architecture with only attention-mechanisms…

Machine Learning · Computer Science 2021-08-19 Radostin Cholakov , Todor Kolev

Financial time-series forecasting has long been a challenging problem because of the inherently noisy and stochastic nature of the market. In the High-Frequency Trading (HFT), forecasting for trading purposes is even a more challenging task…

Computational Engineering, Finance, and Science · Computer Science 2019-06-11 Dat Thanh Tran , Alexandros Iosifidis , Juho Kanniainen , Moncef Gabbouj

Recent advancements in multivariate time series forecasting have been propelled by Linear-based, Transformer-based, and Convolution-based models, with Transformer-based architectures gaining prominence for their efficacy in temporal and…

Machine Learning · Computer Science 2024-09-27 Chaolv Zeng , Zhanyu Liu , Guanjie Zheng , Linghe Kong

Spatiotemporal forecasting is critical in applications such as traffic prediction, climate modeling, and environmental monitoring. However, the prevalence of missing data in real-world sensor networks significantly complicates this task. In…

Machine Learning · Computer Science 2025-01-20 Muhammad Bilal , Luis Carretero Lopez