English
Related papers

Related papers: XLinear: Frequency-Enhanced MLP with CrossFilter f…

200 papers

Patch-wise Transformer based time series forecasting achieves superior accuracy. However, this superiority relies heavily on intricate model design with massive parameters, rendering both training and inference expensive, thus preventing…

Machine Learning · Computer Science 2025-01-22 Meng Wang , Jintao Yang , Bin Yang , Hui Li , Tongxin Gong , Bo Yang , Jiangtao Cui

In this research, an effort is made to address microgrid systems' operational challenges, characterized by power oscillations that eventually contribute to grid instability. An integrated strategy is proposed, leveraging the strengths of…

Machine Learning · Computer Science 2024-07-23 Vinod Kumar Maddineni , Naga Babu Koganti , Praveen Damacharla

Long-term Time Series Forecasting is crucial across numerous critical domains, yet its accuracy remains fundamentally constrained by the receptive field bottleneck in existing models. Mainstream Transformer- and Multi-layer Perceptron…

Computational Engineering, Finance, and Science · Computer Science 2025-11-13 Weixu Wang , Xiaobo Zhou , Xin Qiao , Lei Wang , Tie Qiu

Within the field of complicated multivariate time series forecasting (TSF), popular techniques frequently rely on intricate deep learning architectures, ranging from transformer-based designs to recurrent neural networks. However, recent…

Machine Learning · Computer Science 2023-12-25 Aiyinsi Zuo , Haixi Zhang , Zirui Li , Ce Zheng

Long-term time series forecasting is critical in domains such as finance, economics, and energy, where accurate and reliable predictions over extended horizons drive strategic decision-making. Despite the progress in machine learning-based…

Machine Learning · Computer Science 2025-02-18 Aditya Dey , Jonas Kusch , Fadi Al Machot

Multivariate Time series forecasting is crucial in domains such as transportation, meteorology, and finance, especially for predicting extreme weather events. State-of-the-art methods predominantly rely on Transformer architectures, which…

Machine Learning · Computer Science 2024-10-16 Li Wu , Wenbin Pei , Jiulong Jiao , Qiang Zhang

We present an approach that uses a deep learning model, in particular, a MultiLayer Perceptron (MLP), for estimating the missing values of a variable in multivariate time series data. We focus on filling a long continuous gap (e.g.,…

Time series forecasting is widely used in the fields of equipment life cycle forecasting, weather forecasting, traffic flow forecasting, and other fields. Recently, some scholars have tried to apply Transformer to time series forecasting…

Machine Learning · Computer Science 2022-02-24 Benhan Li , Shengdong Du , Tianrui Li

Probabilistic forecasting is not only a way to add more information to a prediction of the future, but it also builds on weaknesses in point prediction. Sudden changes in a time series can still be captured by a cumulative distribution…

Machine Learning · Computer Science 2025-11-19 Niklas Erdmann , Lars Bentsen , Roy Stenbro , Heine Nygard Riise , Narada Dilp Warakagoda , Paal E. Engelstad

Transformer-based models have greatly pushed the boundaries of time series forecasting recently. Existing methods typically encode time series data into $\textit{patches}$ using one or a fixed set of patch lengths. This, however, could…

Machine Learning · Computer Science 2024-02-09 Linfeng Du , Ji Xin , Alex Labach , Saba Zuberi , Maksims Volkovs , Rahul G. Krishnan

Nonlinear vector autoregression (NVAR) and reservoir computing (RC) have shown promise in forecasting chaotic dynamical systems, such as the Lorenz-63 model and El Nino-Southern Oscillation. However, their reliance on fixed nonlinear…

Machine Learning · Computer Science 2025-12-02 Azimov Sherkhon , Susana Lopez-Moreno , Eric Dolores-Cuenca , Sieun Lee , Sangil Kim

This work concerns estimation of multidimensional nonlinear regression models using multilayer perceptron (MLP). The main problem with such model is that we have to know the covariance matrix of the noise to get optimal estimator. however…

Statistics Theory · Mathematics 2008-02-22 Joseph Rynkiewicz

Transformer-based architectures have achieved remarkable success in natural language processing and computer vision. However, their performance in multivariate long-term forecasting often falls short compared to simpler linear baselines.…

Machine Learning · Computer Science 2025-07-09 Dizhen Liang

Medical Image Computing (MIC) is a broad research topic covering both pixel-wise (e.g., segmentation, registration) and image-wise (e.g., classification, regression) vision tasks. Effective analysis demands models that capture both global…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Mingyuan Meng

Machine learning is being deployed in a growing number of applications which demand real-time, accurate, and robust predictions under heavy query load. However, most machine learning frameworks and systems only address model training and…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-03-01 Daniel Crankshaw , Xin Wang , Giulio Zhou , Michael J. Franklin , Joseph E. Gonzalez , Ion Stoica

Transformer-based models have emerged as promising tools for time series forecasting. However, these model cannot make accurate prediction for long input time series. On the one hand, they failed to capture global dependencies within time…

Machine Learning · Computer Science 2023-08-16 YanJun Zhao , Ziqing Ma , Tian Zhou , Liang Sun , Mengni Ye , Yi Qian

Accurate and efficient multivariate time series (MTS) forecasting is essential for applications such as traffic management and weather prediction, which depend on capturing long-range temporal dependencies and interactions between entities.…

Machine Learning · Computer Science 2025-05-27 Yiming Niu , Jinliang Deng , Lulu Zhang , Zimu Zhou , Yongxin Tong

Forecasting irregularly sampled multivariate time series with missing values (IMTS) is a fundamental challenge in domains such as healthcare, climate science, and biology. While recent advances in vision and time series forecasting have…

Machine Learning · Computer Science 2026-02-27 Christian Klötergens , Tim Dernedde , Lars Schmidt-Thieme , Vijaya Krishna Yalavarthi

The task of multi-channel time series forecasting is ubiquitous in numerous fields such as finance, supply chain management, and energy planning. It is critical to effectively capture complex dynamic dependencies within and between channels…

Artificial Intelligence · Computer Science 2026-03-20 Lei Gao , Hengda Bao , Jingfei Fang , Guangzheng Wu , Weihua Zhou , Yun Zhou

In recent times, Large Language Models (LLMs) have captured a global spotlight and revolutionized the field of Natural Language Processing. One of the factors attributed to the effectiveness of LLMs is the model architecture used for…

Machine Learning · Computer Science 2023-08-31 Oluwaseyi Ogunfowora , Homayoun Najjaran