English
Related papers

Related papers: Frequency-domain MLPs are More Effective Learners …

200 papers

With the development of Internet of Things (IoT) systems, precise long-term forecasting method is requisite for decision makers to evaluate current statuses and formulate future policies. Currently, Transformer and MLP are two paradigms for…

Machine Learning · Computer Science 2023-12-12 Li Shen , Yuning Wei , Yangzhu Wang , Hongguang Li

Large language models (LLMs) have been applied in many fields and have developed rapidly in recent years. As a classic machine learning task, time series forecasting has recently been boosted by LLMs. Recent works treat large language…

Computation and Language · Computer Science 2024-12-31 Hua Tang , Chong Zhang , Mingyu Jin , Qinkai Yu , Zhenting Wang , Xiaobo Jin , Yongfeng Zhang , Mengnan Du

Time series forecasting is a fundamental tool with wide ranging applications, yet recent debates question whether complex nonlinear architectures truly outperform simple linear models. Prior claims of dominance of the linear model often…

Machine Learning · Computer Science 2026-02-13 Md Rakibul Haque , Vishwa Goudar , Shireen Elhabian , Warren Woodrich Pettine

Downsampling-based methods for time series forecasting have attracted increasing attention due to their superiority in capturing sequence trends. However, this approaches mainly capture dependencies within subsequences but neglect…

Computational Engineering, Finance, and Science · Computer Science 2026-01-21 Zhangyao Song , Nanqing Jiang , Miaohong He , Xiaoyu Zhao , Tao Guo

Predicting the demand for electricity with uncertainty helps in planning and operation of the grid to provide reliable supply of power to the consumers. Machine learning (ML)-based demand forecasting approaches can be categorized into (1)…

Machine Learning · Computer Science 2023-02-15 Yiwei Fu , Nurali Virani , Honggang Wang

Time series prediction can be generalized as a process that extracts useful information from historical records and then determines future values. Learning long-range dependencies that are embedded in time series is often an obstacle for…

Neural and Evolutionary Computing · Computer Science 2018-10-25 Yuxiu Hua , Zhifeng Zhao , Rongpeng Li , Xianfu Chen , Zhiming Liu , Honggang Zhang

Long-term time series forecasting is a vital task and has a wide range of real applications. Recent methods focus on capturing the underlying patterns from one single domain (e.g. the time domain or the frequency domain), and have not taken…

Machine Learning · Computer Science 2023-08-28 Yuxiao Luo , Ziyu Lyu , Xingyu Huang

In this paper, we introduce Masked Multi-Step Multivariate Forecasting (MMMF), a novel and general self-supervised learning framework for time series forecasting with known future information. In many real-world forecasting scenarios, some…

Machine Learning · Computer Science 2022-09-30 Yiwei Fu , Honggang Wang , Nurali Virani

With the growing availability of multi-domain time series data, there is an increasing demand for general forecasting models pre-trained on multi-source datasets to support diverse downstream prediction scenarios. Existing time series…

Machine Learning · Computer Science 2025-09-09 Yihang Wang , Yuying Qiu , Peng Chen , Kai Zhao , Yang Shu , Zhongwen Rao , Lujia Pan , Bin Yang , Chenjuan Guo

In recent years, deep learning techniques have outperformed traditional models in many machine learning tasks. Deep neural networks have successfully been applied to address time series forecasting problems, which is a very important topic…

Machine Learning · Computer Science 2021-04-09 Pedro Lara-Benítez , Manuel Carranza-García , José C. Riquelme

This paper introduces SparseTSF, a novel, extremely lightweight model for Long-term Time Series Forecasting (LTSF), designed to address the challenges of modeling complex temporal dependencies over extended horizons with minimal…

Machine Learning · Computer Science 2024-06-04 Shengsheng Lin , Weiwei Lin , Wentai Wu , Haojun Chen , Junjie Yang

Firms earning prediction plays a vital role in investment decisions, dividends expectation, and share price. It often involves multiple tensor-compatible datasets with non-linear multi-way relationships, spatiotemporal structures, and…

Machine Learning · Computer Science 2021-09-07 Ajim Uddin , Dan Zhou , Xinyuan Tao , Chia-Ching Chou , Dantong Yu

While machine learning is widely used to optimize wireless networks, training a separate model for each task in communication and localization is becoming increasingly unsustainable due to the significant costs associated with training and…

Signal Processing · Electrical Eng. & Systems 2025-11-20 Mohammad Cheraghinia , Eli De Poorter , Jaron Fontaine , Kwang Soon Kim , Merouane Debbah , Adnan Shahid

Accurate analysis of industrial time-series big data is critical for the Prognostics and Health Management (PHM) of industrial equipment. While recent advancements in Large Language Models (LLMs) have shown promise in time-series analysis,…

Machine Learning · Computer Science 2026-03-10 Haiteng Wang , Yikang Li , Yunfei Zhu , Jingheng Yan , Lei Ren , Laurence T. Yang

We introduce LatentTimePFN (LaT-PFN), a foundational Time Series model with a strong embedding space that enables zero-shot forecasting. To achieve this, we perform in-context learning in latent space utilizing a novel integration of the…

Machine Learning · Computer Science 2024-05-24 Stijn Verdenius , Andrea Zerio , Roy L. M. Wang

Explicit structural information has been proven to be encoded by Graph Neural Networks (GNNs), serving as auxiliary knowledge to enhance model capabilities and improve performance in downstream NLP tasks. However, recent studies indicate…

Computation and Language · Computer Science 2025-06-30 Li Zhou , Hao Jiang , Junjie Li , Zefeng Zhao , Feng Jiang , Wenyu Chen , Haizhou Li

Wind power is seeing a strong growth around the world. At the same time, shrinking profit margins in the energy markets let wind farm managers explore options for cost reductions in the turbine operation and maintenance. Sensor-based…

Machine Learning · Computer Science 2021-06-17 Angela Meyer

Time series forecasting is critical across multiple domains, where time series data exhibit both local patterns and global dependencies. While Transformer-based methods effectively capture global dependencies, they often overlook short-term…

Machine Learning · Computer Science 2026-04-17 Wenjie Ou , Zhishuo Zhao , Cheng Chen , Dongyue Guo , Yi Lin

In-context learning (ICL), the remarkable ability to solve a task from only input exemplars, is often assumed to be a unique hallmark of Transformer models. By examining commonly employed synthetic ICL tasks, we demonstrate that multi-layer…

Machine Learning · Computer Science 2025-02-26 William L. Tong , Cengiz Pehlevan

Spatial-temporal data modeling aims to mine the underlying spatial relationships and temporal dependencies of objects in a system. However, most existing methods focus on the modeling of spatial-temporal data in a single mode, lacking the…

Machine Learning · Computer Science 2023-08-23 Zihang Liu , Le Yu , Tongyu Zhu , Leiei Sun