English
Related papers

Related papers: Unlocking the Power of Patch: Patch-Based MLP for …

200 papers

Time series forecasting plays a critical role in domains such as energy, finance, and healthcare, where accurate predictions inform decision-making under uncertainty. Although Transformer-based models have demonstrated success in sequential…

Machine Learning · Computer Science 2025-05-27 Ali Forootani , Mohammad Khosravi

Transformer-based time series foundation models face a fundamental trade-off in choice of tokenization: point-wise embeddings preserve temporal fidelity but scale poorly with sequence length, whereas fixed-length patching improves…

Artificial Intelligence · Computer Science 2026-03-13 Sravan Kumar Ankireddy , Nikita Seleznev , Nam H. Nguyen , Yulun Wu , Senthil Kumar , Furong Huang , C. Bayan Bruss

Time series forecasting is critical across multiple domains, where time series data exhibit both local patterns and global dependencies. While Transformer-based methods effectively capture global dependencies, they often overlook short-term…

Machine Learning · Computer Science 2026-04-17 Wenjie Ou , Zhishuo Zhao , Cheng Chen , Dongyue Guo , Yi Lin

Understanding the robustness of deep learning models for multivariate long-term time series forecasting (M-LTSF) remains challenging, as evaluations typically rely on real-world datasets with unknown noise properties. We propose a…

Machine Learning · Computer Science 2026-03-27 Nick Janssen , Melanie Schaller , Bodo Rosenhahn

Short fixed-length inputs are the main bottleneck of deep learning methods in long time-series forecasting tasks. Prolonging input length causes overfitting, rapidly deteriorating accuracy. Our research indicates that the overfitting is a…

Machine Learning · Computer Science 2025-09-05 Chao Ma , Yikai Hou , Xiang Li , Yinggang Sun , Haining Yu

With the development of Internet of Things (IoT) systems, precise long-term forecasting method is requisite for decision makers to evaluate current statuses and formulate future policies. Currently, Transformer and MLP are two paradigms for…

Machine Learning · Computer Science 2023-12-12 Li Shen , Yuning Wei , Yangzhu Wang , Hongguang Li

Multivariate time-series forecasting is vital in various domains, e.g., economic planning and weather prediction. Deep train-from-scratch models have exhibited effective performance yet require large amounts of data, which limits real-world…

Machine Learning · Computer Science 2025-02-21 Ching Chang , Wei-Yao Wang , Wen-Chih Peng , Tien-Fu Chen

Time Series Forecasting (TSF) faces persistent challenges in modeling intricate temporal dependencies across different scales. Despite recent advances leveraging different decomposition operations and novel architectures based on CNN, MLP…

Machine Learning · Computer Science 2025-10-24 Haonan Yang , Jianchao Tang , Zhuo Li , Long Lan

Time-series anomaly detection plays a central role across a wide range of application domains. With the increasing proliferation of the Internet of Things (IoT) and smart manufacturing, time-series data has dramatically increased in both…

Machine Learning · Computer Science 2025-10-13 Yuan-Cheng Yu , Yen-Chieh Ouyang , Chun-An Lin

We consider the problem of learning predictive models from longitudinal data, consisting of irregularly repeated, sparse observations from a set of individuals over time. Such data often exhibit {\em longitudinal correlation} (LC)…

Machine Learning · Statistics 2019-11-25 Junjie Liang , Dongkuan Xu , Yiwei Sun , Vasant Honavar

Long-term time series forecasting requires models that simultaneously capture rapid oscillations, medium-range periodicities, and slowly evolving macro-trends from a fixed look-back window. Existing lightweight MLP-based models typically…

Machine Learning · Computer Science 2026-05-18 Ahmed Cherif

In recent times, Large Language Models (LLMs) have captured a global spotlight and revolutionized the field of Natural Language Processing. One of the factors attributed to the effectiveness of LLMs is the model architecture used for…

Machine Learning · Computer Science 2023-08-31 Oluwaseyi Ogunfowora , Homayoun Najjaran

The forecasting of irregular multivariate time series (IMTS) is crucial in key areas such as healthcare, biomechanics, climate science, and astronomy. However, achieving accurate and practical predictions is challenging due to two main…

Machine Learning · Computer Science 2025-11-18 Xvyuan Liu , Xiangfei Qiu , Xingjian Wu , Zhengyu Li , Chenjuan Guo , Jilin Hu , Bin Yang

Time series prediction, a crucial task across various domains, faces significant challenges due to the inherent complexities of time series data, including non-stationarity, multi-scale periodicity, and transient dynamics, particularly when…

Machine Learning · Computer Science 2025-07-18 Qianru Zhang , Chenglei Yu , Haixin Wang , Yudong Yan , Yuansheng Cao , Siu-Ming Yiu , Tailin Wu , Hongzhi Yin

Spatial-temporal forecasting systems play a crucial role in addressing numerous real-world challenges. In this paper, we investigate the potential of addressing spatial-temporal forecasting problems using general time series forecasting…

The emergence of 6th generation (6G) mobile networks brings new challenges in supporting high-mobility communications, particularly in addressing the issue of channel aging. While existing channel prediction methods offer improved accuracy…

Machine Learning · Computer Science 2024-10-30 Yanliang Jin , Yifan Wu , Yuan Gao , Shunqing Zhang , Shugong Xu , Cheng-Xiang Wang

As multimodal data proliferates across diverse real-world applications, leveraging heterogeneous information such as texts and timestamps for accurate time series forecasting (TSF) has become a critical challenge. While diffusion models…

Machine Learning · Computer Science 2025-12-09 Da Zhang , Bingyu Li , Zhuyuan Zhao , Junyu Gao , Feiping Nie , Xuelong Li

We introduce the Byte Latent Transformer (BLT), a new byte-level LLM architecture that, for the first time, matches tokenization-based LLM performance at scale with significant improvements in inference efficiency and robustness. BLT…

Multivariate time series forecasting (MTSF) aims to learn temporal dynamics among variables to forecast future time series. Existing statistical and deep learning-based methods suffer from limited learnable parameters and small-scale…

Machine Learning · Computer Science 2025-04-01 Chenxi Liu , Qianxiong Xu , Hao Miao , Sun Yang , Lingzheng Zhang , Cheng Long , Ziyue Li , Rui Zhao

This research examines the use of Large Language Models (LLMs) in predicting time series, with a specific focus on the LLMTIME model. Despite the established effectiveness of LLMs in tasks such as text generation, language translation, and…

Machine Learning · Computer Science 2024-08-12 Rui Cao , Qiao Wang