English
Related papers

Related papers: LLM-Mixer: Multiscale Mixing in LLMs for Time Seri…

200 papers

The importance of recommender systems is growing rapidly due to the exponential increase in the volume of content generated daily. This surge in content presents unique challenges for designing effective recommender systems. Key among these…

Computation and Language · Computer Science 2025-06-12 Jiahao Tian , Jinman Zhao , Zhenkai Wang , Zhicheng Ding

SDForger is a flexible and efficient framework for generating high-quality multivariate time series using LLMs. Leveraging a compact data representation, SDForger provides synthetic time series generation from a few samples and…

Computation and Language · Computer Science 2026-01-07 Cécile Rousseau , Tobia Boschi , Giandomenico Cornacchia , Dhaval Salwala , Alessandra Pascale , Juan Bernabe Moreno

Ensembling is a powerful technique for improving the accuracy of machine learning models, with methods like stacking achieving strong results in tabular tasks. In time series forecasting, however, ensemble methods remain underutilized, with…

Machine Learning · Computer Science 2025-11-20 Nathanael Bosch , Oleksandr Shchur , Nick Erickson , Michael Bohlke-Schneider , Caner Türkmen

Transformer-based and MLP-based methods have emerged as leading approaches in time series forecasting (TSF). While Transformer-based methods excel in capturing long-range dependencies, they suffer from high computational complexities and…

Machine Learning · Computer Science 2025-04-16 Yifan Hu , Peiyuan Liu , Peng Zhu , Dawei Cheng , Tao Dai

Multivariate time series forecasting (MTSF) aims to learn temporal dynamics among variables to forecast future time series. Existing statistical and deep learning-based methods suffer from limited learnable parameters and small-scale…

Machine Learning · Computer Science 2025-04-01 Chenxi Liu , Qianxiong Xu , Hao Miao , Sun Yang , Lingzheng Zhang , Cheng Long , Ziyue Li , Rui Zhao

Research on long-term time series prediction has primarily relied on Transformer and MLP models, while the potential of convolutional networks in this domain remains underexplored. To address this, we propose a novel multi-scale time series…

Machine Learning · Computer Science 2025-10-03 Chenghan Li , Mingchen Li , Yipu Liao , Ruisheng Diao

Multivariate time series forecasting is widely applied in fields such as transportation, energy, and finance. However, the data commonly suffers from issues of multi-scale characteristics, weak correlations, and noise interference, which…

Machine Learning · Computer Science 2026-03-02 Xiang Ao

Large Language Models (LLMs) have shown promising performance in time series modeling tasks, but do they truly understand time series data? While multiple benchmarks have been proposed to answer this fundamental question, most are manually…

Artificial Intelligence · Computer Science 2026-04-15 Malgorzata Gwiazda , Yifu Cai , Mononito Goswami , Arjun Choudhry , Artur Dubrawski

In the evolving landscape of transportation systems, integrating Large Language Models (LLMs) offers a promising frontier for advancing intelligent decision-making across various applications. This paper introduces a novel 3-dimensional…

Machine Learning · Computer Science 2024-12-17 Dexter Le , Aybars Yunusoglu , Karn Tiwari , Murat Isik , I. Can Dikmen

Recent work has shown that simple linear models can outperform several Transformer based approaches in long term time-series forecasting. Motivated by this, we propose a Multi-layer Perceptron (MLP) based encoder-decoder model, Time-series…

Machine Learning · Statistics 2024-04-05 Abhimanyu Das , Weihao Kong , Andrew Leach , Shaan Mathur , Rajat Sen , Rose Yu

This paper explores the potential of large language models (LLMs) to generate financial reports from time series data. We propose a framework encompassing prompt engineering, model selection, and evaluation. We introduce an automated…

Computation and Language · Computer Science 2025-07-02 Elizabeth Fons , Elena Kochkina , Rachneet Kaur , Zhen Zeng , Berowne Hlavaty , Charese Smiley , Svitlana Vyetrenko , Manuela Veloso

Long-term Time Series Forecasting (LTSF) is critical for numerous real-world applications, such as electricity consumption planning, financial forecasting, and disease propagation analysis. LTSF requires capturing long-range dependencies…

Machine Learning · Computer Science 2024-10-04 Aitian Ma , Dongsheng Luo , Mo Sha

Enlarging the context window of large language models (LLMs) has become a crucial research area, particularly for applications involving extremely long texts. In this work, we propose a novel training-free framework for processing long…

Computation and Language · Computer Science 2024-10-15 Zihan Zhou , Chong Li , Xinyi Chen , Shuo Wang , Yu Chao , Zhili Li , Haoyu Wang , Rongqiao An , Qi Shi , Zhixing Tan , Xu Han , Xiaodong Shi , Zhiyuan Liu , Maosong Sun

Conventional forecasting methods rely on unimodal time series data, limiting their ability to exploit rich textual information. Recently, large language models (LLMs) and time series foundation models (TSFMs) have demonstrated powerful…

Machine Learning · Computer Science 2025-05-16 Chengsen Wang , Qi Qi , Zhongwen Rao , Lujia Pan , Jingyu Wang , Jianxin Liao

Time Series Forecasting (TSF) has long been a challenge in time series analysis. Inspired by the success of Large Language Models (LLMs), researchers are now developing Large Time Series Models (LTSMs)-universal transformer-based models…

The long horizon forecasting (LHF) problem has come up in the time series literature for over the last 35 years or so. This review covers aspects of LHF in this period and how deep learning has incorporated variants of trend, seasonality,…

Machine Learning · Computer Science 2025-06-17 Hans Krupakar , Kandappan V A

Time series analysis is pivotal in domains like financial forecasting and biomedical monitoring, yet traditional methods are constrained by limited nonlinear feature representation and long-term dependency capture. The emergence of Large…

Machine Learning · Computer Science 2025-06-16 Feifei Shi , Xueyan Yin , Kang Wang , Wanyu Tu , Qifu Sun , Huansheng Ning

Deep learning has contributed remarkably to the advancement of time series analysis. Still, deep models can encounter performance bottlenecks in real-world data-scarce scenarios, which can be concealed due to the performance saturation with…

Machine Learning · Computer Science 2024-10-21 Yong Liu , Haoran Zhang , Chenyu Li , Xiangdong Huang , Jianmin Wang , Mingsheng Long

Mixed integer linear programming (MILP) solvers expose hundreds of parameters that have an outsized impact on performance but are difficult to configure for all but expert users. Existing machine learning (ML) approaches require training on…

Machine Learning · Computer Science 2025-09-25 Connor Lawless , Yingxi Li , Anders Wikum , Madeleine Udell , Ellen Vitercik

Large Language Models (LLMs) have recently demonstrated significant potential in time series forecasting, offering impressive capabilities in handling complex temporal data. However, their robustness and reliability in real-world…

Machine Learning · Computer Science 2025-03-14 Fuqiang Liu , Sicong Jiang , Luis Miranda-Moreno , Seongjin Choi , Lijun Sun