English
Related papers

Related papers: SVTime: Small Time Series Forecasting Models Infor…

200 papers

Recently, large language models (LLMs) have demonstrated powerful capabilities in performing various tasks and thus are applied by recent studies to time series forecasting (TSF) tasks, which predict future values with the given historical…

Computation and Language · Computer Science 2025-07-15 Chen Su , Yuanhe Tian , Qinyu Liu , Jun Zhang , Yan Song

The recent boom of large pre-trained models witnesses remarkable success in developing foundation models (FMs) for time series forecasting. Despite impressive performance across diverse downstream forecasting tasks, existing time series FMs…

Machine Learning · Computer Science 2025-10-23 Hui He , Kun Yi , Yuanchi Ma , Qi Zhang , Zhendong Niu , Guansong Pang

As large vision-language models (LVLMs) evolve rapidly, the demand for high-quality and diverse data to align these models becomes increasingly crucial. However, the creation of such data with human supervision proves costly and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Lei Li , Zhihui Xie , Mukai Li , Shunian Chen , Peiyi Wang , Liang Chen , Yazheng Yang , Benyou Wang , Lingpeng Kong , Qi Liu

Time series analysis has witnessed the inspiring development from traditional autoregressive models, deep learning models, to recent Transformers and Large Language Models (LLMs). Efforts in leveraging vision models for time series analysis…

Machine Learning · Computer Science 2025-09-03 Jingchao Ni , Ziming Zhao , ChengAo Shen , Hanghang Tong , Dongjin Song , Wei Cheng , Dongsheng Luo , Haifeng Chen

Recently, there has been a surge of Transformer-based solutions for the long-term time series forecasting (LTSF) task. Despite the growing performance over the past few years, we question the validity of this line of research in this work.…

Artificial Intelligence · Computer Science 2022-08-18 Ailing Zeng , Muxi Chen , Lei Zhang , Qiang Xu

Deep learning is playing an increasingly important role in time series analysis. We focused on time series forecasting using attention free mechanism, a more efficient framework, and proposed a new architecture for time series prediction…

Machine Learning · Computer Science 2022-09-21 Hugo Inzirillo , Ludovic De Villelongue

In recent work on time-series prediction, Transformers and even large language models have garnered significant attention due to their strong capabilities in sequence modeling. However, in practical deployments, time-series prediction often…

Machine Learning · Computer Science 2026-02-17 Wenxuan Xie , Fanpu Cao

Time series forecasting aims to model temporal dependencies among variables for future state inference, holding significant importance and widespread applications in real-world scenarios. Although deep learning-based methods have achieved…

Machine Learning · Computer Science 2026-05-21 Zesen Wang , Lijuan Lan , Yonggang Li

Large foundation models, including large language models (LLMs), vision transformers (ViTs), diffusion, and LLM-based multimodal models, are revolutionizing the entire machine learning lifecycle, from training to deployment. However, the…

Time series foundation models (TSFMs) are revolutionizing the forecasting landscape from specific dataset modeling to generalizable task evaluation. However, we contend that existing benchmarks exhibit common limitations in four dimensions:…

A rich supply of data and innovative algorithms have made data-driven modeling a popular technique in modern industry. Among various data-driven methods, latent variable models (LVMs) and their counterparts account for a major share and…

Systems and Control · Electrical Eng. & Systems 2022-10-06 Xiangyin Kong , Xiaoyu Jiang , Bingxin Zhang , Jinsong Yuan , Zhiqiang Ge

Visual foundation models (VFMs) have become increasingly popular due to their state-of-the-art performance. However, interpretability remains crucial for critical applications. In this sense, self-explainable models (SEM) aim to provide…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Hugues Turbé , Mina Bjelogrlic , Gianmarco Mengaldo , Christian Lovis

Using pre-trained large language models (LLMs) as a backbone for time series prediction has recently attracted growing research interest. Existing approaches typically split time series into patches, map them to the token space of LLMs via…

Machine Learning · Computer Science 2026-03-09 Xinyu Zhang , Shanshan Feng , Xutao Li , Kenghong Lin , Fan Li , Pengfei Jia

We formulate a new inference task in the domain of multivariate time series forecasting (MTSF), called Variable Subset Forecast (VSF), where only a small subset of the variables is available during inference. Variables are absent during…

Machine Learning · Computer Science 2022-06-28 Jatin Chauhan , Aravindan Raghuveer , Rishi Saket , Jay Nandy , Balaraman Ravindran

This paper introduces SparseTSF, a novel, extremely lightweight model for Long-term Time Series Forecasting (LTSF), designed to address the challenges of modeling complex temporal dependencies over extended horizons with minimal…

Machine Learning · Computer Science 2024-06-04 Shengsheng Lin , Weiwei Lin , Wentai Wu , Haojun Chen , Junjie Yang

Large pre-trained models excel in zero/few-shot learning for language and vision tasks but face challenges in multivariate time series (TS) forecasting due to diverse data characteristics. Consequently, recent research efforts have focused…

Time series forecasting is a long-standing and highly challenging research topic. Recently, driven by the rise of large language models (LLMs), research has increasingly shifted from purely time series methods toward harnessing textual…

Artificial Intelligence · Computer Science 2025-09-03 Shiqiao Zhou , Holger Schöner , Huanbo Lyu , Edouard Fouché , Shuo Wang

Unlike natural language processing and computer vision, the development of Foundation Models (FMs) for time series forecasting is blocked due to data scarcity. While recent efforts are focused on building such FMs by unlocking the potential…

Machine Learning · Computer Science 2024-10-10 Qingxiang Liu , Xu Liu , Chenghao Liu , Qingsong Wen , Yuxuan Liang

Time series forecasting aids decision-making, especially for stakeholders who rely on accurate predictions, making it very important to understand and explain these models to ensure informed decisions. Traditional explainable AI (XAI)…

Computation and Language · Computer Science 2024-10-22 Taha Aksu , Chenghao Liu , Amrita Saha , Sarah Tan , Caiming Xiong , Doyen Sahoo

Time series forecasting is a critical task across domains such as energy, finance, and meteorology, where accurate predictions enable informed decision-making. While transformer-based and large-parameter models have recently achieved…

Machine Learning · Computer Science 2026-02-11 Julien Guité-Vinet , Alexandre Blondin Massé , Éric Beaudry