English
Related papers

Related papers: VisionTS++: Cross-Modal Time Series Foundation Mod…

200 papers

Vision foundation models (VFMs) are predominantly developed using data-centric methods. These methods require training on vast amounts of data usually with high-quality labels, which poses a bottleneck for most institutions that lack both…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Jiabo Huang , Chen Chen , Lingjuan Lyu

Time series foundation models (TSFMs) are revolutionizing the forecasting landscape from specific dataset modeling to generalizable task evaluation. However, we contend that existing benchmarks exhibit common limitations in four dimensions:…

Foundation models have revolutionized artificial intelligence, setting new benchmarks in performance and enabling transformative capabilities across a wide range of vision and language tasks. However, despite the prevalence of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Adam Goodge , Wee Siong Ng , Bryan Hooi , See Kiong Ng

Foundation models or pre-trained models have substantially improved the performance of various language, vision, and vision-language understanding tasks. However, existing foundation models can only perform the best in one type of tasks,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Xinsong Zhang , Yan Zeng , Jipeng Zhang , Hang Li

Unlike natural language processing and computer vision, the development of Foundation Models (FMs) for time series forecasting is blocked due to data scarcity. While recent efforts are focused on building such FMs by unlocking the potential…

Machine Learning · Computer Science 2024-10-10 Qingxiang Liu , Xu Liu , Chenghao Liu , Qingsong Wen , Yuxuan Liang

Time series forecasting (TSF) plays a crucial role in various applications, including medical monitoring and crop growth. Despite the advancements in deep learning methods for TSF, their capacity to predict long-term series remains…

Artificial Intelligence · Computer Science 2024-11-05 Rujia Shen , Yang Yang , Yaoxion Lin , Liangliang Liu , Boran Wang , Yi Guan , Jingchi Jiang

Deep learning (e.g., Transformer) has been widely and successfully used in multivariate time series forecasting (MTSF). Unlike existing methods that focus on training models from a single modal of time series input, large language models…

Machine Learning · Computer Science 2025-04-09 Peiyuan Liu , Hang Guo , Tao Dai , Naiqi Li , Jigang Bao , Xudong Ren , Yong Jiang , Shu-Tao Xia

Time series forecasting underpins applications in finance, healthcare, and environmental monitoring. Despite the success of Time Series Foundation Models (TSFMs), existing approaches operate in a unimodal setting and rely on static prompts…

Artificial Intelligence · Computer Science 2026-03-10 Sehyuk Park , Soyeon Caren Han , Eduard Hovy

Time series analysis has witnessed the inspiring development from traditional autoregressive models, deep learning models, to recent Transformers and Large Language Models (LLMs). Efforts in leveraging vision models for time series analysis…

Machine Learning · Computer Science 2025-09-03 Jingchao Ni , Ziming Zhao , ChengAo Shen , Hanghang Tong , Dongjin Song , Wei Cheng , Dongsheng Luo , Haifeng Chen

Diffusion models achieve remarkable success in processing images and text, and have been extended to special domains such as time series forecasting (TSF). Existing diffusion-based approaches for TSF primarily focus on modeling…

Computation and Language · Computer Science 2025-04-29 Chen Su , Yuanhe Tian , Yan Song

Time series foundation models (TSFMs) offer strong zero-shot forecasting via large-scale pre-training, yet fine-tuning remains critical for boosting performance in domains with limited public data. With the growing number of TSFMs,…

Machine Learning · Computer Science 2025-09-30 Qingren Yao , Ming Jin , Chengqi Zhang , Chao-Han Huck Yang , Jun Qi , Shirui Pan

Multivariate Time Series (MTS) analysis is crucial to understanding and managing complex systems, such as traffic and energy systems, and a variety of approaches to MTS forecasting have been proposed recently. However, we often observe…

Machine Learning · Computer Science 2024-10-18 Zezhi Shao , Fei Wang , Yongjun Xu , Wei Wei , Chengqing Yu , Zhao Zhang , Di Yao , Tao Sun , Guangyin Jin , Xin Cao , Gao Cong , Christian S. Jensen , Xueqi Cheng

Time-Series Foundation Models (TSFMs) excel at zero-shot unimodal forecasting using numerical data, but unlike LLMs they cannot consume multimodal, non-numerical context that often shape real-world trajectories. In this work, we bridge this…

Machine Learning · Computer Science 2026-05-29 Haoxin Liu , Yichen Zhou , Rajat Sen , B. Aditya Prakash , Abhimanyu Das

Time series are generated in diverse domains such as economic, traffic, health, and energy, where forecasting of future values has numerous important applications. Not surprisingly, many forecasting methods are being proposed. To ensure…

Time series forecasting plays a crucial role in decision-making across various domains, but it presents significant challenges. Recent studies have explored image-driven approaches using computer vision models to address these challenges,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Zhen Zeng , Rachneet Kaur , Suchetha Siddagangappa , Tucker Balch , Manuela Veloso

Time series reasoning is crucial to decision-making in diverse domains, including finance, energy usage, traffic, weather, and scientific discovery. While existing time series foundation models (TSFMs) can capture low-level dynamic patterns…

Computation and Language · Computer Science 2025-10-07 Fangxu Yu , Hongyu Zhao , Tianyi Zhou

Deep learning has achieved strong performance in Time Series Forecasting (TSF). However, we identify a critical representation paradox, termed Latent Chaos: models with accurate predictions often learn latent representations that are…

Machine Learning · Computer Science 2026-05-13 Jie Yang , Yifan Hu , Yuante Li , Kexin Zhang , Kaize Ding , Philip S. Yu

Multivariate Time Series (MTS) forecasting plays a vital role in a wide range of applications. Recently, Spatial-Temporal Graph Neural Networks (STGNNs) have become increasingly popular MTS forecasting methods. STGNNs jointly model the…

Machine Learning · Computer Science 2022-08-17 Zezhi Shao , Zhao Zhang , Fei Wang , Yongjun Xu

Multivariate time-series forecasting is vital in various domains, e.g., economic planning and weather prediction. Deep train-from-scratch models have exhibited effective performance yet require large amounts of data, which limits real-world…

Machine Learning · Computer Science 2025-02-21 Ching Chang , Wei-Yao Wang , Wen-Chih Peng , Tien-Fu Chen

Pre-trained models exhibit strong generalization to various downstream tasks. However, given the numerous models available in the model hub, identifying the most suitable one by individually fine-tuning is time-consuming. In this paper, we…

Machine Learning · Computer Science 2026-03-10 Tengxue Zhang , Biao Ouyang , Yang Shu , Xinyang Chen , Chenjuan Guo , Bin Yang