English
Related papers

Related papers: Multi-Modal Forecaster: Jointly Predicting Time Se…

200 papers

Time series forecasting is widely used in extensive applications, such as traffic planning and weather forecasting. However, real-world time series usually present intricate temporal variations, making forecasting extremely challenging.…

Machine Learning · Computer Science 2024-05-24 Shiyu Wang , Haixu Wu , Xiaoming Shi , Tengge Hu , Huakun Luo , Lintao Ma , James Y. Zhang , Jun Zhou

Recent studies have indicated that vision models pre-trained on images can serve as time series foundation models (TSFMs) by reformulating time series forecasting (TSF) as image reconstruction. However, effective cross-modal transfer from…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Lefei Shen , Mouxiang Chen , Xu Liu , Han Fu , Xiaoxue Ren , Jianling Sun , Zhuo Li , Chenghao Liu

Multivariate time series forecasting (MTSF) seeks to model temporal dynamics among variables to predict future trends. Transformer-based models and large language models (LLMs) have shown promise due to their ability to capture long-range…

Machine Learning · Computer Science 2025-08-07 Abdul Monaf Chowdhury , Rabeya Akter , Safaeid Hossain Arib

Time Series forecasting (TSF) in the modern era faces significant computational and storage cost challenges due to the massive scale of real-world data. Dataset Distillation (DD), a paradigm that synthesizes a small, compact dataset to…

Machine Learning · Computer Science 2026-03-05 Seungha Hong , Sanghwan Jang , Wonbin Kweon , Suyeon Kim , Gyuseok Lee , Hwanjo Yu

We introduce a framework for generating highly multimodal datasets with explicitly calculable mutual information (MI) between modalities. This enables the construction of benchmark datasets that provide a novel testbed for systematic…

Machine Learning · Statistics 2026-02-26 Raheem Karim Hashmani , Garrett W. Merz , Helen Qu , Mariel Pettee , Kyle Cranmer

This study proposes a unified forecasting framework for high-dimensional multi-task time series to meet the prediction demands of cloud native backend systems operating under highly dynamic loads, coupled metrics, and parallel tasks. The…

Machine Learning · Computer Science 2025-12-25 Zixiao Huang , Jixiao Yang , Sijia Li , Chi Zhang , Jinyu Chen , Chengda Xu

Effective analysis of time series data presents significant challenges due to the complex temporal dependencies and cross-channel interactions in multivariate data. Inspired by the way human analysts visually inspect time series to uncover…

Machine Learning · Computer Science 2025-10-10 Qinghua Liu , Sam Heshmati , Zheda Mai , Zubin Abraham , John Paparrizos , Liu Ren

Forecasting the behaviour of complex dynamical systems such as interconnected sensor networks characterized by high-dimensional multivariate time series(MTS) is of paramount importance for making informed decisions and planning for the…

Machine Learning · Computer Science 2024-08-23 Sagar Srinivas Sakhinana , Shivam Gupta , Krishna Sai Sudhir Aripirala , Venkataramana Runkana

Contrastive learning has become a fundamental approach in both uni-modal and multi-modal frameworks. This learning paradigm pulls positive pairs of samples closer while pushing negatives apart. In the uni-modal setting (e.g., image-based…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Siarhei Sheludzko , Dhimitrios Duka , Bernt Schiele , Hilde Kuehne , Anna Kukleva

Flooding is one of the most destructive and costly natural disasters, and climate changes would further increase risks globally. This work presents a novel multimodal machine learning approach for multi-year global flood risk prediction,…

Machine Learning · Computer Science 2023-01-31 Cynthia Zeng , Dimitris Bertsimas

We introduce TimeCopilot, the first open-source agentic framework for forecasting that combines multiple Time Series Foundation Models (TSFMs) with Large Language Models (LLMs) through a single unified API. TimeCopilot automates the…

Machine Learning · Computer Science 2025-11-10 Azul Garza , Renée Rosillo

In the era of Large Language Models (LLMs), tremendous strides have been made in the field of multimodal understanding. However, existing advanced algorithms are limited to effectively utilizing the immense representation capabilities and…

Artificial Intelligence · Computer Science 2023-09-06 Hao Feng , Zijian Wang , Jingqun Tang , Jinghui Lu , Wengang Zhou , Houqiang Li , Can Huang

Multivariate time series data provide a robust framework for future predictions by leveraging information across multiple dimensions, ensuring broad applicability in practical scenarios. However, their high dimensionality and mixing…

Machine Learning · Computer Science 2024-11-28 Xuanbing Zhu , Dunbin Shen , Zhongwen Rao , Huiyi Ma , Yingguang Hao , Hongyu Wang

The World Wide Web needs reliable predictive capabilities to respond to changes in user behavior and usage patterns. Time series forecasting (TSF) is a key means to achieve this goal. In recent years, the large language models (LLMs) for…

Machine Learning · Computer Science 2026-01-23 Jianqi Zhang , Jingyao Wang , Wenwen Qiang , Fanjiang Xu , Changwen Zheng

This position paper argues that the next generation of artificial intelligence in meteorological and climate sciences must transition from fragmented hybrid heuristics toward a unified paradigm of physics-guided multimodal transformers.…

Machine Learning · Computer Science 2026-01-29 Jing Han , Hanting Chen , Kai Han , Xiaomeng Huang , Wenjun Xu , Dacheng Tao , Ping Zhang

Forecasting is a critical task in decision-making across numerous domains. While historical numerical data provide a start, they fail to convey the complete context for reliable and accurate predictions. Human forecasters frequently rely on…

With the rapid development of location based services, multimodal spatio-temporal (ST) data including trajectories, transportation modes, traffic flow and social check-ins are being collected for deep learning based methods. These deep…

Machine Learning · Computer Science 2024-07-24 Chenxing Wang

Trajectory prediction modules are key enablers for safe and efficient planning of autonomous vehicles (AVs), particularly in highly interactive traffic scenarios. Recently, learning-based trajectory predictors have experienced considerable…

Robotics · Computer Science 2023-07-06 Sushant Veer , Apoorva Sharma , Marco Pavone

Time Series Forecasting (TSF) has long been a challenge in time series analysis. Inspired by the success of Large Language Models (LLMs), researchers are now developing Large Time Series Models (LTSMs)-universal transformer-based models…

Within the field of complicated multivariate time series forecasting (TSF), popular techniques frequently rely on intricate deep learning architectures, ranging from transformer-based designs to recurrent neural networks. However, recent…

Machine Learning · Computer Science 2023-12-25 Aiyinsi Zuo , Haixi Zhang , Zirui Li , Ce Zheng