English
Related papers

Related papers: Dual-Forecaster: A Multimodal Time Series Model In…

200 papers

Multimodal time series forecasting has garnered significant attention for its potential to provide more accurate predictions than traditional single-modality models by leveraging rich information inherent in other modalities. However, due…

Machine Learning · Computer Science 2026-02-26 Jiafeng Lin , Yuxuan Wang , Huakun Luo , Zhongyi Pei , Jianmin Wang

Recent advancements in time series forecasting have explored augmenting models with text or vision modalities to improve accuracy. While text provides contextual understanding, it often lacks fine-grained temporal details. Conversely,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Siru Zhong , Weilin Ruan , Ming Jin , Huan Li , Qingsong Wen , Yuxuan Liang

Time series forecasting using historical data has been an interesting and challenging topic, especially when the data is corrupted by missing values. In many industrial problem, it is important to learn the inference function between the…

Machine Learning · Computer Science 2023-06-02 Trang H. Tran , Lam M. Nguyen , Kyongmin Yeo , Nam Nguyen , Dzung Phan , Roman Vaculin , Jayant Kalagnanam

Irregularly sampled time series (ISTS) are widespread in real-world scenarios, exhibiting asynchronous observations on uneven time intervals across variables. Existing ISTS forecasting methods often solely utilize historical observations to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Zhi Lei , Chenxi Liu , Hao Miao , Wanghui Qiu , Bin Yang , Chenjuan Guo

Time series forecasting plays a crucial role in various applications, particularly in healthcare, where accurate predictions of future health trajectories can significantly impact clinical decision-making. Ensuring transparency and…

Machine Learning · Computer Science 2025-05-22 Jeremy Qin

While many advances in time series models focus exclusively on numerical data, research on multimodal time series, particularly those involving contextual textual information, remains in its infancy. With recent progress in large language…

Machine Learning · Computer Science 2026-03-10 Zihao Li , Xiao Lin , Zhining Liu , Jiaru Zou , Ziwei Wu , Lecheng Zheng , Dongqi Fu , Yada Zhu , Hendrik Hamann , Hanghang Tong , Jingrui He

Time series anomaly detection plays a critical role in many dynamic systems. Despite its importance, previous approaches have primarily relied on unimodal numerical data, overlooking the importance of complementary information from other…

Machine Learning · Computer Science 2026-03-24 Shiyan Hu , Jianxin Jin , Yang Shu , Peng Chen , Bin Yang , Chenjuan Guo

Time series forecasting is a critical task for artificial intelligence with numerous real-world applications. Traditional approaches primarily rely on historical time series data to predict the future values. However, in practical…

Recent studies in time series forecasting (TSF) use multimodal inputs, such as text and historical time series data, to predict future values. These studies mainly focus on developing advanced techniques to integrate textual information…

Computation and Language · Computer Science 2025-09-03 Chen Su , Yuanhe Tian , Yan Song , Yongdong Zhang

The proliferation of edge devices has generated an unprecedented volume of time series data across different domains, motivating various well-customized methods. Recently, Large Language Models (LLMs) have emerged as a new paradigm for time…

Machine Learning · Computer Science 2025-05-06 Chenxi Liu , Shaowen Zhou , Qianxiong Xu , Hao Miao , Cheng Long , Ziyue Li , Rui Zhao

Understanding the relationship between textual news and time-series evolution is a critical yet under-explored challenge in applied data science. While multimodal learning has gained traction, existing multimodal time-series datasets fall…

Computation and Language · Computer Science 2026-02-12 Jialin Chen , Aosong Feng , Ziyu Zhao , Juan Garza , Gaukhar Nurbek , Cheng Qin , Ali Maatouk , Leandros Tassiulas , Yifeng Gao , Rex Ying

Large Language Models (LLMs) have emerged as a promising paradigm for time series analytics, leveraging their massive parameters and the shared sequential nature of textual and time series data. However, a cross-modality gap exists between…

Machine Learning · Computer Science 2025-07-16 Chenxi Liu , Hao Miao , Cheng Long , Yan Zhao , Ziyue Li , Panos Kalnis

Effective analysis of time series data presents significant challenges due to the complex temporal dependencies and cross-channel interactions in multivariate data. Inspired by the way human analysts visually inspect time series to uncover…

Machine Learning · Computer Science 2025-10-10 Qinghua Liu , Sam Heshmati , Zheda Mai , Zubin Abraham , John Paparrizos , Liu Ren

Real-world time series come with text: metadata, descriptions, news, reports. Yet time series foundation models process numerical sequences in isolation, and the multimodal text-and-time-series models that attempt to bridge the two all…

Machine Learning · Computer Science 2026-05-21 Paul Quinlan , Jeremy Levasseur , Qingguo Li , Xiaodan Zhu

Multivariate time series data typically comprises two distinct modalities: variable semantics and sampled numerical observations. Traditional time series models treat variables as anonymous statistical signals, overlooking the rich semantic…

Machine Learning · Computer Science 2025-08-18 Yifei Sun , Junming Liu , Yirong Chen , Xuefeng Yan , Ding Wang

As multimodal data proliferates across diverse real-world applications, leveraging heterogeneous information such as texts and timestamps for accurate time series forecasting (TSF) has become a critical challenge. While diffusion models…

Machine Learning · Computer Science 2025-12-09 Da Zhang , Bingyu Li , Zhuyuan Zhao , Junyu Gao , Feiping Nie , Xuelong Li

This paper introduces multimodal conformal regression. Traditionally confined to scenarios with solely numerical input features, conformal prediction is now extended to multimodal contexts through our methodology, which harnesses internal…

Machine Learning · Computer Science 2026-05-15 Alexis Bose , Jonathan Ethier , Paul Guinand

Time series data is prevalent across numerous fields, necessitating the development of robust and accurate forecasting models. Capturing patterns both within and between temporal and multivariate components is crucial for reliable…

Machine Learning · Computer Science 2025-11-21 Maurice Kraus , Felix Divo , Devendra Singh Dhami , Kristian Kersting

While existing time series foundation models primarily rely on large-scale unimodal pretraining, they lack complementary modalities to enhance time series understanding. Building multimodal foundation models is a natural next step, but it…

Machine Learning · Computer Science 2026-02-06 Peng Chen , Siyuan Wang , Shiyan Hu , Xingjian Wu , Yang Shu , Zhongwen Rao , Meng Wang , Yijie Li , Bin Yang , Chenjuan Guo

Neural topic models can successfully find coherent and diverse topics in textual data. However, they are limited in dealing with multimodal datasets (e.g., images and text). This paper presents the first systematic and comprehensive…

Computation and Language · Computer Science 2024-03-27 Felipe González-Pizarro , Giuseppe Carenini