English
Related papers

Related papers: LLM-Integrated Bayesian State Space Models for Mul…

200 papers

Time series forecasting is important for applications spanning energy markets, climate analysis, and traffic management. However, existing methods struggle to effectively integrate exogenous texts and align them with the probabilistic…

Machine Learning · Computer Science 2025-07-30 Yueyang Yao , Jiajun Li , Xingyuan Dai , MengMeng Zhang , Xiaoyan Gong , Fei-Yue Wang , Yisheng Lv

A new dynamic latent space eigenmodel (LSM) is proposed for weighted temporal networks. The model accommodates integer-valued weights, excess of zeros, time-varying node positions (features), and time-varying network sparsity. The latent…

Methodology · Statistics 2026-04-15 Roberto Casarin , Matteo Iacopini , Antonio Peruzzi

Accurate beam prediction is a key enabler for next-generation wireless communication systems. In this paper, we propose a multimodal large language model (LLM)-based beam prediction framework that effectively utilizes contextual…

Signal Processing · Electrical Eng. & Systems 2026-03-24 Tianhao Mao , Le Liang , Jie Yang , Xiao Li , Shi Jin , Geoffrey Ye Li

We introduce a new version of deep state-space models (DSSMs) that combines a recurrent neural network with a state-space framework to forecast time series data. The model estimates the observed series as functions of latent variables that…

Machine Learning · Statistics 2022-05-20 Haoxuan Wu , David S. Matteson , Martin T. Wells

Pre-trained Large Language Models (LLMs) encapsulate large amounts of knowledge and take enormous amounts of compute to train. We make use of this resource, together with the observation that LLMs are able to transfer knowledge and…

Machine Learning · Computer Science 2025-01-14 Malcolm L. Wolff , Shenghao Yang , Kari Torkkola , Michael W. Mahoney

This paper introduces a novel Bayesian learning model to explain the behavior of Large Language Models (LLMs), focusing on their core optimization metric of next token prediction. We develop a theoretical framework based on an ideal…

Machine Learning · Computer Science 2024-09-25 Siddhartha Dalal , Vishal Misra

Irregularly sampled time series (ISTS) are widespread in real-world scenarios, exhibiting asynchronous observations on uneven time intervals across variables. Existing ISTS forecasting methods often solely utilize historical observations to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Zhi Lei , Chenxi Liu , Hao Miao , Wanghui Qiu , Bin Yang , Chenjuan Guo

Time series forecasting holds significant importance in many real-world dynamic systems and has been extensively studied. Unlike natural language process (NLP) and computer vision (CV), where a single large model can tackle multiple tasks,…

Multivariate Time Series Forecasting plays a key role in many applications. Recent works have explored using Large Language Models for MTSF to take advantage of their reasoning abilities. However, many methods treat LLMs as end-to-end…

Artificial Intelligence · Computer Science 2025-09-19 Kuiye Ding , Fanda Fan , Yao Wang , Ruijie jian , Xiaorui Wang , Luqi Gong , Yishan Jiang , Chunjie Luo , Jianfeng Zhan

Understanding and predicting urban dynamics is crucial for managing transportation systems, optimizing urban planning, and enhancing public services. While neural network-based approaches have achieved success, they often rely on…

Machine Learning · Computer Science 2025-05-23 Yuhang Liu , Yingxue Zhang , Xin Zhang , Ling Tian , Yanhua Li , Jun Luo

We introduce the Locally Linear Latent Variable Model (LL-LVM), a probabilistic model for non-linear manifold discovery that describes a joint distribution over observations, their manifold coordinates and locally linear maps conditioned on…

Machine Learning · Statistics 2015-12-02 Mijung Park , Wittawat Jitkrittum , Ahmad Qamar , Zoltan Szabo , Lars Buesing , Maneesh Sahani

Spatiotemporal predictive learning (ST-PL) is a hotspot with numerous applications, such as object movement and meteorological prediction. It aims at predicting the subsequent frames via observed sequences. However, inherent uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Zenghao Chai , Zhengzhuo Xu , Yunpeng Bai , Zhihui Lin , Chun Yuan

Recent advancements in time series forecasting have explored augmenting models with text or vision modalities to improve accuracy. While text provides contextual understanding, it often lacks fine-grained temporal details. Conversely,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Siru Zhong , Weilin Ruan , Ming Jin , Huan Li , Qingsong Wen , Yuxuan Liang

Time series analysis provides essential insights for real-world system dynamics and informs downstream decision-making, yet most existing methods often overlook the rich contextual signals present in auxiliary modalities. To bridge this…

Machine Learning · Computer Science 2026-03-24 Yushan Jiang , Wenchao Yu , Geon Lee , Dongjin Song , Kijung Shin , Wei Cheng , Yanchi Liu , Haifeng Chen

In this paper we present BayesLDM, a system for Bayesian longitudinal data modeling consisting of a high-level modeling language with specific features for modeling complex multivariate time series data coupled with a compiler that can…

Accurate prediction of human behavior is crucial for AI systems to effectively support real-world applications, such as autonomous robots anticipating and assisting with human tasks. Real-world scenarios frequently present challenges such…

Human-Computer Interaction · Computer Science 2025-07-21 Kojiro Takeyama , Yimeng Liu , Misha Sra

The growing complexity of power systems has made accurate load forecasting more important than ever. An increasing number of advanced load forecasting methods have been developed. However, the static design of current methods offers no…

Machine Learning · Computer Science 2025-05-23 Yu Zuo , Dalin Qin , Yi Wang

Accurate load forecasting is crucial for maintaining the power balance between generators and consumers,particularly with the increasing integration of renewable energy sources, which introduce significant intermittent volatility. With the…

Systems and Control · Electrical Eng. & Systems 2024-09-04 Mingyang Gao , Suyang Zhou , Wei Gu , Zhi Wu , Haiquan Liu , Aihua Zhou

Multimodal recommender systems (MRS) integrate heterogeneous user and item data, such as text, images, and structured information, to enhance recommendation performance. The emergence of large language models (LLMs) introduces new…

Information Retrieval · Computer Science 2025-05-16 Alejo Lopez-Avila , Jinhua Du

We study an emerging and intriguing problem of multimodal temporal event forecasting with large language models. Compared to using text or graph modalities, the investigation of utilizing images for temporal event forecasting has not been…

Multimedia · Computer Science 2024-08-09 Haoxuan Li , Zhengmao Yang , Yunshan Ma , Yi Bin , Yang Yang , Tat-Seng Chua