English
Related papers

Related papers: MoTime: A Dataset Suite for Multimodal Time Series…

200 papers

More information leads to better decisions and predictions, right? Confirming this hypothesis, several studies concluded that the simultaneous use of optical and thermal images leads to better predictions in crowd counting. However, the way…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Martin Thißen , Elke Hergenröther

While many advances in time series models focus exclusively on numerical data, research on multimodal time series, particularly those involving contextual textual information, remains in its infancy. With recent progress in large language…

Machine Learning · Computer Science 2026-03-10 Zihao Li , Xiao Lin , Zhining Liu , Jiaru Zou , Ziwei Wu , Lecheng Zheng , Dongqi Fu , Yada Zhu , Hendrik Hamann , Hanghang Tong , Jingrui He

Diffusion models achieve remarkable success in processing images and text, and have been extended to special domains such as time series forecasting (TSF). Existing diffusion-based approaches for TSF primarily focus on modeling…

Computation and Language · Computer Science 2025-04-29 Chen Su , Yuanhe Tian , Yan Song

Multivariate Time Series (MTS) analysis is crucial to understanding and managing complex systems, such as traffic and energy systems, and a variety of approaches to MTS forecasting have been proposed recently. However, we often observe…

Machine Learning · Computer Science 2024-10-18 Zezhi Shao , Fei Wang , Yongjun Xu , Wei Wei , Chengqing Yu , Zhao Zhang , Di Yao , Tao Sun , Guangyin Jin , Xin Cao , Gao Cong , Christian S. Jensen , Xueqi Cheng

This work contributes to the development of neural forecasting models with novel randomization-based learning methods. These methods improve the fitting abilities of the neural model, in comparison to the standard method, by generating…

Machine Learning · Computer Science 2021-07-06 Grzegorz Dudek

Generation and analysis of time-series data is relevant to many quantitative fields ranging from economics to fluid mechanics. In the physical sciences, structures such as metastable and coherent sets, slow relaxation processes, collective…

\textit{SummerTime} seeks to summarize globally time series signals and provides a fixed-length, robust summarization of the variable-length time series. Many classical machine learning methods for classification and regression depend on…

Machine Learning · Computer Science 2020-02-24 Kevin M. Amaral , Zihan Li , Wei Ding , Scott Crouter , Ping Chen

Motion forecasting for agents in autonomous driving is highly challenging due to the numerous possibilities for each agent's next action and their complex interactions in space and time. In real applications, motion forecasting takes place…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Nan Song , Bozhou Zhang , Xiatian Zhu , Li Zhang

Multimodal time series forecasting has garnered significant attention for its potential to provide more accurate predictions than traditional single-modality models by leveraging rich information inherent in other modalities. However, due…

Machine Learning · Computer Science 2026-02-26 Jiafeng Lin , Yuxuan Wang , Huakun Luo , Zhongyi Pei , Jianmin Wang

This paper introduces a data-driven time embedding method for modeling long-range seasonal dependencies in spatiotemporal forecasting tasks. The proposed approach employs Dynamic Mode Decomposition (DMD) to extract temporal modes directly…

Machine Learning · Computer Science 2025-08-05 Menglin Kong , Vincent Zhihao Zheng , Xudong Wang , Lijun Sun

While existing time series foundation models primarily rely on large-scale unimodal pretraining, they lack complementary modalities to enhance time series understanding. Building multimodal foundation models is a natural next step, but it…

Machine Learning · Computer Science 2026-02-06 Peng Chen , Siyuan Wang , Shiyan Hu , Xingjian Wu , Yang Shu , Zhongwen Rao , Meng Wang , Yijie Li , Bin Yang , Chenjuan Guo

Time series forecasting is widely used in business intelligence, e.g., forecast stock market price, sales, and help the analysis of data trend. Most time series of interest are macroscopic time series that are aggregated from microscopic…

Machine Learning · Computer Science 2021-10-28 Zhibo Zhu , Ziqi Liu , Ge Jin , Zhiqiang Zhang , Lei Chen , Jun Zhou , Jianyong Zhou

Accurate univariate forecasting remains a pressing need in real-world systems, such as energy markets, hydrology, retail demand, and IoT monitoring, where signals are often intermittent and horizons span both short- and long-term. While…

Machine Learning · Computer Science 2025-08-26 Kyrylo Yemets , Mykola Lukashchuk , Ivan Izonin

We present a novel framework to bootstrap Motion forecasting with Self-consistent Constraints (MISC). The motion forecasting task aims at predicting future trajectories of vehicles by incorporating spatial and temporal information from the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Maosheng Ye , Jiamiao Xu , Xunnong Xu , Tengfei Wang , Tongyi Cao , Qifeng Chen

While multimodal foundation models can now natively work with data beyond text, they remain underutilized in analyzing the considerable amounts of multi-dimensional time-series data in fields like healthcare, finance, and social sciences,…

Time series, typically represented as numerical sequences, can also be transformed into images and texts, offering multi-modal views (MMVs) of the same underlying signal. These MMVs can reveal complementary patterns and enable the use of…

Machine Learning · Computer Science 2025-11-03 ChengAo Shen , Wenchao Yu , Ziming Zhao , Dongjin Song , Wei Cheng , Haifeng Chen , Jingchao Ni

Time series forecasting plays a crucial role in various applications, particularly in healthcare, where accurate predictions of future health trajectories can significantly impact clinical decision-making. Ensuring transparency and…

Machine Learning · Computer Science 2025-05-22 Jeremy Qin

Unmanned surface vehicles can encounter a number of varied visual circumstances during operation, some of which can be very difficult to interpret. While most cases can be solved only using color camera images, some weather and lighting…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Jon Muhovič , Janez Perš

Forecasting motion and spatial positions of objects is of fundamental importance, especially in safety-critical settings such as autonomous driving. In this work, we address the issue by forecasting two different modalities that carry…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Andrea Ciamarra , Federico Becattini , Lorenzo Seidenari , Alberto Del Bimbo

Recent research in time series forecasting frequently investigates the integration of textual and visual modalities with numerical models to better navigate non-stationary environments. Despite delivering solid numerical results, existing…

Machine Learning · Computer Science 2026-05-26 Hui Cheng , Jinsheng Guo , Zhenhao Weng , Yan Qiao , Meng Li