English
Related papers

Related papers: Plots Unlock Time-Series Understanding in Multimod…

200 papers

Irregularly sampled time series are increasingly prevalent, particularly in medical domains. While various specialized methods have been developed to handle these irregularities, effectively modeling their complex dynamics and pronounced…

Machine Learning · Computer Science 2023-11-01 Zekun Li , Shiyang Li , Xifeng Yan

Motivated by the recent success of time-series foundation models for zero-shot forecasting, we present a methodology for $\textit{in-context fine-tuning}$ of a time-series foundation model. In particular, we design a pretrained foundation…

Machine Learning · Computer Science 2024-11-01 Abhimanyu Das , Matthew Faw , Rajat Sen , Yichen Zhou

Most existing single-modal time series models rely solely on numerical series, which suffer from the limitations imposed by insufficient information. Recent studies have revealed that multimodal models can address the core issue by…

Machine Learning · Computer Science 2025-05-05 Wenfa Wu , Guanyu Zhang , Zheng Tan , Yi Wang , Hongsheng Qi

Real-world time series often exhibit complex interdependencies that cannot be captured in isolation. Global models that model past data from multiple related time series globally while producing series-specific forecasts locally are now…

Machine Learning · Computer Science 2024-05-14 Abishek Sriramulu , Christoph Bergmeir , Slawek Smyl

Existing time series forecasting methods primarily rely on the numerical data itself. However, real-world time series exhibit complex patterns associated with multimodal information, making them difficult to predict with numerical data…

Artificial Intelligence · Computer Science 2026-03-17 Siyuan Wang , Peng Chen , Yihang Wang , Wanghui Qiu , Chenjuan Guo , Bin Yang , Yang Shu

Time series data are prevalent across various domains and often encompass large datasets containing multiple time-dependent features in each sample. Exploring time-varying data is critical for data science practitioners aiming to understand…

Graphics · Computer Science 2025-09-26 Evandro S. Ortigossa , Fábio F. Dias , Diego C. Nascimento , Luis Gustavo Nonato

We present a novel approach for time series classification where we represent time series data as plot images and feed them to a simple CNN, outperforming several state-of-the-art methods. We propose a simple and highly replicable way of…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Nuno M. Rodrigues , João E. Batista , Leonardo Trujillo , Bernardo Duarte , Mario Giacobini , Leonardo Vanneschi , Sara Silva

This paper introduces a novel spatiotemporal feature representation model designed to address the limitations of traditional methods in multidimensional time series (MTS) analysis. The proposed approach converts MTS into one-dimensional…

Machine Learning · Computer Science 2024-10-10 Xu Yan , Yaoting Jiang , Wenyi Liu , Didi Yi , Jianjun Wei

Recent breakthroughs in natural language processing and computer vision, driven by efficient pre-training on large datasets, have enabled foundation models to excel on a wide range of tasks. However, this potential has not yet been fully…

Machine Learning · Computer Science 2025-02-03 Özgün Turgut , Philip Müller , Martin J. Menten , Daniel Rueckert

Spatial-temporal data modeling aims to mine the underlying spatial relationships and temporal dependencies of objects in a system. However, most existing methods focus on the modeling of spatial-temporal data in a single mode, lacking the…

Machine Learning · Computer Science 2023-08-23 Zihang Liu , Le Yu , Tongyu Zhu , Leiei Sun

Healthcare data now span EHRs, medical imaging, genomics, and wearable sensors, but most diagnostic models still process these modalities in isolation. This limits their ability to capture early, cross-modal disease signatures. This paper…

Machine Learning · Computer Science 2025-12-18 Md Talha Mohsin , Ismail Abdulrashid

Foundation Models are designed to serve as versatile embedding machines, with strong zero shot capabilities and superior generalization performance when fine-tuned on diverse downstream tasks. While this is largely true for language and…

Machine Learning · Computer Science 2025-10-08 Nouha Karaouli , Denis Coquenet , Elisa Fromont , Martial Mermillod , Marina Reyboz

Visibility algorithms transform time series into graphs and encode dynamical information in their topology, paving the way for graph-theoretical time series analysis as well as building a bridge between nonlinear dynamics and network…

Data Analysis, Statistics and Probability · Physics 2016-05-11 Jacopo Iacovacci , Lucas Lacasa

Machine learning models built on training data with multiple modalities can reveal new insights that are not accessible through unimodal datasets. For example, cardiac magnetic resonance images (MRIs) and electrocardiograms (ECGs) are both…

Machine Learning · Computer Science 2023-12-05 Bum Chul Kwon , Samuel Friedman , Kai Xu , Steven A Lubitz , Anthony Philippakis , Puneet Batra , Patrick T Ellinor , Kenney Ng

Transformer-based foundation models have emerged as a dominant paradigm in time series analysis, offering unprecedented capabilities in tasks such as forecasting, anomaly detection, classification, trend analysis and many more time series…

In the past few years, time series foundation models have achieved superior predicting accuracy. However, real-world time series often exhibit significant diversity in their temporal patterns across different time spans and domains, making…

Machine Learning · Computer Science 2026-03-19 Aobo Liang , Yan Sun , Xiaohou Shi , Ke Li

The inference-time resource costs of large language and vision models present a growing challenge in production deployments. We propose the use of foundation model programs, i.e., programs that can invoke foundation models with varying…

Machine Learning · Computer Science 2025-08-12 Lunyiu Nie , Zhimin Ding , Kevin Yu , Marco Cheung , Chris Jermaine , Swarat Chaudhuri

Multimodal demand forecasting aims at predicting product demand utilizing visual, textual, and contextual information. This paper proposes a method for multimodal product demand forecasting using convolutional, graph-based, and…

Machine Learning · Computer Science 2023-07-07 Maarten Sukel , Stevan Rudinac , Marcel Worring

Missing values are pervasive in large-scale time-series data, posing challenges for reliable analysis and decision-making. Many neural architectures have been designed to model and impute the complex and heterogeneous missingness patterns…

Machine Learning · Computer Science 2026-02-26 Joseph Arul Raj , Linglong Qian , Zina Ibrahim

In many phenomena, data are collected on a large scale and of different frequencies. In this context, functional data analysis (FDA) has become an important statistical methodology for analyzing and modeling such data. The approach of FDA…

Methodology · Statistics 2022-04-11 Israel Martínez-Hernández , Marc G. Genton