English
Related papers

Related papers: Aurora: Towards Universal Generative Multimodal Ti…

200 papers

Time Series Forecasting (TSF) is key functionality in numerous fields, such as financial investment, weather services, and energy management. Although increasingly capable TSF methods occur, many of them require domain-specific data…

Machine Learning · Computer Science 2025-06-13 Zhe Li , Xiangfei Qiu , Peng Chen , Yihang Wang , Hanyin Cheng , Yang Shu , Jilin Hu , Chenjuan Guo , Aoying Zhou , Christian S. Jensen , Bin Yang

Current forecasting approaches are largely unimodal and ignore the rich textual data that often accompany the time series due to lack of well-curated multimodal benchmark dataset. In this work, we develop TimeText Corpus (TTC), a carefully…

Artificial Intelligence · Computer Science 2024-11-22 Kai Kim , Howard Tsai , Rajat Sen , Abhimanyu Das , Zihao Zhou , Abhishek Tanpure , Mathew Luo , Rose Yu

We introduce MMaDA, a novel class of multimodal diffusion foundation models designed to achieve superior performance across diverse domains such as textual reasoning, multimodal understanding, and text-to-image generation. The approach is…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Ling Yang , Ye Tian , Bowen Li , Xinchen Zhang , Ke Shen , Yunhai Tong , Mengdi Wang

This work studies the problem of time series analysis with generalist (or foundation) models, which are models trained across many data domains. Drawing inspiration from the widespread success of large language models, we consider the…

Machine Learning · Computer Science 2025-01-03 Sabera Talukder , Yisong Yue , Georgia Gkioxari

In recent times, the field of unsupervised representation learning (URL) for time series data has garnered significant interest due to its remarkable adaptability across diverse downstream applications. Unsupervised learning goals differ…

Machine Learning · Computer Science 2025-05-12 Chen Liang , Donghua Yang , Zhiyu Liang , Hongzhi Wang , Zheng Liang , Xiyang Zhang , Jianfeng Huang

Time series foundation models (TSFMs) have recently achieved strong zero-shot forecasting performance through large-scale pretraining and retrieval-augmented prediction. However, our empirical analysis reveals a non-trivial limitation of…

Machine Learning · Computer Science 2026-05-26 Jinjin Chi , Lei Feng , Lulu Zhang , Yongcheng Jing , Yiming Wang , Ximing Li , Jialie Shen , Leszek Rutkowski , Dacheng Tao

Text and time series data offer complementary views of financial markets: news articles provide narrative context about company events, while stock prices reflect how markets react to those events. However, despite their complementary…

Computational Engineering, Finance, and Science · Computer Science 2025-09-25 Ross Koval , Nicholas Andrews , Xifeng Yan

Time series forecasting is a critical task for artificial intelligence with numerous real-world applications. Traditional approaches primarily rely on historical time series data to predict the future values. However, in practical…

Several applications of Internet of Things (IoT) technology involve capturing data from multiple sensors resulting in multi-sensor time series. Existing neural networks based approaches for such multi-sensor or multivariate time series…

Machine Learning · Computer Science 2020-07-21 Vibhor Gupta , Jyoti Narwariya , Pankaj Malhotra , Lovekesh Vig , Gautam Shroff

Cross-domain time series imputation is an underexplored data-centric research task that presents significant challenges, particularly when the target domain suffers from high missing rates and domain shifts in temporal dynamics. Existing…

Machine Learning · Computer Science 2025-06-17 Kexin Zhang , Baoyu Jing , K. Selçuk Candan , Dawei Zhou , Qingsong Wen , Han Liu , Kaize Ding

A unified foundation model for medical time series -- pretrained on open access and ethics board-approved medical corpora -- offers the potential to reduce annotation burdens, minimize model customization, and enable robust transfer across…

Machine Learning · Computer Science 2025-12-17 Hao Li , Bowen Deng , Chang Xu , Zhiyuan Feng , Viktor Schlegel , Yu-Hao Huang , Yizheng Sun , Jingyuan Sun , Kailai Yang , Yiyao Yu , Jiang Bian

Recent innovations in diffusion probabilistic models have paved the way for significant progress in image, text and audio generation, leading to their applications in generative time series forecasting. However, leveraging such abilities to…

Machine Learning · Computer Science 2025-11-07 Yuansan Liu , Sudanthi Wijewickrema , Dongting Hu , Christofer Bester , Stephen O'Leary , James Bailey

Multi-modal time series analysis has recently emerged as a prominent research area in data mining, driven by the increasing availability of diverse data modalities, such as text, images, and structured tabular data from real-world sources.…

Time series foundation models have recently gained a lot of attention due to their ability to model complex time series data encompassing different domains including traffic, energy, and weather. Although they exhibit strong average…

Machine Learning · Computer Science 2026-01-21 Shivani Tomar , Seshu Tirupathi , Elizabeth Daly , Ivana Dusparic

Geospatial imaging leverages data from diverse sensing modalities-such as EO, SAR, and LiDAR, ranging from ground-level drones to satellite views. These heterogeneous inputs offer significant opportunities for scene understanding but…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Alex Berian , Daniel Brignac , JhihYang Wu , Natnael Daba , Abhijit Mahalanobis

Generative modeling of time series is a central challenge in time series analysis, particularly under data-scarce conditions. Despite recent advances in generative modeling, a comprehensive understanding of how state-of-the-art generative…

Machine Learning · Computer Science 2025-05-28 Tal Gonen , Itai Pemper , Ilan Naiman , Nimrod Berman , Omri Azencot

Ultrasound images vary widely across scanners, operators, and anatomical targets, which often causes models trained in one setting to generalize poorly to new hospitals and clinical conditions. The Foundation Model Challenge for Ultrasound…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Ufaq Khan , L. D. M. S. Sai Teja , Ayuba Shakiru , Mai A. Shaaban , Yutong Xie , Muhammad Bilal , Muhammad Haris Khan

Unsupervised domain adaptation (UDA) enables the transfer of models trained on source domains to unlabeled target domains. However, transferring complex time series models presents challenges due to the dynamic temporal structure variations…

Machine Learning · Computer Science 2023-06-21 Huan He , Owen Queen , Teddy Koker , Consuelo Cuevas , Theodoros Tsiligkaridis , Marinka Zitnik

There has been a recent surge of interest in time series modeling using the Transformer architecture. However, forecasting multivariate time series with Transformer presents a unique challenge as it requires modeling both temporal…

Machine Learning · Computer Science 2025-07-04 Yu-Hsiang Lan , Eric K. Oermann

Textbook Question Answering (TQA) is a complex multimodal task to infer answers given large context descriptions and abundant diagrams. Compared with Visual Question Answering (VQA), TQA contains a large number of uncommon terminologies and…

Multimedia · Computer Science 2021-12-07 Fangzhi Xu , Qika Lin , Jun Liu , Lingling Zhang , Tianzhe Zhao , Qi Chai , Yudai Pan