English
Related papers

Related papers: Olivia: Harmonizing Time Series Foundation Models …

200 papers

We introduce Sundial, a family of native, flexible, and scalable time series foundation models. To predict the next-patch's distribution, we propose a TimeFlow Loss based on flow-matching, which facilitates native pre-training of…

Machine Learning · Computer Science 2026-05-12 Yong Liu , Guo Qin , Zhiyuan Shi , Zhi Chen , Caiyin Yang , Xiangdong Huang , Jianmin Wang , Mingsheng Long

Forecasting time series with irregular temporal structures remains challenging for universal pre-trained models. Existing approaches often assume regular sampling or depend heavily on imputation, limiting their applicability in real-world…

Machine Learning · Computer Science 2025-08-26 Jingge Xiao , Yile Chen , Gao Cong , Wolfgang Nejdl , Simon Gottschalk

Self-supervised foundation models have achieved remarkable success across domains, including time series. However, the potential of non-contrastive methods, a paradigm that has driven significant advances in computer vision, remains…

Machine Learning · Computer Science 2026-03-03 Yessin Moakher , Youssef Attia El Hili , Vasilii Feofanov

We investigate the relationship between Orthogonal Time Frequency Space (OTFS) modulation and Orthogonal Short Time Fourier (OSTF) signaling. OTFS was recently proposed as a new scheme for high Doppler scenarios and builds on OSTF. We first…

Information Theory · Computer Science 2021-09-14 Akbar M Sayeed

Foundational models, trained on vast and diverse datasets, have demonstrated remarkable capabilities in generalizing across different domains and distributions for various zero-shot tasks. Our work addresses the challenge of retaining these…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Tom Shaked , Yuval Goldman , Oran Shayer

Foundation models have transformed language, vision, and time series data analysis, yet progress on dynamic predictions for physical systems remains limited. Given the complexity of physical constraints, two challenges stand out. $(i)$…

Machine Learning · Computer Science 2026-02-05 Haoran Li , Chenhan Xiao , Lihao Mai , Yang Weng , Erik Blasch

We introduce Ordinal Synchronization ($OS$) as a new measure to quantify synchronization between dynamical systems. $OS$ is calculated from the extraction of the ordinal patterns related to two time series, their transformation into…

Quantitative Methods · Quantitative Biology 2019-01-30 Ignacio Echegoyen , Victor Vera-Ávila , Ricardo Sevilla-Escoboza , Johann H. Martínez , Javier M. Buldú

We present TimeFound, an encoder-decoder transformer-based time series foundation model for out-of-the-box zero-shot forecasting. To handle time series data from various domains, TimeFound employs a multi-resolution patching strategy to…

Machine Learning · Computer Science 2025-03-07 Congxi Xiao , Jingbo Zhou , Yixiong Xiao , Xinjiang Lu , Le Zhang , Hui Xiong

Training a general-purpose time series foundation models with robust generalization capabilities across diverse applications from scratch is still an open challenge. Efforts are primarily focused on fusing cross-domain time series datasets…

Machine Learning · Computer Science 2024-12-13 Shengchao Chen , Guodong Long , Jing Jiang , Chengqi Zhang

In this paper, we propose an opportunistic downlink interference alignment (ODIA) for interference-limited cellular downlink, which intelligently combines user scheduling and downlink IA techniques. The proposed ODIA not only efficiently…

Information Theory · Computer Science 2016-11-18 Hyun Jong Yang , Won-Yong Shin , Bang Chul Jung , Changho Suh , Arogyaswami Paulraj

Collaborative perception in Internet of Vehicles (IoV) aggregates multi-vehicle observations for broader scene coverage and improved decision-making. However, fusion quality degrades under spatiotemporal heterogeneity from unsynchronized…

Networking and Internet Architecture · Computer Science 2026-02-17 Qiaomei Han , Xianbin Wang , Minghui Liwang , Dusit Niyato

Recently, a new precoding technique called orthogonal time-frequency signaling (OTFS) has been proposed for time- and frequency-selective communication channels. OTFS precodes a data frame with a complete set of spreading sequences and…

Information Theory · Computer Science 2017-10-30 Thomas Zemen , Markus Hofer , David Loeschenbrand

Unsupervised/self-supervised time series representation learning is a challenging problem because of its complex dynamics and sparse annotations. Existing works mainly adopt the framework of contrastive learning with the time-based…

Machine Learning · Computer Science 2022-05-31 Ling Yang , Shenda Hong

Transformer-based time series foundation models face a fundamental trade-off in choice of tokenization: point-wise embeddings preserve temporal fidelity but scale poorly with sequence length, whereas fixed-length patching improves…

Artificial Intelligence · Computer Science 2026-03-13 Sravan Kumar Ankireddy , Nikita Seleznev , Nam H. Nguyen , Yulun Wu , Senthil Kumar , Furong Huang , C. Bayan Bruss

Time Series forecasting (TSF) in the modern era faces significant computational and storage cost challenges due to the massive scale of real-world data. Dataset Distillation (DD), a paradigm that synthesizes a small, compact dataset to…

Machine Learning · Computer Science 2026-03-05 Seungha Hong , Sanghwan Jang , Wonbin Kweon , Suyeon Kim , Gyuseok Lee , Hwanjo Yu

The industry is rich in cases when we are required to make forecasting for large amounts of time series at once. However, we might be in a situation where we can not afford to train a separate model for each of them. Such issue in time…

Machine Learning · Computer Science 2024-03-06 Kseniia Kuvshinova , Olga Tsymboi , Alina Kostromina , Dmitry Simakov , Elizaveta Kovtun

Foundation models, such as large language models (LLMs), are powerful but often require customization before deployment to satisfy practical constraints such as safety, privacy, and task-specific requirements, leading to "constrained"…

Data selection accelerates training by identifying representative training data while preserving model performance. However, existing methods mainly focus on designing sample-importance criteria, i.e., deciding what to select, while…

Machine Learning · Computer Science 2026-05-15 Suorong Yang , Hanqi Zhu , Hai Gan , Fangjian Su , Guang Li , Furao Shen , Soujanya Poria

In the past few years, time series foundation models have achieved superior predicting accuracy. However, real-world time series often exhibit significant diversity in their temporal patterns across different time spans and domains, making…

Machine Learning · Computer Science 2026-03-19 Aobo Liang , Yan Sun , Xiaohou Shi , Ke Li

Notable progress has been made in generalist medical large language models across various healthcare areas. However, large-scale modeling of in-hospital time series data - such as vital signs, lab results, and treatments in critical care -…