English
Related papers

Related papers: Olivia: Harmonizing Time Series Foundation Models …

200 papers

Complex architectures for wireless communications, digital electronics and space-based navigation interlink several oscillator-based devices such as clocks, transponders and synthesizers. Estimators characterizing their stability are…

Data Analysis, Statistics and Probability · Physics 2023-11-02 Fabrizio De Marchi , Michael K. Plumaris , Eric A. Burt , Luciano Iess

Time series foundation models (TSFMs) have recently achieved strong zero-shot forecasting performance through large-scale pretraining and retrieval-augmented prediction. However, our empirical analysis reveals a non-trivial limitation of…

Machine Learning · Computer Science 2026-05-26 Jinjin Chi , Lei Feng , Lulu Zhang , Yongcheng Jing , Yiming Wang , Ximing Li , Jialie Shen , Leszek Rutkowski , Dacheng Tao

Accurate representation of the multiscale features in spatiotemporal physical systems using vision transformer (ViT) architectures requires extremely long, computationally prohibitive token sequences. To address this issue, we propose two…

Machine Learning · Computer Science 2024-12-31 Pei Zhang , M. Paul Laiu , Matthew Norman , Doug Stefanski , John Gounley

We investigate topological and spectral properties of models of European and US-American power grids and of paradigmatic network models as well as their implications for the synchronization dynamics of phase oscillators with heterogeneous…

Physics and Society · Physics 2024-03-29 Max Potratzki , Timo Bröhl , Thorsten Rings , Klaus Lehnertz

This paper introduces a new two-dimensional modulation technique called Orthogonal Time Frequency Space (OTFS) modulation. OTFS has the novel and important feature of being designed in the delay-Doppler domain. When coupled with a suitable…

We propose an algorithm to impute and forecast a time series by transforming the observed time series into a matrix, utilizing matrix estimation to recover missing values and de-noise observed entries, and performing linear regression to…

Machine Learning · Computer Science 2019-04-29 Anish Agarwal , Muhammad Jehangir Amjad , Devavrat Shah , Dennis Shen

In recent times, the field of unsupervised representation learning (URL) for time series data has garnered significant interest due to its remarkable adaptability across diverse downstream applications. Unsupervised learning goals differ…

Machine Learning · Computer Science 2025-05-12 Chen Liang , Donghua Yang , Zhiyu Liang , Hongzhi Wang , Zheng Liang , Xiyang Zhang , Jianfeng Huang

Time distributed optimization is an implementation strategy that can significantly reduce the computational burden of model predictive control by exploiting its robustness to incomplete optimization. When using this strategy, optimization…

Optimization and Control · Mathematics 2020-04-14 Dominic Liao-McPherson , Marco Nicotra , Ilya Kolmanovsky

Long-term time series forecasting (LTSF) has been widely applied in finance, traffic prediction, and other domains. Recently, patch-based transformers have emerged as a promising approach, segmenting data into sub-level patches that serve…

Machine Learning · Computer Science 2024-08-06 Ruixin Ding , Yuqi Chen , Yu-Ting Lan , Wei Zhang

Large pre-trained models have been vital in recent advancements in domains like language and vision, making model training for individual downstream tasks more efficient and provide superior performance. However, tackling time-series…

Machine Learning · Computer Science 2024-12-06 Harshavardhan Kamarthi , B. Aditya Prakash

Foundation Models are designed to serve as versatile embedding machines, with strong zero shot capabilities and superior generalization performance when fine-tuned on diverse downstream tasks. While this is largely true for language and…

Machine Learning · Computer Science 2025-10-08 Nouha Karaouli , Denis Coquenet , Elisa Fromont , Martial Mermillod , Marina Reyboz

Flow-based models have proven successful for time-series generation, particularly when defined in lower-dimensional latent spaces that enable efficient sampling. However, how to design latent representations with desirable equivariance…

Machine Learning · Computer Science 2026-02-02 Camilo Carvajal Reyes , Felipe Tobar

This work presents a sum-of-squares (SOS) based framework to perform data-driven stabilization and robust control tasks on discrete-time linear systems where the full-state observations are corrupted by L-infinity bounded input,…

Optimization and Control · Mathematics 2023-03-31 Jared Miller , Tianyu Dai , Mario Sznaier

This paper introduces and analyzes a framework that accommodates general heterogeneity in regression modeling. It demonstrates that regression models with fixed or time-varying parameters can be estimated using the OLS and time-varying OLS…

Econometrics · Economics 2025-11-11 Liudas Giraitis , George Kapetanios , Yufei Li , Alexia Ventouri

Time series forecasting faces two important but often overlooked challenges. Firstly, the inherent random noise in the time series labels sets a theoretical lower bound for the forecasting error, which is positively correlated with the…

Machine Learning · Computer Science 2025-09-26 Tianyi Shi , Zhu Meng , Yue Chen , Siyang Zheng , Fei Su , Jin Huang , Changrui Ren , Zhicheng Zhao

Orthogonal time frequency space (OTFS)/vector OFDM (VOFDM) is widely regarded as a promising waveform for next-generation mobile communications. However, its spectral characteristics are not yet fully understood. The bandwidth allocation…

Signal Processing · Electrical Eng. & Systems 2026-03-05 Wei Wang , Xiang-Gen Xia

A powerful concept behind much of the recent progress in machine learning is the extraction of common features across data from heterogeneous sources or tasks. Intuitively, using all of one's data to learn a common representation function…

Machine Learning · Statistics 2024-10-15 Thomas T. C. K. Zhang , Leonardo F. Toso , James Anderson , Nikolai Matni

Deep learning has demonstrated remarkable achievements in medical image segmentation. However, prevailing deep learning models struggle with poor generalization due to (i) intra-class variations, where the same class appears differently in…

Image and Video Processing · Electrical Eng. & Systems 2024-08-09 Vandan Gorade , Sparsh Mittal , Debesh Jha , Rekha Singhal , Ulas Bagci

On-policy distillation (OPD) has emerged as an efficient post-training paradigm for large language models. However, existing studies largely attribute this advantage to denser and more stable supervision, while the parameter-level…

Computation and Language · Computer Science 2026-05-22 Yuchen Cai , Ding Cao , Liang Lin , Chunxi Luo , Xin Xu , Kai Yang , Weijie Liu , Saiyong Yang , Tianxiang Zhao , Guangzhong Sun , Guiquan Liu , Junfeng Fang

Multi-rater medical image segmentation captures the inherent ambiguity of clinical interpretation, where diagnostic boundaries vary across experts and imaging devices. Existing approaches often reduce this diversity to consensus labels or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Sanaz Karimijafarbigloo , Armin Khosravi , Alireza Kheyrkhah , Reza Azad , Mauricio Reyes , Dorit Merhof