中文
相关论文

相关论文: Olivia: Harmonizing Time Series Foundation Models …

200 篇论文

Most time series foundation models are pretrained by directly predicting future observations, which often yields weakly structured latent representations that capture surface noise rather than coherent and predictable temporal dynamics. In…

机器学习 · 计算机科学 2026-02-17 Xinxing Zhou , Qingren Yao , Yiji Zhao , Chenghao Liu , Flora Salim , Xiaojie Yuan , Yanlong Wen , Ming Jin

Time Series Foundation Models (TSFMs) have achieved remarkable success through large-scale pretraining. However, their design primarily targets real-valued series, limiting their ability to handle general forecasting tasks involving diverse…

机器学习 · 计算机科学 2026-03-25 Lu Han , Yu Liu , Lan Li , Qiwen Deng , Jian Jiang , Yinbo Sun , Zhe Yu , Binfeng Wang , Xingyu Lu , Lintao Ma , Han-Jia Ye , De-Chuan Zhan

Achieving high-performance in multi-object tracking algorithms heavily relies on modeling spatio-temporal relationships during the data association stage. Mainstream approaches encompass rule-based and deep learning-based methods for…

计算机视觉与模式识别 · 计算机科学 2024-04-18 Zhonglin Liu , Shujie Chen , Jianfeng Dong , Xun Wang , Di Zhou

Time Series foundation models (TSFMs) deliver strong forecasting performance through large-scale pretraining, but their large parameter sizes make deployment costly. While knowledge distillation offers a natural and effective approach for…

机器学习 · 计算机科学 2026-01-21 Yuqi Li , Kuiye Ding , Chuanguang Yang , Szu-Yu Chen , Yingli Tian

In the transformative landscape of smart cities, the integration of the cutting-edge web technologies into time series forecasting presents a pivotal opportunity to enhance urban planning, sustainability, and economic growth. The…

机器学习 · 计算机科学 2024-05-10 Ziyi Zhang , Shaogang Ren , Xiaoning Qian , Nick Duffield

Foundation models for zero-shot time series forecasting face challenges in efficient long-horizon prediction and reproducibility, with existing synthetic-only approaches underperforming on challenging benchmarks. This paper presents…

机器学习 · 计算机科学 2026-02-06 Vladyslav Moroshan , Julien Siems , Arber Zela , Timur Carstensen , Frank Hutter

Variational data assimilation optimizes for an initial state of a dynamical system such that its evolution fits observational data. The physical model can subsequently be evolved into the future to make predictions. This principle is a…

机器学习 · 计算机科学 2021-05-21 Thomas Frerix , Dmitrii Kochkov , Jamie A. Smith , Daniel Cremers , Michael P. Brenner , Stephan Hoyer

Deep learning (DL) approaches are being increasingly used for time-series forecasting, with many efforts devoted to designing complex DL models. Recent studies have shown that the DL success is often attributed to effective data…

人机交互 · 计算机科学 2023-07-28 Jianing Hao , Qing Shi , Yilin Ye , Wei Zeng

Generating high-quality time series data has emerged as a critical research topic due to its broad utility in supporting downstream time series mining tasks. A major challenge lies in modeling the intrinsic stochasticity of temporal…

人工智能 · 计算机科学 2025-11-20 He Panjing , Cheng Mingyue , Li Li , Zhang XiaoHan

Distributed deep learning (DDL) is a promising research area, which aims to increase the efficiency of training deep learning tasks with large size of datasets and models. As the computation capability of DDL nodes continues to increase,…

分布式、并行与集群计算 · 计算机科学 2023-07-11 Zixuan Chen , Lei Shi , Xuandong Liu , Jiahui Li , Sen Liu , Yang Xu

Spectral behaviors have been widely discussed in machine learning, yet the optimizer's own spectral bias remains unclear. We argue that first-order optimizers exhibit an intrinsic frequency preference that significantly reshapes the…

机器学习 · 计算机科学 2025-09-08 Gongyue Zhang , Honghai Liu

Efficiently modeling spatio-temporal (ST) physical processes and observations presents a challenging problem for the deep learning community. Many recent studies have concentrated on meticulously reconciling various advantages, leading to…

人工智能 · 计算机科学 2024-06-04 Hao Wu , Yuxuan Liang , Wei Xiong , Zhengyang Zhou , Wei Huang , Shilong Wang , Kun Wang

Multimodal time series forecasting is crucial in real-world applications, where decisions depend on both numerical data and contextual signals. The core challenge is to effectively combine temporal numerical patterns with the context…

机器学习 · 计算机科学 2026-02-04 Huu Hiep Nguyen , Minh Hoang Nguyen , Dung Nguyen , Hung Le

Foundation models, particularly Large Language Models (LLMs), have revolutionized text and video processing, yet time series data presents distinct challenges for such approaches due to domain-specific features such as missing values,…

机器学习 · 计算机科学 2025-02-12 Defu Cao , Wen Ye , Yizhou Zhang , Yan Liu

Time-series forecasting (TSF) finds broad applications in real-world scenarios. Due to the dynamic nature of time-series data, it is crucial to equip TSF models with out-of-distribution (OOD) generalization abilities, as historical training…

机器学习 · 计算机科学 2024-06-14 Haoxin Liu , Harshavardhan Kamarthi , Lingkai Kong , Zhiyuan Zhao , Chao Zhang , B. Aditya Prakash

Understanding the bottlenecks in implementing stochastic gradient descent (SGD)-based distributed support vector machines (SVM) algorithm is important in training larger data sets. The communication time to do the model synchronization…

分布式、并行与集群计算 · 计算机科学 2019-05-06 Vibhatha Abeykoon , Geoffrey Fox , Minje Kim

This work deals with the numerical approximation of plasmas which are confined by the effect of a fast oscillating magnetic field (see \cite{Bostan2012}) in the Vlasov model. The presence of this magnetic field induces oscillations (in…

数值分析 · 数学 2024-11-08 Megala Anandan , Benjamin Boutin , Nicolas Crouseilles

Diffusion Transformers (DiTs) excel in generative tasks but face practical deployment challenges due to high inference costs. Feature caching, which stores and retrieves redundant computations, offers the potential for acceleration.…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Yushi Huang , Zining Wang , Ruihao Gong , Jing Liu , Xinjie Zhang , Jinyang Guo , Xianglong Liu , Jun Zhang

We introduce a particle-based framework inspired by smoothed particle hydrodynamics (SPH) to simulate the dynamics of a continuous field of coupled phase oscillators. This methodology discretizes the spatial domain into particles and…

适应与自组织系统 · 物理学 2025-07-08 Hugues Berry , Jan-Michael Rye , Leonardo Trujillo

Foundation models have recently gained attention within the field of machine learning thanks to its efficiency in broad data processing. While researchers had attempted to extend this success to time series models, the main challenge is…

机器学习 · 计算机科学 2023-11-22 Trang H. Tran , Lam M. Nguyen , Kyongmin Yeo , Nam Nguyen , Roman Vaculin