中文
相关论文

相关论文: Unified Training of Universal Time Series Forecast…

200 篇论文

The emergence of deep learning has yielded noteworthy advancements in time series forecasting (TSF). Transformer architectures, in particular, have witnessed broad utilization and adoption in TSF tasks. Transformers have proven to be the…

机器学习 · 计算机科学 2023-11-01 Liyilei Su , Xumin Zuo , Rui Li , Xin Wang , Heng Zhao , Bingding Huang

Time series forecasting is a fundamental problem with applications in climate, energy, healthcare, and finance. Many existing approaches require domain-specific feature engineering and substantial labeled data for each task. We introduce…

机器学习 · 计算机科学 2026-01-29 Olaf Yunus Laitinen Imanov , Derya Umut Kulali , Taner Yilmaz

Numerous deep learning architectures have been developed to accommodate the diversity of time series datasets across different domains. In this article, we survey common encoder and decoder designs used in both one-step-ahead and…

机器学习 · 统计学 2021-04-28 Bryan Lim , Stefan Zohren

Although Transformers excel in natural language processing, their extension to time series forecasting remains challenging due to insufficient consideration of the differences between textual and temporal modalities. In this paper, we…

机器学习 · 计算机科学 2025-10-09 Zhipeng Liu , Peibo Duan , Xuan Tang , Baixin Li , Yongsheng Huang , Mingyang Geng , Changsheng Zhang , Bin Zhang , Binwu Wang

Deep time series forecasting has emerged as a rapidly growing field in recent years. Despite the exponential growth of community interests, progress on standard benchmarks is often limited to marginal improvements. A common consensus of the…

机器学习 · 计算机科学 2026-05-05 Yuxuan Wang , Haixu Wu , Yuezhou Ma , Yuchen Fang , Ziyi Zhang , Yong Liu , Shiyu Wang , Zhou Ye , Yang Xiang , Jianmin Wang , Mingsheng Long

Transformer-based models have greatly pushed the boundaries of time series forecasting recently. Existing methods typically encode time series data into $\textit{patches}$ using one or a fixed set of patch lengths. This, however, could…

机器学习 · 计算机科学 2024-02-09 Linfeng Du , Ji Xin , Alex Labach , Saba Zuberi , Maksims Volkovs , Rahul G. Krishnan

Time series forecasting at scale presents significant challenges for modern prediction systems, particularly when dealing with large sets of synchronized series, such as in a global payment network. In such systems, three key challenges…

We present Timer-XL, a causal Transformer for unified time series forecasting. To uniformly predict multidimensional time series, we generalize next token prediction, predominantly adopted for 1D token sequences, to multivariate next token…

机器学习 · 计算机科学 2025-03-04 Yong Liu , Guo Qin , Xiangdong Huang , Jianmin Wang , Mingsheng Long

Time-series analysis plays a pivotal role across a range of critical applications, from finance to healthcare, which involves various tasks, such as forecasting and classification. To handle the inherent complexities of time-series data,…

机器学习 · 计算机科学 2024-05-20 Jiawei Li , Jingshu Peng , Haoyang Li , Lei Chen

Conventional time-series forecasting methods typically aim to minimize overall prediction error, without accounting for the varying importance of different forecast ranges in downstream applications. We propose a training methodology that…

Foundation models, particularly Large Language Models (LLMs), have revolutionized text and video processing, yet time series data presents distinct challenges for such approaches due to domain-specific features such as missing values,…

机器学习 · 计算机科学 2025-02-12 Defu Cao , Wen Ye , Yizhou Zhang , Yan Liu

Time series has been left behind in the era of pre-training and transfer learning. While research in the fields of natural language processing and computer vision are enjoying progressively larger datasets to train massive models, the most…

机器学习 · 计算机科学 2023-12-06 Gerald Woo , Chenghao Liu , Akshat Kumar , Doyen Sahoo

In recent times, Large Language Models (LLMs) have captured a global spotlight and revolutionized the field of Natural Language Processing. One of the factors attributed to the effectiveness of LLMs is the model architecture used for…

机器学习 · 计算机科学 2023-08-31 Oluwaseyi Ogunfowora , Homayoun Najjaran

Time series forecasting faces two important but often overlooked challenges. Firstly, the inherent random noise in the time series labels sets a theoretical lower bound for the forecasting error, which is positively correlated with the…

机器学习 · 计算机科学 2025-09-26 Tianyi Shi , Zhu Meng , Yue Chen , Siyang Zheng , Fei Su , Jin Huang , Changrui Ren , Zhicheng Zhao

Meta-forecasting is a newly emerging field which combines meta-learning and time series forecasting. The goal of meta-forecasting is to train over a collection of source time series and generalize to new time series one-at-a-time. Previous…

机器学习 · 计算机科学 2023-02-07 Mike Van Ness , Huibin Shen , Hao Wang , Xiaoyong Jin , Danielle C. Maddix , Karthick Gopalswamy

Since distribution shifts are likely to occur during test-time and can drastically decrease the model's performance, online test-time adaptation (TTA) continues to update the model after deployment, leveraging the current test data.…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Robert A. Marsden , Mario Döbler , Bin Yang

While current time series research focuses on developing new models, crucial questions of selecting an optimal approach for training such models are underexplored. Tsururu, a Python library introduced in this paper, bridges SoTA research…

机器学习 · 计算机科学 2025-09-22 Alina Kostromina , Kseniia Kuvshinova , Aleksandr Yugay , Andrey Savchenko , Dmitry Simakov

Existing data-driven approaches in modeling and predicting time series data include ARIMA (Autoregressive Integrated Moving Average), Transformer-based models, LSTM (Long Short-Term Memory) and TCN (Temporal Convolutional Network). These…

机器学习 · 计算机科学 2025-12-09 Saroj Gopali , Bipin Chhetri , Deepika Giri , Sima Siami-Namini , Akbar Siami Namin

As multimodal data proliferates across diverse real-world applications, leveraging heterogeneous information such as texts and timestamps for accurate time series forecasting (TSF) has become a critical challenge. While diffusion models…

机器学习 · 计算机科学 2025-12-09 Da Zhang , Bingyu Li , Zhuyuan Zhao , Junyu Gao , Feiping Nie , Xuelong Li

Multivariate time-series forecasting is vital in various domains, e.g., economic planning and weather prediction. Deep train-from-scratch models have exhibited effective performance yet require large amounts of data, which limits real-world…

机器学习 · 计算机科学 2025-02-21 Ching Chang , Wei-Yao Wang , Wen-Chih Peng , Tien-Fu Chen