中文
相关论文

相关论文: GBT: Two-stage transformer framework for non-stati…

200 篇论文

Predicting precipitation maps is a highly complex spatiotemporal modeling task, critical for mitigating the impacts of extreme weather events. Short-term precipitation forecasting, or nowcasting, requires models that are not only accurate…

This paper introduces a new transformer-based model for the problem of travel time estimation. The key feature of the proposed GCT-TTE architecture is the utilization of different data modalities capturing different properties of an input…

人工智能 · 计算机科学 2023-10-17 Vladimir Mashurov , Vaagn Chopurian , Vadim Porvatov , Arseny Ivanov , Natalia Semenova

Transformers have been actively studied for time-series forecasting in recent years. While often showing promising results in various scenarios, traditional Transformers are not designed to fully exploit the characteristics of time-series…

机器学习 · 计算机科学 2022-06-22 Gerald Woo , Chenghao Liu , Doyen Sahoo , Akshat Kumar , Steven Hoi

Graph Neural Networks frequently exhibit significant performance degradation in the out-of-distribution test scenario. While test-time training (TTT) offers a promising solution, existing Parameter Finetuning (PaFT) paradigm suffer from…

机器学习 · 计算机科学 2026-01-30 Jiaxin Zhang , Yiqi Wang , Siwei Wang , Xihong Yang , Yu Shi , Xinwang Liu , En Zhu

Multi-stage stochastic programming is a well-established framework for sequential decision making under uncertainty by seeking policies that are fully adapted to the uncertainty. Often such flexible policies are not desirable, and the…

最优化与控制 · 数学 2024-08-06 Beste Basciftci , Shabbir Ahmed , Nagi Gebraeel

Accurate and reliable energy time series prediction is of great significance for power generation planning and allocation. At present, deep learning time series prediction has become the mainstream method. However, the multi-scale time…

机器学习 · 计算机科学 2025-08-08 Wei Li , Zixin Wang , Qizheng Sun , Qixiang Gao , Fenglei Yang

Time series forecasting is crucial for applications across multiple domains and various scenarios. Although Transformer models have dramatically advanced the landscape of forecasting, their effectiveness remains debated. Recent findings…

机器学习 · 计算机科学 2024-12-24 Dongbin Kim , Jinseong Park , Jaewook Lee , Hoki Kim

Real-world time series often exhibit a non-stationary nature, degrading the performance of pre-trained forecasting models. Test-Time Adaptation (TTA) addresses this by adjusting models during inference, but existing methods typically update…

机器学习 · 计算机科学 2025-07-01 Heitor R. Medeiros , Hossein Sharifi-Noghabi , Gabriel L. Oliveira , Saghar Irandoust

The attention mechanism has demonstrated remarkable potential in sequence modeling, exemplified by its successful application in natural language processing with models such as Bidirectional Encoder Representations from Transformers (BERT)…

机器学习 · 计算机科学 2025-11-26 Bowen Zhao , Huanlai Xing , Zhiwen Xiao , Jincheng Peng , Li Feng , Xinhan Wang , Rong Qu , Hui Li

In the smart grid of the future, accurate load forecasts on the level of individual clients can help to balance supply and demand locally and to prevent grid outages. While the number of monitored clients will increase with the ongoing…

Reliable uncertainty quantification is critical in multivariate time series forecasting problems arising in domains such as energy systems and transportation networks, among many others. Although Transformer-based architectures have…

机器学习 · 计算机科学 2026-03-13 Rajdeep Pathak , Rahul Goswami , Madhurima Panja , Palash Ghosh , Tanujit Chakraborty

Financial time series forecasting presents significant challenges due to complex nonlinear relationships, temporal dependencies, variable interdependencies and limited data availability, particularly for tasks involving low-frequency data,…

综合金融 · 定量金融 2025-07-11 Ben A. Marconi

Time series foundation models (TSFMs) offer strong zero-shot forecasting via large-scale pre-training, yet fine-tuning remains critical for boosting performance in domains with limited public data. With the growing number of TSFMs,…

机器学习 · 计算机科学 2025-09-30 Qingren Yao , Ming Jin , Chengqi Zhang , Chao-Han Huck Yang , Jun Qi , Shirui Pan

For prediction and real-time control tasks, machine-learning (ML)-based digital twins are frequently employed. However, while these models are typically accurate, they are custom-designed for individual systems, making system-to-system…

材料科学 · 物理学 2023-06-07 Niranjan Sitapure , Joseph S. Kwon

Automatic Time Series Forecasting (TSF) model design which aims to help users to efficiently design suitable forecasting model for the given time series data scenarios, is a novel research topic to be urgently solved. In this paper, we…

机器学习 · 计算机科学 2022-03-29 Chunnan Wang , Xingyu Chen , Chengyue Wu , Hongzhi Wang

Many real-world applications require the prediction of long sequence time-series, such as electricity consumption planning. Long sequence time-series forecasting (LSTF) demands a high prediction capacity of the model, which is the ability…

机器学习 · 计算机科学 2021-03-30 Haoyi Zhou , Shanghang Zhang , Jieqi Peng , Shuai Zhang , Jianxin Li , Hui Xiong , Wancai Zhang

Traffic flow prediction (TFP) is a fundamental problem of the Intelligent Transportation System (ITS), as it models the latent spatial-temporal dependency of traffic flow for potential congestion prediction. Recent graph-based models with…

机器学习 · 计算机科学 2023-08-02 Ying Yang , Kai Du , Xingyuan Dai , Jianwu Fang

This paper introduces TRACE-GPT, which stands for Time-seRies Anomaly-detection with Convolutional Embedding and Generative Pre-trained Transformers. TRACE-GPT is designed to pre-train univariate time-series sensor data and detect faults on…

机器学习 · 计算机科学 2024-03-28 Sewoong Lee , JinKyou Choi , Min Su Kim

A reliable and efficient representation of multivariate time series is crucial in various downstream machine learning tasks. In multivariate time series forecasting, each variable depends on its historical values and there are…

机器学习 · 计算机科学 2022-08-22 William T. Ng , K. Siu , Albert C. Cheung , Michael K. Ng

Deep models for Multivariate Time Series (MTS) forecasting have recently demonstrated significant success. Channel-dependent models capture complex dependencies that channel-independent models cannot capture. However, the number of channels…

机器学习 · 计算机科学 2024-08-09 Xin Zhou , Weiqing Wang , Wray Buntine , Shilin Qu , Abishek Sriramulu , Weicong Tan , Christoph Bergmeir