中文
相关论文

相关论文: PFformer: A Position-Free Transformer Variant for …

200 篇论文

Accurate fault detection and localization in electrical distribution systems is crucial, especially with the increasing integration of distributed energy resources (DERs), which inject greater variability and complexity into grid…

系统与控制 · 电气工程与系统科学 2026-03-02 Kriti Thakur , Alivelu Manga Parimi , Mayukha Pal

Current Transformer methods for Multivariate Time-Series Forecasting (MTSF) are all based on the conventional attention mechanism. They involve sequence embedding and performing a linear projection of Q, K, and V, and then computing…

机器学习 · 计算机科学 2024-07-22 Haixiang Wu

The real-time crash likelihood prediction model is an essential component of the proactive traffic safety management system. Over the years, numerous studies have attempted to construct a crash likelihood prediction model in order to…

机器学习 · 计算机科学 2023-08-30 B M Tazbiul Hassan Anik , Zubayer Islam , Mohamed Abdel-Aty

Transformer-based models have significantly advanced time series forecasting. Recent work, like the Cross-Attention-only Time Series transformer (CATS), shows that removing self-attention can make the model more accurate and efficient.…

机器学习 · 计算机科学 2025-09-08 Jiajun Song , Xiaoou Liu

Introduction: Long-term time series forecasting (LTSF) has gained significant attention in recent years. While various specialized designs exist for capturing temporal dependency, recent studies have shown that even a single linear layer…

机器学习 · 计算机科学 2026-05-19 Zhe Li , Shiyi Qi , Yiduo Li , Zenglin Xu

Time Series Forecasting (TSF) is used to predict the target variables at a future time point based on the learning from previous time points. To keep the problem tractable, learning methods use data from a fixed length window in the past as…

机器学习 · 计算机科学 2022-04-26 Jimeng Shi , Mahek Jain , Giri Narasimhan

Transformer-based models have achieved remarkable success in multivariate time series forecasting (MTSF) by capturing long-range dependencies. However, their widespread adoption is hindered by the quadratic computational complexity of…

机器学习 · 计算机科学 2026-05-12 Fanpu Cao , Shu Yang , Zhengjian Chen , Ye Liu , Laizhong Cui

We formulate a new inference task in the domain of multivariate time series forecasting (MTSF), called Variable Subset Forecast (VSF), where only a small subset of the variables is available during inference. Variables are absent during…

机器学习 · 计算机科学 2022-06-28 Jatin Chauhan , Aravindan Raghuveer , Rishi Saket , Jay Nandy , Balaraman Ravindran

Transformers have achieved remarkable progress in time series forecasting, yet their reliance on deterministic dot-product attention limits their capacity to model uncertainty and nonlinear dependencies across multivariate temporal…

机器学习 · 计算机科学 2026-03-24 Bulent Haznedar , Levent Karacan

Meteorological agencies around the world rely on real-time flood guidance to issue life-saving advisories and warnings. For decades traditional numerical weather prediction (NWP) models have been state-of-the-art for precipitation…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Levi Harris , Tianlong Chen

The prediction of residential power usage is essential in assisting a smart grid to manage and preserve energy to ensure efficient use. An accurate energy forecasting at the customer level will reflect directly into efficiency improvements…

Currently, iTransformer is one of the most popular and effective models for multivariate time series (MTS) forecasting. Thanks to its inverted framework, iTransformer effectively captures multivariate correlation. However, the inverted…

机器学习 · 计算机科学 2025-07-17 Hongming Tan , Ting Chen , Ruochong Jin , Wai Kin Chan

Time series forecasting is crucial for many fields, such as disaster warning, weather prediction, and energy consumption. The Transformer-based models are considered to have revolutionized the field of sequence modeling. However, the…

机器学习 · 计算机科学 2022-11-01 Junlong Tong , Liping Xie , Wankou Yang , Kanjian Zhang

Many real-world applications require the prediction of long sequence time-series, such as electricity consumption planning. Long sequence time-series forecasting (LSTF) demands a high prediction capacity of the model, which is the ability…

机器学习 · 计算机科学 2021-03-30 Haoyi Zhou , Shanghang Zhang , Jieqi Peng , Shuai Zhang , Jianxin Li , Hui Xiong , Wancai Zhang

This paper addresses the task of anomaly diagnosis when the underlying data generation process has a complex spatio-temporal (ST) dependency. The key technical challenge is to extract actionable insights from the dependency tensor…

机器学习 · 计算机科学 2023-05-30 Jokin Labaien , Tsuyoshi Idé , Pin-Yu Chen , Ekhi Zugasti , Xabier De Carlos

Accurate and reliable energy forecasting is essential for power grid operators who strive to minimize extreme forecasting errors that pose significant operational challenges and incur high intra-day trading costs. Incorporating planning…

计算机与社会 · 计算机科学 2026-05-13 Raffael Theiler , Leandro Von Krannichfeldt , Giovanni Sansavini , Michael F. Howland , Olga Fink

Foundation models (FMs) for the Earth system learn statistical relationships between physical variables across massive datasets to enable versatile downstream applications through finetuning, separating them from task-specific weather…

Multivariate time series forecasting focuses on predicting future values based on historical context. State-of-the-art sequence-to-sequence models rely on neural attention between timesteps, which allows for temporal learning but fails to…

机器学习 · 计算机科学 2023-03-21 Jake Grigsby , Zhe Wang , Nam Nguyen , Yanjun Qi

Financial time series forecasting presents significant challenges due to complex nonlinear relationships, temporal dependencies, variable interdependencies and limited data availability, particularly for tasks involving low-frequency data,…

综合金融 · 定量金融 2025-07-11 Ben A. Marconi

The key problem in multivariate time series (MTS) analysis and forecasting aims to disclose the underlying couplings between variables that drive the co-movements. Considerable recent successful MTS methods are built with graph neural…

机器学习 · 计算机科学 2022-10-11 Kun Yi , Qi Zhang , Liang Hu , Hui He , Ning An , LongBing Cao , ZhenDong Niu