中文
相关论文

相关论文: EnTransformer: A Deep Generative Transformer for M…

200 篇论文

Recent innovations in diffusion probabilistic models have paved the way for significant progress in image, text and audio generation, leading to their applications in generative time series forecasting. However, leveraging such abilities to…

机器学习 · 计算机科学 2025-11-07 Yuansan Liu , Sudanthi Wijewickrema , Dongting Hu , Christofer Bester , Stephen O'Leary , James Bailey

The recent boom of linear forecasting models questions the ongoing passion for architectural modifications of Transformer-based forecasters. These forecasters leverage Transformers to model the global dependencies over temporal tokens of…

机器学习 · 计算机科学 2024-03-15 Yong Liu , Tengge Hu , Haoran Zhang , Haixu Wu , Shiyu Wang , Lintao Ma , Mingsheng Long

Transformers have demonstrated impressive strength in long-term series forecasting. Existing prediction research mostly focused on mapping past short sub-series (lookback window) to future series (forecast window). The longer training…

机器学习 · 计算机科学 2023-02-22 Julong Young , Junhui Chen , Feihu Huang , Jian Peng

Trajectory prediction and planning are fundamental yet disconnected components in autonomous driving. Prediction models forecast surrounding agent motion under unknown intentions, producing multimodal distributions, while planning assumes…

机器人学 · 计算机科学 2026-02-04 Constantin Selzer , Fabina B. Flohr

In recent times, Large Language Models (LLMs) have captured a global spotlight and revolutionized the field of Natural Language Processing. One of the factors attributed to the effectiveness of LLMs is the model architecture used for…

机器学习 · 计算机科学 2023-08-31 Oluwaseyi Ogunfowora , Homayoun Najjaran

Time-evolving traffic flow forecasting are playing a vital role in intelligent transportation systems and smart cities. However, the dynamic traffic flow forecasting is a highly nonlinear problem with complex temporal-spatial dependencies.…

机器学习 · 计算机科学 2025-08-05 Zhenan Lin , Yuni Lai , Wai Lun Lo , Richard Tai-Chiu Hsung , Harris Sik-Ho Tsang , Xiaoyu Xue , Kai Zhou , Yulin Zhu

The reliable operation of modern power grids requires probabilistic load forecasts with well-calibrated uncertainty estimates. However, existing deep learning models produce overconfident point predictions that fail catastrophically under…

机器学习 · 计算机科学 2026-03-10 Sajib Debnath , Md. Uzzal Mia

Transformer-based models, despite their promise for long-term time series forecasting (LTSF), suffer from an inherent low-pass filtering effect that limits their effectiveness. This issue arises due to undifferentiated propagation of…

机器学习 · 计算机科学 2026-01-23 Jingjing Bai , Yoshinobu Kawahara

In this paper, we present a new approach to time series forecasting. Time series data are prevalent in many scientific and engineering disciplines. Time series forecasting is a crucial task in modeling time series data, and is an important…

机器学习 · 计算机科学 2020-01-24 Neo Wu , Bradley Green , Xue Ben , Shawn O'Banion

Real-world time series data are inherently multivariate, often exhibiting complex inter-channel dependencies. Each channel is typically sampled at its own period and is prone to missing values due to various practical and operational…

机器学习 · 计算机科学 2026-03-11 Jinkwan Jang , Hyungjin Park , Jinmyeong Choi , Taesup Kim

While generative modeling on time series facilitates more capable and flexible probabilistic forecasting, existing generative time series models do not address the multi-dimensional properties of time series data well. The prevalent…

机器学习 · 计算机科学 2026-02-09 Haoran Zhang , Haixuan Liu , Yong Liu , Yunzhong Qiu , Yuxuan Wang , Jianmin Wang , Mingsheng Long

The proliferation of intermittent distributed renewable energy sources (RES) in modern power systems has fundamentally compromised the reliability and accuracy of deterministic net load forecasting. Generative models, particularly diffusion…

系统与控制 · 电气工程与系统科学 2025-06-04 Yixiang Huang , Jianhua Pei , Luocheng Chen , Zhenchang Du , Jinfu Chen , Zirui Peng

With the recent advancements in wireless technologies, forecasting electromagnetic field (EMF) exposure has become critical to enable proactive network spectrum and power allocation, as well as network deployment planning. In this paper, we…

机器学习 · 计算机科学 2025-04-02 Xavier Mootoo , Hina Tabassum , Luca Chiaraviglio

Multi-dimensional time series data, such as matrix and tensor-variate time series, are increasingly prevalent in fields such as economics, finance, and climate science. Traditional Transformer models, though adept with sequential data, do…

机器学习 · 计算机科学 2024-10-29 Linghang Kong , Elynn Chen , Yuzhou Chen , Yuefeng Han

Accurate load forecasting plays a vital role in numerous sectors, but accurately capturing the complex dynamics of dynamic power systems remains a challenge for traditional statistical models. For these reasons, time-series models (ARIMA)…

神经与进化计算 · 计算机科学 2024-02-06 Anuvab Sen , Arul Rhik Mazumder , Udayon Sen

Recent advancements in transformer-based models have greatly improved time series analysis, providing robust solutions for tasks such as forecasting, anomaly detection, and classification. A crucial element of these models is positional…

机器学习 · 计算机科学 2026-05-07 Habib Irani , Vangelis Metsis

This paper introduces a unified theoretical perspective that views deep generative models as probability transformation functions. Despite the apparent differences in architecture and training methodologies among various types of generative…

机器学习 · 计算机科学 2025-06-23 Vitalii Bondar , Vira Babenko , Roman Trembovetskyi , Yurii Korobeinyk , Viktoriya Dzyuba

I propose a novel framework that integrates stochastic differential equations (SDEs) with deep generative models to improve uncertainty quantification in machine learning applications involving structured and temporal data. This approach,…

机器学习 · 统计学 2026-01-09 James Rice

Time series forecasting is a critical task in domains such as energy, finance, and meteorology, where accurate long-term predictions are essential. While Transformer-based models have shown promise in capturing temporal dependencies, their…

机器学习 · 计算机科学 2024-12-10 Zhenkai Qin , Baozhong Wei , Caifeng Gao , Jianyuan Ni

When solving forecasting problems including multiple time-series features, existing approaches often fall into two extreme categories, depending on whether to utilize inter-feature information: univariate and complete-multivariate models.…

人工智能 · 计算机科学 2024-08-20 Jaehoon Lee , Hankook Lee , Sungik Choi , Sungjun Cho , Moontae Lee