中文
相关论文

相关论文: Transformers vs. Recurrent Models for Estimating F…

200 篇论文

There has been a recent surge of interest in time series modeling using the Transformer architecture. However, forecasting multivariate time series with Transformer presents a unique challenge as it requires modeling both temporal…

机器学习 · 计算机科学 2025-07-04 Yu-Hsiang Lan , Eric K. Oermann

Predictive Process Monitoring (PPM) aims to forecast the future behavior of ongoing process instances using historical event data, enabling proactive decision-making. While recent advances rely heavily on deep learning models such as LSTMs…

机器学习 · 计算机科学 2025-09-23 Amaan Ansari , Lukas Kirchdorfer , Raheleh Hadian

Spatio-temporal prediction plays a crucial role in intelligent transportation, weather forecasting, and urban planning. While integrating multi-modal data has shown potential for enhancing prediction accuracy, key challenges persist: (i)…

机器学习 · 计算机科学 2025-10-29 Yuting Huang , Ziquan Fang , Zhihao Zeng , Lu Chen , Yunjun Gao

The immense success of the Transformer architecture in Natural Language Processing has led to its adoption in Time Se ries Forecasting (TSF), where superior performance has been shown. However, a recent important paper questioned their…

计算与语言 · 计算机科学 2025-10-28 Musleh Alharthi , Kaleel Mahmood , Sarosh Patel , Ausif Mahmood

Ensuring sustainability demands more efficient energy management with minimized energy wastage. Therefore, the power grid of the future should provide an unprecedented level of flexibility in energy management. To that end, intelligent…

神经与进化计算 · 计算机科学 2018-11-29 Daniel L. Marino , Kasun Amarasinghe , Milos Manic

Regional climate models (RCMs) are essential tools for simulating and studying regional climate variability and change. However, their high computational cost limits the production of comprehensive ensembles of regional climate projections…

大气与海洋物理 · 物理学 2023-11-08 Jorge Bano-Medina , Maialen Iturbide , Jesus Fernandez , Jose Manuel Gutierrez

With the rapid development of artificial intelligence, long short term memory (LSTM), one kind of recurrent neural network (RNN), has been widely applied in time series prediction. Like RNN, Transformer is designed to handle the sequential…

交易与市场微观结构 · 定量金融 2023-09-21 Paul Bilokon , Yitao Qiu

Reliable uncertainty quantification is critical in multivariate time series forecasting problems arising in domains such as energy systems and transportation networks, among many others. Although Transformer-based architectures have…

机器学习 · 计算机科学 2026-03-13 Rajdeep Pathak , Rahul Goswami , Madhurima Panja , Palash Ghosh , Tanujit Chakraborty

Recurrent neural networks for language models like long short-term memory (LSTM) have been utilized as a tool for modeling and predicting long term dynamics of complex stochastic molecular systems. Recently successful examples on learning…

人工智能 · 计算机科学 2021-07-15 Wenqi Zeng , Siqin Cao , Xuhui Huang , Yuan Yao

Effectively modeling non-stationary dynamics in probabilistic multivariate time series(MTS) forecasting requires balancing expressiveness with robustness. Existing parametric approaches benefit from strong inductive biases but lack…

机器学习 · 计算机科学 2026-05-25 Jinglin Li , Jun Tan , QI Fang , Ning Gui

Transition Matching (TM) is an emerging paradigm for generative modeling that generalizes diffusion and flow-matching models as well as continuous-state autoregressive models. TM, similar to previous paradigms, gradually transforms noise…

机器学习 · 计算机科学 2025-12-16 Uriel Singer , Yaron Lipman

Various deep learning models, especially some latest Transformer-based approaches, have greatly improved the state-of-art performance for long-term time series forecasting.However, those transformer-based models suffer a severe…

机器学习 · 计算机科学 2022-06-27 Tian Zhou , Jianqing Zhu , Xue Wang , Ziqing Ma , Qingsong Wen , Liang Sun , Rong Jin

This paper proposes an improved deep learning based maximum power point tracking (MPPT) in solar photovoltaic cells considering various time series based environmental inputs. Generally, artificial neural network based MPPT algorithms use…

系统与控制 · 电气工程与系统科学 2024-09-26 Palaash Agrawal , Hari Om Bansal , Aditya R. Gautam , Om Prakash Mahela , Baseem Khan

The emergence of deep learning has yielded noteworthy advancements in time series forecasting (TSF). Transformer architectures, in particular, have witnessed broad utilization and adoption in TSF tasks. Transformers have proven to be the…

机器学习 · 计算机科学 2023-11-01 Liyilei Su , Xumin Zuo , Rui Li , Xin Wang , Heng Zhao , Bingding Huang

We consider the general problem of modeling temporal data with long-range dependencies, wherein new observations are fully or partially predictable based on temporally-distant, past observations. A sufficiently powerful temporal model…

Recently, the superiority of Transformer for long-term time series forecasting (LTSF) tasks has been challenged, particularly since recent work has shown that simple models can outperform numerous Transformer-based approaches. This suggests…

机器学习 · 计算机科学 2023-10-10 Shengsheng Lin , Weiwei Lin , Wentai Wu , Songbo Wang , Yongxiang Wang

Forecasting within signal processing pipelines is crucial for mitigating delays, particularly in predicting the dynamic movements of objects such as NBA players. This task poses significant challenges due to the inherently interactive and…

Wildfire modelling is an attempt to reproduce fire behaviour. Through active fire analysis, it is possible to reproduce a dynamical process, such as wildfires, with limited duration time series data. Recurrent neural networks (RNNs) can…

机器学习 · 计算机科学 2020-05-28 Rylan Perumal , Terence L van Zyl

The primary objective of this research is to build a Momentum Transformer that is expected to outperform benchmark time-series momentum and mean-reversion trading strategies. We extend the ideas introduced in the paper Trading with the…

计算金融 · 定量金融 2024-12-18 Max Mason , Waasi A Jagirdar , David Huang , Rahul Murugan

Many models such as Long Short Term Memory (LSTMs), Gated Recurrent Units (GRUs) and transformers have been developed to classify time series data with the assumption that events in a sequence are ordered. On the other hand, fewer models…

机器学习 · 计算机科学 2021-02-02 Stephanie Ger , Diego Klabjan , Jean Utke