English
Related papers

Related papers: An Attention Free Long Short-Term Memory for Time …

200 papers

Can meta-learning discover generic ways of processing time series (TS) from a diverse dataset so as to greatly improve generalization on new TS coming from different datasets? This work provides positive evidence to this using a broad…

Machine Learning · Computer Science 2020-12-16 Boris N. Oreshkin , Dmitri Carpov , Nicolas Chapados , Yoshua Bengio

As Transformer-based models have achieved impressive performance on various time series tasks, Long-Term Series Forecasting (LTSF) tasks have also received extensive attention in recent years. However, due to the inherent computational…

Machine Learning · Computer Science 2024-02-06 Daojun Liang , Haixia Zhang , Dongfeng Yuan , Xiaoyan Ma , Dongyang Li , Minggao Zhang

The task of multi-channel time series forecasting is ubiquitous in numerous fields such as finance, supply chain management, and energy planning. It is critical to effectively capture complex dynamic dependencies within and between channels…

Artificial Intelligence · Computer Science 2026-03-20 Lei Gao , Hengda Bao , Jingfei Fang , Guangzheng Wu , Weihua Zhou , Yun Zhou

Sleep disorders have a major impact on both lifestyle and health. Effective sleep disorder prediction from lifestyle and physiological data can provide essential details for early intervention. This research utilizes three deep time series…

Machine Learning · Computer Science 2024-12-30 Pegah Ahadian , Wei Xu , Sherry Wang , Qiang Guan

Predictive business process monitoring methods exploit logs of completed cases of a process in order to make predictions about running cases thereof. Existing methods in this space are tailor-made for specific prediction tasks. Moreover,…

Applications · Statistics 2017-12-20 Niek Tax , Ilya Verenich , Marcello La Rosa , Marlon Dumas

We predict asset returns and measure risk premia using a prominent technique from artificial intelligence -- deep sequence modeling. Because asset returns often exhibit sequential dependence that may not be effectively captured by…

Machine Learning · Computer Science 2021-08-23 Lin William Cong , Ke Tang , Jingyuan Wang , Yang Zhang

There has been a recent surge of interest in time series modeling using the Transformer architecture. However, forecasting multivariate time series with Transformer presents a unique challenge as it requires modeling both temporal…

Machine Learning · Computer Science 2025-07-04 Yu-Hsiang Lan , Eric K. Oermann

Multivariate time series forecasting is an important machine learning problem across many domains, including predictions of solar plant energy output, electricity consumption, and traffic jam situation. Temporal data arise in these…

Machine Learning · Computer Science 2018-04-20 Guokun Lai , Wei-Cheng Chang , Yiming Yang , Hanxiao Liu

Accurate short-term energy consumption forecasting is essential for efficient power grid management, resource allocation, and market stability. Traditional time-series models often fail to capture the complex, non-linear dependencies and…

Computers and Society · Computer Science 2026-01-27 Abhishek Maity , Viraj Tukarul

Visual attention mechanisms have proven to be integrally important constituent components of many modern deep neural architectures. They provide an efficient and effective way to utilize visual information selectively, which has shown to be…

Computer Vision and Pattern Recognition · Computer Science 2019-05-24 Siddhesh Khandelwal , Leonid Sigal

Considering the difficulty of financial time series forecasting in financial aid, much of the current research focuses on leveraging big data analytics in financial services. One modern approach is to utilize "predictive analysis",…

Machine Learning · Computer Science 2024-10-28 Md Khairul Islam , Ayush Karmacharya , Timothy Sue , Judy Fox

Load forecasting is a crucial topic in energy management systems (EMS) due to its vital role in optimizing energy scheduling and enabling more flexible and intelligent power grid systems. As a result, these systems allow power utility…

Machine Learning · Computer Science 2023-05-16 Firas Bayram , Phil Aupke , Bestoun S. Ahmed , Andreas Kassler , Andreas Theocharis , Jonas Forsman

As global fossil fuel reserves diminish, there's a growing impetus for nations to transition towards renewable energy sources. Sri Lanka, for instance, aims to generate 70% of its electricity from renewable sources by 2030. Achieving this…

Signal Processing · Electrical Eng. & Systems 2026-05-04 Anushka Bandara , Sahan Siriwardena , Akila Wijethunge , Janaka Ekanayake

The paper describes the deep learning approach for forecasting non-stationary time series with using time trend correction in a neural network model. Along with the layers for predicting sales values, the neural network model includes a…

Machine Learning · Computer Science 2022-05-25 Bohdan M. Pavlyshenko

The explosion of Time Series (TS) data, driven by advancements in technology, necessitates sophisticated analytical methods. Modern management systems increasingly rely on analyzing this data, highlighting the importance of effcient…

Machine Learning · Computer Science 2025-03-27 Seyedeh Azadeh Fallah Mortezanejad , Ruochen Wang

Machine learning methods trained on raw numerical time series data exhibit fundamental limitations such as a high sensitivity to the hyper parameters and even to the initialization of random weights. A combination of a recurrent neural…

Machine Learning · Computer Science 2020-03-13 Steven Elsworth , Stefan Güttel

Time series forecasting has important applications in financial analysis, weather forecasting, and traffic management. However, existing deep learning models are limited in processing non-stationary time series data because they cannot…

Machine Learning · Computer Science 2025-05-13 Yuqi Xiong , Yang Wen

The early outcome prediction of ongoing or completed processes confers competitive advantage to organizations. The performance of classic machine learning and, more recently, deep learning techniques such as Long Short-Term Memory (LSTM) on…

Machine Learning · Computer Science 2021-04-15 Hans Weytjens , Jochen De Weerdt

Long Short-Term Memory (LSTM) networks, a type of recurrent neural network with a more complex computational unit, have been successfully applied to a variety of sequence modeling tasks. In this paper we develop Tree Long Short-Term Memory…

Computation and Language · Computer Science 2016-04-05 Xingxing Zhang , Liang Lu , Mirella Lapata

Multivariate time series (MTS) analysis prevails in real-world applications such as finance, climate science and healthcare. The various self-attention mechanisms, the backbone of the state-of-the-art Transformer-based models, efficiently…

Machine Learning · Computer Science 2023-11-21 Quang Minh Nguyen , Lam M. Nguyen , Subhro Das