English
Related papers

Related papers: Transformers versus LSTMs for electronic trading

200 papers

Two of the many trends in neural network research of the past few years have been (i) the learning of dynamical systems, especially with recurrent neural networks such as long short-term memory networks (LSTMs) and (ii) the introduction of…

Numerical Analysis · Mathematics 2024-11-15 Benedikt Brantner , Guillaume de Romemont , Michael Kraus , Zeyuan Li

Long Short-Term Memory (LSTM) networks are often used to capture temporal dependency patterns. By stacking multi-layer LSTM networks, it can capture even more complex patterns. This paper explores the effectiveness of applying stacked LSTM…

Machine Learning · Computer Science 2020-11-03 Frank Xiao

Accurate vehicle trajectory prediction is crucial for ensuring safe and efficient autonomous driving. This work explores the integration of Transformer based model with Long Short-Term Memory (LSTM) based technique to enhance spatial and…

Robotics · Computer Science 2024-12-19 Chandra Raskoti , Weizi Li

Multivariate time series forecasting focuses on predicting future values based on historical context. State-of-the-art sequence-to-sequence models rely on neural attention between timesteps, which allows for temporal learning but fails to…

Machine Learning · Computer Science 2023-03-21 Jake Grigsby , Zhe Wang , Nam Nguyen , Yanjun Qi

Deep Learning and transfer learning models are being used to generate time series forecasts; however, there is scarce evidence about their performance prediction that it is more evident for monthly time series. The purpose of this paper is…

Machine Learning · Computer Science 2023-10-12 Martín Solís , Luis-Alexander Calvo-Valverde

This paper presents a deep learning framework based on Long Short-term Memory Network(LSTM) that predicts price movement of cryptocurrencies from trade-by-trade data. The main focus of this study is on predicting short-term price changes in…

Statistical Finance · Quantitative Finance 2020-10-16 Qi Zhao

Stock trend analysis has been an influential time-series prediction topic due to its lucrative and inherently chaotic nature. Many models looking to accurately predict the trend of stocks have been based on Recurrent Neural Networks (RNNs).…

Statistical Finance · Quantitative Finance 2023-05-25 Harsimrat Kaeley , Ye Qiao , Nader Bagherzadeh

In recent years, deep learning techniques have outperformed traditional models in many machine learning tasks. Deep neural networks have successfully been applied to address time series forecasting problems, which is a very important topic…

Machine Learning · Computer Science 2021-04-09 Pedro Lara-Benítez , Manuel Carranza-García , José C. Riquelme

The early outcome prediction of ongoing or completed processes confers competitive advantage to organizations. The performance of classic machine learning and, more recently, deep learning techniques such as Long Short-Term Memory (LSTM) on…

Machine Learning · Computer Science 2021-04-15 Hans Weytjens , Jochen De Weerdt

In this paper we investigate to what extent long short-term memory neural networks (LSTMs) are suitable for demand forecasting in the e-grocery retail sector. For this purpose, univariate as well as multivariate LSTM-based models were…

Machine Learning · Computer Science 2020-08-20 Marta Gołąbek , Robin Senge , Rainer Neumann

The present document delineates the analysis, design, implementation, and benchmarking of various neural network architectures within a short-term frequency prediction system for the foreign exchange market (FOREX). Our aim is to simulate…

Mathematical Finance · Quantitative Finance 2024-05-15 Theodoros Zafeiriou , Dimitris Kalles

Many models such as Long Short Term Memory (LSTMs), Gated Recurrent Units (GRUs) and transformers have been developed to classify time series data with the assumption that events in a sequence are ordered. On the other hand, fewer models…

Machine Learning · Computer Science 2021-02-02 Stephanie Ger , Diego Klabjan , Jean Utke

Time series prediction with neural networks has been the focus of much research in the past few decades. Given the recent deep learning revolution, there has been much attention in using deep learning models for time series prediction, and…

Machine Learning · Computer Science 2021-06-08 Rohitash Chandra , Shaurya Goyal , Rishabh Gupta

Transformer-based architectures have achieved remarkable success in natural language processing and computer vision. However, their performance in multivariate long-term forecasting often falls short compared to simpler linear baselines.…

Machine Learning · Computer Science 2025-07-09 Dizhen Liang

Analysis of time-series data allows to identify long-term trends and make predictions that can help to improve our lives. With the rapid development of artificial neural networks, long short-term memory (LSTM) recurrent neural network (RNN)…

Emerging Technologies · Computer Science 2018-09-11 Kazybek Adam , Kamilya Smagulova , Alex Pappachen James

Recently, machine learning methods have provided a broad spectrum of original and efficient algorithms based on Deep Neural Networks (DNN) to automatically predict an outcome with respect to a sequence of inputs. Recurrent hidden cells…

Machine Learning · Computer Science 2017-02-15 Mohamed Bouaziz , Mohamed Morchid , Richard Dufour , Georges Linarès , Renato De Mori

Decision Transformer (DT) is a recently proposed architecture for Reinforcement Learning that frames the decision-making process as an auto-regressive sequence modeling problem and uses a Transformer model to predict the next action in a…

Machine Learning · Computer Science 2022-11-29 Max Siebenborn , Boris Belousov , Junning Huang , Jan Peters

In this study, we propose a novel adaptive control architecture, which provides dramatically better transient response performance compared to conventional adaptive control methods. What makes this architecture unique is the synergistic…

Systems and Control · Electrical Eng. & Systems 2023-01-09 Emirhan Inanc , Yigit Gurses , Abdullah Habboush , Yildiray Yildiz , Anuradha M. Annaswamy

The evaluation of the financial markets to predict their behaviour have been attempted using a number of approaches, to make smart and profitable investment decisions. Owing to the highly non-linear trends and inter-dependencies, it is…

Statistical Finance · Quantitative Finance 2022-08-02 Shaswat Mohanty , Anirudh Vijay , Nandagopan Gopakumar

Traditional recurrent neural network architectures, such as long short-term memory neural networks (LSTM), have historically held a prominent role in time series forecasting (TSF) tasks. While the recently introduced sLSTM for Natural…

Machine Learning · Computer Science 2025-02-25 Yaxuan Kong , Zepu Wang , Yuqi Nie , Tian Zhou , Stefan Zohren , Yuxuan Liang , Peng Sun , Qingsong Wen