English
Related papers

Related papers: Transformer for Times Series: an Application to th…

200 papers

Time series forecasting is important across various domains for decision-making. In particular, financial time series such as stock prices can be hard to predict as it is difficult to model short-term and long-term temporal dependencies…

Machine Learning · Computer Science 2023-04-12 Zhen Zeng , Rachneet Kaur , Suchetha Siddagangappa , Saba Rahimi , Tucker Balch , Manuela Veloso

Time series forecasting is crucial for decision-making across various domains, particularly in financial markets where stock prices exhibit complex and non-linear behaviors. Accurately predicting future price movements is challenging due to…

General Economics · Economics 2025-04-29 Tiantian Tu

This paper investigates the application of Transformer-based neural networks to stock price forecasting, with a special focus on the intersection of machine learning techniques and financial market analysis. The evolution of Transformer…

Computational Engineering, Finance, and Science · Computer Science 2024-12-31 Kamil Ł. Szydłowski , Jarosław A. Chudziak

Transformer architecture has widespread applications, particularly in Natural Language Processing and computer vision. Recently Transformers have been employed in various aspects of time-series analysis. This tutorial provides an overview…

Machine Learning · Computer Science 2023-07-27 Sabeen Ahmed , Ian E. Nielsen , Aakash Tripathi , Shamoon Siddiqui , Ghulam Rasool , Ravi P. Ramachandran

To the naked eye, stock prices are considered chaotic, dynamic, and unpredictable. Indeed, it is one of the most difficult forecasting tasks that hundreds of millions of retail traders and professional traders around the world try to do…

Computational Finance · Quantitative Finance 2025-02-17 Shuozhe Li , Zachery B Schulwol , Risto Miikkulainen

The emergence of deep learning has yielded noteworthy advancements in time series forecasting (TSF). Transformer architectures, in particular, have witnessed broad utilization and adoption in TSF tasks. Transformers have proven to be the…

Machine Learning · Computer Science 2023-11-01 Liyilei Su , Xumin Zuo , Rui Li , Xin Wang , Heng Zhao , Bingding Huang

Recent innovations in transformers have shown their superior performance in natural language processing (NLP) and computer vision (CV). The ability to capture long-range dependencies and interactions in sequential data has also triggered a…

Statistical Finance · Quantitative Finance 2025-03-24 Chu Myaet Thwal , Ye Lin Tun , Kitae Kim , Seong-Bae Park , Choong Seon Hong

Recurrent Neural Networks were, until recently, one of the best ways to capture the timely dependencies in sequences. However, with the introduction of the Transformer, it has been proven that an architecture with only attention-mechanisms…

Machine Learning · Computer Science 2021-08-19 Radostin Cholakov , Todor Kolev

Transformer is the state-of-the-art model for many natural language processing, computer vision, and audio analysis problems. Transformer effectively combines information from the past input and output samples in auto-regressive manner so…

Machine Learning · Computer Science 2025-03-14 Joni-Kristian Kämäräinen

The Transformer is a highly successful deep learning model that has revolutionised the world of artificial neural networks, first in natural language processing and later in computer vision. This model is based on the attention mechanism…

Machine Learning · Computer Science 2023-05-09 Riccardo Ughi , Eugenio Lomurno , Matteo Matteucci

Transformers have achieved superior performances in many tasks in natural language processing and computer vision, which also triggered great interest in the time series community. Among multiple advantages of Transformers, the ability to…

Machine Learning · Computer Science 2023-05-15 Qingsong Wen , Tian Zhou , Chaoli Zhang , Weiqi Chen , Ziqing Ma , Junchi Yan , Liang Sun

We present a conformal prediction method for time series using the Transformer architecture to capture long-memory and long-range dependencies. Specifically, we use the Transformer decoder as a conditional quantile estimator to predict the…

Machine Learning · Computer Science 2024-06-11 Junghwan Lee , Chen Xu , Yao Xie

Recently, there has been a surge of Transformer-based solutions for the long-term time series forecasting (LTSF) task. Despite the growing performance over the past few years, we question the validity of this line of research in this work.…

Artificial Intelligence · Computer Science 2022-08-18 Ailing Zeng , Muxi Chen , Lei Zhang , Qiang Xu

This paper aims to study the prediction of the bank stability index based on the Time Series Transformer model. The bank stability index is an important indicator to measure the health status and risk resistance of financial institutions.…

Risk Management · Quantitative Finance 2024-12-06 Wenying Sun , Zhen Xu , Wenqing Zhang , Kunyuan Ma , You Wu , Mengfang Sun

In this paper, we tackle the challenge of predicting stock movements in financial markets by introducing Higher Order Transformers, a novel architecture designed for processing multivariate time-series data. We extend the self-attention…

Machine Learning · Computer Science 2024-12-17 Soroush Omranpour , Guillaume Rabusseau , Reihaneh Rabbany

With the rapid development of artificial intelligence, long short term memory (LSTM), one kind of recurrent neural network (RNN), has been widely applied in time series prediction. Like RNN, Transformer is designed to handle the sequential…

Trading and Market Microstructure · Quantitative Finance 2023-09-21 Paul Bilokon , Yitao Qiu

Time series forecasting is an important task in many fields ranging from supply chain management to weather forecasting. Recently, Transformer neural network architectures have shown promising results in forecasting on common time series…

Machine Learning · Computer Science 2024-08-08 Rares Cristian , Pavithra Harsha , Clemente Ocejo , Georgia Perakis , Brian Quanz , Ioannis Spantidakis , Hamza Zerhouni

The recent boom of linear forecasting models questions the ongoing passion for architectural modifications of Transformer-based forecasters. These forecasters leverage Transformers to model the global dependencies over temporal tokens of…

Machine Learning · Computer Science 2024-03-15 Yong Liu , Tengge Hu , Haoran Zhang , Haixu Wu , Shiyu Wang , Lintao Ma , Mingsheng Long

Financial prediction is a complex and challenging task of time series analysis and signal processing, expected to model both short-term fluctuations and long-term temporal dependencies. Transformers have remarkable success mostly in natural…

Machine Learning · Computer Science 2025-11-17 Nguyen Kim Hai Bui , Nguyen Duy Chien , Péter Kovács , Gergő Bognár

The Ornstein-Uhlenbeck (OU) process, a mean-reverting stochastic process, has been widely applied as a time series model in various domains. This paper describes the design and implementation of a model-based synthetic time series model…

Computational Engineering, Finance, and Science · Computer Science 2023-11-07 Haibei Zhu , Svitlana Vyetrenko , Tucker Balch
‹ Prev 1 2 3 10 Next ›