English
Related papers

Related papers: Multi-head Temporal Attention-Augmented Bilinear N…

200 papers

We propose here an extended attention model for sequence-to-sequence recurrent neural networks (RNNs) designed to capture (pseudo-)periods in time series. This extended attention model can be deployed on top of any RNN and is shown to yield…

Machine Learning · Computer Science 2017-08-22 Yagmur G. Cinar , Hamid Mirisaee , Parantapa Goswami , Eric Gaussier , Ali Ait-Bachir , Vadim Strijov

Multivariate time series have many applications, from healthcare and meteorology to life science. Although deep learning models have shown excellent predictive performance for time series, they have been criticised for being "black-boxes"…

Machine Learning · Computer Science 2024-05-06 Qiqi Su , Christos Kloukinas , Artur d'Avila Garcez

The paper describes the deep learning approach for forecasting non-stationary time series with using time trend correction in a neural network model. Along with the layers for predicting sales values, the neural network model includes a…

Machine Learning · Computer Science 2022-05-25 Bohdan M. Pavlyshenko

Analyzing both temporal and spatial patterns for an accurate forecasting model for financial time series forecasting is a challenge due to the complex nature of temporal-spatial dynamics: time series from different locations often have…

Machine Learning · Computer Science 2022-10-18 Hu Yang , Yi Huang , Haijun Wang , Yu Chen

Deep Learning (DL) models can be used to tackle time series analysis tasks with great success. However, the performance of DL models can degenerate rapidly if the data are not appropriately normalized. This issue is even more apparent when…

Computational Finance · Quantitative Finance 2019-09-24 Nikolaos Passalis , Anastasios Tefas , Juho Kanniainen , Moncef Gabbouj , Alexandros Iosifidis

Time series forecasting is a key component in many industrial and business decision processes and recurrent neural network (RNN) based models have achieved impressive progress on various time series forecasting tasks. However, most of the…

Machine Learning · Computer Science 2021-01-26 Zekai Chen , Jiaze E , Xiao Zhang , Hao Sheng , Xiuzheng Cheng

Time series analysis is critical for emerging net- work intelligent control and management functions. However, existing statistical-based and shallow machine learning models have shown limited prediction capabilities on multivariate time…

Machine Learning · Computer Science 2026-03-13 Yufeng Xin , Ethan Fan

Financial time series forecasting is, without a doubt, the top choice of computational intelligence for finance researchers from both academia and financial industry due to its broad implementation areas and substantial impact. Machine…

Machine Learning · Computer Science 2019-12-02 Omer Berat Sezer , Mehmet Ugur Gudelek , Ahmet Murat Ozbayoglu

As industrial systems become more complex and monitoring sensors for everything from surveillance to our health become more ubiquitous, multivariate time series prediction is taking an important place in the smooth-running of our society. A…

Machine Learning · Computer Science 2022-03-03 Fan Jin , Ke Zhang , Yipan Huang , Yifei Zhu , Baiping Chen

Given a sequence of sets, where each set contains an arbitrary number of elements, the problem of temporal sets prediction aims to predict the elements in the subsequent set. In practice, temporal sets prediction is much more complex than…

Machine Learning · Computer Science 2020-07-09 Le Yu , Leilei Sun , Bowen Du , Chuanren Liu , Hui Xiong , Weifeng Lv

The attention mechanism has demonstrated remarkable potential in sequence modeling, exemplified by its successful application in natural language processing with models such as Bidirectional Encoder Representations from Transformers (BERT)…

Machine Learning · Computer Science 2025-11-26 Bowen Zhao , Huanlai Xing , Zhiwen Xiao , Jincheng Peng , Li Feng , Xinhan Wang , Rong Qu , Hui Li

We consider a setting where multiple entities inter-act with each other over time and the time-varying statuses of the entities are represented as multiple correlated time series. For example, speed sensors are deployed in different…

Machine Learning · Computer Science 2021-03-23 Razvan-Gabriel Cirstea , Chenjuan Guo , Bin Yang

The prediction of financial markets is a challenging yet important task. In modern electronically-driven markets, traditional time-series econometric methods often appear incapable of capturing the true complexity of the multi-level…

Econometrics · Economics 2023-02-01 Martin Magris , Mostafa Shabani , Alexandros Iosifidis

Multi-horizon probabilistic time series forecasting has wide applicability to real-world tasks such as demand forecasting. Recent work in neural time-series forecasting mainly focus on the use of Seq2Seq architectures. For example,…

Machine Learning · Computer Science 2022-09-09 Sitan Yang , Carson Eisenach , Dhruv Madeka

The probability prediction of multivariate time series is a notoriously challenging but practical task. On the one hand, the challenge is how to effectively capture the cross-series correlations between interacting time series, to achieve…

Machine Learning · Computer Science 2023-07-24 Shibo Feng , Chunyan Miao , Ke Xu , Jiaxiang Wu , Pengcheng Wu , Yang Zhang , Peilin Zhao

Multivariate geo-sensory time series prediction is challenging because of the complex spatial and temporal correlation. In urban water distribution systems (WDS), numerous spatial-correlated sensors have been deployed to continuously…

Machine Learning · Computer Science 2020-04-15 Ziqing Ma , Shuming Liu , Guancheng Guo , Xipeng Yu

Attention-based models have been widely used in many areas, such as computer vision and natural language processing. However, relevant applications in time series classification (TSC) have not been explored deeply yet, causing a significant…

Machine Learning · Computer Science 2022-07-18 Bowen Zhao , Huanlai Xing , Xinhan Wang , Fuhong Song , Zhiwen Xiao

Time series forecasting is important in finance domain. Financial time series (TS) patterns are influenced by both short-term public opinions and medium-/long-term policy and market trends. Hence, processing multi-period inputs becomes…

Statistical Finance · Quantitative Finance 2026-02-03 Xu Zhang , Zhengang Huang , Yunzhi Wu , Xun Lu , Erpeng Qi , Yunkai Chen , Zhongya Xue , Qitong Wang , Peng Wang , Wei Wang

Forecasting based on financial time-series is a challenging task since most real-world data exhibits nonstationary property and nonlinear dependencies. In addition, different data modalities often embed different nonlinear relationships…

Machine Learning · Computer Science 2019-03-19 Dat Thanh Tran , Juho Kanniainen , Moncef Gabbouj , Alexandros Iosifidis

Optimal decision-making in social settings is often based on forecasts from time series (TS) data. Recently, several approaches using deep neural networks (DNNs) such as recurrent neural networks (RNNs) have been introduced for TS…

Machine Learning · Computer Science 2020-11-17 Philippe Chatigny , Jean-Marc Patenaude , Shengrui Wang