English
Related papers

Related papers: Classifying Process Instances Using Recurrent Neur…

200 papers

Successful recurrent models such as long short-term memories (LSTMs) and gated recurrent units (GRUs) use ad hoc gating mechanisms. Empirically these models have been found to improve the learning of medium to long term temporal…

Machine Learning · Computer Science 2018-05-01 Corentin Tallec , Yann Ollivier

Time series forecasting is difficult. It is difficult even for recurrent neural networks with their inherent ability to learn sequentiality. This article presents a recurrent neural network based time series forecasting framework covering…

Machine Learning · Computer Science 2019-01-03 Gábor Petneházi

Predictive business process monitoring methods exploit logs of completed cases of a process in order to make predictions about running cases thereof. Existing methods in this space are tailor-made for specific prediction tasks. Moreover,…

Applications · Statistics 2017-12-20 Niek Tax , Ilya Verenich , Marcello La Rosa , Marlon Dumas

Recurrent neural networks with a gating mechanism such as an LSTM or GRU are powerful tools to model sequential data. In the mechanism, a forget gate, which was introduced to control information flow in a hidden state in the RNN, has…

Machine Learning · Statistics 2021-11-08 Kentaro Ohno , Atsutoshi Kumagai

A unique feature of Recurrent Neural Networks (RNNs) is that it incrementally processes input sequences. In this research, we aim to uncover the inherent generalization properties, i.e., inductive bias, of RNNs with respect to how…

Machine Learning · Computer Science 2023-05-17 Taiga Ishii , Ryo Ueda , Yusuke Miyao

In this paper we compare different types of recurrent units in recurrent neural networks (RNNs). Especially, we focus on more sophisticated units that implement a gating mechanism, such as a long short-term memory (LSTM) unit and a recently…

Neural and Evolutionary Computing · Computer Science 2014-12-12 Junyoung Chung , Caglar Gulcehre , KyungHyun Cho , Yoshua Bengio

We study the classification of animal behavior using accelerometry data through various recurrent neural network (RNN) models. We evaluate the classification performance and complexity of the considered models, which feature long short-time…

Machine Learning · Computer Science 2021-11-29 Liang Wang , Reza Arablouei , Flavio A. P. Alvarenga , Greg J. Bishop-Hurley

We explore the architecture of recurrent neural networks (RNNs) by studying the complexity of string sequences it is able to memorize. Symbolic sequences of different complexity are generated to simulate RNN training and study parameter…

Machine Learning · Computer Science 2023-11-17 Roberto Cahuantzi , Xinye Chen , Stefan Güttel

Predictive monitoring of business processes is a subfield of process mining that aims to predict, among other things, the characteristics of the next event or the sequence of next events. Although multiple approaches based on deep learning…

Machine Learning · Computer Science 2021-12-24 Efrén Rama-Maneiro , Juan C. Vidal , Manuel Lama

Predicting the completion time of business process instances would be a very helpful aid when managing processes under service level agreement constraints. The ability to know in advance the trend of running process instances would allow…

Machine Learning · Computer Science 2017-11-13 Nicolò Navarin , Beatrice Vincenzi , Mirko Polato , Alessandro Sperduti

We report the results of our classification-based machine translation model, built upon the framework of a recurrent neural network using gated recurrent units. Unlike other RNN models that attempt to maximize the overall conditional log…

Neural and Evolutionary Computing · Computer Science 2017-03-24 Ri Wang , Maysum Panju , Mahmood Gohari

Various methods using machine and deep learning have been proposed to tackle different tasks in predictive process monitoring, forecasting for an ongoing case e.g. the most likely next event or suffix, its remaining time, or an…

Machine Learning · Computer Science 2022-12-14 Jari Peeperkorn , Seppe vanden Broucke , Jochen De Weerdt

Despite the great successes of deep learning, the effectiveness of deep neural networks has not been understood at any theoretical depth. This work is motivated by the thrust of developing a deeper understanding of recurrent neural…

Machine Learning · Computer Science 2018-02-12 Dingkun Long , Richong Zhang , Yongyi Mao

Owing to their superior modeling capabilities, gated Recurrent Neural Networks, such as Gated Recurrent Units (GRUs) and Long Short-Term Memory networks (LSTMs), have become popular tools for learning dynamical systems. This paper aims to…

Machine Learning · Computer Science 2022-03-18 Fabio Bonassi , Riccardo Scattolini

Recurrent neural network is a powerful model that learns temporal patterns in sequential data. For a long time, it was believed that recurrent networks are difficult to train using simple optimizers, such as stochastic gradient descent, due…

Neural and Evolutionary Computing · Computer Science 2015-04-20 Tomas Mikolov , Armand Joulin , Sumit Chopra , Michael Mathieu , Marc'Aurelio Ranzato

Deep-learning models such as Convolutional Neural Networks (CNN) and Long Short-Term Memory (LSTM) have been successfully used for process-mining tasks. They have achieved better performance for different predictive tasks than traditional…

Machine Learning · Computer Science 2021-05-04 Ishwar Venugopal , Jessica Töllich , Michael Fairbank , Ansgar Scherp

The recurrent neural network and its variants have shown great success in processing sequences in recent years. However, this deep neural network has not aroused much attention in anomaly detection through predictively process monitoring.…

Machine Learning · Computer Science 2023-09-06 Jiaqi Qiu , Yu Lin , Inez Zwetsloot

We present a novel Recurrent Graph Network (RGN) approach for predicting discrete marked event sequences by learning the underlying complex stochastic process. Using the framework of Point Processes, we interpret a marked discrete event…

Machine Learning · Computer Science 2022-08-12 Saurabh Dash , Xueyuan She , Saibal Mukhopadhyay

Wildfire modelling is an attempt to reproduce fire behaviour. Through active fire analysis, it is possible to reproduce a dynamical process, such as wildfires, with limited duration time series data. Recurrent neural networks (RNNs) can…

Machine Learning · Computer Science 2020-05-28 Rylan Perumal , Terence L van Zyl

Recurrent neural networks (RNNs) have shown clear superiority in sequence modeling, particularly the ones with gated units, such as long short-term memory (LSTM) and gated recurrent unit (GRU). However, the dynamic properties behind the…

Machine Learning · Computer Science 2017-02-28 Zhiyuan Tang , Ying Shi , Dong Wang , Yang Feng , Shiyue Zhang
‹ Prev 1 2 3 10 Next ›