English
Related papers

Related papers: Process Outcome Prediction: CNN vs. LSTM (with Att…

200 papers

This paper compares Kolmogorov-Arnold Networks (KAN) and Long Short-Term Memory networks (LSTM) for forecasting non-deterministic stock price data, evaluating predictive accuracy versus interpretability trade-offs using Root Mean Square…

Machine Learning · Computer Science 2025-11-25 Tabish Ali Rather , S M Mahmudul Hasan Joy , Nadezda Sukhorukova , Federico Frascoli

Image captioning is a challenging task that combines the field of computer vision and natural language processing. A variety of approaches have been proposed to achieve the goal of automatically describing an image, and recurrent neural…

Computer Vision and Pattern Recognition · Computer Science 2018-05-24 Qingzhong Wang , Antoni B. Chan

Identifying sleep stages and patterns is an essential part of diagnosing and treating sleep disorders. With the advancement of smart technologies, sensor data related to sleeping patterns can be captured easily. In this paper, we propose a…

Signal Processing · Electrical Eng. & Systems 2022-04-29 Vidya Rohini Konanur Sathish , Wai Lok Woo , Edmond S. L. Ho

The Linear Attention Recurrent Neural Network (LARNN) is a recurrent attention module derived from the Long Short-Term Memory (LSTM) cell and ideas from the consciousness Recurrent Neural Network (RNN). Yes, it LARNNs. The LARNN uses…

Machine Learning · Computer Science 2018-08-17 Guillaume Chevalier

In recent years, the convolutional neural networks (CNNs) have received a lot of interest in the side-channel community. The previous work has shown that CNNs have the potential of breaking the cryptographic algorithm protected with masking…

Cryptography and Security · Computer Science 2020-09-21 Minhui Jin , Mengce Zheng , Honggang Hu , Nenghai Yu

Predictive business process monitoring (PBPM) aims to predict future process behavior during ongoing process executions based on event log data. Especially, techniques for the next activity and timestamp prediction can help to improve the…

Machine Learning · Computer Science 2020-11-06 An Nguyen , Srijeet Chatterjee , Sven Weinzierl , Leo Schwinn , Martin Matzner , Bjoern Eskofier

Recurrent Neural Networks (RNNs) with Long Short-Term Memory units (LSTM) are widely used because they are expressive and are easy to train. Our interest lies in empirically evaluating the expressiveness and the learnability of LSTMs in the…

Neural and Evolutionary Computing · Computer Science 2015-11-24 Wojciech Zaremba , Ilya Sutskever

We propose a novel convolutional architecture, named $gen$CNN, for word sequence prediction. Different from previous work on neural network-based language modeling and generation (e.g., RNN or LSTM), we choose not to greedily summarize the…

Computation and Language · Computer Science 2015-04-27 Mingxuan Wang , Zhengdong Lu , Hang Li , Wenbin Jiang , Qun Liu

Tasks in Predictive Business Process Monitoring (PBPM), such as Next Activity Prediction, focus on generating useful business predictions from historical case logs. Recently, Deep Learning methods, particularly sequence-to-sequence models…

Machine Learning · Computer Science 2025-03-25 Shahaf Bassan , Shlomit Gur , Sergey Zeltyn , Konstantinos Mavrogiorgos , Ron Eliav , Dimosthenis Kyriazis

Convolutional Neural Networks (CNNs), a prominent type of Deep Neural Networks (DNNs), have emerged as a state-of-the-art solution for solving machine learning tasks. To improve the performance and energy efficiency of CNN inference, the…

Hardware Architecture · Computer Science 2024-08-06 Rachmad Vidya Wicaksana Putra , Muhammad Abdullah Hanif , Muhammad Shafique

Convolutional neural networks (CNNs) have been successful in representing the fully-connected inferencing ability perceived to be seen in the human brain: they take full advantage of the hierarchy-style patterns commonly seen in complex…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Joshua Ball

Predictive business process monitoring (PBPM) is a class of techniques designed to predict behaviour, such as next activities, in running traces. PBPM techniques aim to improve process performance by providing predictions to process…

Artificial Intelligence · Computer Science 2020-12-25 Sven Weinzierl , Sandra Zilker , Jens Brunk , Kate Revoredo , Martin Matzner , Jörg Becker

Convolutional neural networks (CNN) are one of the best-performing neural network architectures for environmental sound classification (ESC). Recently, temporal attention mechanisms have been used in CNN to capture the useful information…

Sound · Computer Science 2020-05-22 Helin Wang , Yuexian Zou , Dading Chong , Wenwu Wang

Convolutional Neural Networks are extensively used in a wide range of applications, commonly including computer vision tasks like image and video classification, recognition, and segmentation. Recent research results demonstrate that…

Signal Processing · Electrical Eng. & Systems 2020-05-11 Marco Carreras , Gianfranco Deriu , Luigi Raffo , Luca Benini , Paolo Meloni

Stock market plays an important role in the economic development. Due to the complex volatility of the stock market, the research and prediction on the change of the stock price, can avoid the risk for the investors. The traditional time…

Statistical Finance · Quantitative Finance 2023-02-23 Zhuangwei Shi , Yang Hu , Guangliang Mo , Jian Wu

LSTM or Long Short Term Memory Networks is a specific type of Recurrent Neural Network (RNN) that is very effective in dealing with long sequence data and learning long term dependencies. In this work, we perform sentiment analysis on a GOP…

Computation and Language · Computer Science 2020-05-11 Karthik Gopalakrishnan , Fathi M. Salem

Convolutional Neural Networks (CNNs) were recently shown to provide state-of-the-art results for object category viewpoint estimation. However different ways of formulating this problem have been proposed and the competing approaches have…

Computer Vision and Pattern Recognition · Computer Science 2016-09-14 Francisco Massa , Renaud Marlet , Mathieu Aubry

Neural network models become increasingly popular as dynamic modeling tools in the control community. They have many appealing features including nonlinear structures, being able to approximate any functions. While most researchers hold…

Machine Learning · Computer Science 2023-10-23 Jinming Zhou , Yucai Zhu

Recently, non-recurrent architectures (convolutional, self-attentional) have outperformed RNNs in neural machine translation. CNNs and self-attentional networks can connect distant words via shorter network paths than RNNs, and it has been…

Computation and Language · Computer Science 2018-11-13 Gongbo Tang , Mathias Müller , Annette Rios , Rico Sennrich

Today when many practitioners run basic NLP on the entire web and large-volume traffic, faster methods are paramount to saving time and energy costs. Recent advances in GPU hardware have led to the emergence of bi-directional LSTMs as a…

Computation and Language · Computer Science 2017-07-25 Emma Strubell , Patrick Verga , David Belanger , Andrew McCallum