English
Related papers

Related papers: Comparison of RNN Encoder-Decoder Models for Anoma…

200 papers

In a previous paper, we have shown that a recurrent neural network (RNN) can be used to detect cellular network radio signal degradations accurately. We unexpectedly found, though, that accuracy gains diminished as we added layers to the…

Machine Learning · Computer Science 2024-04-18 David Mulvey , Chuan Heng Foh , Muhammad Ali Imran , Rahim Tafazolli

Over the long history of machine learning, which dates back several decades, recurrent neural networks (RNNs) have been used mainly for sequential data and time series and generally with 1D information. Even in some rare studies on 2D…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Nguyen Huu Phong , Bernardete Ribeiro

In this paper, we propose a novel neural network model called RNN Encoder-Decoder that consists of two recurrent neural networks (RNN). One RNN encodes a sequence of symbols into a fixed-length vector representation, and the other decodes…

Computation and Language · Computer Science 2014-09-04 Kyunghyun Cho , Bart van Merrienboer , Caglar Gulcehre , Dzmitry Bahdanau , Fethi Bougares , Holger Schwenk , Yoshua Bengio

Deep learning (DL) in general and Recurrent neural networks (RNNs) in particular have seen high success levels in sequence based applications. This paper pertains to RNNs for time series modelling and forecasting. We propose a novel RNN…

Machine Learning · Computer Science 2022-07-12 Avinash Achar , Soumen Pachal

We propose a new encoder-decoder approach to learn distributed sentence representations that are applicable to multiple purposes. The model is learned by using a convolutional neural network as an encoder to map an input sentence into a…

Computation and Language · Computer Science 2017-07-28 Zhe Gan , Yunchen Pu , Ricardo Henao , Chunyuan Li , Xiaodong He , Lawrence Carin

We analyze the performance of encoder-decoder neural models and compare them with well-known established methods. The latter represent different classes of traditional approaches that are applied to the monotone sequence-to-sequence tasks…

Computation and Language · Computer Science 2016-10-27 Carsten Schnober , Steffen Eger , Erik-Lân Do Dinh , Iryna Gurevych

This work proposes a real-time anomaly detection scheme that leverages the multi-step ahead prediction capabilities of encoder-decoder (ED) deep learning models with recurrent units. Specifically, an encoder-decoder is used to model…

Machine Learning · Computer Science 2023-09-08 Sadananda Behera , Tania Panayiotou , Georgios Ellinas

We address the problem of anomaly detection, that is, detecting anomalous events in a video sequence. Anomaly detection methods based on convolutional neural networks (CNNs) typically leverage proxy tasks, such as reconstructing input video…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Hyunjong Park , Jongyoun Noh , Bumsub Ham

Hacking and false data injection from adversaries can threaten power grids' everyday operations and cause significant economic loss. Anomaly detection in power grids aims to detect and discriminate anomalies caused by cyber attacks against…

Machine Learning · Computer Science 2023-03-14 Xijuan Sun , Di Wu , Arnaud Zinflou , Benoit Boulet

Recently, anomaly scores have been formulated using reconstruction loss of the adversarially learned generators and/or classification loss of discriminators. Unavailability of anomaly examples in the training data makes optimization of such…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Muhammad Zaigham Zaheer , Jin Ha Lee , Arif Mahmood , Marcella Astrid , Seung-Ik Lee

Encouraged by the success of deep learning in a variety of domains, we investigate the suitability and effectiveness of Recurrent Neural Networks (RNNs) in a domain where deep learning has not yet been used; namely detecting confusion from…

Computer Vision and Pattern Recognition · Computer Science 2019-06-27 Shane D. Sims , Vanessa Putnam , Cristina Conati

Encoder-decoder-based recurrent neural network (RNN) has made significant progress in sequence-to-sequence learning tasks such as machine translation and conversational models. Recent works have shown the advantage of this type of network…

Machine Learning · Computer Science 2023-05-10 Jing Xiong , Pengyang Zhou , Alan Chen , Yu Zhang

Recurrent Neural Networks (RNN) received a vast amount of attention last decade. Recently, the architectures of Recurrent AutoEncoders (RAE) found many applications in practice. RAE can extract the semantically valuable information, called…

Machine Learning · Computer Science 2021-06-14 Robert Susik

Reliably detecting anomalies in a given set of images is a task of high practical relevance for visual quality inspection, surveillance, or medical image analysis. Autoencoder neural networks learn to reconstruct normal images, and hence…

Machine Learning · Computer Science 2019-01-21 Laura Beggel , Michael Pfeiffer , Bernd Bischl

Recurrent neural networks have gained widespread use in modeling sequential data. Learning long-term dependencies using these models remains difficult though, due to exploding or vanishing gradients. In this paper, we draw connections…

Machine Learning · Statistics 2019-02-27 Bo Chang , Minmin Chen , Eldad Haber , Ed H. Chi

Real-time lightweight time series anomaly detection has become increasingly crucial in cybersecurity and many other domains. Its ability to adapt to unforeseen pattern changes and swiftly identify anomalies enables prompt responses and…

Machine Learning · Computer Science 2024-07-29 Ming-Chang Lee , Jia-Chun Lin , Sokratis Katsikas

Recurrent Neural Networks are powerful machine learning frameworks that allow for data to be saved and referenced in a temporal sequence. This opens many new possibilities in fields such as handwriting analysis and speech recognition. This…

Machine Learning · Computer Science 2021-09-14 Joseph M. Ackerson , Dave Rushit , Seliya Jim

Generative adversarial networks (GANs) have shown promise for various problems including anomaly detection. When anomaly detection is performed using GAN models that learn only the features of normal data samples, data that are not similar…

Machine Learning · Computer Science 2020-12-23 Teguh Budianto , Tomohiro Nakai , Kazunori Imoto , Takahiro Takimoto , Kosuke Haruki

Missing data scenarios are very common in ML applications in general and time-series/sequence applications are no exceptions. This paper pertains to a novel Recurrent Neural Network (RNN) based solution for sequence prediction under missing…

Machine Learning · Computer Science 2022-08-19 Soumen Pachal , Avinash Achar

Matching algorithms can be used for identifying errors in quantum systems, being the most famous the Blossom algorithm. Recent works have shown that small distance quantum error correction codes can be efficiently decoded by employing…

Quantum Physics · Physics 2019-11-27 Savvas Varsamopoulos , Koen Bertels , Carmen G. Almudever
‹ Prev 1 2 3 10 Next ›