English
Related papers

Related papers: Property-Directed Verification of Recurrent Neural…

200 papers

Change detection is one of the central problems in earth observation and was extensively investigated over recent decades. In this paper, we propose a novel recurrent convolutional neural network (ReCNN) architecture, which is trained to…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Lichao Mou , Lorenzo Bruzzone , Xiao Xiang Zhu

This paper proposes a method for estimating the effect of a policy intervention on an outcome over time. We train recurrent neural networks (RNNs) on the history of control unit outcomes to learn a useful representation for predicting…

Machine Learning · Statistics 2021-08-24 Jason Poulos , Shuxi Zeng

Recurrent Neural Networks (RNNs) can be seriously impacted by the initial parameters assignment, which may result in poor generalization performances on new unseen data. With the objective to tackle this crucial issue, in the context of RNN…

Machine Learning · Computer Science 2019-11-05 Dino Ienco , Roberto Interdonato , Raffaele Gaetano

Recurrent neural networks (RNNs) in combination with a pooling operator and the neighbourhood components analysis (NCA) objective function are able to detect the characterizing dynamics of sequences and embed them into a fixed-length vector…

Neural and Evolutionary Computing · Computer Science 2013-08-23 Justin Bayer , Christian Osendorfer , Patrick van der Smagt

While deep feature learning has revolutionized techniques for static-image understanding, the same does not quite hold for video processing. Architectures and optimization techniques used for video are largely based off those for static…

Computer Vision and Pattern Recognition · Computer Science 2017-12-13 Achal Dave , Olga Russakovsky , Deva Ramanan

A popular strategy to train recurrent neural networks (RNNs), known as ``teacher forcing'' takes the ground truth as input at each time step and makes the later predictions partly conditioned on those inputs. Such training strategy impairs…

Computation and Language · Computer Science 2021-03-23 Liping Yuan , Jiangtao Feng , Xiaoqing Zheng , Xuanjing Huang

Recurrent neural networks (RNNs) are very good at modelling the flow of text, but typically need to be trained on a far larger corpus than is available for the PAN 2015 Author Identification task. This paper describes a novel approach where…

Computation and Language · Computer Science 2016-08-17 Douglas Bagnall

Recurrent Neural Networks are powerful machine learning frameworks that allow for data to be saved and referenced in a temporal sequence. This opens many new possibilities in fields such as handwriting analysis and speech recognition. This…

Machine Learning · Computer Science 2021-09-14 Joseph M. Ackerson , Dave Rushit , Seliya Jim

Deep Reinforcement Learning has enabled the learning of policies for complex tasks in partially observable environments, without explicitly learning the underlying model of the tasks. While such model-free methods achieve considerable…

Machine Learning · Computer Science 2017-01-11 Tanmay Shankar , Santosha K. Dwivedy , Prithwijit Guha

This study presents a novel model for invertible sentence embeddings using a residual recurrent network trained on an unsupervised encoding task. Rather than the probabilistic outputs common to neural machine translation models, our…

Computation and Language · Computer Science 2023-04-07 Jeremy Wilkerson

Recurrent neural networks (RNNs) have been widely applied to various sequential tasks such as text processing, video recognition, and molecular property prediction. We introduce the first coverage-guided testing tool, coined testRNN, for…

Neural and Evolutionary Computing · Computer Science 2019-06-21 Wei Huang , Youcheng Sun , Xiaowei Huang , James Sharp

Recurrent neural network (RNN) is an effective neural network in solving very complex supervised and unsupervised tasks. There has been a significant improvement in RNN field such as natural language processing, speech processing, computer…

Cryptography and Security · Computer Science 2019-01-15 Mohammed Harun Babu R , Vinayakumar R , Soman KP

Recurrent neural networks (RNNs) are a class of neural networks used in sequential tasks. However, in general, RNNs have a large number of parameters and involve enormous computational costs by repeating the recurrent structures in many…

Machine Learning · Statistics 2024-03-25 Takashi Furuya , Kazuma Suetake , Koichi Taniguchi , Hiroyuki Kusumoto , Ryuji Saiin , Tomohiro Daimon

Deep neural networks (DNNs) are the workhorses of deep learning, which constitutes the state of the art in numerous application domains. However, DNN-based decision rules are notoriously prone to poor generalization, i.e., may prove…

Machine Learning · Computer Science 2023-05-11 Guy Amir , Osher Maayan , Tom Zelazny , Guy Katz , Michael Schapira

Recurrent Neural Networks (RNNs) produce state-of-art performance on many machine learning tasks but their demand on resources in terms of memory and computational power are often high. Therefore, there is a great interest in optimizing the…

Neural and Evolutionary Computing · Computer Science 2017-02-28 Joachim Ott , Zhouhan Lin , Ying Zhang , Shih-Chii Liu , Yoshua Bengio

Verifying properties and interpreting the behaviour of deep neural networks (DNN) is an important task given their ubiquitous use in applications, including safety-critical ones, and their black-box nature. We propose an automata-theoric…

Formal Languages and Automata Theory · Computer Science 2023-09-28 Marco Sälzer , Eric Alsmann , Florian Bruse , Martin Lange

The pharmaceutical industry has witnessed exponential growth in transforming operations towards continuous manufacturing to effectively achieve increased profitability, reduced waste, and extended product range. Model Predictive Control…

Systems and Control · Computer Science 2018-07-26 Wee Chin Wong , Jiali Li , Xiaonan Wang

Neural networks hold great potential to act as approximate models of nonlinear dynamical systems, with the resulting neural approximations enabling verification and control of such systems. However, in safety-critical contexts, the use of…

Machine Learning · Computer Science 2025-09-30 Frederik Baymler Mathiesen , Nikolaus Vertovec , Francesco Fabiano , Luca Laurenti , Alessandro Abate

Over the long history of machine learning, which dates back several decades, recurrent neural networks (RNNs) have been used mainly for sequential data and time series and generally with 1D information. Even in some rare studies on 2D…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Nguyen Huu Phong , Bernardete Ribeiro

We present a dataset and experiments on applying recurrent neural networks (RNNs) for guiding clause selection in the connection tableau proof calculus. The RNN encodes a sequence of literals from the current branch of the partial proof…

Artificial Intelligence · Computer Science 2020-04-10 Bartosz Piotrowski , Josef Urban