English
Related papers

Related papers: Extracting Automata from Recurrent Neural Networks…

200 papers

Verifying properties and interpreting the behaviour of deep neural networks (DNN) is an important task given their ubiquitous use in applications, including safety-critical ones, and their black-box nature. We propose an automata-theoric…

Formal Languages and Automata Theory · Computer Science 2023-09-28 Marco Sälzer , Eric Alsmann , Florian Bruse , Martin Lange

In this work, we introduce DeepDFA, a novel approach to identifying Deterministic Finite Automata (DFAs) from traces, harnessing a differentiable yet discrete model. Inspired by both the probabilistic relaxation of DFAs and Recurrent Neural…

Machine Learning · Computer Science 2024-08-19 Elena Umili , Roberto Capobianco

Accurate state estimation is critical for optimal policy design in dynamic systems. However, obtaining true system states is often impractical or infeasible, complicating the policy learning process. This paper introduces a novel neural…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Ashik E Rasul , Hyung-Jin Yoon

Automatic term extraction (ATE) is a Natural Language Processing (NLP) task that eases the effort of manually identifying terms from domain-specific corpora by providing a list of candidate terms. As units of knowledge in a specific field…

Computation and Language · Computer Science 2023-01-18 Hanh Thi Hong Tran , Matej Martinc , Jaya Caporusso , Antoine Doucet , Senja Pollak

We present a new model-based algorithm for reinforcement learning (RL) which consists of explicit exploration and exploitation phases, and is applicable in large or infinite state spaces. The algorithm maintains a set of dynamics models…

Machine Learning · Computer Science 2019-12-03 Mikael Henaff

Non-Markovian Reinforcement Learning (RL) tasks present significant challenges, as agents must reason over entire trajectories of state-action pairs to make optimal decisions. A common strategy to address this is through symbolic…

Machine Learning · Computer Science 2025-09-24 Hazem Dewidar , Elena Umili

This paper introduces a new algorithm for the induction if complex finite state automata from samples of behavior. The algorithm is based on information theoretic principles. The algorithm reduces the search space by many orders of…

Artificial Intelligence · Computer Science 2013-02-08 Matthew S. Collins , Jonathan Oliver

This paper describes an efficient rule generation algorithm, called rule generation from artificial neural networks (RGANN) to generate symbolic rules from ANNs. Classification rules are sought in many areas from automatic knowledge…

Neural and Evolutionary Computing · Computer Science 2010-09-28 S. M. Kamruzzaman

Automata over infinite alphabets have emerged as a convenient computational model for processing structures involving data, such as nonces in cryptographic protocols or data values in XML documents. We introduce active learning methods for…

Formal Languages and Automata Theory · Computer Science 2026-03-27 Florian Frank , Stefan Milius , Jurriaan Rot , Henning Urbat

We propose a novel technique for algorithm-selection, applicable to optimisation domains in which there is implicit sequential information encapsulated in the data, e.g., in online bin-packing. Specifically we train two types of recurrent…

Machine Learning · Computer Science 2022-03-28 Mohamad Alissa , Kevin Sim , Emma Hart

Although deep learning models have proven effective at solving problems in natural language processing, the mechanism by which they come to their conclusions is often unclear. As a result, these models are generally treated as black boxes,…

Computation and Language · Computer Science 2017-02-28 W. James Murdoch , Arthur Szlam

Recurrent Neural Networks (RNNs) have been shown to capture various aspects of syntax from raw linguistic input. In most previous experiments, however, learning happens over unrealistic corpora, which do not reflect the type and amount of…

Computation and Language · Computer Science 2024-11-12 Ludovica Pannitto , Aurélie Herbelot

Artificial neural networks (ANNs) have been successfully applied to solve a variety of classification and function approximation problems. Although ANNs can generally predict better than decision trees for pattern classification problems,…

Neural and Evolutionary Computing · Computer Science 2010-09-28 S. M. Kamruzzaman , Md. Monirul Islam

Many methods for the verification of complex computer systems require the existence of a tractable mathematical abstraction of the system, often in the form of an automaton. In reality, however, such a model is hard to come up with, in…

Formal Languages and Automata Theory · Computer Science 2023-08-09 Stefan Zetzsche

We present an active automata learning algorithm which learns a decomposition of a finite state machine, based on projecting onto individual outputs. This is dual to a recent compositional learning algorithm by Labbaf et al. (2023). When…

Logic in Computer Science · Computer Science 2024-05-15 Rick Koenders , Joshua Moerman

We propose an automata theoretic learning algorithm for the identification of black-box switched linear systems whose switching logics are event-driven. A switched system is expressed by a deterministic finite automaton (FA) whose node…

Systems and Control · Electrical Eng. & Systems 2021-11-11 Atreyee Kundu , Pavithra Prabhakar

Although backpropagation ANNs generally predict better than decision trees do for pattern classification problems, they are often regarded as black boxes, i.e., their predictions cannot be explained as those of decision trees. In many…

Neural and Evolutionary Computing · Computer Science 2010-09-28 S. M. Kamruzzaman , Md. Monirul Islam

Recently, the problem of obtaining a short regular expression equivalent to a given finite automaton has been intensively investigated. Algorithms for converting finite automata to regular expressions have an exponential blow-up in the…

Formal Languages and Automata Theory · Computer Science 2010-08-11 Nelma Moreira , Davide Nabais , Rogério Reis

Recently, Neural Networks have been proven extremely effective in many natural language processing tasks such as sentiment analysis, question answering, or machine translation. Aiming to exploit such advantages in the Ontology Learning…

Computation and Language · Computer Science 2016-07-15 Giulio Petrucci , Chiara Ghidini , Marco Rospocher

Automaton models are often seen as interpretable models. Interpretability itself is not well defined: it remains unclear what interpretability means without first explicitly specifying objectives or desired attributes. In this paper, we…

Machine Learning · Statistics 2016-11-28 Christian Albert Hammerschmidt , Sicco Verwer , Qin Lin , Radu State