English
Related papers

Related papers: Extracting Automata from Recurrent Neural Networks…

200 papers

We present an Angluin-style algorithm to learn nominal automata, which are acceptors of languages over infinite (structured) alphabets. The abstract approach we take allows us to seamlessly extend known variations of the algorithm to this…

Formal Languages and Automata Theory · Computer Science 2018-12-18 Joshua Moerman , Matteo Sammartino , Alexandra Silva , Bartek Klin , Michał Szynwelski

Recurrent Neural Networks (RNNs) have achieved tremendous success in processing sequential data, yet understanding and analyzing their behaviours remains a significant challenge. To this end, many efforts have been made to extract finite…

Computation and Language · Computer Science 2023-06-27 Zeming Wei , Xiyue Zhang , Yihao Zhang , Meng Sun

We investigate an approach for extracting knowledge from trained neural networks based on Angluin's exact learning model with membership and equivalence queries to an oracle. In this approach, the oracle is a trained neural network. We…

Machine Learning · Computer Science 2023-09-14 Sophie Blum , Raoul Koudijs , Ana Ozaki , Samia Touileb

We investigate the problem of extracting rules, expressed in Horn logic, from neural network models. Our work is based on the exact learning model, in which a learner interacts with a teacher (the neural network model) via queries in order…

Machine Learning · Computer Science 2022-04-04 Cosimo Persia , Ana Ozaki

We present an algorithm for active learning of deterministic timed automata with a single clock. The algorithm is within the framework of Angluin's $L^*$ algorithm and inspired by existing work on the active learning of symbolic automata.…

Formal Languages and Automata Theory · Computer Science 2020-03-27 Jie An , Mingshuai Chen , Bohua Zhan , Naijun Zhan , Miaomiao Zhang

In many real-world problems, the learning agent needs to learn a problem's abstractions and solution simultaneously. However, most such abstractions need to be designed and refined by hand for different problems and domains of application.…

Machine Learning · Computer Science 2022-12-09 Mehdi Dadvar , Rashmeet Kaur Nayyar , Siddharth Srivastava

We investigate a learning algorithm in the context of nominal automata, an extension of classical automata to alphabets featuring names. This class of automata captures nominal regular languages; analogously to the classical language…

Formal Languages and Automata Theory · Computer Science 2019-09-16 Yi Xiao , Emilio Tuosto

Since the seminal work by Angluin and the introduction of the L*-algorithm, active learning of automata by membership and equivalence queries has been extensively studied to learn various extensions of automata. For weighted automata,…

Formal Languages and Automata Theory · Computer Science 2025-08-13 Laure Daviaud , Marianne Johnson

Despite the fact that deep reinforcement learning (RL) has surpassed human-level performances in various tasks, it still has several fundamental challenges. First, most RL methods require intensive data from the exploration of the…

Machine Learning · Computer Science 2021-07-06 Zhe Xu , Bo Wu , Aditya Ojha , Daniel Neider , Ufuk Topcu

We present an algorithm for active learning of deterministic timed automata with multiple clocks. The algorithm is within the querying framework of Angluin's $L^*$ algorithm and follows the idea proposed in existing work on the active…

Formal Languages and Automata Theory · Computer Science 2024-05-21 Yu Teng , Miaomiao Zhang , Jie An

We give a new proof of a result from well quasi-order theory on the computability of bases for upwards-closed sets of words. This new proof is based on Angluin's L* algorithm, that learns an automaton from a minimally adequate teacher. This…

Formal Languages and Automata Theory · Computer Science 2025-07-30 Quentin Aristote

We propose a generic categorical framework for learning unknown formal languages of various types (e.g. finite or infinite words, weighted and nominal languages). Our approach is parametric in a monad T that represents the given type of…

Formal Languages and Automata Theory · Computer Science 2020-08-31 Henning Urbat , Lutz Schröder

Abstract models of system-level behaviour have applications in design exploration, analysis, testing and verification. We describe a new algorithm for automatically extracting useful models, as automata, from execution traces of a HW/SW…

Formal Languages and Automata Theory · Computer Science 2020-05-06 Natasha Yogananda Jeppu , Tom Melham , Daniel Kroening , John O'Leary

Recurrent neural networks are a widely used class of neural architectures. They have, however, two shortcomings. First, it is difficult to understand what exactly they learn. Second, they tend to work poorly on sequences requiring long-term…

Machine Learning · Computer Science 2019-05-08 Cheng Wang , Mathias Niepert

We present SummaRuNNer, a Recurrent Neural Network (RNN) based sequence model for extractive summarization of documents and show that it achieves performance better than or comparable to state-of-the-art. Our model has the additional…

Computation and Language · Computer Science 2016-11-15 Ramesh Nallapati , Feifei Zhai , Bowen Zhou

Automata extraction is a method for synthesising interpretable surrogates for black-box neural models that can be analysed symbolically. Existing techniques assume a finite input alphabet, and thus are not directly applicable to data…

Artificial Intelligence · Computer Science 2025-11-25 Chih-Duo Hong , Hongjian Jiang , Anthony W. Lin , Oliver Markgraf , Julian Parsert , Tony Tan

Traditional approaches to inference of deterministic finite-state automata (DFA) stem from symbolic AI, including both active learning methods (e.g., Angluin's L* algorithm and its variants) and passive techniques (e.g., Biermann and…

Formal Languages and Automata Theory · Computer Science 2025-10-21 Elaheh Hosseinkhani , Martin Leucker

We present counting reward automata-a finite state machine variant capable of modelling any reward function expressible as a formal language. Unlike previous approaches, which are limited to the expression of tasks as regular languages, our…

Artificial Intelligence · Computer Science 2024-02-20 Tristan Bester , Benjamin Rosman , Steven James , Geraud Nangue Tasse

We introduce the class of P-finite automata. These are a generalisation of weighted automata, in which the weights of transitions can depend polynomially on the length of the input word. P-finite automata can also be viewed as simple…

Logic in Computer Science · Computer Science 2023-10-24 Alex Buna-Marginean , Vincent Cheval , Mahsa Shirmohammadi , James Worrell

We present abstraction-refinement algorithms for model checking safety properties of timed automata. The abstraction domain we consider abstracts away zones by restricting the set of clock constraints that can be used to define them, while…

Formal Languages and Automata Theory · Computer Science 2019-05-27 Victor Roussanaly , Ocan Sankur , Nicolas Markey