English
Related papers

Related papers: Extracting Automata from Recurrent Neural Networks…

200 papers

We present a technique designed to automatically compute predicate abstractions for dense real-timed models represented as networks of timed automata. We use the CIPM algorithm in our previous work which computes new invariants for timed…

Logic in Computer Science · Computer Science 2009-11-18 Bahareh Badban , Stefan Leue , Jan-Georg Smaus

We present an extension of the Angluin-style learning algorithm for tree automata that incorporates deductive inference. The learning algorithm is provided with a term rewriting system that specifies properties of the target tree language…

Formal Languages and Automata Theory · Computer Science 2026-05-25 Jakub Kopystiański , Jan Otop

Quantitative automata are useful representations for numerous applications, including modeling probability distributions over sequences to Markov chains and reward machines. Actively learning such automata typically occurs using explicitly…

Formal Languages and Automata Theory · Computer Science 2024-11-19 Eric Hsiung , Swarat Chaudhuri , Joydeep Biswas

We present an extended automata learning framework that combines active automata learning with deductive inference. The learning algorithm asks membership and equivalence queries as in the original framework, but it is also given advice,…

Formal Languages and Automata Theory · Computer Science 2025-08-15 Michał Fica , Jan Otop

In machine learning, it is very important for a robot to be able to estimate dynamics from sequences of input data. This problem can be solved using a recurrent neural network. In this paper, we will discuss the preprocessing of 10 states…

Robotics · Computer Science 2019-05-03 Kyle Mott

It is well known that building analytical performance models in practice is difficult because it requires a considerable degree of proficiency in the underlying mathematics. In this paper, we propose a machine-learning approach to derive…

Performance · Computer Science 2020-02-26 Giulio Garbi , Emilio Incerto , Mirco Tribastone

Recurrent neural networks (RNN) as used in machine learning are commonly formulated in discrete time, i.e. as recursive maps. This brings a lot of advantages for training models on data, e.g. for the purpose of time series prediction or…

Dynamical Systems · Mathematics 2020-07-02 Zahra Monfared , Daniel Durstewitz

Probabilistic deterministic finite automata (PDFA) are discrete event systems modeling conditional probabilities over languages: Given an already seen sequence of tokens they return the probability of tokens of interest to appear next.…

Formal Languages and Automata Theory · Computer Science 2024-07-01 Robert Baumgartner , Sicco Verwer

Recurrent neural networks (RNNs) have emerged as powerful tools for processing sequential data in various fields, including natural language processing and speech recognition. However, the lack of explainability in RNN models has limited…

Machine Learning · Computer Science 2024-02-13 Pouria Golshanrad , Fathiyeh Faghih

In this work, we consider the problem of autonomously discovering behavioral abstractions, or options, for reinforcement learning agents. We propose an algorithm that focuses on the termination condition, as opposed to -- as is common --…

Artificial Intelligence · Computer Science 2019-02-27 Anna Harutyunyan , Will Dabney , Diana Borsa , Nicolas Heess , Remi Munos , Doina Precup

Abstract numeration systems encode natural numbers using radix ordered words of an infinite regular language and linear recurrence sequences play a key role in their valuation. Sequence automata, which are deterministic finite automata with…

Formal Languages and Automata Theory · Computer Science 2025-05-05 Olivier Carton , Jean-Michel Couvreur , Martin Delacourt , Nicolas Ollinger

Rule extraction from black-box models is critical in domains that require model validation before implementation, as can be the case in credit scoring and medical diagnosis. Though already a challenging problem in statistical learning in…

Machine Learning · Computer Science 2018-11-16 Qinglong Wang , Kaixuan Zhang , Alexander G. Ororbia , Xinyu Xing , Xue Liu , C. Lee Giles

Recurrent Neural Networks (RNNs) have shown great success in modeling time-dependent patterns, but there is limited research on their learned representations of latent temporal features and the emergence of these representations during…

Machine Learning · Computer Science 2023-06-13 Peter DelMastro , Rushiv Arora , Edward Rietman , Hava T. Siegelmann

We present recursive recurrent neural networks with attention modeling (R$^2$AM) for lexicon-free optical character recognition in natural scene images. The primary advantages of the proposed method are: (1) use of recursive convolutional…

Computer Vision and Pattern Recognition · Computer Science 2016-03-11 Chen-Yu Lee , Simon Osindero

Recurrent Neural Networks (RNNs) have been widely used in Natural Language Processing (NLP) tasks given its superior performance on processing sequential data. However, it is challenging to interpret and debug RNNs due to the inherent…

Human-Computer Interaction · Computer Science 2023-03-06 Zhijie Wang , Yuheng Huang , Da Song , Lei Ma , Tianyi Zhang

Recurrent neural networks (RNNs) are difficult to train on sequence processing tasks, not only because input noise may be amplified through feedback, but also because any inaccuracy in the weights has similar consequences as input noise. We…

Neural and Evolutionary Computing · Computer Science 2018-05-29 Michael C. Mozer , Denis Kazakov , Robert V. Lindsey

Artificial neural networks have been successfully applied to a variety of business application problems involving classification and regression. Although backpropagation neural networks generally predict better than decision trees do for…

Neural and Evolutionary Computing · Computer Science 2010-09-28 S. M. Kamruzzaman , Ahmed Ryadh Hasan

B\"uchi Automata on infinite words present many interesting problems and are used frequently in program verification and model checking. A lot of these problems on B\"uchi automata are computationally hard, raising the question if a…

Formal Languages and Automata Theory · Computer Science 2022-06-22 Christophe Stammet , Prisca Dotti , Ulrich Ultes-Nitsche , Andreas Fischer

We present the efficient implementations of probabilistic deterministic finite automaton learning methods available in FlexFringe. These implement well-known strategies for state-merging including several modifications to improve their…

Machine Learning · Computer Science 2025-10-01 Sicco Verwer , Christian Hammerschmidt

Weighted automata is a basic tool for specification in quantitative verification, which allows to express quantitative features of analysed systems such as resource consumption. Quantitative specification can be assisted by automata…

Computational Complexity · Computer Science 2024-03-04 Jakub Michaliszyn , Jan Otop