English
Related papers

Related papers: Active Learning of One-Clock Timed Automata using …

200 papers

Active automata learning (AAL) algorithms can learn a behavioral model of a system from interacting with it. The primary challenge remains scaling to larger models, in particular in the presence of many possible inputs to the system. Modern…

Machine Learning · Computer Science 2026-02-26 Loes Kruger , Sebastian Junges , Jurriaan Rot

Active learning agents typically employ a query selection algorithm which solely considers the agent's learning objectives. However, this may be insufficient in more realistic human domains. This work uses imitation learning to enable an…

Machine Learning · Computer Science 2019-07-02 Kalesha Bullard , Yannick Schroecker , Sonia Chernova

Quantitative automata are useful representations for numerous applications, including modeling probability distributions over sequences to Markov chains and reward machines. Actively learning such automata typically occurs using explicitly…

Formal Languages and Automata Theory · Computer Science 2024-11-19 Eric Hsiung , Swarat Chaudhuri , Joydeep Biswas

We present $L^{\#}$, a new and simple approach to active automata learning. Instead of focusing on equivalence of observations, like the $L^{\ast}$ algorithm and its descendants, $L^{\#}$ takes a different perspective: it tries to establish…

Formal Languages and Automata Theory · Computer Science 2022-01-28 Frits Vaandrager , Bharat Garhewal , Jurriaan Rot , Thorsten Wißmann

There are situations in which an agent should receive rewards only after having accomplished a series of previous tasks, that is, rewards are non-Markovian. One natural and quite general way to represent history-dependent rewards is via a…

Artificial Intelligence · Computer Science 2020-10-01 Gavin Rens , Jean-François Raskin , Raphaël Reynouad , Giuseppe Marra

The deterministic membership problem for timed automata asks whether the timed language recognised by a nondeterministic timed automaton can be recognised by a deterministic timed automaton. We show that the problem is decidable when the…

Formal Languages and Automata Theory · Computer Science 2020-07-21 Lorenzo Clemente , Sławomir Lasota , Radosław Piórkowski

We introduce a model that learns active learning algorithms via metalearning. For a distribution of related tasks, our model jointly learns: a data representation, an item selection heuristic, and a method for constructing prediction…

Machine Learning · Computer Science 2017-08-02 Philip Bachman , Alessandro Sordoni , Adam Trischler

Extracting finite state automata (FSAs) from black-box models offers a powerful approach to gaining interpretable insights into complex model behaviors. To support this pursuit, we present a weighted variant of Angluin's (1987)…

Computation and Language · Computer Science 2024-12-20 Clemente Pasti , Talu Karagöz , Anej Svete , Franz Nowak , Reda Boumasmoud , Ryan Cotterell

We present an algorithm to learn a deterministic timed automaton (DTA) via membership and equivalence queries. Our algorithm is an extension of the L* algorithm with a Myhill-Nerode style characterization of recognizable timed languages,…

Formal Languages and Automata Theory · Computer Science 2023-05-30 Masaki Waga

Classification algorithms aim to predict an unknown label (e.g., a quality class) for a new instance (e.g., a product). Therefore, training samples (instances and labels) are used to deduct classification hypotheses. Often, it is relatively…

Machine Learning · Computer Science 2019-01-30 Daniel Kottke , Jim Schellinger , Denis Huseljic , Bernhard Sick

This document investigates the integration of adaptive distinguishing sequences into the process of active automata learning (AAL). A novel AAL algorithm "ADT" (adaptive discrimination tree) is developed and presented. Since the submission…

Machine Learning · Computer Science 2019-02-05 Markus Theo Frohme

One clock alternating timed automata OCATA have been recently introduced as natural extension of (one clock) timed automata to express the semantics of MTL (Ouaknine, Worrell 2005). We consider the application of OCATA to problem of…

Formal Languages and Automata Theory · Computer Science 2013-04-11 Thomas Brihaye , Morgane Estiévenart , Gilles Geeraerts

Recurrent Neural Networks (RNNs) have shown great success in modeling time-dependent patterns, but there is limited research on their learned representations of latent temporal features and the emergence of these representations during…

Machine Learning · Computer Science 2023-06-13 Peter DelMastro , Rushiv Arora , Edward Rietman , Hava T. Siegelmann

We present an active learning algorithm for the problem of body schema learning, i.e. estimating a kinematic model of a serial robot. The learning process is done online using Recursive Least Squares (RLS) estimation, which outperforms…

Robotics · Computer Science 2024-02-12 Ruben Martinez-Cantin , Manuel Lopes , Luis Montesano

Active learning shows promise to decrease test bench time for model-based drivability calibration. This paper presents a new strategy for active output selection, which suits the needs of calibration tasks. The strategy is actively learning…

Machine Learning · Computer Science 2021-02-24 Adrian Prochaska , Julien Pillas , Bernard Bäker

We propose a method for meta-learning reinforcement learning algorithms by searching over the space of computational graphs which compute the loss function for a value-based model-free RL agent to optimize. The learned algorithms are…

Machine Learning · Computer Science 2022-11-11 John D. Co-Reyes , Yingjie Miao , Daiyi Peng , Esteban Real , Sergey Levine , Quoc V. Le , Honglak Lee , Aleksandra Faust

Existing active automata learning (AAL) algorithms have demonstrated their potential in capturing the behavior of complex systems (e.g., in analyzing network protocol implementations). The most widely used AAL algorithms generate finite…

Formal Languages and Automata Theory · Computer Science 2024-01-26 Simon Dierl , Paul Fiterau-Brostean , Falk Howar , Bengt Jonsson , Konstantinos Sagonas , Fredrik Tåquist

This paper presents a new parameter estimation algorithm for the adaptive control of a class of time-varying plants. The main feature of this algorithm is a matrix of time-varying learning rates, which enables parameter estimation error…

Optimization and Control · Mathematics 2021-11-18 Joseph E. Gaudio , Anuradha M. Annaswamy , Eugene Lavretsky , Michael A. Bolender

In this paper, we consider a model of generalized timed automata (GTA) with two kinds of clocks, history and future, that can express many timed features succinctly, including timed automata, event-clock automata with and without diagonal…

Formal Languages and Automata Theory · Computer Science 2024-03-19 S Akshay , Paul Gastin , R Govind , Aniruddha R Joshi , B Srivathsan

This work proposes a procedure for designing algorithms for specific adaptive data collection tasks like active learning and pure-exploration multi-armed bandits. Unlike the design of traditional adaptive algorithms that rely on…

Machine Learning · Computer Science 2025-03-11 Jifan Zhang , Lalit Jain , Kevin Jamieson