English
Related papers

Related papers: Reachability in Augmented Interval Markov Chains

200 papers

We investigate the reachability problem in symmetric vector addition systems with states (VASS), where transitions are invariant under a group of permutations of coordinates. One extremal case, the trivial groups, yields general VASS. In…

Formal Languages and Automata Theory · Computer Science 2026-01-12 Łukasz Kamiński , Sławomir Lasota

We propose a model of random walks on weighted graphs where the weights are interval valued, and connect it to reversible imprecise Markov chains. While the theory of imprecise Markov chains is now well established, this is a first attempt…

Optimization and Control · Mathematics 2016-09-20 Damjan Škulj

Time bounded reachability is a fundamental problem in model checking continuous-time Markov chains (CTMCs) and Markov decision processes (CTMDPs) for specifications in continuous stochastic logics. It can be computed by numerically solving…

Systems and Control · Electrical Eng. & Systems 2020-01-07 Mahmoud Salamati , Sadegh Soudjani , Rupak Majumdar

We propose a new approach to compute an interval over-approximation of the finite time reachable set for a large class of nonlinear systems. This approach relies on the notions of sensitivity matrices, which are the partial derivatives…

Systems and Control · Electrical Eng. & Systems 2021-04-19 Pierre-Jean Meyer , Murat Arcak

Markov Chain Monte Carlo (MCMC) is a flexible approach to approximate sampling from intractable probability distributions, with a rich theoretical foundation and comprising a wealth of exemplar algorithms. While the qualitative correctness…

Computation · Statistics 2025-11-27 Sam Power , Giorgos Vasdekis

One often wishes for the ability to formally analyze large-scale systems---typically, however, one can either formally analyze a rather small system or informally analyze a large-scale system. This work tries to further close this…

Numerical Analysis · Mathematics 2020-08-06 Matthias Althoff

In this paper, we extend hitting times for imprecise Markov chains to the framework of weighted imprecise Markov chains (WIMCs), in which each transition is associated with a strictly positive weight encoded by a matrix $W$. Given a convex…

Probability · Mathematics 2026-03-18 Marco Sangalli , Thomas Krak

We aim at characterizing viability, invariance and some reachability properties of controlled piecewise deterministic Markov processes (PDMPs). Using analytical methods from the theory of viscosity solutions, we establish criteria for…

Optimization and Control · Mathematics 2013-04-09 D. Goreac

We study the problem of characterizing the expected hitting times for a robust generalization of continuous-time Markov chains. This generalization is based on the theory of imprecise probabilities, and the models with which we work…

Probability · Mathematics 2022-06-28 Thomas Krak

This work provides a framework to compute an upper bound on the robust peak-to-peak gain of discrete-time uncertain linear systems using integral quadratic constraints (IQCs). Such bounds are of particular interest in the computation of…

Systems and Control · Electrical Eng. & Systems 2022-11-18 Lukas Schwenkel , Johannes Köhler , Matthias A. Müller , Frank Allgöwer

Reachability analysis evaluates system safety, by identifying the set of states a system may evolve within over a finite time horizon. In contrast to model-based reachability analysis, data-driven reachability analysis estimates reachable…

Systems and Control · Electrical Eng. & Systems 2026-04-06 Elizabeth Dietrich , Hanna Krasowski , Murat Arcak

We introduce a statistical mechanics formalism for the study of constrained graph evolution as a Markovian stochastic process, in analogy with that available for spin systems, deriving its basic properties and highlighting the role of the…

Disordered Systems and Neural Networks · Physics 2015-05-13 A. C. C. Coolen , A. De Martino , A. Annibale

When solving consensus optimization problems over a graph, there is often an explicit characterization of the convergence rate of Gradient Descent (GD) using the spectrum of the graph Laplacian. The same type of problems under the…

Machine Learning · Statistics 2017-10-04 Guilherme França , José Bento

In real world applications, uncertain parameters are the rule rather than the exception. We present a reachability algorithm for linear systems with uncertain parameters and inputs using set propagation of polynomial zonotopes. In contrast…

Systems and Control · Electrical Eng. & Systems 2024-06-18 Yushen Huang , Ertai Luo , Stanley Bak , Yifan Sun

Markov chains are a class of probabilistic models that have achieved widespread application in the quantitative sciences. This is in part due to their versatility, but is compounded by the ease with which they can be probed analytically.…

Machine Learning · Computer Science 2023-12-18 Eddie Seabrook , Laurenz Wiskott

This paper presents a simple algorithm to check whether reachability probabilities in parametric Markov chains are monotonic in (some of) the parameters. The idea is to construct - only using the graph structure of the Markov chain and…

Logic in Computer Science · Computer Science 2019-07-22 Jip Spel , Sebastian Junges , Joost-Pieter Katoen

We study the almost-sure reachability problem in a distributed system obtained as the asynchronous composition of N copies (called processes) of the same automaton (called protocol), that can communicate via a shared register with finite…

Logic in Computer Science · Computer Science 2016-05-06 Patricia Bouyer , Nicolas Markey , Mickael Randour , Arnaud Sangnier , Daniel Stan

Labeled continuous-time Markov chains (CTMCs) describe processes subject to random timing and partial observability. In applications such as runtime monitoring, we must incorporate past observations. The timing of these observations matters…

Logic in Computer Science · Computer Science 2024-01-30 Thom Badings , Matthias Volk , Sebastian Junges , Marielle Stoelinga , Nils Jansen

This paper deals with some reachability issues for piecewise linear switched systems with time-dependent coefficients and multiplicative noise. Namely, it aims at characterizing data that are almost reachable at some fixed time T > 0…

Optimization and Control · Mathematics 2018-10-29 Dan Goreac

Reachability analysis plays a central role in low-thrust spacecraft trajectory optimization by identifying which target states can be achieved under constraints on time, thrust, and propellant. Classical approaches construct reachable sets…

Systems and Control · Electrical Eng. & Systems 2026-05-25 Giacomo Acciarini , Dario Izzo , Zhong Zhang