English
Related papers

Related papers: Mode Reduction for Markov Jump Systems

200 papers

Multidimensional scaling (MDS) is a popular dimensionality reduction techniques that has been widely used for network visualization and cooperative localization. However, the traditional stress minimization formulation of MDS necessitates…

Optimization and Control · Mathematics 2016-12-22 Ketan Rajawat , Sandeep Kumar

Markov jump processes are continuous-time stochastic processes which describe dynamical systems evolving in discrete state spaces. These processes find wide application in the natural sciences and machine learning, but their inference is…

Machine Learning · Computer Science 2025-03-05 David Berghaus , Kostadin Cvejoski , Patrick Seifner , Cesar Ojeda , Ramses J. Sanchez

Filtering is concerned with the sequential estimation of the state, and uncertainties, of a Markovian system, given noisy observations. It is particularly difficult to achieve accurate filtering in complex dynamical systems, such as those…

Probability · Mathematics 2015-12-14 Wonjung Lee , Andrew Stuart

We address a class of Markov jump linear systems that are characterized by the underlying Markov process being time-inhomogeneous with a priori unknown transition probabilities. Necessary and sufficient conditions for uniform stochastic…

Systems and Control · Computer Science 2014-11-24 Collin C. Lutz , Daniel J. Stilwell

In this paper we consider the problem of parameter inference for Markov jump process (MJP) representations of stochastic kinetic models. Since transition probabilities are intractable for most processes of interest yet forward simulation is…

Computation · Statistics 2014-09-16 Andrew Golightly , Darren J. Wilkinson

This paper deals with the problems of stochastic stability and sliding mode control for a class of continuous-time Markovian jump systems with mode-dependent time-varying delays and partly unknown transition probabilities. The design method…

Systems and Control · Computer Science 2018-04-26 Nasibeh Zohrabi , Hasan Zakeri , Amir Hossein Abolmasoumi , Hamid Reza Momeni

Many complex engineering systems consist of multiple subsystems that are developed by different teams of engineers. To analyse, simulate and control such complex systems, accurate yet computationally efficient models are required. Modular…

Systems and Control · Electrical Eng. & Systems 2023-01-02 Lars A. L. Janssen , Bart Besselink , Rob H. B. Fey , Nathan van de Wouw

In this paper, we solve the chance-constrained covariance steering problem for discrete-time Markov Jump Linear Systems (MJLS) using a convex optimization framework. We derive the analytical expressions for the mean and covariance…

Optimization and Control · Mathematics 2026-05-28 Shaurya Shrivastava , Kenshiro Oguri

The concepts of probability, statistics and stochastic theory are being successfully used in structural engineering. Markov Chain modelling is a simple stochastic process model that has found its application in both describing stochastic…

Applications · Statistics 2007-08-14 K. Balaji Rao

This paper investigates the problem of identifying state-dependent switching systems, a class of hybrid dynamical systems that combine multiple linear or nonlinear modes. We propose two broad classes of switching systems: switching linear…

Optimization and Control · Mathematics 2025-09-30 Kaito Iwasaki , Sangli Teng , Anthony Bloch , Maani Ghaffari

Bayesian inference for Markov jump processes (MJPs) where available observations relate to either system states or jumps typically relies on data-augmentation Markov Chain Monte Carlo. State-of-the-art developments involve representing MJP…

Computation · Statistics 2019-04-18 Iker Perez , Theodore Kypraios

Network systems consist of subsystems and their interconnections, and provide a powerful framework for analysis, modeling and control of complex systems. However, subsystems may have high-dimensional dynamics, and the amount and nature of…

Optimization and Control · Mathematics 2020-12-07 Xiaodong Cheng , Jacquelien M. A. Scherpen

There exist several methods for simulating biological and physical systems as represented by chemical reaction networks. Systems with low numbers of particles are frequently modelled as discrete-state Markov jump processes and are typically…

Quantitative Methods · Quantitative Biology 2022-10-24 Joshua C. Kynaston , Christian A Yates , Anna Hekkink , Chris Guiver

We consider continuous-time, finite-horizon, optimal quadratic control of semi-Markov jump linear systems (S-MJLS), and develop principled approximations through Markov-like representations for the holding-time distributions. We adopt a…

Systems and Control · Computer Science 2017-11-07 Saeid Jafari , Ketan Savla

Multi-agent systems can be successfully described by kinetic models, which allow one to explore the large scale aggregate trends resulting from elementary microscopic interactions. The latter may be formalised as collision-like rules, in…

Statistical Mechanics · Physics 2020-11-06 Nadia Loy , Andrea Tosin

Motivated by applications arising in networked systems, this work examines controlled regime-switching systems that stem from a mean-variance formulation. A main point is that the switching process is a hidden Markov chain. An additional…

Optimization and Control · Mathematics 2014-01-21 Zhixin Yang , George Yin , Qing Zhang

We propose a new flexible tensor model for multiple-equation regression that accounts for latent regime changes. The model allows for dynamic coefficients and multi-dimensional covariates that vary across equations. We assume the…

Methodology · Statistics 2024-07-02 Roberto Casarin , Radu Craiu , Qing Wang

Incorporating pattern-learning for prediction (PLP) in many discrete-time or discrete-event systems allows for computation-efficient controller design by memorizing patterns to schedule control policies based on their future occurrences. In…

Systems and Control · Electrical Eng. & Systems 2023-05-10 SooJean Han , Soon-Jo Chung , John C. Doyle

This paper considers the problem of computing the schedule of modes in a switched dynamical system, that minimizes a cost functional defined on the trajectory of the system's continuous state variable. A recent approach to such optimal…

Systems and Control · Computer Science 2011-07-18 Yorai Wardi , Magnus Egerstedt

Markov jump processes (MJPs) are continuous-time stochastic processes widely used in a variety of applied disciplines. Inference for MJPs typically proceeds via Markov chain Monte Carlo, the state-of-the-art being a uniformization-based…

Computation · Statistics 2020-04-14 Boqian Zhang , Vinayak Rao