English
Related papers

Related papers: Switched Linear Systems Meet Markov Decision Proce…

200 papers

We study the long-term qualitative behavior of randomly perturbed dynamical systems. More specifically, we look at limit cycles of stochastic differential equations (SDE) with Markovian switching, in which the process switches at random…

Probability · Mathematics 2024-07-10 Nguyen H. Du , Alexandru Hening , Dang H. Nguyen , George Yin

In this work, a novel digital channelizer design is developed through the use of a compact, system-level modeling approach. The model efficiently captures key properties of a digital channelizer system and its time-varying operation. The…

Signal Processing · Electrical Eng. & Systems 2017-12-25 A. Sapio , L. Li , J. Wu , M. Wolf , S. S. Bhattacharyya

Markov Decision Processes (MDPs) are a popular class of models suitable for solving control decision problems in probabilistic reactive systems. We consider parametric MDPs (pMDPs) that include parameters in some of the transition…

Logic in Computer Science · Computer Science 2018-06-14 Sebastian Arming , Ezio Bartocci , Krishnendu Chatterjee , Joost-Pieter Katoen , Ana Sokolova

This paper investigates the mean stability of a class of discrete-time stochastic switched linear systems using the $L^p$-norm joint spectral radius of the probability distributions governing the switched systems. First we prove a converse…

Optimization and Control · Mathematics 2016-11-04 Masaki Ogura , Clyde F. Martin

Control strategies for dissipative preparation of target quantum states, both pure and mixed, and subspaces are obtained by switching between a set of available semigroup generators. We show that the class of problems of interest can be…

Quantum Physics · Physics 2015-06-17 Pierre Scaramuzza , Francesco Ticozzi

This paper considers an infinite-horizon Markov decision process (MDP) that allows for general non-exponential discount functions, in both discrete and continuous time. Due to the inherent time inconsistency, we look for a randomized…

Optimization and Control · Mathematics 2024-12-10 Erhan Bayraktar , Yu-Jui Huang , Zhenhua Wang , Zhou Zhou

We develop a tracking model predictive control (MPC) scheme for nonlinear systems using the linearized dynamics at the current state as a prediction model. Under reasonable assumptions on the linearized dynamics, we prove that the proposed…

Optimization and Control · Mathematics 2022-09-20 Julian Berberich , Johannes Köhler , Matthias A. Müller , Frank Allgöwer

We investigate the uniform stability properties of discrete-time linear switched systems subject to arbitrary switching, focusing on the "marginally unstable" regime in which the system is not Lyapunov stable but in which trajectories…

Dynamical Systems · Mathematics 2022-03-28 Ian D. Morris

In this paper we consider distributed adaptive stabilization for uncertain multivariable linear systems with a time-varying diagonal matrix gain. We show that uncertain multivariable linear systems are stabilizable by diagonal matrix high…

Systems and Control · Electrical Eng. & Systems 2021-05-31 Zhiyong Sun , Anders Rantzer , Zhongkui Li , Anders Robertsson

This paper deals with the stability analysis problem of discrete-time switched linear systems with ranged dwell time. A novel concept called L-switching-cycle is proposed, which contains sequences of multiple activation cycles satisfying…

Optimization and Control · Mathematics 2021-06-01 Weiming Xiang

This paper investigates the problem of identifying state-dependent switching systems, a class of hybrid dynamical systems that combine multiple linear or nonlinear modes. We propose two broad classes of switching systems: switching linear…

Optimization and Control · Mathematics 2025-09-30 Kaito Iwasaki , Sangli Teng , Anthony Bloch , Maani Ghaffari

In this paper, we present a novel approach to determine the stability of switched linear and nonlinear systems using Sum of Squares optimisation. Particularly, we use Sum of Squares optimisation to search for a Lyapunov function that…

Dynamical Systems · Mathematics 2023-06-26 Jacopo Piccini , Elias August , Sigurdur Hafstein , Stefania Andersen

This paper addresses a scheduling problem in the context of a cyber-physical system where a sensor and a controller communicate over an unreliable channel. The sensor observes the state of a source at each time, and according to a…

Optimization and Control · Mathematics 2025-02-25 Saad Kriouile , Mohamad Assaad , Touraj Soleymani

We consider stability analysis of constrained switching linear systems in which the dynamics is unknown and whose switching signal is constrained by an automaton. We propose a data-driven Lyapunov framework for providing probabilistic…

Systems and Control · Electrical Eng. & Systems 2022-07-15 Adrien Banse , Zheming Wang , Raphaël M. Jungers

We develop a predictor-feedback control design for multi-input nonlinear systems with distinct input delays, of arbitrary length, in each individual input channel. Due to the fact that different input signals reach the plant at different…

Optimization and Control · Mathematics 2015-08-25 Nikolaos Bekiaris-Liberis , Miroslav Krstic

We study individual-based dynamics in finite populations, subject to randomly switching environmental conditions. These are inspired by models in which genes transition between on and off states, regulating underlying protein dynamics.…

Statistical Mechanics · Physics 2016-05-18 Peter G. Hufton , Yen Ting Lin , Tobias Galla , Alan J. McKane

We study asymptotic stability of continuous-time systems with mode-dependent guaranteed dwell time. These systems are reformulated as special cases of a general class of mixed (discrete-continuous) linear switching systems on graphs, in…

Dynamical Systems · Mathematics 2019-12-24 Yacine Chitour , Nicola Guglielmi , Mario Sigalotti , Vladimir Protasov

This study introduces a comparative modeling framework using stationary and non-stationary transition probabilities within a Markov Decision Process (MDP) to assess COVID-19 disease dynamics. Stationary transition probabilities assume…

In this work, we study finite-time stability of switched and hybrid systems in the presence of unstable modes. We present sufficient conditions in terms of multiple Lyapunov functions for the origin of the system to be finite time stable.…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Kunal Garg , Dimitra Panagou

The stability problem of a class of nonlinear switched systems defined on compact sets with state-dependent switching is considered. Instead of the Caratheodory solutions, the general Filippov solutions are studied. This encapsulates…

Optimization and Control · Mathematics 2017-07-31 Mohamadreza Ahmadi , Hamed Mojallali , Rafael Wisniewski