English
Related papers

Related papers: Performance vs complexity trade-offs for Markovian…

200 papers

This paper is concerned with the development of rigorous approximations to various expectations associated with Markov chains and processes having non-stationary transition probabilities. Such non-stationary models arise naturally in…

Probability · Mathematics 2018-05-07 Zeyu Zheng , Harsha Honnappa , Peter W. Glynn

In this paper, we study a remote monitoring system where a receiver observes a remote binary Markov source and decides whether to sample and transmit the state through a randomly delayed channel. We adopt uncertainty of information (UoI),…

Information Theory · Computer Science 2024-05-20 Xiaomeng Chen , Aimin Li , Shaohua Wu

The paper presents a framework for online learning of the Koopman operator using streaming data. Many complex systems for which data-driven modeling and control are sought provide streaming sensor data, the abundance of which can present…

Systems and Control · Electrical Eng. & Systems 2026-04-01 Kartik Loya , Phanindra Tallapragada

This paper addresses the emulation-based observer design for networked control systems (NCS) with linear plants that operate at two time scales in the presence of measurement noise. The system is formulated as a hybrid singularly perturbed…

Systems and Control · Electrical Eng. & Systems 2025-12-09 Weixuan Wang , Alejandro I. Maass , Dragan Nešić , Ying Tan , Romain Postoyan , W. P. M. H. Heemels

This paper investigates MDPs with intermittent state information. We consider a scenario where the controller perceives the state information of the process via an unreliable communication channel. The transmissions of state information…

Artificial Intelligence · Computer Science 2025-02-17 Gongpu Chen , Soung-Chang Liew

Filtering is concerned with online estimation of the state of a dynamical system from partial and noisy observations. In applications where the state of the system is high dimensional, ensemble Kalman filters are often the method of choice.…

Systems and Control · Electrical Eng. & Systems 2024-07-30 Omar Al Ghattas , Jiajun Bao , Daniel Sanz-Alonso

This paper explores the problem of selecting sensor nodes for a general class of nonlinear dynamical networks. In particular, we study the problem by utilizing altered definitions of observability and open-loop lifted observers. The…

Systems and Control · Electrical Eng. & Systems 2023-07-17 Mohamad H. Kazma , Sebastian A. Nugroho , Aleksandar Haber , Ahmad F. Taha

The problem of real-time remote tracking and reconstruction of a two-state Markov process is considered here. A transmitter sends samples from an observed information source to a remote monitor over an unreliable wireless channel. The…

Information Theory · Computer Science 2023-09-22 Mehrdad Salimnejad , Marios Kountouris , Nikolaos Pappas

Accurate state estimation is essential for monitoring and controlling nonlinear chemical reactors, such as continuous stirred-tank reactors (CSTRs), where limited sensor coverage and process uncertainties hinder real-time observability.…

We consider the problem of tracking the state of Gauss-Markov processes over rate-limited erasure-prone links. We concentrate first on the scenario in which several independent processes are seen by a single observer. The observer maps the…

Information Theory · Computer Science 2018-05-24 Anatoly Khina , Victoria Kostina , Ashish Khisti , Babak Hassibi

This paper deals with the finite horizon optimal control problem for discrete-time Markov jump linear system with input delay. The correlation among the jumping parameters and the input delay are considered simultaneously, which forms the…

Optimization and Control · Mathematics 2018-08-22 Chunyan Han , Hongdan Li , Huanshui Zhang

In this paper we provide a set of stability conditions for linear time-varying networked control systems with arbitrary topologies using a piecewise quadratic switching stabilization approach with multiple quadratic Lyapunov functions. We…

Optimization and Control · Mathematics 2018-04-04 Mohammad Razeghi-Jahromi , Saeed Manaffam , Alireza Seyedi , Azadeh Vosoughi

This work proposes a detectability condition for linear time-varying systems based on the exponential dichotomy spectrum. The condition guarantees the existence of an observer, whose gain is determined only by the unstable modes of the…

Systems and Control · Electrical Eng. & Systems 2022-09-20 Markus Tranninger , Richard Seeber , Martin Steinberger , Martin Horn , Christian Pötzsche

In this letter, we investigate a receiver architecture, which uses the received signal in order to simultaneously harvest energy and estimate a Gauss-Markov linear process. We study three communication scenarios: i) static channel, ii)…

Information Theory · Computer Science 2021-10-27 Ioannis Krikidis , Constantinos Psomas

This paper considers a network of agents, where each agent is assumed to take actions optimally with respect to a predefined payoff function involving the latest actions of the agent's neighbors. Neighborhood relationships stem from payoff…

Dynamical Systems · Mathematics 2021-01-19 Sadegh Arefizadeh , Sadjaad Ozgoli , Sadegh Bolouki , Tamer Başar

Efficient remote monitoring of distributed sources is essential for many Internet of Things (IoT) applications. This work studies the uncertainty at the receiver when tracking two-state Markov sources over a slotted random access channel…

Information Theory · Computer Science 2025-02-04 Andrea Munari

We propose a method for approximating solutions to optimization problems involving the global stability properties of parameter-dependent continuous-time autonomous dynamical systems. The method relies on an approximation of the…

Optimization and Control · Mathematics 2013-08-12 Péter Koltai , Alexander Volf

This paper studies the performative prediction problem which optimizes a stochastic loss function with data distribution that depends on the decision variable. We consider a setting where the agent(s) provides samples adapted to the…

Optimization and Control · Mathematics 2021-10-05 Qiang Li , Hoi-To Wai

This paper considers the problem of distributed estimation in a sensor network, where multiple sensors are deployed to infer the state of a linear time-invariant (LTI) Gaussian system. By proposing a lossless decomposition of Kalman filter,…

Systems and Control · Electrical Eng. & Systems 2022-04-19 Jiaqi Yan , Yilin Mo , Hideaki Ishii

We develop a predictive-first optimisation framework for streaming hidden Markov models. Unlike classical approaches that prioritise full posterior recovery under a fully specified generative model, we assume access to regime-specific…

Machine Learning · Statistics 2026-04-13 Gerardo Duran-Martin