English
Related papers

Related papers: Stochastic Dynamics II: Finite Random Dynamical Sy…

200 papers

Three major challenges in reinforcement learning are the complex dynamical systems with large state spaces, the costly data acquisition processes, and the deviation of real-world dynamics from the training environment deployment. To…

Machine Learning · Computer Science 2024-06-04 Shyam Sundhar Ramesh , Pier Giuseppe Sessa , Yifan Hu , Andreas Krause , Ilija Bogunovic

Dynamics of deterministic systems perturbed by random additive noise is characterized quantitatively. Since for such systems the KS-entropy diverges we analyse the difference between the total entropy of a noisy system and the entropy of…

In this paper we develop a model of stochastic gene expression, which is an extension of the model investigated in the paper [T. Lipniacki, P. Paszek, A. Marciniak-Czochra, A.R. Brasier, M. Kimmel, Transcriptional stochasticity in gene…

Probability · Mathematics 2015-10-20 Ryszard Rudnicki , Andrzej Tomski

This paper presents a robust version of the stratified sampling method when multiple uncertain input models are considered for stochastic simulation. Various variance reduction techniques have demonstrated their superior performance in…

Optimization and Control · Mathematics 2023-06-16 Seung Min Baik , Eunshin Byon , Young Myoung Ko

A major goal of stochastic thermodynamics is to estimate the inevitable dissipation that accompanies particular observable phenomena in an otherwise not fully accessible system. Quantitative results are often formulated as lower bounds on…

Statistical Mechanics · Physics 2025-03-17 Malena T. Bauer , Udo Seifert , Jann van der Meer

Many random processes can be simulated as the output of a deterministic model accepting random inputs. Such a model usually describes a complex mathematical or physical stochastic system and the randomness is introduced in the input…

Machine Learning · Statistics 2012-11-21 A. Gokcen Mahmutoglu , Alper T. Erdogan , Alper Demir

We establish a collection of closed-loop guarantees and propose a scalable optimization algorithm for distributionally robust model predictive control (DRMPC) applied to linear systems, convex constraints, and quadratic costs. Via standard…

Optimization and Control · Mathematics 2024-11-13 Robert D. McAllister , Peyman Mohajerin Esfahani

We consider parametric version of fixed-delay continuous-time Markov chains (or equivalently deterministic and stochastic Petri nets, DSPN) where fixed-delay transitions are specified by parameters, rather than concrete values. Our goal is…

Performance · Computer Science 2016-04-18 Tomáš Brázdil , Ľuboš Korenčiak , Jan Krčál , Petr Novotný , Vojtěch Řehák

Permutation entropy quantifies the diversity of possible orderings of the values a random or deterministic system can take, as Shannon entropy quantifies the diversity of values. We show that the metric and permutation entropy…

Chaotic Dynamics · Physics 2016-08-16 Jose M. Amigo , Matthew B. Kennel , Ljupco Kocarev

A general theory is developed to study individual based models which are discrete in time. We begin by constructing a Markov chain model that converges to a one-dimensional map in the infinite population limit. Stochastic fluctuations are…

Statistical Mechanics · Physics 2014-06-03 Joseph D. Challenger , Duccio Fanelli , Alan J. McKane

We present a general approach for computing the dynamic partition function of a continuous-time Markov process. The Ruelle topological pressure is identified with the large deviation function of a physical observable. We construct for the…

Statistical Mechanics · Physics 2010-05-11 Vivien Lecomte , Cecile Appert-Rolland , Frederic van Wijland

In this work, we investigate the synthesis of dynamic information releasing mechanisms, referred to as ''masks'', to minimize information leakage from a stochastic system to an external observer. Specifically, for a stochastic system, an…

Systems and Control · Electrical Eng. & Systems 2025-02-18 Sumukha Udupa , Chongyang Shi , Jie Fu

Stochastic dynamics of several systems can be modeled via piecewise deterministic time evolution of the state, interspersed by random discrete events. Within this general class of systems, we consider time-triggered stochastic hybrid…

Systems and Control · Computer Science 2018-04-27 Mohammad Soltani , Abhyudai Singh

Intrinsic computation refers to how dynamical systems store, structure, and transform historical and spatial information. By graphing a measure of structural complexity against a measure of randomness, complexity-entropy diagrams display…

Chaotic Dynamics · Physics 2009-11-13 David P. Feldman , Carl S. McTague , James P. Crutchfield

Stochastic gradient descent is an optimisation method that combines classical gradient descent with random subsampling within the target functional. In this work, we introduce the stochastic gradient process as a continuous-time…

Probability · Mathematics 2021-05-11 Jonas Latz

Dynamical systems (DSs) provide a framework for high flexibility, robustness, and control reliability and are widely used in motion planning and physical human-robot interaction. The properties of the DS directly determine the robot's…

Robotics · Computer Science 2024-11-05 Tengyu Hou , Hanming Bai , Ye Ding , Han Ding

Available methods for identification of stochastic dynamical systems from input-output data generally impose restricting structural assumptions on either the noise structure in the data-generating system or the possible state probability…

Systems and Control · Electrical Eng. & Systems 2024-05-02 Gerben I. Beintema , Maarten Schoukens , Roland Tóth

We prove that all R\'enyi entanglement entropies of spin-chains described by generic (gapped), translational invariant matrix product states (MPS) are extensive for disconnected sub-systems: All R\'enyi entanglement entropy densities of the…

Quantum Physics · Physics 2020-08-31 Alberto Rolandi , Henrik Wilming

This paper considers random access in deadline-constrained broadcasting with frame-synchronized traffic. To enhance the maximum achievable timely delivery ratio (TDR), we define a dynamic control scheme that allows each active node to…

Systems and Control · Electrical Eng. & Systems 2021-08-09 Aoyu Gong , Lei Deng , Fang Liu , Yijin Zhang

We describe a new algorithm for simulating complex Markoff-processes. We have used a reaction-cell method in order to simulate arbitrary reactions. It can be used for any kind of RDS on arbitrary topologies, including fractal dimensions or…

chem-ph · Physics 2009-10-28 Thomas Fricke , Dietmar Wendt