English
Related papers

Related papers: Critical scaling in hidden state inference for lin…

200 papers

The scaling forms of the space- and time-dependent two-time correlation and response functions are calculated for the kinetic spherical model with a conserved order-parameter and quenched to its critical point from a completely disordered…

Statistical Mechanics · Physics 2011-02-16 Florian Baumann , Malte Henkel

We conduct a comprehensive investigation into the dynamics of gradient descent using large-order constant step-sizes in the context of quadratic regression models. Within this framework, we reveal that the dynamics can be encapsulated by a…

Machine Learning · Computer Science 2023-10-04 Xuxing Chen , Krishnakumar Balasubramanian , Promit Ghosal , Bhavya Agrawalla

We propose a new procedure to monitor and forecast the onset of transitions in high dimensional complex systems. We describe our procedure by an application to the Tangled Nature model of evolutionary ecology. The quasi-stable…

Adaptation and Self-Organizing Systems · Physics 2014-12-31 Andrea Cairoli , Duccio Piovani , Henrik Jeldtoft Jensen

Predicting the behavior of a dynamical system from noisy observations of its past outputs is a classical problem encountered across engineering and science. For linear systems with Gaussian inputs, the Kalman filter -- the best linear…

Machine Learning · Computer Science 2026-03-10 Usman Akram , Haris Vikalo

Time series subject to change in regime have attracted much interest in domains such as econometry, finance or meteorology. For discrete-valued regimes, some models such as the popular Hidden Markov Chain (HMC) describe time series whose…

Machine Learning · Computer Science 2021-02-26 Fatoumata Dama , Christine Sinoquet

The unadjusted Langevin algorithm is commonly used to sample probability distributions in extremely high-dimensional settings. However, existing analyses of the algorithm for strongly log-concave distributions suggest that, as the dimension…

Machine Learning · Statistics 2025-09-05 Yifan Chen , Xiaoou Cheng , Jonathan Niles-Weed , Jonathan Weare

Scale invariance is a hallmark of criticality in complex dynamical systems. While random external inputs or tunable stochastic interactions are typically required to produce critical behavior, it remains unclear whether scale-invariant…

Statistical Mechanics · Physics 2026-04-02 Hakan Akgun , Xianquan Yan , Tamer Taskiran , Muhamet Ibrahimi , Ching Hua Lee , Seymur Jahangirov

Scaling regions -- intervals on a graph where the dependent variable depends linearly on the independent variable -- abound in dynamical systems, notably in calculations of invariants like the correlation dimension or a Lyapunov exponent.…

Data Analysis, Statistics and Probability · Physics 2023-06-08 Varad Deshmukh , Elizabeth Bradley , Joshua Garland , James D. Meiss

The complexity of real-world geophysical systems is often compounded by the fact that the observed measurements depend on hidden variables. These latent variables include unresolved small scales and/or rapidly evolving processes, partially…

We consider stochastic systems of interacting particles or agents, with dynamics determined by an interaction kernel which only depends on pairwise distances. We study the problem of inferring this interaction kernel from observations of…

Statistics Theory · Mathematics 2020-07-31 Fei Lu , Mauro Maggioni , Sui Tang

This paper considers the stabilization of unknown switched linear systems using data. Instead of a full system model, we have access to a finite number of trajectories of each of the different modes prior to the online operation of the…

Optimization and Control · Mathematics 2024-07-29 Jaap Eising , Shenyu Liu , Sonia Martinez , Jorge Cortes

State estimation that combines observational data with mathematical models is central to many applications and is commonly addressed through filtering methods, such as ensemble Kalman filters. In this article, we examine the signal-tracking…

Numerical Analysis · Mathematics 2025-09-08 Nazanin Abedini , Jana de Wiljes , Svetlana Dubinkina

Lumping a Markov process introduces a coarser level of description that is useful in many contexts and applications. The dynamics on the coarse grained states is often approximated by its Markovian component. In this letter we derive…

Statistical Mechanics · Physics 2012-07-31 David Andrieux

We address the problem of learning the dynamics of an unknown non-parametric system linking a target and a feature time series. The feature time series is measured on a sparse and irregular grid, while we have access to only a few points of…

Machine Learning · Statistics 2023-06-01 Linus Bleistein , Adeline Fermanian , Anne-Sophie Jannot , Agathe Guilloux

Adaptive dynamical systems arise in a multitude of contexts, e.g., optimization, control, communications, signal processing, and machine learning. A precise characterization of their fundamental limitations is therefore of paramount…

Information Theory · Computer Science 2010-10-13 Maxim Raginsky

We develop a framework for the analysis of deep neural networks and neural ODE models that are trained with stochastic gradient algorithms. We do that by identifying the connections between control theory, deep learning and theory of…

Probability · Mathematics 2021-03-18 Jean-François Jabir , David Šiška , Łukasz Szpruch

This paper considers optimization problems over networks where agents have individual objectives to meet, or individual parameter vectors to estimate, subject to subspace constraints that require the objectives across the network to lie in…

Multiagent Systems · Computer Science 2020-04-22 Roula Nassif , Stefan Vlaski , Ali H. Sayed

We consider the modeling, stability analysis and controller design problems for discrete-time LTI systems with state feedback, when the actuation signal is subject to switching propagation delays, due to e.g. the routing in a multi-hop…

Optimization and Control · Mathematics 2014-01-09 R. M. Jungers , A. D'Innocenzo , M. D. Di Benedetto

Temporally evolving systems are typically modeled by dynamic equations. A key challenge in accurate modeling is understanding the causal relationships between subsystems, as well as identifying the presence and influence of unobserved…

Methodology · Statistics 2024-10-28 András Telcs , Marcell T. Kurbucz , Antal Jakovác

Modeling heterogeneous correlated time series requires the ability to learn hidden dynamic relationships between component time series with possibly varying periodicities and generative processes. To address this challenge, we formulate and…

Methodology · Statistics 2025-12-02 Jeshwanth Mohan , Bharath Ramsundar , Sandya Subramanian