English
Related papers

Related papers: Predictive information in a nonequilibrium critica…

200 papers

Reliable estimation of predictive uncertainty is crucial for machine learning applications, particularly in high-stakes scenarios where hedging against risks is essential. Despite its significance, there is no universal agreement on how to…

Machine Learning · Computer Science 2025-06-17 Kajetan Schweighofer , Lukas Aichberger , Mykyta Ielanskyi , Sepp Hochreiter

Many complex systems operating far from the equilibrium exhibit stochastic dynamics that can be described by a Langevin equation. Inferring Langevin equations from data can reveal how transient dynamics of such systems give rise to their…

Machine Learning · Statistics 2021-11-01 Mikhail Genkin , Owen Hughes , Tatiana A. Engel

In some estimation problems, especially in applications dealing with information theory, signal processing and biology, theory provides us with additional information allowing us to restrict the parameter space to a finite number of points.…

Methodology · Statistics 2012-07-25 Christine Choirat , Raffaello Seri

This work deals with the problem of simultaneous regulation and model parameter estimation in adaptive model predictive control. We propose an adaptive model predictive control and conditions which guarantee a persistently exciting closed…

Systems and Control · Electrical Eng. & Systems 2021-11-22 Sven Brüggemann , Robert R. Bitmead

In this paper we are concerned with the learnability of energies from data obtained by observing time evolutions of their critical points starting at random initial equilibria. As a byproduct of our theoretical framework we introduce the…

Machine Learning · Computer Science 2019-11-04 Stefano Almi , Massimo Fornasier , Richard Huber

We consider the adaptive control problem for discrete-time, nonlinear stochastic systems with linearly parameterised uncertainty. Assuming access to a parameterised family of controllers that can stabilise the system in a bounded set within…

Systems and Control · Electrical Eng. & Systems 2025-11-24 Seth Siriya , Jingge Zhu , Dragan Nešić , Ye Pu

The Information bottleneck method is an unsupervised non-parametric data organization technique. Given a joint distribution P(A,B), this method constructs a new variable T that extracts partitions, or clusters, over the values of A that are…

Machine Learning · Computer Science 2013-01-14 Nir Friedman , Ori Mosenzon , Noam Slonim , Naftali Tishby

We develop a tractable and flexible approach for incorporating side information into dynamic optimization under uncertainty. The proposed framework uses predictive machine learning methods (such as $k$-nearest neighbors, kernel regression,…

Optimization and Control · Mathematics 2020-07-23 Dimitris Bertsimas , Christopher McCord , Bradley Sturt

Linear time-invariant systems are very popular models in system theory and applications. A fundamental problem in system identification that remains rather unaddressed in extant literature is to leverage commonalities amongst related linear…

Machine Learning · Statistics 2024-01-03 Aditya Modi , Mohamad Kazem Shirani Faradonbeh , Ambuj Tewari , George Michailidis

Predicting the evolution of a large system of units using its structure of interaction is a fundamental problem in complex system theory. And so is the problem of reconstructing the structure of interaction from temporal observations. Here,…

Statistical Mechanics · Physics 2025-02-10 Charles Murphy , Vincent Thibeault , Antoine Allard , Patrick Desrosiers

Information theory is used to perform a thermodynamic study of non equilibrium anisotropic radiation. We limit our analysis to a second-order truncation of the moments, obtaining a distribution function which leads to a natural closure of…

Statistical Mechanics · Physics 2009-10-30 Raquel Dominguez-Cascante

Prediction of events is the challenge in many different disciplines, from meteorology to finance; the more this task is difficult, the more a system is {\it complex}. Nevertheless, even according to this restricted definition, a general…

chao-dyn · Physics 2007-05-23 Maurizio Serva

The information scrambling in many-body systems is closely related to quantum chaotic dynamics, complexity, and gravity. Here we propose a collision model to simulate the information dynamics in an all-optical system. In our model the…

Quantum Physics · Physics 2020-04-23 Yan Li , Xingli Li , Jiasen Jin

Classical deterministic optimal control problems assume full information about the controlled process. The theory of control for general partially-observable processes is powerful, but the methods are computationally expensive and typically…

Optimization and Control · Mathematics 2024-08-02 Dongping Qi , Adam Dhillon , Alexander Vladimirsky

We present a numerical method for learning unknown nonautonomous stochastic dynamical system, i.e., stochastic system subject to time dependent excitation or control signals. Our basic assumption is that the governing equations for the…

Machine Learning · Computer Science 2025-03-04 Yuan Chen , Dongbin Xiu

A model of phase transitions with coupling between the order parameter and its gradient is proposed. It is shown, that this nonlinear model is suitable for the description of phase transitions accompanied by the formation of spatially…

Statistical Mechanics · Physics 2013-03-19 B. I. Lev , A. G. Zagorodny

Data-driven modeling is useful for reconstructing nonlinear dynamical systems when the underlying process is unknown or too expensive to compute. Having reliable uncertainty assessment of the forecast enables tools to be deployed to predict…

Methodology · Statistics 2023-11-01 Mengyang Gu , Yizi Lin , Victor Chang Lee , Diana Qiu

We propose a framework for studying predictability of extreme events in complex systems. Major conceptual elements -- direct cascading or fragmentation, spatial dynamics, and external driving -- are combined in a classical age-dependent…

Adaptation and Self-Organizing Systems · Physics 2007-08-14 Andrei Gabrielov , Vladimir Keilis-Borok , Ilya Zaliapin

Using numerical simulations of a model disk system, we demonstrate that a machine learning generated order parameter can detect depinning transitions and different dynamic flow phases in systems driven far from equilibrium. We specifically…

Statistical Mechanics · Physics 2024-04-23 D. McDermott , C. J. O. Reichhardt , C. Reichhardt

To describe the nonequilibrium states of a system we introduce a new thermodynamic parameter - the lifetime of a system. The statistical distributions which can be obtained out of the mesoscopic description characterizing the behaviour of a…

Statistical Mechanics · Physics 2007-05-23 V. V. Ryazanov