English
Related papers

Related papers: Data-driven Solution of Stochastic Differential Eq…

200 papers

This paper shows how to evolve numerically the maximum entropy probability distributions for a given set of constraints, which is a variational calculus problem. An evolutionary algorithm can obtain approximations to some well-known…

Methodology · Statistics 2020-02-07 Raul Rojas

We investigate the maximum caliber variational principle as an inference algorithm used to predict dynamical properties of complex nonequilibrium, stationary, statistical systems in the presence of incomplete information. Specifically, we…

Statistical Mechanics · Physics 2016-12-28 Carlo Cafaro , Sean Alan Ali

Inferring the input parameters of simulators from observations is a crucial challenge with applications from epidemiology to molecular dynamics. Here we show a simple approach in the regime of sparse data and approximately correct models,…

Methodology · Statistics 2022-04-06 Rainier Barrett , Mehrad Ansari , Gourab Ghoshal , Andrew D White

We propose a novel data-driven stochastic model predictive control framework for uncertain linear systems with noisy output measurements. Our approach leverages multi-step predictors to efficiently propagate uncertainty, ensuring chance…

Systems and Control · Electrical Eng. & Systems 2025-03-18 Haldun Balim , Andrea Carron , Melanie N. Zeilinger , Johannes Köhler

Analytic continuation of numerical data obtained in imaginary time or frequency has become an essential part of many branches of quantum computational physics. It is, however, an ill-conditioned procedure and thus a hard numerical problem.…

Strongly Correlated Electrons · Physics 2016-08-18 Dominic Bergeron , A. -M. S. Tremblay

This paper presents an algorithmic framework for solving unconstrained stochastic optimization problems using only stochastic function evaluations. We employ central finite-difference based gradient estimation methods to approximate the…

Optimization and Control · Mathematics 2025-01-14 Raghu Bollapragada , Cem Karamanli

This paper deals with uncertainty quantification and out-of-distribution detection in deep learning using Bayesian and ensemble methods. It proposes a practical solution to the lack of prediction diversity observed recently for standard…

Machine Learning · Computer Science 2025-02-03 Antoine de Mathelin , François Deheeger , Mathilde Mougeot , Nicolas Vayatis

We exploit the idea to use the maximal-entropy method, successfully tested in information theory and statistical thermodynamics, to determine approximating function's coefficients and squared errors' weights simultaneously as output of one…

Numerical Analysis · Mathematics 2021-03-04 Domenico Giordano , Felice Iavernaro

We review here {\it Maximum Caliber} (Max Cal), a general variational principle for inferring distributions of paths in dynamical processes and networks. Max Cal is to dynamical trajectories what the principle of {\it Maximum Entropy} (Max…

Statistical Mechanics · Physics 2018-01-17 Purushottam D. Dixit , Jason Wagoner , Corey Weistuch , Steve Pressé , Kingshuk Ghosh , Ken A. Dill

A broad set of sufficient conditions that guarantees the existence of the maximum entropy (maxent) distribution consistent with specified bounds on certain generalized moments is derived. Most results in the literature are either focused on…

Information Theory · Computer Science 2009-09-29 Prakash Ishwar , Pierre Moulin

Entropy, its production, and its change in a dynamical system can be understood from either a fully stochastic dynamic description or from a deterministic dynamics exhibiting chaotic behavior. By taking the former approach based on the…

Mathematical Physics · Physics 2025-08-26 Hong Qian , Zhongwei Shen

We introduce MESSY estimation, a Maximum-Entropy based Stochastic and Symbolic densitY estimation method. The proposed approach recovers probability density functions symbolically from samples using moments of a Gradient flow in which the…

Machine Learning · Computer Science 2024-02-13 Tony Tohme , Mohsen Sadr , Kamal Youcef-Toumi , Nicolas G. Hadjiconstantinou

The principle of maximum entropy (Maxent) is often used to obtain prior probability distributions as a method to obtain a Gibbs measure under some restriction giving the probability that a system will be in a certain state compared to the…

Information Theory · Computer Science 2019-06-26 Hector Zenil , Narsis A. Kiani , Jesper Tegnér

In this paper, we address the problem of uncertainty propagation through nonlinear stochastic dynamical systems. More precisely, given a discrete-time continuous-state probabilistic nonlinear dynamical system, we aim at finding the sequence…

Systems and Control · Electrical Eng. & Systems 2021-02-01 Ashkan Jasour , Allen Wang , Brian C. Williams

In this paper, we combine deterministic splitting methods with a polynomial chaos expansion method for solving stochastic parabolic evolution problems. The stochastic differential equation is reduced to a system of deterministic equations…

Numerical Analysis · Mathematics 2021-07-02 Andreas Kofler , Tijana Levajković , Hermann Mena , Alexander Ostermann

This paper studies optimal control problems of unknown linear systems subject to stochastic disturbances of uncertain distribution. Uncertainty about the stochastic disturbances is usually described via ambiguity sets of probability…

Systems and Control · Electrical Eng. & Systems 2023-06-30 Guanru Pan , Timm Faulwasser

Maximum entropy estimation is of broad interest for inferring properties of systems across many different disciplines. In this work, we significantly extend a technique we previously introduced for estimating the maximum entropy of a set of…

Data Analysis, Statistics and Probability · Physics 2016-01-05 Elliot A. Martin , Jaroslav Hlinka , Alexander Meinke , Filip Děchtěrenko , Jörn Davidsen

Given data generated by an observable stochastic process, we study how to construct statistically optimal decisions for general stochastic optimization problems. Our setting encompasses non-standard data structures, including data…

Optimization and Control · Mathematics 2025-08-01 Radek Salač , Michael Kupper , Tobias Sutter

In this paper, we present a novel maximum entropy formulation of the Differential Dynamic Programming algorithm and derive two variants using unimodal and multimodal value functions parameterizations. By combining the maximum entropy…

Optimization and Control · Mathematics 2022-03-01 Oswin So , Ziyi Wang , Evangelos A. Theodorou

Inferring a quantum system from incomplete information is a common problem in many aspects of quantum information science and applications, where the principle of maximum entropy (MaxEnt) plays an important role. The quantum state…

Quantum Physics · Physics 2022-07-26 Shi-Yao Hou , Zipeng Wu , Jinfeng Zeng , Ningping Cao , Chenfeng Cao , Youning Li , Bei Zeng