English
Related papers

Related papers: Non-Markovian Optimal Prediction

200 papers

Predictive statistical mechanics is a form of inference from available data, without additional assumptions, for predicting reproducible phenomena. By applying it to systems with Hamiltonian dynamics, a problem of predicting the macroscopic…

Statistical Mechanics · Physics 2015-09-22 Domagoj Kuic

We introduce a new method to accurately and efficiently estimate the effective dynamics of collective variables in molecular simulations. Such reduced dynamics play an essential role in the study of a broad class of processes, ranging from…

Statistical Mechanics · Physics 2022-03-28 Hadrien Vroylandt , Ludovic Goudenège , Pierre Monmarché , Fabio Pietrucci , Benjamin Rotenberg

This paper studies continuous-time stochastic control problems whose controlled states are fully non-Markovian and depend on unknown model parameters. Such problems arise naturally in path-dependent stochastic differential equations,…

Machine Learning · Statistics 2026-05-29 Dorival Leão , Alberto Ohashi , Simone Scotti , Adolfo M. D da Silva

This paper presents a novel numerical optimisation method for infinite dimensional optimisation. The functional optimisation makes minimal assumptions about the functional and without any specific knowledge on the derivative of the…

Optimization and Control · Mathematics 2016-11-18 Muhammad F. Kasim , Peter A. Norreys

We propose a suitable analytical framework to perform numerical analysis of problems arising in compressible fluid models with uncertain data. We discuss both weak and strong stochastic approach, where the former is based on the knowledge…

Analysis of PDEs · Mathematics 2022-08-24 Eduard Feireisl

It is well known that for any finite state Markov decision process (MDP) there is a memoryless deterministic policy that maximizes the expected reward. For partially observable Markov decision processes (POMDPs), optimal memoryless policies…

Optimization and Control · Mathematics 2016-02-16 Guido Montufar , Keyan Ghazi-Zahedi , Nihat Ay

When a physical system is driven away from equilibrium, the statistical distribution of its dynamical trajectories informs many of its physical properties. Characterizing the nature of the distribution of dynamical observables, such as a…

Statistical Mechanics · Physics 2024-06-19 Jiawei Yan , Grant M. Rotskoff

This article presents a general framework for recovering missing dynamical systems using available data and machine learning techniques. The proposed framework reformulates the prediction problem as a supervised learning problem to…

Numerical Analysis · Mathematics 2020-10-20 John Harlim , Shixiao W. Jiang , Senwei Liang , Haizhao Yang

We develop a novel procedure for estimating the optimizer of general convex stochastic optimization problems of the form $\min_{x\in\mathcal{X}} \mathbb{E}[F(x,\xi)]$, when the given data is a finite independent sample selected according to…

Statistics Theory · Mathematics 2022-01-26 Daniel Bartl , Shahar Mendelson

We provide results of a deterministic approximation for non-Markovian stochastic processes modeling finite populations of individuals who recurrently play symmetric finite games and imitate each other according to payoffs. We show that a…

Dynamical Systems · Mathematics 2023-06-05 Ozgur Aydogmus , Yun Kang

This paper proposes a statistically optimal approach for learning a function value using a confidence interval in a wide range of models, including general non-parametric estimation of an expected loss described as a stochastic programming…

Machine Learning · Statistics 2025-08-07 Arnab Ganguly , Tobias Sutter

We present a numerical algorithm for finding real non-negative solutions to polynomial equations. Our methods are based on the expectation maximization and iterative proportional fitting algorithms, which are used in statistics to find…

Numerical Analysis · Mathematics 2010-04-02 Dustin Cartwright

We propose a stochastic recursive momentum method for Riemannian non-convex optimization that achieves a near-optimal complexity of $\tilde{\mathcal{O}}(\epsilon^{-3})$ to find $\epsilon$-approximate solution with one sample. That is, our…

Optimization and Control · Mathematics 2020-08-12 Andi Han , Junbin Gao

We study the numerical solution of nonlinear partially observed optimal stopping problems. The system state is taken to be a multi-dimensional diffusion and drives the drift of the observation process, which is another multi-dimensional…

Optimization and Control · Mathematics 2010-01-20 Mike Ludkovski

A general method for deriving closed reduced models of Hamiltonian dynamical systems is developed using techniques from optimization and statistical estimation. As in standard projection operator methods, a set of resolved variables is…

Mathematical Physics · Physics 2015-10-05 Bruce Turkington

We consider the optimization of an uncertain objective over continuous and multi-dimensional decision spaces in problems in which we are only provided with observational data. We propose a novel algorithmic framework that is tractable,…

Machine Learning · Statistics 2018-10-30 Dimitris Bertsimas , Christopher McCord

Memoryless processes are ubiquitous in nature, in contrast with the mathematics of open systems theory, which states that non-Markovian processes should be the norm. This discrepancy is usually addressed by subjectively making the…

Quantum Physics · Physics 2021-06-10 Pedro Figueroa-Romero , Felix A. Pollock , Kavan Modi

We propose policy gradient algorithms for robust infinite-horizon Markov decision processes (MDPs) with non-rectangular uncertainty sets, thereby addressing an open challenge in the robust MDP literature. Indeed, uncertainty sets that…

Optimization and Control · Mathematics 2025-09-30 Mengmeng Li , Daniel Kuhn , Tobias Sutter

This paper focuses on investigating an inexact stochastic model-based optimization algorithm that integrates preconditioning techniques for solving stochastic composite optimization problems. The proposed framework unifies and extends the…

Optimization and Control · Mathematics 2025-12-12 Chenglong Bao , Yancheng Yuan , Shulan Zhu

This paper studies the distributed optimization problem when the objective functions might be nondifferentiable and subject to heterogeneous set constraints. Unlike existing subgradient methods, we focus on the case when the exact…

Optimization and Control · Mathematics 2021-11-23 Kui Zhu , Yutao Tang