English
Related papers

Related papers: Statistical mechanics of the inverse Ising problem…

200 papers

Conventional inverse optimization inputs a solution and finds the parameters of an optimization model that render a given solution optimal. The literature mostly focuses on inferring the objective function in linear problems when accepted…

Optimization and Control · Mathematics 2024-10-10 Houra Mahmoudzadeh , Kimia Ghobadi

We develop and analyze stochastic optimization algorithms for problems in which the expected loss is strongly convex, and the optimum is (approximately) sparse. Previous approaches are able to exploit only one of these two structures,…

Machine Learning · Statistics 2012-07-19 Alekh Agarwal , Sahand Negahban , Martin J. Wainwright

We study inverse optimization (IO), where the goal is to use a parametric optimization program as the hypothesis class to infer relationships between input-decision pairs. Most of the literature focuses on learning only the objective…

Optimization and Control · Mathematics 2025-05-22 Ke Ren , Peyman Mohajerin Esfahani , Angelos Georghiou

This paper is devoted to a new modification of a recently proposed adaptive stochastic mirror descent algorithm for constrained convex optimization problems in the case of several convex functional constraints. Algorithms, standard and its…

Optimization and Control · Mathematics 2020-01-22 Mohammad S. Alkousa

The central object of this PhD thesis is known under different names in the fields of computer science and statistical mechanics. In computer science, it is called the Maximum Cut problem, one of the famous twenty-one Karp's original…

Machine Learning · Computer Science 2022-08-31 Mikhail Krechetov

We develop a statistical-mechanical formulation for image restoration and error-correcting codes. These problems are shown to be equivalent to the Ising spin glass with ferromagnetic bias under random external fields. We prove that the…

Disordered Systems and Neural Networks · Physics 2009-10-31 H. Nishimori , K. Y. M. Wong

The main features of the statistical approach to inverse problems are described on the example of a linear model with additive noise. The approach does not use any Bayesian hypothesis regarding an unknown object; instead, the standard…

Methodology · Statistics 2017-05-05 V. Yu. Terebizh

We study an inverse problem of the stochastic optimal control of general diffusions with performance index having the quadratic penalty term of the control process. Under mild conditions on the system dynamics, the cost functions, and the…

Optimization and Control · Mathematics 2022-11-17 Yumiharu Nakano

Many imaging problems require solving an inverse problem that is ill-conditioned or ill-posed. Imaging methods typically address this difficulty by regularising the estimation problem to make it well-posed. This often requires setting the…

Methodology · Statistics 2020-08-17 Ana F. Vidal , Valentin De Bortoli , Marcelo Pereyra , Alain Durmus

We consider the minimization of submodular functions subject to ordering constraints. We show that this optimization problem can be cast as a convex optimization problem on a space of uni-dimensional measures, with ordering constraints…

Machine Learning · Computer Science 2017-07-31 Francis Bach

This article develops a methodology that enables learning an objective function of an optimal control system from incomplete trajectory observations. The objective function is assumed to be a weighted sum of features (or basis functions)…

Robotics · Computer Science 2021-05-07 Wanxin Jin , Dana Kulić , Shaoshuai Mou , Sandra Hirche

We consider the problem of learning the underlying graph of an unknown Ising model on p spins from a collection of i.i.d. samples generated from the model. We suggest a new estimator that is computationally efficient and requires a number…

Machine Learning · Computer Science 2017-04-17 Marc Vuffray , Sidhant Misra , Andrey Y. Lokhov , Michael Chertkov

Analytic and optimization methods for solving inverse kinematics (IK) problems have been deeply studied throughout the history of robotics. The two strategies have complementary strengths and weaknesses, but developing a unified approach to…

Robotics · Computer Science 2026-02-06 Thomas Cohn , Lihan Tang , Alexandre Amice , Russ Tedrake

A fundamental problem of statistical data analysis, distribution density estimation by experimental data, is considered. A new method with optimal asymptotic behavior, the root density estimator, is developed. The method proposed may be…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Yu. I. Bogdanov

The large amounts of data from molecular biology and neuroscience have lead to a renewed interest in the inverse Ising problem: how to reconstruct parameters of the Ising model (couplings between spins and external fields) from a number of…

Disordered Systems and Neural Networks · Physics 2012-08-13 H. Chau Nguyen , Johannes Berg

In data-driven inverse optimization an observer aims to learn the preferences of an agent who solves a parametric optimization problem depending on an exogenous signal. Thus, the observer seeks the agent's objective function that best…

Optimization and Control · Mathematics 2017-07-25 Peyman Mohajerin Esfahani , Soroosh Shafieezadeh-Abadeh , Grani Adiwena Hanasusanto , Daniel Kuhn

In this paper some adaptive mirror descent algorithms for problems of minimization convex objective functional with several convex Lipschitz (generally, non-smooth) functional constraints are considered. It is shown that the methods are…

Optimization and Control · Mathematics 2018-12-20 F. S. Stonyakin , M . S. Alkousa , A. A. Titov

We present a procedure to solve the inverse Ising problem, that is to find the interactions between a set of binary variables from the measure of their equilibrium correlations. The method consists in constructing and selecting specific…

Disordered Systems and Neural Networks · Physics 2015-05-30 Simona Cocco , Rémi Monasson

These lecture notes summarize various summer schools that I have given on the topic of solving inverse problems (state and parameter estimation) by combining optimally measurement observations and parametrized PDE models. After defining a…

Numerical Analysis · Mathematics 2022-03-16 Olga Mula

A powerful existing technique for evaluating statistical mechanical quantities in two-dimensional Ising models is based on constructing a matrix representing the nearest neighbor spin couplings and then evaluating the Pfaffian of the…

Disordered Systems and Neural Networks · Physics 2013-04-16 Creighton K. Thomas , A. Alan Middleton