English
Related papers

Related papers: Replica bounds for optimization problems and dilut…

200 papers

We present a new method to study disordered systems in the low temperature limit. The method uses the replicated Hamiltonian. It studies the saddle points of this Hamiltonian and shows how the various saddle point contributions can be…

Disordered Systems and Neural Networks · Physics 2009-10-28 Viktor Dotsenko , Marc Mezard

We present an iterative framework to improve the amortized approximations of posterior distributions in the context of Bayesian inverse problems, which is inspired by loop-unrolled gradient descent methods and is theoretically grounded in…

Machine Learning · Computer Science 2023-05-16 Rafael Orozco , Ali Siahkoohi , Mathias Louboutin , Felix J. Herrmann

We consider the problem of finding a near ground state of a $p$-spin model with Rademacher couplings by means of a low-depth circuit. As a direct extension of the authors' recent work [Gamarnik, Jagannath, Wein 2020], we establish that any…

Computational Complexity · Computer Science 2022-01-25 David Gamarnik , Aukosh Jagannath , Alexander S. Wein

We introduce a Sherrington-Kirkpatrick spin-glass model with the addition of elastic degrees of freedom. The problem is formulated in terms of an effective four-spin Hamiltonian in the pressure ensemble, which can be treated by the replica…

Disordered Systems and Neural Networks · Physics 2009-04-30 D. B. Liarte , S. R. Salinas , C. S. O. Yokoi

In this paper we translate Talagrand's solution of the K-sat model at high temperature into the language of asymptotic Gibbs measures. Using exact cavity equations in the infinite volume limit allows us to remove many technicalities of the…

Probability · Mathematics 2014-08-13 Dmitry Panchenko

This article is aimed at extending the framework of optimal control techniques to the situation where the control field values are restricted to a finite set. We propose a generalization of the standard GRAPE algorithm suited to this…

Optimization and Control · Mathematics 2015-10-28 G. Dridi , M. Lapert , Julien Salomon , D Sugny , S. J. Glaser

Finite element methods provide accurate and efficient methods for the numerical solution of partial differential equations by means of restricting variational problems to finite-dimensional approximating spaces. However, they do not…

Numerical Analysis · Mathematics 2025-06-24 Robert C. Kirby , John D. Stephens

Constraint satisfaction is a critical component in a wide range of engineering applications, including but not limited to safe multi-agent control and economic dispatch in power systems. This study explores violation-free distributed…

Optimization and Control · Mathematics 2024-04-12 Changxin Liu , Xiao Tan , Xuyang Wu , Dimos V. Dimarogonas , Karl H. Johansson

In this work we investigate the min-max-min robust optimization problem and the k-adaptability robust optimization problem for binary problems with uncertain costs. The idea of the first approach is to calculate a set of k feasible…

Optimization and Control · Mathematics 2023-08-16 Jannis Kurtz

In this paper, we tackle the resolution of chance-constrained problems reformulated via Sample Average Approximation. The resulting data-driven deterministic reformulation takes the form of a large-scale mixed-integer program cursed with…

Optimization and Control · Mathematics 2023-06-27 Álvaro Porras , Concepción Domínguez , Juan M. Morales , Salvador Pineda

In this paper, we consider algorithm-independent lower bounds for the problem of black-box optimization of functions having a bounded norm is some Reproducing Kernel Hilbert Space (RKHS), which can be viewed as a non-Bayesian Gaussian…

Machine Learning · Statistics 2021-05-25 Xu Cai , Jonathan Scarlett

We study systems without quenched disorder with a complex landscape, and we use replica symmetry theory to describe them. We discuss the Golay-Bernasconi-Derrida approximation of the low autocorrelation model, and we reconstruct it by using…

High Energy Physics - Theory · Physics 2009-10-28 E. Marinari , G. Parisi , F. Ritort

We discuss the implementation of two distributed solvers of the random K-SAT problem, based on some development of the recently introduced survey-propagation (SP) algorithm. The first solver, called the "SP diffusion algorithm", diffuses as…

Disordered Systems and Neural Networks · Physics 2009-11-11 Joel Chavas , Cyril Furtlehner , Marc Mezard , Riccardo Zecchina

This note is concerned with a diluted version of the perceptron model. We establish a replica symmetric formula at high temperature, which is achieved by studying the asymptotic behavior of a given spin magnetization. Our main task will be…

Probability · Mathematics 2007-05-23 David Marquez-Carreras , Carles Rovira , Samy Tindel

We consider increasingly complex models of matrix denoising and dictionary learning in the Bayes-optimal setting, in the challenging regime where the matrices to infer have a rank growing linearly with the system size. This is in contrast…

Information Theory · Computer Science 2022-09-14 Jean Barbier , Nicolas Macris

Boolean satisfiability [1] (k-SAT) is one of the most studied optimization problems, as an efficient (that is, polynomial-time) solution to k-SAT (for $k\geq 3$) implies efficient solutions to a large number of hard optimization problems…

Computational Complexity · Computer Science 2012-08-03 Maria Ercsey-Ravasz , Zoltan Toroczkai

Using a formalism based on the spectral decomposition of the replicated transfer matrix for disordered Ising models, we obtain several results that apply both to isolated one-dimensional systems and to locally tree-like graph and factor…

Disordered Systems and Neural Networks · Physics 2014-08-04 Carlo Lucibello , Flaviano Morone , Tommaso Rizzo

Intractable distributions present a common difficulty in inference within the probabilistic knowledge representation framework and variational methods have recently been popular in providing an approximate solution. In this article, we…

Artificial Intelligence · Computer Science 2011-05-30 D. Barber , P. de van Laar

We address a specific but recurring problem related to sampled linear systems. In particular, we provide a numerical method for the rigorous verification of constraint satisfaction for linear continuous-time systems between sampling…

Optimization and Control · Mathematics 2016-03-30 Moritz Schulze Darup

We study two-stage robust optimization problems with mixed discrete-continuous decisions in both stages. Despite their broad range of applications, these problems pose two fundamental challenges: (i) they constitute infinite-dimensional…

Optimization and Control · Mathematics 2018-07-31 Anirudh Subramanyam , Chrysanthos E. Gounaris , Wolfram Wiesemann