English
Related papers

Related papers: Semidefinite programs simulate approximate message…

200 papers

Given symmetric matrices $A_0, A_1, \ldots, A_n$ of size $m$ with rational entries, the set of real vectors $x = (x_1, \ldots, x_n)$ such that the matrix $A_0 + x_1 A_1 + \cdots + x_n A_n$ has non-negative eigenvalues is called a…

Symbolic Computation · Computer Science 2020-06-11 Didier Henrion , Simone Naldi , Mohab Safey El Din

We consider semidefinite programs (SDPs) of size n with equality constraints. In order to overcome scalability issues, Burer and Monteiro proposed a factorized approach based on optimizing over a matrix Y of size $n$ by $k$ such that $X =…

Machine Learning · Statistics 2018-11-29 Thomas Pumir , Samy Jelassi , Nicolas Boumal

We consider tensor factorizations using a generative model and a Bayesian approach. We compute rigorously the mutual information, the Minimal Mean Squared Error (MMSE), and unveil information-theoretic phase transitions. In addition, we…

Statistics Theory · Mathematics 2020-01-22 Thibault Lesieur , Léo Miolane , Marc Lelarge , Florent Krzakala , Lenka Zdeborová

A numerical method is developed to solve linear semi-infinite programming problem (LSIP) in which the iterates produced by the algorithm are feasible for the original problem. This is achieved by constructing a sequence of standard linear…

Optimization and Control · Mathematics 2021-01-26 Shuxiong Wang

We introduce an iterative optimization scheme for convex objectives consisting of a linear loss and a non-separable penalty, based on the expectation-consistent approximation and the vector approximate message-passing (VAMP) algorithm.…

Machine Learning · Statistics 2018-09-18 Andre Manoel , Florent Krzakala , Gaël Varoquaux , Bertrand Thirion , Lenka Zdeborová

Maximum A posteriori Probability (MAP) inference in graphical models amounts to solving a graph-structured combinatorial optimization problem. Popular inference algorithms such as belief propagation (BP) and generalized belief propagation…

Machine Learning · Statistics 2017-09-20 Murat A. Erdogdu , Yash Deshpande , Andrea Montanari

Often, large, high dimensional datasets collected across multiple modalities can be organized as a higher order tensor. Low-rank tensor decomposition then arises as a powerful and widely used tool to discover simple low dimensional…

Machine Learning · Statistics 2020-01-29 Jonathan Kadmon , Surya Ganguli

Many problems of systems control theory boil down to solving polynomial equations, polynomial inequalities or polyomial differential equations. Recent advances in convex optimization and real algebraic geometry can be combined to generate…

Optimization and Control · Mathematics 2013-09-13 Didier Henrion

We consider large-scale linear inverse problems in Bayesian settings. We follow a recent line of work that applies the approximate message passing (AMP) framework to multi-processor (MP) computational systems, where each processor node…

Information Theory · Computer Science 2016-11-09 Junan Zhu , Dror Baron , Ahmad Beirami

We show how the notion of message passing can be used to streamline the algebra and computer coding for fast approximate inference in large Bayesian semiparametric regression models. In particular, this approach is amenable to handling…

Methodology · Statistics 2016-04-07 M. P. Wand

In Multi-Input Multi-Output (MIMO) systems, Maximum-Likelihood (ML) decoding is equivalent to finding the closest lattice point in an N-dimensional complex space. In general, this problem is known to be NP hard. In this paper, we propose a…

Information Theory · Computer Science 2007-07-13 Amin Mobasher , Mahmoud Taherzadeh , Renata Sotirov , Amir K. Khandani

Many problems are NP-hard and, unless P = NP, do not admit polynomial-time exact algorithms. The fastest known exact algorithms exactly usually take time exponential in the input size. Much research effort has gone into obtaining faster…

Data Structures and Algorithms · Computer Science 2025-01-27 Stefan Kratsch , Pascal Kunz

This paper proposes a fast approximate message-passing (AMP) algorithm for solving compressed sensing (CS) recovery problems with 1D-finite-difference sparsity in term of MMSE estimation. The proposed algorithm, named ssAMP-BGFD, is…

Information Theory · Computer Science 2015-09-07 Jaewook Kang , Hyoyoung Jung , Heung-No Lee , Kiseon Kim

We consider optimal route planning when the objective function is a general nonlinear and non-monotonic function. Such an objective models user behavior more accurately, for example, when a user is risk-averse, or the utility function needs…

Data Structures and Algorithms · Computer Science 2015-11-24 Ger Yang , Evdokia Nikolova

The sparse Beyesian learning (also referred to as Bayesian compressed sensing) algorithm is one of the most popular approaches for sparse signal recovery, and has demonstrated superior performance in a series of experiments. Nevertheless,…

Information Theory · Computer Science 2015-01-21 Fuwei Li , Jun Fang , Huiping Duan , Zhi Chen , Hongbin Li

The Quadratic Assignment Problem (QAP) is an important discrete optimization instance that encompasses many well-known combinatorial optimization problems, and has applications in a wide range of areas such as logistics and computer vision.…

Optimization and Control · Mathematics 2024-10-16 Junyu Chen , Yong Sheng Soh

Semidefinite programs (SDPs) are standard convex problems that are frequently found in control and optimization applications. Interior-point methods can solve SDPs in polynomial time up to arbitrary accuracy, but scale poorly as the size of…

Optimization and Control · Mathematics 2022-01-10 Jared Miller , Yang Zheng , Mario Sznaier , Antonis Papachristodoulou

Semidefinite programming (SDP) is a unifying framework that generalizes both linear programming and quadratically-constrained quadratic programming, while also yielding efficient solvers, both in theory and in practice. However, there exist…

Data Structures and Algorithms · Computer Science 2022-10-24 Elena Grigorescu , Young-San Lin , Sandeep Silwal , Maoyuan Song , Samson Zhou

We study the problem of estimating a rank-$1$ signal in the presence of rotationally invariant noise-a class of perturbations more general than Gaussian noise. Principal Component Analysis (PCA) provides a natural estimator, and sharp…

Machine Learning · Statistics 2021-10-15 Marco Mondelli , Ramji Venkataramanan

Approximate message-passing (AMP) method is a simple and efficient framework for the linear inverse problems. In this letter, we propose a faster AMP to solve the \emph{$L_1$-Split-Analysis} for the 2D sparsity separation, which is referred…

Information Theory · Computer Science 2015-07-13 Jaewook Kang , Hyoyoung Jung , Kiseon Kim
‹ Prev 1 8 9 10 Next ›