English
Related papers

Related papers: Open problem: Tightness of maximum likelihood semi…

200 papers

We study computational and statistical aspects of learning Latent Markov Decision Processes (LMDPs). In this model, the learner interacts with an MDP drawn at the beginning of each epoch from an unknown mixture of MDPs. To sidestep known…

Machine Learning · Computer Science 2024-06-13 Fan Chen , Constantinos Daskalakis , Noah Golowich , Alexander Rakhlin

A $\mu$-constrained Boolean Max-CSP$(\psi)$ instance is a Boolean Max-CSP instance on predicate $\psi:\{0,1\}^r \to \{0,1\}$ where the objective is to find a labeling of relative weight exactly $\mu$ that maximizes the fraction of satisfied…

Data Structures and Algorithms · Computer Science 2023-08-21 Suprovat Ghoshal , Euiwoong Lee

This paper deals with the algorithmic aspects of solving feasibility problems of semidefinite programming (SDP), aka linear matrix inequalities (LMI). Since in some SDP instances all feasible solutions have irrational entries, numerical…

Optimization and Control · Mathematics 2025-04-28 Vladimir Kolmogorov , Simone Naldi , Jeferson Zapata

Semidefinite programs (SDPs) and their solvers are powerful tools with many applications in machine learning and data science. Designing scalable SDP solvers is challenging because by standard the positive semidefinite decision variable is…

Optimization and Control · Mathematics 2024-08-09 Yufan Huang , David F. Gleich

An estimation problem of fundamental interest is that of phase synchronization, in which the goal is to recover a collection of phases using noisy measurements of relative phases. It is known that in the Gaussian noise setting, the maximum…

Optimization and Control · Mathematics 2016-11-02 Huikang Liu , Man-Chung Yue , Anthony Man-Cho So

Computing tight Lipschitz bounds for deep neural networks is crucial for analyzing their robustness and stability, but existing approaches either produce relatively conservative estimates or rely on semidefinite programming (SDP)…

Machine Learning · Computer Science 2025-03-19 Usman Syed , Bin Hu

Certifying the safety or robustness of neural networks against input uncertainties and adversarial attacks is an emerging challenge in the area of safe machine learning and control. To provide such a guarantee, one must be able to bound the…

Optimization and Control · Mathematics 2021-09-16 Mahyar Fazlyab , Manfred Morari , George J. Pappas

Markov Decision Processes (MDPs) are stochastic optimization problems that model situations where a decision maker controls a system based on its state. Partially observed Markov decision processes (POMDPs) are generalizations of MDPs where…

Optimization and Control · Mathematics 2019-03-26 Victor Cohen , Axel Parmentier

Given an affine space of matrices $\mathcal{L}$ and a matrix $\Theta\in \mathcal{L}$, consider the problem of computing the closest rank deficient matrix to $\Theta$ on $\mathcal{L}$ with respect to the Frobenius norm. This is a nonconvex…

Optimization and Control · Mathematics 2020-10-12 Diego Cifuentes

The support recovery problem consists of determining a sparse subset of a set of variables that is relevant in generating a set of observations, and arises in a diverse range of settings such as compressive sensing, and subset selection in…

Information Theory · Computer Science 2016-08-31 Jonathan Scarlett , Volkan Cevher

We introduce a method for proving lower bounds on the efficacy of semidefinite programming (SDP) relaxations for combinatorial problems. In particular, we show that the cut, TSP, and stable set polytopes on $n$-vertex graphs are not the…

Computational Complexity · Computer Science 2014-11-25 James R. Lee , Prasad Raghavendra , David Steurer

Determinantal point processes (DPPs) have wide-ranging applications in machine learning, where they are used to enforce the notion of diversity in subset selection problems. Many estimators have been proposed, but surprisingly the basic…

Statistics Theory · Mathematics 2017-07-25 Victor-Emmanuel Brunel , Ankur Moitra , Philippe Rigollet , John Urschel

In this paper we establish a connection between non-convex optimization methods for training deep neural networks and nonlinear partial differential equations (PDEs). Relaxation techniques arising in statistical physics which have already…

Machine Learning · Computer Science 2017-06-05 Pratik Chaudhari , Adam Oberman , Stanley Osher , Stefano Soatto , Guillaume Carlier

We approximate the backward reachable set of discrete-time autonomous polynomial systems using the recently developed occupation measure approach. We formulate the problem as an infinite-dimensional linear programming (LP) problem on…

Systems and Control · Computer Science 2018-07-27 Weiqiao Han , Russ Tedrake

Quadratic programs with box constraints involve minimizing a possibly nonconvex quadratic function subject to lower and upper bounds on each variable. This is a well-known NP-hard problem that frequently arises in various applications. We…

Optimization and Control · Mathematics 2023-03-14 Yuzhou Qiu , E. Alper Yıldırım

The traveling salesman problem (TSP) is a fundamental problem in combinatorial optimization. Several semidefinite programming relaxations have been proposed recently that exploit a variety of mathematical structures including, e.g.,…

Data Structures and Algorithms · Computer Science 2019-07-23 Samuel C. Gutekunst , David P. Williamson

Binary Integer Programming (BIP) problems are of interest due in part to the difficulty they pose and because of their various applications, including those in graph theory, combinatorial optimization and network optimization. In this note,…

Optimization and Control · Mathematics 2012-08-21 Pietro Paparella

The ability to compute reward-optimal policies for given and known finite Markov decision processes (MDPs) underpins a variety of applications across planning, controller synthesis, and verification. However, we often want policies (1) to…

Logic in Computer Science · Computer Science 2025-11-18 Linus Heck , Filip Macák , Milan Češka , Sebastian Junges

We consider a very wide class of models for sparse random Boolean 2CSPs; equivalently, degree-2 optimization problems over~$\{\pm 1\}^n$. For each model $\mathcal{M}$, we identify the "high-probability value"~$s^*_{\mathcal{M}}$ of the…

Data Structures and Algorithms · Computer Science 2021-08-03 Amulya Musipatla , Ryan O'Donnell , Tselil Schramm , Xinyu Wu

Many computer vision problems can be formulated as binary quadratic programs (BQPs). Two classic relaxation methods are widely used for solving BQPs, namely, spectral methods and semidefinite programming (SDP), each with their own…

Computer Vision and Pattern Recognition · Computer Science 2016-11-18 Peng Wang , Chunhua Shen , Anton van den Hengel