English
Related papers

Related papers: Efficient Low-Rank Semidefinite Programming with R…

200 papers

This paper presents a novel approach to training neural networks with formal safety guarantees using semidefinite programming (SDP) for verification. Our method focuses on verifying safety over large, high-dimensional input regions,…

Machine Learning · Computer Science 2024-09-17 Roman Soletskyi , David "davidad" Dalrymple

Low rank matrix recovery problems appear widely in statistics, combinatorics, and imaging. One celebrated method for solving these problems is to formulate and solve a semidefinite program (SDP). It is often known that the exact solution to…

Optimization and Control · Mathematics 2021-07-26 Lijun Ding , Madeleine Udell

Semidefinite programming (SDP) is a unifying framework that generalizes both linear programming and quadratically-constrained quadratic programming, while also yielding efficient solvers, both in theory and in practice. However, there exist…

Data Structures and Algorithms · Computer Science 2022-10-24 Elena Grigorescu , Young-San Lin , Sandeep Silwal , Maoyuan Song , Samson Zhou

We adapt a manifold sampling algorithm for the nonsmooth, nonconvex formulations of learning that arise when imposing robustness to outliers present in the training data. We demonstrate the approach on objectives based on trimmed loss.…

Optimization and Control · Mathematics 2018-07-10 Matt Menickelly , Stefan M. Wild

This paper develops a new storage-optimal algorithm that provably solves generic semidefinite programs (SDPs) in standard form. This method is particularly effective for weakly constrained SDPs. The key idea is to formulate an approximate…

Optimization and Control · Mathematics 2020-06-19 Lijun Ding , Alp Yurtsever , Volkan Cevher , Joel A. Tropp , Madeleine Udell

In this paper we consider the problem of minimizing composite objective functions consisting of a convex differentiable loss function plus a non-smooth regularization term, such as $L_1$ norm or nuclear norm, under R\'enyi differential…

Machine Learning · Computer Science 2019-09-26 Chen Chen , Jaewoo Lee

We present two stochastic descent algorithms that apply to unconstrained optimization and are particularly efficient when the objective function is slow to evaluate and gradients are not easily obtained, as in some PDE-constrained…

Optimization and Control · Mathematics 2019-04-30 David Kozak , Stephen Becker , Alireza Doostan , Luis Tenorio

We consider the problem of learning support vector machines robust to uncertainty. It has been established in the literature that typical loss functions, including the hinge loss, are sensible to data perturbations and outliers, thus…

Machine Learning · Computer Science 2024-02-06 Valentina Cepeda , Andrés Gómez , Shaoning Han

In this paper, we study multistage stochastic mixed-integer nonlinear programs (MS-MINLP). This general class of problems encompasses, as important special cases, multistage stochastic convex optimization with non-Lipschitzian value…

Optimization and Control · Mathematics 2022-05-23 Shixuan Zhang , Xu Andy Sun

We propose a prox-regular-type low-rank constrained nonconvex nonsmooth optimization model for Robust Low-Rank Matrix Recovery (RLRMR), i.e., estimate problem of low-rank matrix from an observed signal corrupted by outliers. For RLRMR, the…

Optimization and Control · Mathematics 2026-02-03 Keita Kume , Isao Yamada

Composite convex optimization problems which include both a nonsmooth term and a low-rank promoting term have important applications in machine learning and signal processing, such as when one wishes to recover an unknown matrix that is…

Machine Learning · Computer Science 2018-09-28 Dan Garber , Atara Kaplan

In this article, an efficient sequential linear programming algorithm (SLP) for uncertainty analysis-based data-driven computational mechanics (UA-DDCM) is presented. By assuming that the uncertain constitutive relationship embedded behind…

Optimization and Control · Mathematics 2022-11-09 Mengcheng Huang , Chang Liu , Zongliang Du , Shan Tang , Xu Guo

When sum-of-squares (SOS) programs are recast as semidefinite programs (SDPs) using the standard monomial basis, the constraint matrices in the SDP possess a structural property that we call \emph{partial orthogonality}. In this paper, we…

Optimization and Control · Mathematics 2020-01-13 Yang Zheng , Giovanni Fantuzzi , Antonis Papachristodoulou

We extend a primal-dual fixed point algorithm (PDFP) proposed in [5] to solve two kinds of separable multi-block minimization problems, arising in signal processing and imaging science. This work shows the flexibility of applying PDFP…

Optimization and Control · Mathematics 2016-02-02 Peijun Chen , Jianguo Huang , Xiaoqun Zhang

This paper presents a novel sensitivity-based distributed programming (SBDP) approach for non-convex, large-scale nonlinear programs (NLP). The algorithm relies on first-order sensitivities to cooperatively solve the central NLP in a…

Optimization and Control · Mathematics 2026-03-30 Maximilian Pierer von Esch , Andreas Völz , Knut Graichen

Sparse signal recovery based on nonconvex and nonsmooth optimization problems has significant applications and demonstrates superior performance in signal processing and machine learning. This work deals with a scale-invariant…

Optimization and Control · Mathematics 2025-09-29 Lang Yu , Nanjing Huang

We consider a distributionally robust stochastic optimization problem and formulate it as a stochastic two-level composition optimization problem with the use of the mean--semideviation risk measure. In this setting, we consider a single…

Optimization and Control · Mathematics 2023-06-12 Landi Zhu , Mert Gürbüzbalaban , Andrzej Ruszczyński

We introduce Sieve-SDP, a simple facial reduction algorithm to preprocess semidefinite programs (SDPs). Sieve-SDP inspects the constraints of the problem to detect lack of strict feasibility, deletes redundant rows and columns, and reduces…

Optimization and Control · Mathematics 2021-03-02 Yuzixuan , Zhu , Gabor Pataki , Quoc Tran-Dinh

Ranking tasks constitute fundamental components of extreme similarity learning frameworks, where extremely large corpora of objects are modeled through relative similarity relationships adhering to predefined ordinal structures. Among…

Machine Learning · Computer Science 2025-06-12 Yuanhao Pu , Defu Lian , Xiaolong Chen , Xu Huang , Jin Chen , Enhong Chen

Distributed algorithms for solving coupled semidefinite programs (SDPs) commonly require many iterations to converge. They also put high computational demand on the computational agents. In this paper we show that in case the coupled…

Optimization and Control · Mathematics 2015-04-30 Sina Khoshfetrat Pakazad , Anders Hansson , Martin S. Andersen , Anders Rantzer
‹ Prev 1 4 5 6 7 8 10 Next ›