English
Related papers

Related papers: Accuracy Certificates for Convex Minimization with…

200 papers

We introduce lower-bound certificates for classical planning tasks, which can be used to prove the unsolvability of a task or the optimality of a plan in a way that can be verified by an independent third party. We describe a general…

Artificial Intelligence · Computer Science 2025-05-06 Simon Dold , Malte Helmert , Jakob Nordström , Gabriele Röger , Tanja Schindler

In this paper, we consider the problem of certifying the robustness of neural networks to perturbed and adversarial input data. Such certification is imperative for the application of neural networks in safety-critical decision-making and…

Machine Learning · Computer Science 2020-09-21 Brendon G. Anderson , Ziye Ma , Jingqi Li , Somayeh Sojoudi

We establish new lower-bounds for the information complexity of mixed-integer convex optimization under two "bit-wise" oracles. The first oracle provides bits of first-order information in the standard coordinate model, and the second…

Optimization and Control · Mathematics 2025-11-05 Amitabh Basu , Phillip Kerger , Marco Molinaro

Several signal recovery tasks can be relaxed into semidefinite programs with rank-one minimizers. A common technique for proving these programs succeed is to construct a dual certificate. Unfortunately, dual certificates may not exist under…

Optimization and Control · Mathematics 2014-05-29 Paul Hand

In this paper, we develop new first-order method for composite non-convex minimization problems with simple constraints and inexact oracle. The objective function is given as a sum of "`hard"', possibly non-convex part, and "`simple"'…

Optimization and Control · Mathematics 2017-03-28 Pavel Dvurechensky

In safety-critical applications that rely on the solution of an optimization problem, the certification of the optimization algorithm is of vital importance. Certification and suboptimality results are available for a wide range of…

Optimization and Control · Mathematics 2023-12-06 Pablo Krupa , Omar Inverso , Mirco Tribastone , Alberto Bemporad

First-order methods for minimization and saddle point (min-max) problems are widely used for solving large-scale problems, in particular arising in machine learning. The majority of works obtain favorable complexity guarantees of such…

In this paper we present complexity certification results for a distributed Augmented Lagrangian (AL) algorithm used to solve convex optimization problems involving globally coupled linear constraints. Our method relies on the Accelerated…

Optimization and Control · Mathematics 2018-01-16 Soomin Lee , Nikolaos Chatzipanagiotis , Michael M. Zavlanos

In this paper we propose and analyze two dual methods based on inexact gradient information and averaging that generate approximate primal solutions for smooth convex optimization problems. The complicating constraints are moved into the…

Optimization and Control · Mathematics 2013-02-14 Ion Necoara , Valentin Nedelcu

We construct a family of functions suitable for establishing lower bounds on the oracle complexity of first-order minimization of smooth strongly-convex functions. Based on this construction, we derive new lower bounds on the complexity of…

Optimization and Control · Mathematics 2021-06-16 Yoel Drori , Adrien Taylor

Successive quadratic approximations, or second-order proximal methods, are useful for minimizing functions that are a sum of a smooth part and a convex, possibly nonsmooth part that promotes regularization. Most analyses of iteration…

Optimization and Control · Mathematics 2019-01-25 Ching-pei Lee , Stephen J. Wright

This paper develops a general theoretical framework to analyze structured sparse recovery problems using the notation of dual certificate. Although certain aspects of the dual certificate idea have already been used in some previous work,…

Machine Learning · Statistics 2012-04-05 Cun-Hui Zhang , Tong Zhang

We develop algorithms for certifying an approximation to a nonsingular solution of a square system of equations built from univariate analytic functions. These algorithms are based on the existence of oracles for evaluating basic data about…

Symbolic Computation · Computer Science 2019-07-22 Michael Burr , Kisun Lee , Anton Leykin

In this paper we present the solver DuQuad specialized for solving general convex quadratic problems arising in many engineering applications. When it is difficult to project on the primal feasible set, we use the (augmented) Lagrangian…

Optimization and Control · Mathematics 2015-04-23 Ion Necoara , Andrei Patrascu

We consider decision-making problems that are formulated as non-convex optimization programs where uncertainty enters the constraints through an additive term, independent of the decision variables, and robustness is imposed using a finite…

Optimization and Control · Mathematics 2026-02-25 Alexander J Gallo , Massimiliano Zoggia , Alessandro Falsone , Maria Prandini , Simone Garatti

Modern state estimation is often formulated as an optimization problem and solved using efficient local search methods. These methods at best guarantee convergence to local minima, but, in some cases, global optimality can also be…

Robotics · Computer Science 2022-11-28 Connor Holmes , Timothy D. Barfoot

Algorithmic reproducibility measures the deviation in outputs of machine learning algorithms upon minor changes in the training process. Previous work suggests that first-order methods would need to trade-off convergence rate (gradient…

Machine Learning · Computer Science 2024-01-11 Liang Zhang , Junchi Yang , Amin Karbasi , Niao He

Proof certificates can be used to validate the correctness of algebraic derivations. However, in practice, we frequently observed that the exact same proof steps are repeated for different sets of variables, which leads to unnecessarily…

Symbolic Computation · Computer Science 2025-07-29 Daniela Kaufmann , Clemens Hofstadler

Farkas' lemma is a fundamental result from linear programming providing linear certificates for infeasibility of systems of linear inequalities. In semidefinite programming, such linear certificates only exist for strongly infeasible linear…

Optimization and Control · Mathematics 2012-03-02 Igor Klep , Markus Schweighofer

In this paper we present the first fast optimality certifier for the non-minimal version of the Relative Pose problem for calibrated cameras from epipolar constraints. The proposed certifier is based on Lagrangian duality and relies on a…

Computer Vision and Pattern Recognition · Computer Science 2021-02-22 Mercedes Garcia-Salguero , Jesus Briales , Javier Gonzalez-Jimenez