English
Related papers

Related papers: Accuracy Certificates for Convex Minimization with…

200 papers

The performance of a reinforcement learning algorithm can vary drastically during learning because of exploration. Existing algorithms provide little information about the quality of their current policy before executing it, and thus have…

Machine Learning · Computer Science 2019-05-29 Christoph Dann , Lihong Li , Wei Wei , Emma Brunskill

The challenge of mastering computational tasks of enormous size tends to frequently override questioning the quality of the numerical outcome in terms of accuracy. By this we do not mean the accuracy within the discrete setting, which…

Numerical Analysis · Mathematics 2019-10-17 Markus Bachmayr , Wolfgang Dahmen

Computational problem certificates are additional data structures for each output, which can be used by a-possibly randomized-verification algorithm that proves the correctness of each output. In this paper, we give an algorithm that…

Symbolic Computation · Computer Science 2019-12-03 Jean-Guillaume Dumas , Erich Kaltofen , Emmanuel Thomé , Gilles Villard

Certificates to a linear algebra computation are additional data structures for each output, which can be used by a---possibly randomized---verification algorithm that proves the correctness of each output. The certificates are essentially…

Symbolic Computation · Computer Science 2020-01-09 Jean-Guillaume Dumas , Erich Kaltofen

This paper introduces a new storage-optimal first-order method (FOM), CertSDP, for solving a special class of semidefinite programs (SDPs) to high accuracy. The class of SDPs that we consider, the exact QMP-like SDPs, is characterized by…

Optimization and Control · Mathematics 2024-03-05 Alex L. Wang , Fatma Kilinc-Karzan

Performance analysis of first-order algorithms with inexact oracles has gained recent attention due to various emerging applications in which obtaining exact gradients is impossible or computationally expensive. Previous research has…

Optimization and Control · Mathematics 2025-10-15 Yin Liu , Sam Davanloo Tajbakhsh

This paper is motivated by the increasing security concerns of cyber-physical systems. Here, we develop a discretization-free verification scheme targeting an information-flow security property, called approximate initial-state opacity, for…

Optimization and Control · Mathematics 2021-09-24 Siyuan Liu , Majid Zamani

We introduce the concept of inexact first-order oracle of degree q for a possibly nonconvex and nonsmooth function, which naturally appears in the context of approximate gradient, weak level of smoothness and other situations. Our…

Optimization and Control · Mathematics 2024-01-22 Yassine Nabou , Francois Glineur , Ion Necoara

Online classification is a central problem in optimization, statistical learning and data science. Classical algorithms such as the perceptron offer efficient updates and finite mistake guarantees on linearly separable data, but they do not…

Optimization and Control · Mathematics 2025-09-25 Nam Ho-Nguyen , Fatma Kılınç-Karzan , Ellie Nguyen , Lingqing Shen

In the certification problem, the algorithm is given a function $f$ with certificate complexity $k$ and an input $x^\star$, and the goal is to find a certificate of size $\le \text{poly}(k)$ for $f$'s value at $x^\star$. This problem is in…

Computational Complexity · Computer Science 2022-11-07 Guy Blanc , Caleb Koch , Jane Lange , Carmen Strassle , Li-Yang Tan

In this paper, we consider smooth convex optimization problems with simple constraints and inexactness in the oracle information such as value, partial or directional derivatives of the objective function. We introduce a unifying framework,…

Optimization and Control · Mathematics 2020-12-17 Pavel Dvurechensky , Alexander Gasnikov , Alexander Tiurin , Vladimir Zholobov

In this paper we provide a detailed analysis of the iteration complexity of dual first order methods for solving conic convex problems. When it is difficult to project on the primal feasible set described by convex constraints, we use the…

Optimization and Control · Mathematics 2015-03-16 Ion Necoara , Andrei Patrascu

We consider the problem of minimizing a convex function over a subset of R^n that is not necessarily convex (minimization of a convex function over the integer points in a polytope is a special case). We define a family of duals for this…

Optimization and Control · Mathematics 2016-10-28 Amitabh Basu , Michele Conforti , Gérard Cornuéjols , Robert Weismantel , Stefan Weltge

We consider optimization methods for convex minimization problems under inexact information on the objective function. We introduce inexact model of the objective, which as a particular cases includes $(\delta,L)$ inexact oracle and…

Deploying mathematical optimization in autonomous production systems requires precise contracts for objects returned by an optimization solver. Unfortunately, conventions on dual solution and infeasibility certificates (rays) vary widely…

Optimization and Control · Mathematics 2026-02-05 Juan Pablo Vielma , Ross Anderson , Joey Huchette

This paper presents new first-order methods for achieving optimal oracle complexities in convex optimization with convex functional constraints. Oracle complexities are measured by the number of function and gradient evaluations. To achieve…

Optimization and Control · Mathematics 2026-04-17 Qi Deng , Guanghui Lan , Zhenwei Lin

Many optimization problems of interest are known to be intractable, and while there are often heuristics that are known to work on typical instances, it is usually not easy to determine a posteriori whether the optimal solution was found.…

Optimization and Control · Mathematics 2015-09-03 Afonso S. Bandeira

This paper investigates online algorithms for smooth time-varying optimization problems, focusing first on methods with constant step-size, momentum, and extrapolation-length. Assuming strong convexity, precise results for the tracking…

Optimization and Control · Mathematics 2024-07-16 Liam Madden , Stephen Becker , Emiliano Dall'Anese

First-order optimization methods have attracted a lot of attention due to their practical success in many applications, including in machine learning. Obtaining convergence guarantees and worst-case performance certificates for first-order…

Optimization and Control · Mathematics 2023-10-04 Baptiste Goujaud , Aymeric Dieuleveut , Adrien Taylor

This paper investigates the problem of certifying optimality for sparse generalized linear models (GLMs), where sparsity is enforced through an $\ell_0$ cardinality constraint. While branch-and-bound (BnB) frameworks can certify optimality…

Machine Learning · Computer Science 2025-06-12 Jiachang Liu , Soroosh Shafiee , Andrea Lodi