English
Related papers

Related papers: Improving the constant in Nesterov's $\frac{\pi}{2…

200 papers

Why is it that semidefinite relaxations have been so successful in numerous applications in computer vision and robotics for solving non-convex optimization problems involving rotations? In studying the empirical performance we note that…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Lucas Brynte , Viktor Larsson , José Pedro Iglesias , Carl Olsson , Fredrik Kahl

This paper considers a quadratically-constrained cardinality minimization problem with applications to digital filter design, subset selection for linear regression, and portfolio selection. Two relaxations are investigated: the continuous…

Optimization and Control · Mathematics 2012-10-19 Dennis Wei

A tight continuous relaxation is a crucial factor in solving mixed integer formulations of many NP-hard combinatorial optimization problems. The (weighted) max $k$-cut problem is a fundamental combinatorial optimization problem with…

Optimization and Control · Mathematics 2023-08-04 Ramin Fakhimi , Hamidreza Validi , Illya V. Hicks , Tamás Terlaky , Luis F. Zuluaga

In many contexts one encounters Hermitian operators $M$ on a Hilbert space whose dimension is so large that it is impossible to write down all matrix entries in an orthonormal basis. How does one determine whether such $M$ is positive…

Algebraic Geometry · Mathematics 2020-04-17 Gemma de las Cuevas , Tobias Fritz , Tim Netzer

For solving large-scale non-convex problems, we propose inexact variants of trust region and adaptive cubic regularization methods, which, to increase efficiency, incorporate various approximations. In particular, in addition to approximate…

Optimization and Control · Mathematics 2018-02-21 Zhewei Yao , Peng Xu , Farbod Roosta-Khorasani , Michael W. Mahoney

In this paper, we consider an unconstrained optimization model where the objective is a sum of a large number of possibly nonconvex functions, though overall the objective is assumed to be smooth and convex. Our bid to solving such model…

Optimization and Control · Mathematics 2022-03-15 Xi Chen , Bo Jiang , Tianyi Lin , Shuzhong Zhang

Given a compact parameter set $Y\subset R^p$, we consider polynomial optimization problems $(P_y$) on $R^n$ whose description depends on the parameter $y\inY$. We assume that one can compute all moments of some probability measure $\phi$ on…

Optimization and Control · Mathematics 2009-05-18 Jean B. Lasserre

In this paper we propose a unified two-phase scheme for convex optimization to accelerate: (1) the adaptive cubic regularization methods with exact/inexact Hessian matrices, and (2) the adaptive gradient method, without any knowledge of the…

Optimization and Control · Mathematics 2017-12-29 Bo Jiang , Tianyi Lin , Shuzhong Zhang

In this paper we propose and apply the enhanced semidefinite relaxation technique for solving a class of non-convex quadratic optimization problems. The approach is based on enhancing the semidefinite relaxation methodology by complementing…

Optimization and Control · Mathematics 2015-04-21 Daniel Sevcovic , Maria Trnovska

We study local complexity measures for stochastic convex optimization problems, providing a local minimax theory analogous to that of H\'{a}jek and Le Cam for classical statistical problems. We give complementary optimality results,…

Statistics Theory · Mathematics 2019-06-05 John Duchi , Feng Ruan

We give curvature-dependant convergence rates for the optimization of weakly convex functions defined on a manifold of 1-bounded geometry via Riemannian gradient descent and via the dynamic trivialization algorithm. In order to do this, we…

Optimization and Control · Mathematics 2020-08-07 Mario Lezcano-Casado

We prove precise rates of convergence for monotone approximation schemes of fractional and nonlocal Hamilton-Jacobi-Bellman (HJB) equations. We consider diffusion corrected difference-quadrature schemes from the literature and new…

Analysis of PDEs · Mathematics 2023-09-04 Indranil Chowdhury , Espen R. Jakobsen

Based on a factorization of an input covariance matrix, we define a mild generalization of an upper bound of Nikolov (2015) and Li and Xie (2020) for the NP-Hard constrained maximum-entropy sampling problem (CMESP). We demonstrate that this…

Optimization and Control · Mathematics 2022-07-11 Zhongzhu Chen , Marcia Fampa , Jon Lee

Building on the blueprint from Goemans and Williamson (1995) for the Max-Cut problem, we construct a polynomial-time approximation algorithm for orthogonally constrained quadratic optimization problems. First, we derive a semidefinite…

Optimization and Control · Mathematics 2026-03-17 Ryan Cory-Wright , Jean Pauphilet

Sparse regression models are increasingly prevalent due to their ease of interpretability and superior out-of-sample performance. However, the exact model of sparse regression with an $\ell_0$ constraint restricting the support of the…

Machine Learning · Statistics 2020-10-20 Alper Atamturk , Andres Gomez

We introduce the concept of strong high-order approximate minimizers for nonconvex optimization problems. These apply in both standard smooth and composite non-smooth settings, and additionally allow convex or inexpensive constraints. An…

Optimization and Control · Mathematics 2020-01-30 Coralia Cartis , Nick Gould , Philippe L. Toint

In this research paper, the problem of optimization of a quadratic form over the convex hull generated by the corners of hypercube is attempted and solved. Some results related to stable states/vectors, anti-stable states/vectors (over the…

Computational Complexity · Computer Science 2012-07-04 Garimella Rama Murthy

We consider the chance-constrained binary knapsack problem (CKP), where the item weights are independent and normally distributed. We introduce a continuous relaxation for the CKP, represented as a non-convex optimization problem, which we…

Optimization and Control · Mathematics 2024-03-12 Junyoung Kim , Kyungsik Lee

We describe an approach for finding upper bounds on an ODE dynamical system's maximal Lyapunov exponent among all trajectories in a specified set. A minimization problem is formulated whose infimum is equal to the maximal Lyapunov exponent,…

Dynamical Systems · Mathematics 2023-08-15 Hans Oeri , David Goluskin

We establish the optimal nonergodic sublinear convergence rate of the proximal point algorithm for maximal monotone inclusion problems. First, the optimal bound is formulated by the performance estimation framework, resulting in an infinite…

Optimization and Control · Mathematics 2019-07-15 Guoyong Gu , Junfeng Yang