English
Related papers

Related papers: Near-Optimal Bounds for Generalized Orthogonal Pro…

200 papers

Quadratic assignment problems are a fundamental class of combinatorial optimization problems which are ubiquitous in applications, yet their exact resolution is NP-hard. To circumvent this impasse, it was proposed to regularize such…

Optimization and Control · Mathematics 2025-09-25 Venkatkrishna Karumanchi , Gabriel Rioux , Ziv Goldfeld

We present a combination technique based on mixed differences of both spatial approximations and quadrature formulae for the stochastic variables to solve efficiently a class of Optimal Control Problems (OCPs) constrained by random partial…

Numerical Analysis · Mathematics 2024-03-29 Fabio Nobile , Tommaso Vanzan

The generalized Gauss-Newton (GGN) optimization method incorporates curvature estimates into its solution steps, and provides a good approximation to the Newton method for large-scale optimization problems. GGN has been found particularly…

Machine Learning · Computer Science 2024-04-24 Adeyemi D. Adeoye , Philipp Christian Petersen , Alberto Bemporad

Generalised planning (GP) refers to the task of synthesising programs that solve families of related planning problems. We introduce a novel, yet simple method for GP: given a set of training problems, for each problem, compute an optimal…

Artificial Intelligence · Computer Science 2025-11-17 Dillon Z. Chen , Till Hofmann , Toryn Q. Klassen , Sheila A. McIlraith

As a greedy algorithm to recover sparse signals from compressed measurements, orthogonal matching pursuit (OMP) algorithm has received much attention in recent years. In this paper, we introduce an extension of the OMP for pursuing…

Information Theory · Computer Science 2014-04-01 Jian Wang , Seokbeop Kwon , Byonghyo Shim

If a sparse semidefinite program (SDP), specified over $n\times n$ matrices and subject to $m$ linear constraints, has an aggregate sparsity graph $G$ with small treewidth, then chordal conversion will sometimes allow an interior-point…

Optimization and Control · Mathematics 2024-09-23 Richard Y. Zhang

Point cloud registration based on correspondences computes the rigid transformation that maximizes the number of inliers constrained within the noise threshold. Current state-of-the-art (SOTA) methods employing spatial compatibility graphs…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Zhao Zheng , Jingfan Fan , Long Shao , Hong Song , Danni Ai , Tianyu Fu , Deqiang Xiao , Yongtian Wang , Jian Yang

This paper studies the problem of maximizing the sum of traces of matrix quadratic forms on a product of Stiefel manifolds. This orthogonal trace-sum maximization (OTSM) problem generalizes many interesting problems such as generalized…

Optimization and Control · Mathematics 2021-02-09 Joong-Ho Won , Hua Zhou , Kenneth Lange

Combining recent moment and sparse semidefinite programming (SDP) relaxation techniques, we propose an approach to find smooth approximations for solutions of problems involving nonlinear differential equations. Given a system of nonlinear…

Optimization and Control · Mathematics 2010-08-13 Martin Mevissen , Jean-Bernard Lasserre , Didier Henrion

Stochastic gradient descent (SGD) is a simple and popular method to solve stochastic optimization problems which arise in machine learning. For strongly convex problems, its convergence rate was known to be O(\log(T)/T), by running SGD for…

Machine Learning · Computer Science 2015-03-19 Alexander Rakhlin , Ohad Shamir , Karthik Sridharan

We propose a new method for generating semidefinite relaxations of optimal power flow problems. The method is based on chordal conversion techniques: by dropping some equality constraints in the conversion, we obtain semidefinite…

Optimization and Control · Mathematics 2013-12-09 Martin S. Andersen , Anders Hansson , Lieven Vandenberghe

Generalized Polynomial Chaos (gPC) expansions are well established for forward uncertainty propagation in many application areas. Although the associated computational effort may be reduced in comparison to Monte Carlo techniques, for…

Computational Engineering, Finance, and Science · Computer Science 2023-07-26 Niklas Georg , Ulrich Römer

In this paper, we consider a modified projected Gauss-Newton method for solving constrained nonlinear least-squares problems. We assume that the functional constraints are smooth and the the other constraints are represented by a simple…

Optimization and Control · Mathematics 2025-04-02 Yassine Nabou , Lucian Toma , Ion Necoara

Procrustes problems are matrix approximation problems searching for a~transformation of the given dataset to fit another dataset. They find applications in numerous areas, such as factor and multivariate analysis, computer vision,…

Optimization and Control · Mathematics 2023-05-01 Terézia Fulová , Mária Trnovská

In this paper we consider finding an approximate second-order stationary point (SOSP) of general nonconvex conic optimization that minimizes a twice differentiable function subject to nonlinear equality constraints and also a convex conic…

Optimization and Control · Mathematics 2024-09-02 Chuan He , Heng Huang , Zhaosong Lu

We introduce GS-PowerHP, a novel zeroth-order method for non-convex optimization problems of the form $\max_{x \in \mathbb{R}^d} f(x)$. Our approach leverages two key components: a power-transformed Gaussian-smoothed surrogate…

Optimization and Control · Mathematics 2025-11-18 Chen Xu

In this work, we study the iteration complexity of gradient methods for minimizing convex quadratic functions regularized by powers of Euclidean norms. We show that, due to the uniform convexity of the objective, gradient methods have…

Optimization and Control · Mathematics 2025-01-28 Daniel Berg Thomsen , Nikita Doikov

Interpreting objects with basic geometric primitives has long been studied in computer vision. Among geometric primitives, superquadrics are well known for their ability to represent a wide range of shapes with few parameters. However, as…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Weixiao Liu , Yuwei Wu , Sipu Ruan , Gregory S. Chirikjian

Graduated optimization is a global optimization technique that is used to minimize a multimodal nonconvex function by smoothing the objective function with noise and gradually refining the solution. This paper experimentally evaluates the…

Machine Learning · Computer Science 2024-12-17 Naoki Sato , Hideaki Iiduka

Probabilistic smoothing is a standard tool for global optimization, but existing methods rely on Gaussian kernels and specific transforms, often resulting in strong hyperparameter sensitivity and limited robustness. We propose a general…

Machine Learning · Computer Science 2026-05-27 Kukyoung Jang , Taehyun Cho , Junrui Zhang , Ping Xu , Kyungjae Lee