English
Related papers

Related papers: Frame Scalings: A Condition Number Approach

200 papers

There are different solution concepts for convex vector optimization problems (CVOPs) and a recent one, which is motivated from a set optimization point of view, consists of finitely many efficient solutions that generate polyhedral inner…

Optimization and Control · Mathematics 2019-05-28 Firdevs Ulus

In this paper, we consider set optimization problems where the solution concept is given by the set approach. Specifically, we deal with the lower less and the upper less set relations. First, we derive the convexity and Lipschitzianity of…

Optimization and Control · Mathematics 2021-07-28 Gemayqzel Bouza , Ernest Quintana , Christiane Tammer , Vu Anh Tuan

Preconditioning is a crucial operation in gradient-based numerical optimisation. It helps decrease the local condition number of a function by appropriately transforming its gradient. For a convex function, where the gradient can be…

Optimization and Control · Mathematics 2023-08-29 Dmitrii A. Pasechnyuk , Alexander Gasnikov , Martin Takáč

We characterize the first-order sensitivity of approximately recovering a low-rank matrix from linear measurements, a standard problem in compressed sensing. A special case covered by our analysis is approximating an incomplete matrix by a…

Numerical Analysis · Mathematics 2024-07-02 Paul Breiding , Nick Vannieuwenhoven

Some metric and graphical regularity properties of generalized constraint systems are investigated. Then, these properties are applied in order to penalize (in the sense of Clarke) various scalar and vector optimization problems. This…

Optimization and Control · Mathematics 2011-11-08 Marius Durea , Radu Strugariu

In this paper, we consider the optimization problem of minimizing a continuously differentiable function subject to both convex constraints and sparsity constraints. By exploiting a mixed-integer reformulation from the literature, we define…

Optimization and Control · Mathematics 2021-04-28 M. Lapucci , T. Levato , F. Rinaldi , M. Sciandrone

Various control schemes rely on a solution of a convex optimization problem involving a particular robust quadratic constraint, which can be reformulated as a linear matrix inequality using the well-known $\mathcal{S}$-lemma. However, the…

Optimization and Control · Mathematics 2020-12-10 Goran Banjac , Jianzhe Zhen , Dick den Hertog , John Lygeros

Bayesian optimization is a class of data efficient model based algorithms typically focused on global optimization. We consider the more general case where a user is faced with multiple problems that each need to be optimized conditional on…

Machine Learning · Statistics 2020-11-04 Michael Pearce , Janis Klaise , Matthew Groves

This document introduces a strategy to solve linear optimization problems. The strategy is based on the bounding condition each constraint produces on each one of the problem's dimension. The solution of a linear optimization problem is…

Optimization and Control · Mathematics 2018-09-24 Gerardo L. Febres

The geometric problem of estimating an unknown compact convex set from evaluations of its support function arises in a range of scientific and engineering applications. Traditional approaches typically rely on estimators that minimize the…

Statistics Theory · Mathematics 2021-02-26 Yong Sheng Soh , Venkat Chandrasekaran

Sparse principal component analysis addresses the problem of finding a linear combination of the variables in a given data set with a sparse coefficients vector that maximizes the variability of the data. This model enhances the ability to…

Optimization and Control · Mathematics 2017-03-09 Amir Beck , Yakov Vaisbourd

In this work we collect and compare to each other many different numerical methods for regularized regression problem and for the problem of projection on a hyperplane. Such problems arise, for example, as a subproblem of demand matrix…

This work investigates the optimal allocation of inference compute across three key scaling factors in video vision language models: language model size, frame count, and the number of visual tokens per frame. While prior works typically…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Peiqi Wang , ShengYun Peng , Xuewen Zhang , Hanchao Yu , Yibo Yang , Lifu Huang , Fujun Liu , Qifan Wang

Optimization of complex functions, such as the output of computer simulators, is a difficult task that has received much attention in the literature. A less studied problem is that of optimization under unknown constraints, i.e., when the…

Methodology · Statistics 2010-07-06 Robert B. Gramacy , Herbert K. H. Lee

We solve the problem of best approximation by partial isometries of given rank to an arbitrary rectangular matrix, when the distance is measured in any unitarily invariant norm. In the case where the norm is strictly convex, we parametrize…

Functional Analysis · Mathematics 2016-11-08 Jorge Antezana , Eduardo Chiumiento

It was recently established that for convex optimization problems with sparse optimal solutions (be it entry-wise sparsity or matrix rank-wise sparsity) it is possible to design first-order methods with linear convergence rates that depend…

Optimization and Control · Mathematics 2026-03-20 Dan Garber

The best practical techniques for exact solution of instances of the constrained maximum-entropy sampling problem, a discrete-optimization problem arising in the design of experiments, are via a branch-and-bound framework, working with a…

Optimization and Control · Mathematics 2024-02-19 Zhongzhu Chen , Marcia Fampa , Jon Lee

Weight optimization of frame structures with continuous cross-section parametrization is a challenging non-convex problem that has traditionally been solved by local optimization techniques. Here, we exploit its inherent semi-algebraic…

Optimization and Control · Mathematics 2025-01-29 Marek Tyburec , Michal Kočvara , Martin Kružík

Saddle point optimization is a critical problem employed in numerous real-world applications, including portfolio optimization, generative adversarial networks, and robotics. It has been extensively studied in cases where the objective…

Machine Learning · Computer Science 2025-03-25 Shubhankar Agarwal , Hamzah I. Khan , Sandeep P. Chinchali , David Fridovich-Keil

We consider a popular family of constrained optimization problems arising in machine learning that involve optimizing a non-decomposable evaluation metric with a certain thresholded form, while constraining another metric of interest.…

Machine Learning · Computer Science 2021-07-30 Abhishek Kumar , Harikrishna Narasimhan , Andrew Cotter