English
Related papers

Related papers: Multivariate Gaussians, Semidefinite Matrix Comple…

200 papers

This paper is devoted to the theoretical and numerical investigation of an augmented Lagrangian method for the solution of optimization problems with geometric constraints. Specifically, we study situations where parts of the constraints…

Optimization and Control · Mathematics 2022-04-20 Xiaoxi Jia , Christian Kanzow , Patrick Mehlitz , Gerd Wachsmuth

In many applications, solutions of convex optimization problems are updated on-line, as functions of time. In this paper, we consider parametric semidefinite programs, which are linear optimization problems in the semidefinite cone whose…

Optimization and Control · Mathematics 2024-03-26 Antonio Bellon , Didier Henrion , Vyacheslav Kungurtsev , Jakub Marecek

Many supervised machine learning methods are naturally cast as optimization problems. For prediction models which are linear in their parameters, this often leads to convex problems for which many mathematical guarantees exist. Models which…

Machine Learning · Computer Science 2021-10-18 Francis Bach , Lenaïc Chizat

We consider a modification of the covariance function in Gaussian processes to correctly account for known linear constraints. By modelling the target function as a transformation of an underlying function, the constraints are explicitly…

Machine Learning · Statistics 2017-09-20 Carl Jidling , Niklas Wahlström , Adrian Wills , Thomas B. Schön

In this paper, "chance optimization" problems are introduced, where one aims at maximizing the probability of a set defined by polynomial inequalities. These problems are, in general, nonconvex and computationally hard. With the objective…

Optimization and Control · Mathematics 2015-05-12 Ashkan Jasour , Necdet Serhat Aybat , Constantino Lagoa

We derive computationally tractable formulations of the robust counterparts of convex quadratic and conic quadratic constraints that are concave in matrix-valued uncertain parameters. We do this for a broad range of uncertainty sets. In…

Optimization and Control · Mathematics 2022-04-07 Ahmadreza Marandi , Aharon Ben-Tal , Dick den Hertog , Bertrand Melenberg

We consider scalar equilibrium problems governed by a bifunction in a finite-dimensional framework. By using classical arguments in Convex Analysis, we show that under suitable generalized convexity assumptions imposed on the bifunction,…

Optimization and Control · Mathematics 2024-01-02 Valerian-Alin Fodor , Nicolae Popovici

As observed by Auderset et al. (2005) and Wiesel (2012), viewing covariance matrices as elements of a Riemannian manifold and using the concept of geodesic convexity provide useful tools for studying M-estimators of multivariate scatter. In…

Methodology · Statistics 2016-07-27 Lutz Duembgen , David E. Tyler

We compute approximate solutions to inverse problems for determining parameters in differential equation models with stochastic data on output quantities. The formulation of the problem and modeling framework define a solution as a…

Numerical Analysis · Mathematics 2014-07-16 Troy Butler , Don Estep , Simon Tavener , Timothy Wildey , Clint Dawson , Lindley Graham

A commutative associative algebra A with an identity over the field of real numbers which has a basis, where all elements are invertible, is considered in the work. Moreover, among matrixes consisting of the structure constants of A, there…

Complex Variables · Mathematics 2020-09-29 T. M. Osipchuk

We study a general class of convex submodular optimization problems with indicator variables. Many applications such as the problem of inferring Markov random fields (MRFs) with a sparsity or robustness prior can be naturally modeled in…

Optimization and Control · Mathematics 2025-07-08 Andres Gomez , Shaoning Han

We study the problem of matrix estimation and matrix completion under a general framework. This framework includes several important models as special cases such as the gaussian mixture model, mixed membership model, bi-clustering model and…

Statistics Theory · Mathematics 2017-07-10 Olga Klopp , Yu Lu , Alexandre B. Tsybakov , Harrison H. Zhou

Motivated by modern regression applications, in this paper, we study the convexification of a class of convex optimization problems with indicator variables and combinatorial constraints on the indicators. Unlike most of the previous work…

Optimization and Control · Mathematics 2021-06-17 Linchuan Wei , Andres Gomez , Simge Kucukyavuz

We study computational and statistical consequences of problem geometry in stochastic and online optimization. By focusing on constraint set and gradient geometry, we characterize the problem families for which stochastic- and…

Optimization and Control · Mathematics 2025-07-17 Chen Cheng , Daniel Levy , John C. Duchi

A generalization of expectiles for d-dimensional multivariate distribution functions is introduced. The resulting geometric expectiles are unique solutions to a convex risk minimization problem and are given by d-dimensional vectors. They…

Risk Management · Quantitative Finance 2018-01-19 Klaus Herrmann , Marius Hofert , Melina Mailhot

Convex regression is the problem of fitting a convex function to a data set consisting of input-output pairs. We present a new approach to this problem called spectrahedral regression, in which we fit a spectrahedral function to the data,…

Optimization and Control · Mathematics 2021-11-01 Eliza O'Reilly , Venkat Chandrasekaran

Consider a random vector with finite second moments. If its precision matrix is an M-matrix, then all partial correlations are non-negative. If that random vector is additionally Gaussian, the corresponding Markov random field (GMRF) is…

Statistics Theory · Mathematics 2014-04-29 Martin Slawski , Matthias Hein

In this paper we present a general convex optimization approach for solving high-dimensional multiple response tensor regression problems under low-dimensional structural assumptions. We consider using convex and weakly decomposable…

Statistics Theory · Mathematics 2017-04-17 Garvesh Raskutti , Ming Yuan , Han Chen

An important yet challenging problem in numerical linear algebra is finding a principal submatrix with maximum determinant from a given symmetric positive semidefinite matrix. This problem arises in experimental design, statistics, and…

Optimization and Control · Mathematics 2026-05-26 Hao Hu , Stefan Sremac , Hugo J. Woerdeman , Henry Wolkowicz

Positive semi-definite matrices commonly occur as normal matrices of least squares problems in statistics or as kernel matrices in machine learning and approximation theory. They are typically large and dense. Thus algorithms to solve…

Numerical Analysis · Mathematics 2020-12-01 Markus Hegland , Frank deHoog