English
Related papers

Related papers: The Largest-$K$-Norm for General Measure Spaces an…

200 papers

We consider an optimization problem with positively homogeneous functions in its objective and constraint functions. Examples of such positively homogeneous functions include the absolute value function and the $p$-norm function, where $p$…

Optimization and Control · Mathematics 2017-12-22 Shota Yamanaka , Nobuo Yamashita

In this paper we first extend the diminishing stepsize method for nonconvex constrained problems presented in [4] to deal with equality constraints and a nonsmooth objective function of composite type. We then consider the particular case…

Optimization and Control · Mathematics 2023-07-07 Francisco Facchinei , Vyacheskav Kungurtsevb , Lorenzo Lampariello , Gesualdo Scutari

We consider the problem of approximating the solution of variational problems subject to the constraint that the admissible functions must be convex. This problem is at the interface between convex analysis, convex optimization, variational…

Numerical Analysis · Mathematics 2015-03-19 Adam M. Oberman

The problem of replacing an integral norm with respect to a given probability measure by the corresponding integral norm with respect to a discrete measure is discussed in the paper. The above problem is studied for elements of finite…

Numerical Analysis · Mathematics 2019-11-01 F. Dai , A. Prymak , V. N. Temlyakov , S. Tikhonov

Under the linear regression framework, we study the variable selection problem when the underlying model is assumed to have a small number of nonzero coefficients (i.e., the underlying linear model is sparse). Non-convex penalties in…

Statistics Theory · Mathematics 2018-12-19 Shanshan Cao , Xiaoming Huo , Jong-Shi Pang

We derive a novel norm that corresponds to the tightest convex relaxation of sparsity combined with an $\ell_2$ penalty. We show that this new {\em $k$-support norm} provides a tighter relaxation than the elastic net and is thus a good…

Machine Learning · Statistics 2012-06-13 Andreas Argyriou , Rina Foygel , Nathan Srebro

Sparse optimization seeks an optimal solution with few nonzero entries. To achieve this, it is common to add to the criterion a penalty term proportional to the $\ell_1$-norm, which is recognized as the archetype of sparsity-inducing norms.…

Optimization and Control · Mathematics 2026-03-05 Jean-Philippe Chancelier , Michel de Lara , Antoine Deza , Lionel Pournin

This paper defines a convertible nonconvex function(CN function for short) and a weak (strong) uniform (decomposable, exact) CN function, proves the optimization conditions for their global solutions and proposes algorithms for solving the…

Optimization and Control · Mathematics 2022-02-16 M. Jiang , R. Shen , Z. Q. Meng , C. Y. Dang

Consider the regularized sparse minimization problem, which involves empirical sums of loss functions for $n$ data points (each of dimension $d$) and a nonconvex sparsity penalty. We prove that finding an…

Optimization and Control · Mathematics 2017-06-20 Yichen Chen , Dongdong Ge , Mengdi Wang , Zizhuo Wang , Yinyu Ye , Hao Yin

The problem of minimizing a continuously differentiable convex function over an intersection of closed convex sets is ubiquitous in applied mathematics. It is particularly interesting when it is easy to project onto each separate set, but…

Optimization and Control · Mathematics 2014-08-06 Eric C. Chi , Hua Zhou , Kenneth Lange

We present an alternative approach to some results of Koldobsky on measures of sections of symmetric convex bodies, which allows us to extend them to the not necessarily symmetric setting. We prove that if $K$ is a convex body in ${\mathbb…

Metric Geometry · Mathematics 2015-12-31 Giorgos Chasapis , Apostolos Giannopoulos , Dimitris-Marios Liakopoulos

A proximal safeguarded augmented Lagrangian method for minimizing the difference of convex (DC) functions over a nonempty, closed and convex set with additional linear equality as well as convex inequality constraints is presented. Thereby,…

Optimization and Control · Mathematics 2026-04-01 Christian Kanzow , Tanja Neder

Sparse methods for supervised learning aim at finding good linear predictors from as few variables as possible, i.e., with small cardinality of their supports. This combinatorial selection problem is often turned into a convex optimization…

Machine Learning · Computer Science 2010-11-15 Francis Bach

We study a specific convex maximization problem in the space of continuous functions defined on a semi-infinite interval. An unexplained connection to the discrete version of this problem is investigated.

Optimization and Control · Mathematics 2007-05-23 Steven Finch

Functional lifting methods provide a tool for approximating solutions of difficult non-convex problems by embedding them into a larger space. In this work, we investigate a mathematically rigorous formulation based on embedding into the…

Optimization and Control · Mathematics 2020-07-07 Thomas Vogt , Roland Haase , Danielle Bednarski , Jan Lellmann

We prove two theorems about differentiable functions on the Banach space C(K), where K is compact. (i) If C(K) admits a non-trivial function of class C^m and of bounded support, then all continuous real-valued functions on C(K) may be…

Functional Analysis · Mathematics 2007-05-23 Petr Hajek , Richard Haydon

This paper provides a theoretical and numerical investigation of a penalty decomposition scheme for the solution of optimization problems with geometric constraints. In particular, we consider some situations where parts of the constraints…

Optimization and Control · Mathematics 2023-03-23 Matteo Lapucci , Christian Kanzow

We consider the problem of recovering a compactly-supported function from a finite collection of pointwise samples of its Fourier transform taking nonuniformly. First, we show that under suitable conditions on the sampling frequencies -…

Numerical Analysis · Mathematics 2014-04-08 Ben Adcock , Milana Gataric , Anders C. Hansen

We give new polynomial lower bounds for a number of dynamic measure problems in computational geometry. These lower bounds hold in the Word-RAM model, conditioned on the hardness of either 3SUM, APSP, or the Online Matrix-Vector…

Computational Geometry · Computer Science 2022-07-05 Justin Dallant , John Iacono

We solve the truncated K-moment problem when $K\subseteq R^n$ is the closure of a, not necessarily bounded, open set (which includes the important cases $K=R^n$ and $K=R^n_+$). That is, we completely characterize the interior of the convex…

Optimization and Control · Mathematics 2012-11-08 Greg Blekherman , Jean-Bernard Lasserre