English
Related papers

Related papers: Combinatorial Penalties: Which structures are pres…

200 papers

One-bit measurements widely exist in the real world, and they can be used to recover sparse signals. This task is known as the problem of learning halfspaces in learning theory and one-bit compressive sensing (1bit-CS) in signal processing.…

Machine Learning · Computer Science 2017-11-08 Xiaolin Huang , Ming Yan

The existing matrix completion methods focus on optimizing the relaxation of rank function such as nuclear norm, Schatten-p norm, etc. They usually need many iterations to converge. Moreover, only the low-rank property of matrices is…

Machine Learning · Computer Science 2022-03-07 Xuelong Li , Hongyuan Zhang , Rui Zhang

Structural models with no solution are incoherent, and those with multiple solutions are incomplete. We show that models with occasionally binding constraints are not generically coherent. Coherency requires restrictions on the parameters…

General Economics · Economics 2021-12-16 Guido Ascari , Sophocles Mavroeidis

Extension problems for polynomial valuations on different cones of convex functions are investigated. It is shown that for the classes of functions under consideration, the extension problem reduces to a simple geometric obstruction on the…

Functional Analysis · Mathematics 2024-08-14 Jonas Knoerr , Jacopo Ulivelli

Sparse estimation methods are aimed at using or obtaining parsimonious representations of data or models. They were first dedicated to linear variable selection but numerous extensions have now emerged such as structured sparsity or kernel…

Machine Learning · Computer Science 2011-11-24 Francis Bach , Rodolphe Jenatton , Julien Mairal , Guillaume Obozinski

This paper investigates simple bilevel optimization problems where we minimize an upper-level objective over the optimal solution set of a convex lower-level objective. Existing methods for such problems either only guarantee asymptotic…

Optimization and Control · Mathematics 2024-11-05 Pengyu Chen , Xu Shi , Rujun Jiang , Jiulin Wang

Motivated by the minimax concave penalty based variable selection in high-dimensional linear regression, we introduce a simple scheme to construct structured semiconvex sparsity promoting functions from convex sparsity promoting functions…

Optimization and Control · Mathematics 2018-09-19 Lixin Shen , Bruce W. Suter , Erin E. Tripp

We study the geometric structure of compact convex sets in 2-dimensional asymmetric normed lattices. We prove that every q-compact convex set is strongly q-compact and we give a complete geometric description of the compact convex sets with…

General Topology · Mathematics 2014-09-10 Natalia Jonard-Pérez , Enrique A. Sánchez-Pérez

After surveying some known properties of compact convex sets in the plane, we give a two rigorous proofs of the general feeling that supporting lines can be slide-turned slowly and continuously. Targeting a wide readership, our treatment is…

Combinatorics · Mathematics 2016-12-06 Gábor Czédli , László L. Stachó

This paper presents a general convergence theory of penalty based numerical methods for elliptic constrained inequality problems, including variational inequalities, hemivariational inequalities, and variational-hemivariational…

Numerical Analysis · Mathematics 2019-12-18 Weimin Han , Mircea Sofonea

We describe a methodology to build vectorial kinetic schemes, targetting the numerical solution of linear symmetric-hyperbolic systems of conservation laws -a minimal application case for those schemes. Precisely, we fully detail the…

Numerical Analysis · Mathematics 2025-12-10 Emmanuel Audusse , Sébastien Boyaval , Virgile Dubos , Minh-Hoang Le

We consider perturbed nonlinear ill-posed equations in Hilbert spaces, with operators that are monotone on a given closed convex subset. A simple stable approach is Lavrentiev regularization, but existence of solutions of the regularized…

Numerical Analysis · Mathematics 2018-06-05 Robert Plato , Bernd Hofmann

We show that in the framework of CAT(0) spaces, any convex combination of two mappings which are firmly nonexpansive -- or which satisfy the more general property $(P_2)$ -- is asymptotically regular, conditional on its fixed point set…

Optimization and Control · Mathematics 2018-12-04 Andrei Sipos

We consider an optimization problem with strongly convex objective and linear inequalities constraints. To be able to deal with a large number of constraints we provide a penalty reformulation of the problem. As penalty functions we use a…

Optimization and Control · Mathematics 2020-04-29 Angelia Nedich , Tatiana Tatarenko

We study the convex relaxation of clustering and hamming embedding, focusing on the asymmetric case (co-clustering and asymmetric hamming embedding), understanding their relationship to LSH as studied by (Charikar 2002) and to the max-norm…

Machine Learning · Computer Science 2014-05-14 Behnam Neyshabur , Yury Makarychev , Nathan Srebro

In this paper we introduce an enhanced notion of extremal systems for sets in locally convex topological vector spaces and obtain efficient conditions for set extremality in the convex case. Then we apply this machinery to deriving new…

Optimization and Control · Mathematics 2016-10-03 Boris Mordukhovich , Nguyen Mau Nam

This paper discusses a special kind of convex constrained optimization problem, whose constraints consist of box inequalities and linear equalities. For this problem, in addition to general optimization algorithms such as exact penalty…

Optimization and Control · Mathematics 2020-04-21 Yue Sun

Sparse regularization is fundamental in signal processing and feature extraction but often relies on non-differentiable penalties, conflicting with gradient-based optimizers. We propose WEEP (Weakly-convex Envelope of Piecewise Penalty), a…

Machine Learning · Computer Science 2026-01-21 Takanobu Furuhashi , Hidekata Hontani , Qibin Zhao , Tatsuya Yokota

We introduce and study various algorithms for solving nonconvex minimization with inequality constraints, based on the construction of convex surrogate envelopes that majorize the objective and the constraints. In the case where the…

Optimization and Control · Mathematics 2025-06-11 Nuozhou Wang , Junyu Zhang , Shuzhong Zhang

We develop a tighter implementation of basic PL topology, which keeps track of some combinatorial structure beyond PL homeomorphism type. With this technique we clarify some aspects of PL transversality and give combinatorial proofs of a…

Geometric Topology · Mathematics 2018-08-31 Sergey A. Melikhov