English
Related papers

Related papers: Combinatorial Penalties: Which structures are pres…

200 papers

Sparse regression models are increasingly prevalent due to their ease of interpretability and superior out-of-sample performance. However, the exact model of sparse regression with an $\ell_0$ constraint restricting the support of the…

Machine Learning · Statistics 2020-10-20 Alper Atamturk , Andres Gomez

This paper revisits the set membership identification for linear control systems and establishes its convergence rates under relaxed assumptions on (i) the persistent excitation requirement and (ii) the system disturbances. In particular,…

Optimization and Control · Mathematics 2025-09-11 Haonan Xu , Yingying Li

In recent years, several convex programming relaxations have been proposed to estimate the permanent of a non-negative matrix, notably in the works of Gurvits and Samorodnitsky. However, the origins of these relaxations and their…

Data Structures and Algorithms · Computer Science 2017-01-06 Damian Straszak , Nisheeth K. Vishnoi

Resolvent compositions were recently introduced as monotonicity-preserving operations that combine a set-valued monotone operator and a bounded linear operator. They generalize in particular the notion of a resolvent average. We analyze the…

Functional Analysis · Mathematics 2026-01-30 Diego J. Cornejo

Under the linear regression framework, we study the variable selection problem when the underlying model is assumed to have a small number of nonzero coefficients (i.e., the underlying linear model is sparse). Non-convex penalties in…

Statistics Theory · Mathematics 2018-12-19 Shanshan Cao , Xiaoming Huo , Jong-Shi Pang

It is known that, in finite dimensions, the support function of a compact convex set with non empty interior is differentiable excepting the origin if and only if the set is strictly convex. In this paper we realize a thorough study of the…

Functional Analysis · Mathematics 2013-01-07 C. Zalinescu

This paper describes a simple framework for structured sparse recovery based on convex optimization. We show that many structured sparsity models can be naturally represented by linear matrix inequalities on the support of the unknown…

Machine Learning · Computer Science 2015-03-04 Marwa El Halabi , Volkan Cevher

Consider a sum of convex functions, where the only information known about each individual summand is the location of a minimizer. In this work, we give an exact characterization of the set of possible minimizers of the sum. Our results…

Optimization and Control · Mathematics 2024-03-11 Moslem Zamani , François Glineur , Julien M. Hendrickx

A new family of penalty functions, adaptive to likelihood, is introduced for model selection in general regression models. It arises naturally through assuming certain types of prior distribution on the regression parameters. To study…

Methodology · Statistics 2013-08-26 Yang Feng , Tengfei Li , Zhiliang Ying

In this paper, we analyse the recovery properties of nonconvex regularized $M$-estimators, under the assumption that the true parameter is of soft sparsity. In the statistical aspect, we establish the recovery bound for any stationary point…

Statistics Theory · Mathematics 2019-11-20 Xin Li , Dongya Wu , Chong Li , Jinhua Wang , Jen-Chih Yao

We develop tractable convex relaxations for rank-constrained quadratic optimization problems over $n \times m$ matrices, a setting for which tractable relaxations are typically only available when the objective or constraints admit spectral…

Optimization and Control · Mathematics 2026-05-22 Ryan Cory-Wright , Jean Pauphilet

This paper addresses the challenging issue of symmetry in mixed-integer convex optimization problems, which frequently arise in real-world applications such as the unit commitment problem. Although variable aggregation techniques have been…

Optimization and Control · Mathematics 2026-02-05 Junhao Wu , Shaoze Li , Cheng Lu , Zhibin Deng , Shu-Cherng Fang

Precise asymptotics for moderate deviation probabilities are established for open convex sets in both the finite- and infinite-dimensional settings. Our results are based on the existence of dominating points for these sets, a related…

Probability · Mathematics 2016-09-07 Uwe Einmahl , James Kuelbs

We consider estimating a compact set from finite data by approximating the support function of that set via sublinear regression. Support functions uniquely characterize a compact set up to closure of convexification, and are sublinear…

Systems and Control · Electrical Eng. & Systems 2023-03-24 Shadi Haddad , Abhishek Halder

Building sets were introduced in the study of wonderful compactifications of hyperplane arrangement complements and were later generalized to finite meet-semilattices. Convex geometries, the duals of antimatroids, offer a robust…

Combinatorics · Mathematics 2025-11-12 Spencer Backman , Richard Danner

This paper investigates the problem of recovering the support of structured signals via adaptive compressive sensing. We examine several classes of structured support sets, and characterize the fundamental limits of accurately recovering…

Statistics Theory · Mathematics 2016-09-05 Rui M. Castro , Ervin Tánczos

We consider a convex optimization problem with many linear inequality constraints. To deal with a large number of constraints, we provide a penalty reformulation of the problem, where the penalty is a variant of the one-sided Huber loss…

Optimization and Control · Mathematics 2023-11-03 Angelia Nedich , Tatiana Tatarenko

Multibang regularization and combinatorial integral approximation decompositions are two actively researched techniques for integer optimal control. We consider a class of polyhedral functions that arise particularly as convex lower…

Optimization and Control · Mathematics 2021-03-31 Paul Manns

In this work we establish the equivalence of algorithmic regularization and explicit convex penalization for generic convex losses. We introduce a geometric condition for the optimization path of a convex function, and show that if such a…

Optimization and Control · Mathematics 2019-09-10 Qian Qian , Xiaoyuan Qian

We develop two penalty based difference of convex (DC) algorithms for solving chance constrained programs. First, leveraging a rank-based DC decomposition of the chance constraint, we propose a proximal penalty based DC algorithm in the…

Optimization and Control · Mathematics 2026-03-16 Zhiping Li , Nan Jiang , Rujun Jiang