English
Related papers

Related papers: Complexity of Unconstrained L_2-L_p Minimization

200 papers

Linear regression without correspondences concerns the recovery of a signal in the linear regression setting, where the correspondences between the observations and the linear functionals are unknown. The associated maximum likelihood…

Information Theory · Computer Science 2020-09-15 Liangzu Peng , Manolis C. Tsakiris

For high-dimensional sparse parameter estimation problems, Log-Sum Penalty (LSP) regularization effectively reduces the sampling sizes in practice. However, it still lacks theoretical analysis to support the experience from previous…

Information Theory · Computer Science 2014-02-25 Zheng Pan , Guangdong Hou , Changshui Zhang

We are motivated by problems that arise in a number of applications such as Online Marketing and explosives detection, where the observations are usually modeled using Poisson statistics. We model each observation as a Poisson random…

Statistics Theory · Mathematics 2016-11-17 D. Motamedvaziri , M. H. Rohban , V. Saligrama

In this paper, we show that, under the assumption that $\|\e\|_2\leq \epsilon$, every $k-$sparse signal $\x\in \mathbb{R}^n$ can be stably ($\epsilon\neq0$) or exactly recovered ($\epsilon=0$) from $\y=\A\x+\e$ via $l_p-$mnimization with…

Information Theory · Computer Science 2014-06-18 Jinming Wen , Dongfang Li , Fumin Zhu

A regularized minimization model with $l_1$-norm penalty (RP) is introduced for training the autoencoders that belong to a class of two-layer neural networks. We show that the RP can act as an exact penalty model which shares the same…

Optimization and Control · Mathematics 2022-04-22 Wei Liu , Xin Liu , Xiaojun Chen

We consider the optimization problem of minimizing $\int_{\Omega}|\nabla u|^p dx$ with a constrain on the volume of $\{u>0\}$. We consider a penalization problem, and we prove that for small values of the penalization parameter, the…

Analysis of PDEs · Mathematics 2007-05-23 Julian Fernandez Bonder , Sandra Martinez , Noemi Wolanski

For optimization problems with nonlinear constraints, linearly constrained Lagrangian (LCL) methods sequentially minimize a Lagrangian function subject to linearized constraints. These methods converge rapidly near a solution but may not be…

Optimization and Control · Mathematics 2007-05-23 Michael P. Friedlander , Michael A Saunders

We investigate the computational complexity of min-max optimization under coupled constraints. The work of Daskalakis, Skoulakis, and Zampetakis [DSZ21] was the first to study min-max optimization through the lens of computational…

Computer Science and Game Theory · Computer Science 2026-05-28 Martino Bernasconi , Matteo Castiglioni , Andrea Celli , Gabriele Farina

Two important goals of high-dimensional modeling are prediction and variable selection. In this article, we consider regularization with combined $L_1$ and concave penalties, and study the sampling properties of the global optimum of the…

Methodology · Statistics 2016-05-12 Yingying Fan , Jinchi Lv

The l1/l2 ratio regularization function has shown good performance for retrieving sparse signals in a number of recent works, in the context of blind deconvolution. Indeed, it benefits from a scale invariance property much desirable in the…

Optimization and Control · Mathematics 2014-11-11 Audrey Repetti , Mai Quyen Pham , Laurent Duval , Emilie Chouzenoux , Jean-Christophe Pesquet

We consider robust discrete minimization problems where uncertainty is defined by a convex set in the objective. We show how an integrality gap verifier for the linear programming relaxation of the non-robust version of the problem can be…

Data Structures and Algorithms · Computer Science 2019-07-17 Khaled Elbassioni

Sparse and convolutional constraints form a natural prior for many optimization problems that arise from physical processes. Detecting motifs in speech and musical passages, super-resolving images, compressing videos, and reconstructing…

Computer Vision and Pattern Recognition · Computer Science 2014-06-11 Hilton Bristow , Simon Lucey

In this paper we prove that the shape optimization problem $$\min\left\{\lambda_k(\Omega):\ \Omega\subset\R^d,\ \Omega\ \hbox{open},\ P(\Omega)=1,\ |\Omega|<+\infty\right\},$$ has a solution for any $k\in\N$ and dimension $d$. Moreover,…

Analysis of PDEs · Mathematics 2013-10-01 Guido De Philippis , Bozhidar Velichkov

In this paper, we study the minimizing problem: $$ S_{p,1,\alpha,\mu}:= \inf_{u\in W^{1,p}(\mathbb{R}^{N})\setminus\{0\}} \frac{ \int_{\mathbb{R}^{N}}|\nabla u|^{p}\mathrm{d}x - \mu \int_{\mathbb{R}^{N}} \frac{|u|^{p}}{|x|^{p}} \mathrm{d}x}…

Analysis of PDEs · Mathematics 2018-05-29 Yu Su , Haibo Chen

We study the minimum number of constraints needed to formulate random instances of the maximum stable set problem via linear programs (LPs), in two distinct models. In the uniform model, the constraints of the LP are not allowed to depend…

Computational Complexity · Computer Science 2016-10-26 Gábor Braun , Samuel Fiorini , Sebastian Pokutta

Nowadays, l1 penalized likelihood has absorbed a high amount of consideration due to its simplicity and well developed theoretical properties. This method is known as a reliable method in order to apply in a broad range of applications…

Methodology · Statistics 2015-06-12 Hamed Haselimashhadi

Functions of interest are often smooth and sparse in some sense, and both priors should be taken into account when interpolating sampled data. Classical linear interpolation methods are effective under strong regularity assumptions, but…

Functional Analysis · Mathematics 2015-03-27 Holger Rauhut , Rachel Ward

In this work we study weighted total least squares problems on infinite dimensional spaces. We show that in most cases this problem does not admit a solution (except in the trivial case) and then, we consider a regularization on the…

Functional Analysis · Mathematics 2021-05-26 Maximiliano Contino , Guillermina Fongi , Alejandra Maestripieri , Santiago Muro

We provide theoretical analysis of the statistical and computational properties of penalized $M$-estimators that can be formulated as the solution to a possibly nonconvex optimization problem. Many important estimators fall in this…

Machine Learning · Statistics 2015-01-28 Zhaoran Wang , Han Liu , Tong Zhang

In compressed sensing, the l0-norm minimization of sparse signal reconstruction is NP-hard. Recent work shows that compared with the best convex relaxation (l1-norm), nonconvex penalties can better approximate the l0-norm and can…

Signal Processing · Electrical Eng. & Systems 2018-05-03 Hao Wang , Zhanglei Shi , Chi-Sing Leung , Hing Cheung So
‹ Prev 1 8 9 10 Next ›