English
Related papers

Related papers: Conditioning of linear systems arising from penalt…

200 papers

Low-rank methods for semidefinite programming (SDP) have gained a lot of interest recently, especially in machine learning applications. Their analysis often involves determinant-based or Schatten-norm penalties, which are hard to implement…

Optimization and Control · Mathematics 2021-12-07 Mikhail Krechetov , Jakub Marecek , Yury Maximov , Martin Takac

In this paper, we treat the corner singularity expansion and its convergence result regarding the penalized system obtained by eliminating the pressure variable in the Stokes problem of incompressible flow. The penalized problem is a kind…

Analysis of PDEs · Mathematics 2024-09-11 Hyung Jun Choi , Seonghak Kim , Youngwoo Koh

Comparative Judgement is an assessment method where item ratings are estimated based on rankings of subsets of the items. These rankings are typically pairwise, with ratings taken to be the estimated parameters from fitting a Bradley-Terry…

Methodology · Statistics 2024-05-22 Ian Hamilton , Nick Tawn

The eigenfunctions of the Laplace Beltrami operator (Manifold Harmonics) define a function basis that can be used in spectral analysis on manifolds. In [21] the authors recast the problem as an orthogonality constrained optimization problem…

Numerical Analysis · Mathematics 2018-04-23 Martin Huska , Damiana Lazzaro , Serena Morigi

A non-conventional shape optimization approach is introduced to address the identification of an obstacle immersed in a fluid described by the Stokes equation within a larger bounded domain, relying on boundary measurements on the…

Optimization and Control · Mathematics 2024-03-19 Julius Fergy Tiongson Rabago , Lekbir Afraites , Hirofumi Notsu

The paper introduces a penalized matrix estimation procedure aiming at solutions which are sparse and low-rank at the same time. Such structures arise in the context of social networks or protein interactions where underlying graphs have…

Data Structures and Algorithms · Computer Science 2012-07-03 Emile Richard , Pierre-Andre Savalle , Nicolas Vayatis

Penalized estimation principle is fundamental to high-dimensional problems. In the literature, it has been extensively and successfully applied to various models with only structural parameters. As a contrast, in this paper, we apply this…

Statistics Theory · Mathematics 2017-08-03 Jianqing Fan , Runlong Tang , Xiaofeng Shi

For high-dimensional sparse parameter estimation problems, Log-Sum Penalty (LSP) regularization effectively reduces the sampling sizes in practice. However, it still lacks theoretical analysis to support the experience from previous…

Information Theory · Computer Science 2014-02-25 Zheng Pan , Guangdong Hou , Changshui Zhang

We consider the group lasso penalty for the linear model. We note that the standard algorithm for solving the problem assumes that the model matrices in each group are orthonormal. Here we consider a more general penalty that blends the…

Statistics Theory · Mathematics 2010-01-06 J. Friedman , T. Hastie , R. Tibshirani

In this paper we study the worst-case complexity of an inexact Augmented Lagrangian method for nonconvex constrained problems. Assuming that the penalty parameters are bounded, we prove a complexity bound of $\mathcal{O}(|\log(\epsilon)|)$…

Optimization and Control · Mathematics 2021-05-25 Geovani N. Grapiglia , Ya-xiang Yuan

The magnetostatic field distribution in a nonlinear medium amounts to the unique minimizer of the magnetic coenergy over all fields that can be generated by the same current. This is a nonlinear saddlepoint problem whose numerical solution…

Numerical Analysis · Mathematics 2024-03-28 Herbert Egger , Felix Engertsberger , Klaus Roppert

We investigate the properties of certain elliptic systems leading, a~priori, to solutions that belong to the space of Radon measures. We show that if the problem is equipped with a so-called asymptotic Uhlenbeck structure, then the solution…

Analysis of PDEs · Mathematics 2017-05-24 Lisa Beck , Miroslav Bulíček , Josef Málek , Endre Süli

In this work, we consider a constrained convex problem with linear inequalities and provide an inexact penalty re-formulation of the problem. The novelty is in the choice of the penalty functions, which are smooth and can induce a non-zero…

Optimization and Control · Mathematics 2020-05-04 Tatiana Tatarenko , Angelia Nedich

In this work, we study first-order algorithms for solving Bilevel Optimization (BO) where the objective functions are smooth but possibly nonconvex in both levels and the variables are restricted to closed convex sets. As a first step, we…

Optimization and Control · Mathematics 2024-02-13 Jeongyeol Kwon , Dohyun Kwon , Stephen Wright , Robert Nowak

Semidefinite programs (SDPs) -- some of the most useful and versatile optimization problems of the last few decades -- are often pathological: the optimal values of the primal and dual problems may differ and may not be attained. Such SDPs…

Optimization and Control · Mathematics 2019-10-23 Gabor Pataki

Penalized regression methods aim to retrieve reliable predictors among a large set of putative ones from a limited amount of measurements. In particular, penalized regression with singular penalty functions is important for sparse…

Information Theory · Computer Science 2015-11-26 Mohammad Ramezanali , Partha P. Mitra , Anirvan M. Sengupta

We consider the stable approximation of sparse solutions to non-linear operator equations by means of Tikhonov regularization with a subquadratic penalty term. Imposing certain assumptions, which for a linear operator are equivalent to the…

Functional Analysis · Mathematics 2009-12-06 Markus Grasmair , Markus Haltmeier , Otmar Scherzer

In this work, we consider a class of linear ill-posed problems with operators that map from the sequence space $ \ell_r $ ($r \ge 1$) into a Banach space and in addition satisfy a conditional stability estimate in the scale of sequence…

Numerical Analysis · Mathematics 2025-10-21 Robert Plato , Bernd Hofmann

In this paper, we study the following Schr\"odinger-Poisson system: $$ \left\{\aligned&-\Delta u+V_\lambda(x)u+K(x)\phi u=f(x,u)&\quad\text{in }\bbr^3,\\ &-\Delta\phi=K(x)u^2&\quad\text{in }\bbr^3,\\…

Analysis of PDEs · Mathematics 2014-12-18 Juntao Sun , Tsung-fang Wu , Yuanze Wu

We study the problem of estimating high-dimensional regression models regularized by a structured sparsity-inducing penalty that encodes prior structural information on either the input or output variables. We consider two widely adopted…

Machine Learning · Statistics 2012-07-02 Xi Chen , Qihang Lin , Seyoung Kim , Jaime G. Carbonell , Eric P. Xing