中文
相关论文

相关论文: A Convex-Nonconvex Framework for Enhancing Minimiz…

200 篇论文

Within the statistical and machine learning literature, regularization techniques are often used to construct sparse (predictive) models. Most regularization strategies only work for data where all predictors are treated identically, such…

统计计算 · 统计学 2020-12-16 Sander Devriendt , Katrien Antonio , Tom Reynkens , Roel Verbelen

In this paper we study nonconvex penalization using Bernstein functions. Since the Bernstein function is concave and nonsmooth at the origin, it can induce a class of nonconvex functions for high-dimensional sparse estimation problems. We…

机器学习 · 统计学 2013-12-18 Zhihua Zhang

This work studies the problem of sparse signal recovery with automatic grouping of variables. To this end, we investigate sorted nonsmooth penalties as a regularization approach for generalized linear models. We focus on a family of sorted…

最优化与控制 · 数学 2025-06-19 Anne Gagneux , Mathurin Massias , Emmanuel Soubies

In this paper we present a general convex optimization approach for solving high-dimensional multiple response tensor regression problems under low-dimensional structural assumptions. We consider using convex and weakly decomposable…

统计理论 · 数学 2017-04-17 Garvesh Raskutti , Ming Yuan , Han Chen

This paper presents a new parameter free partially penalized immersed finite element method and convergence analysis for solving second order elliptic interface problems. A lifting operator is introduced on interface edges to ensure the…

数值分析 · 数学 2022-02-23 Haifeng Ji , Feng Wang , Jinru Chen , Zhilin Li

In this paper, we propose an unifying view of several recently proposed structured sparsity-inducing norms. We consider the situation of a model simultaneously (a) penalized by a set- function de ned on the support of the unknown parameter…

机器学习 · 统计学 2012-05-08 Guillaume Obozinski , Francis Bach

A novel optimization method is proposed to minimize a convex function subject to bilinear matrix inequality (BMI) constraints. The key idea is to decompose the bilinear mapping as a difference between two positive semidefinite convex…

最优化与控制 · 数学 2011-09-19 Quoc Tran Dinh , Suat Gumussoy , Wim Michiels , Moritz Diehl

Non-convex optimization is ubiquitous in machine learning. Majorization-Minimization (MM) is a powerful iterative procedure for optimizing non-convex functions that works by optimizing a sequence of bounds on the function. In MM, the bound…

计算机视觉与模式识别 · 计算机科学 2019-05-20 Sobhan Naderi Parizi , Kun He , Reza Aghajani , Stan Sclaroff , Pedro Felzenszwalb

We introduce a new weakly-convex penalty function for signals with a group behavior. The penalty promotes signals with a few number of active groups, where within each group, only a few high magnitude coefficients are active. We derive the…

数值分析 · 计算机科学 2017-08-02 İlker Bayram , Savaşkan Bulek

We provide novel theoretical results regarding local optima of regularized $M$-estimators, allowing for nonconvexity in both loss and penalty functions. Under restricted strong convexity on the loss and suitable regularity conditions on the…

统计理论 · 数学 2015-01-05 Po-Ling Loh , Martin J. Wainwright

Feature selection in learning to rank has recently emerged as a crucial issue. Whereas several preprocessing approaches have been proposed, only a few works have been focused on integrating the feature selection into the learning process.…

机器学习 · 计算机科学 2015-07-03 Léa Laporte , Rémi Flamary , Stephane Canu , Sébastien Déjean , Josiane Mothe

In this paper, we consider nonconvex optimization problems with nonlinear equality constraints. We assume that the objective function and the functional constraints are locally smooth. To solve this problem, we introduce a linearized…

最优化与控制 · 数学 2025-03-21 Lahcen El Bourkhissi , Ion Necoara

As observed by Auderset et al. (2005) and Wiesel (2012), viewing covariance matrices as elements of a Riemannian manifold and using the concept of geodesic convexity provide useful tools for studying M-estimators of multivariate scatter. In…

统计方法学 · 统计学 2016-07-27 Lutz Duembgen , David E. Tyler

In this paper, we study properties of penalized and structured M-estimators of multivariate scatter, based on geodesically convex but not necessarily smooth penalty functions. Existence and uniqueness conditions for these penalized and…

统计方法学 · 统计学 2026-03-31 Mengxi Yi , David Tyler

Translating machine learning algorithms into clinical applications requires addressing challenges related to interpretability, such as accounting for the effect of confounding variables (or metadata). Confounding variables affect the…

机器学习 · 计算机科学 2022-07-12 Anthony Vento , Qingyu Zhao , Robert Paul , Kilian M. Pohl , Ehsan Adeli

In high-dimensional model selection problems, penalized simple least-square approaches have been extensively used. This paper addresses the question of both robustness and efficiency of penalized model selection methods, and proposes a…

统计方法学 · 统计学 2011-07-06 Jelena Bradic , Jianqing Fan , Weiwei Wang

Fast accumulation of large amounts of complex data has created a need for more sophisticated statistical methodologies to discover interesting patterns and better extract information from these data. The large scale of the data often…

统计方法学 · 统计学 2014-09-09 Yuliya Marchetti , Qing Zhou

We present a convex mixed-integer programming formulation for non-rigid shape matching. To this end, we propose a novel shape deformation model based on an efficient low-dimensional discrete model, so that finding a globally optimal…

计算机视觉与模式识别 · 计算机科学 2020-03-02 Florian Bernard , Zeeshan Khan Suri , Christian Theobalt

Many scientific and engineering applications feature nonsmooth convex minimization problems over convex sets. In this paper, we address an important instance of this broad class where we assume that the nonsmooth objective is equipped with…

最优化与控制 · 数学 2014-06-23 Quoc Tran Dinh , Anastasios Kyrillidis , Volkan Cevher

In a plethora of applications dealing with inverse problems, e.g. in image processing, social networks, compressive sensing, biological data processing etc., the signal of interest is known to be structured in several ways at the same time.…

计算机视觉与模式识别 · 计算机科学 2016-08-24 Paris Giampouras , Konstantinos Themelis , Athanasios Rontogiannis , Konstantinos Koutroumbas