中文
相关论文

相关论文: Multi-stage Convex Relaxation for Feature Selectio…

200 篇论文

Convex optimization problems arising in applications often have favorable objective functions and complicated constraints, thereby precluding first-order methods from being immediately applicable. We describe an approach that exchanges the…

The goal of this paper is to survey the properties of the eigenvalue relaxation for least squares binary problems. This relaxation is a convex program which is obtained as the Lagrangian dual of the original problem with an implicit compact…

统计方法学 · 统计学 2009-02-10 Stephane Chretien , Franck Corset

Multitask learning can be effective when features useful in one task are also useful for other tasks, and the group lasso is a standard method for selecting a common subset of features. In this paper, we are interested in a less restrictive…

机器学习 · 计算机科学 2013-11-25 Nikhil Rao , Christopher Cox , Robert Nowak , Timothy Rogers

We present a convex relaxation-based algorithm for large-scale general phase retrieval problems. General phase retrieval problems include i.a. the estimation of the phase of the optical field in the pupil plane based on intensity…

最优化与控制 · 数学 2018-08-15 Reinier Doelman , H. Thao Nguyen , Michel Verhaegen

We apply classical and Bayesian lasso regularizations to a family of models with the presence of mixture and process variables. We analyse the performance of these estimates with respect to ordinary least squares estimators by a simulation…

This paper investigates projection-free algorithms for stochastic constrained multi-level optimization. In this context, the objective function is a nested composition of several smooth functions, and the decision set is closed and convex.…

最优化与控制 · 数学 2024-06-07 Wei Jiang , Sifan Yang , Wenhao Yang , Yibo Wang , Yuanyu Wan , Lijun Zhang

We consider the problem of recovering elements of a low-dimensional model from under-determined linear measurements. To perform recovery, we consider the minimization of a convex regularizer subject to a data fit constraint. Given a model,…

信号处理 · 电气工程与系统科学 2024-04-22 Yann Traonmilin , Rémi Gribonval , Samuel Vaiter

The goal of supervised feature selection is to find a subset of input features that are responsible for predicting output values. The least absolute shrinkage and selection operator (Lasso) allows computationally efficient feature selection…

机器学习 · 统计学 2019-01-07 Makoto Yamada , Wittawat Jitkrittum , Leonid Sigal , Eric P. Xing , Masashi Sugiyama

In this paper, we propose a novel variable selection approach in the framework of multivariate linear models taking into account the dependence that may exist between the responses. It consists in estimating beforehand the covariance matrix…

Sparse regression is frequently employed in diverse scientific settings as a feature selection method. A pervasive aspect of scientific data that hampers both feature selection and estimation is the presence of strong correlations between…

统计方法学 · 统计学 2021-03-25 Ankit Kumar , Sharmodeep Bhattacharyya , Kristofer Bouchard

We study the finite convergence of iterative methods for solving convex feasibility problems. Our key assumptions are that the interior of the solution set is nonempty and that certain overrelaxation parameters converge to zero, but with a…

最优化与控制 · 数学 2021-07-13 Victor I. Kolobov , Simeon Reich , Rafał Zalas

We consider the problem of minimizing a sum of several convex non-smooth functions. We introduce a new algorithm called the selective linearization method, which iteratively linearizes all but one of the functions and employs simple…

最优化与控制 · 数学 2016-08-16 Yu Du , Xiaodong Lin , Andrzej Ruszczynski

In this work, we propose a method for determining a non-uniform sampling scheme for multi-dimensional signals by solving a convex optimization problem reminiscent of the sensor selection problem. The resulting sampling scheme minimizes the…

统计方法学 · 统计学 2017-07-12 Johan Swärd , Filip Elvander , Andreas Jakobsson

In this paper, we study the effect of different regularizers and their implications in high dimensional image classification and sparse linear unmixing. Although kernelization or sparse methods are globally accepted solutions for processing…

机器学习 · 统计学 2016-11-03 Devis Tuia , Remi Flamary , Michel Barlaud

Feature selection is an important data preprocessing in data mining and machine learning which can be used to reduce the feature dimension without deteriorating model's performance. Since obtaining annotated data is laborious or even…

机器学习 · 计算机科学 2022-04-08 Zhenzhen Sun , Yuanlong Yu

This article proposes a biconvex modification to convex biclustering in order to improve its performance in high-dimensional settings. In contrast to heuristics that discard a subset of noisy features a priori, our method jointly learns and…

机器学习 · 统计学 2026-04-13 Sam Rosen , Eric C. Chi , Jason Xu

The lasso has become an important practical tool for high dimensional regression as well as the object of intense theoretical investigation. But despite the availability of efficient algorithms, the lasso remains computationally demanding…

统计理论 · 数学 2009-11-23 Christopher Genovese , Jiashun Jin , Larry Wasserman

Convex optimization problems with staged structure appear in several contexts, including optimal control, verification of deep neural networks, and isotonic regression. Off-the-shelf solvers can solve these problems but may scale poorly. We…

最优化与控制 · 数学 2020-10-28 Rudy Bunel , Oliver Hinder , Srinadh Bhojanapalli , Krishnamurthy , Dvijotham

We aim to find a solution $\bm{x}\in\mathbb{C}^n$ to a system of quadratic equations of the form $b_i=\lvert\bm{a}_i^*\bm{x}\rvert^2$, $i=1,2,\ldots,m$, e.g., the well-known NP-hard phase retrieval problem. As opposed to recently proposed…

最优化与控制 · 数学 2019-05-28 Ji Li , Jian-Feng Cai , Hongkai Zhao

This paper deals with the problem of robust matrix completion -- retrieving a low-rank matrix and a sparse matrix from the compressed counterpart of their superposition. Though seemingly not an unresolved issue, we point out that the…

信息论 · 计算机科学 2024-10-10 Yinjian Wang