English
Related papers

Related papers: Efficient Algorithms for Sparse Moment Problems wi…

200 papers

We present a novel binary convex reformulation of the sparse regression problem that constitutes a new duality perspective. We devise a new cutting plane method and provide evidence that it can solve to provable optimality the sparse…

Optimization and Control · Mathematics 2017-09-29 Dimitris Bertsimas , Bart Van Parys

Sparse coding is a class of unsupervised methods for learning a sparse representation of the input data in the form of a linear combination of a dictionary and a sparse code. This learning framework has led to state-of-the-art results in…

Machine Learning · Computer Science 2021-09-01 Ye Xue , Vincent Lau , Songfu Cai

We study the efficient learnability of high-dimensional Gaussian mixtures in the outlier-robust setting, where a small constant fraction of the data is adversarially corrupted. We resolve the polynomial learnability of this problem when the…

Data Structures and Algorithms · Computer Science 2020-05-14 Ilias Diakonikolas , Samuel B. Hopkins , Daniel Kane , Sushrut Karmalkar

Efficiently learning mixture of Gaussians is a fundamental problem in statistics and learning theory. Given samples coming from a random one out of k Gaussian distributions in Rn, the learning problem asks to estimate the means and the…

Machine Learning · Computer Science 2015-03-11 Rong Ge , Qingqing Huang , Sham M. Kakade

In applications such as rank aggregation, mixture models for permutations are frequently used when the population exhibits heterogeneity. In this work, we study the widely used Mallows mixture model. In the high-dimensional setting, we…

Statistics Theory · Mathematics 2022-03-07 Cheng Mao , Yihong Wu

Minimizing a convex function of a measure with a sparsity-inducing penalty is a typical problem arising, e.g., in sparse spikes deconvolution or two-layer neural networks training. We show that this problem can be solved by discretizing the…

Optimization and Control · Mathematics 2020-11-04 Lenaic Chizat

We investigate a class of moment problems, namely recovering a measure supported on the graph of a function from partial knowledge of its moments, as for instance in some problems of optimal transport or density estimation. We show that the…

Optimization and Control · Mathematics 2021-06-24 Didier Henrion , Jean Lasserre

We consider the problem of reconstructing an infinite set of sparse, finite-dimensional vectors, that share a common sparsity pattern, from incomplete measurements. This is in contrast to the work [17], where the single vector signal can be…

Optimization and Control · Mathematics 2021-11-29 Nick Dexter , Hoang Tran , Clayton Webster

In many real-world problems, we are dealing with collections of high-dimensional data, such as images, videos, text and web documents, DNA microarray data, and more. Often, high-dimensional data lie close to low-dimensional structures…

Computer Vision and Pattern Recognition · Computer Science 2013-02-06 Ehsan Elhamifar , Rene Vidal

We propose a new fast algorithm to estimate any sparse generalized linear model with convex or non-convex separable penalties. Our algorithm is able to solve problems with millions of samples and features in seconds, by relying on…

We study the problem of learning a distribution from samples, when the underlying distribution is a mixture of product distributions over discrete domains. This problem is motivated by several practical applications such as crowd-sourcing,…

Machine Learning · Statistics 2014-05-20 Prateek Jain , Sewoong Oh

Changepoints are a very common feature of Big Data that arrive in the form of a data stream. In this paper, we study high-dimensional time series in which, at certain time points, the mean structure changes in a sparse subset of the…

Methodology · Statistics 2017-03-21 Tengyao Wang , Richard J. Samworth

The Method of Moments [Pea94] is one of the most widely used methods in statistics for parameter estimation, by means of solving the system of equations that match the population and estimated moments. However, in practice and especially…

Statistics Theory · Mathematics 2019-04-16 Yihong Wu , Pengkun Yang

We give a polynomial-time algorithm for learning high-dimensional halfspaces with margins in $d$-dimensional space to within desired TV distance when the ambient distribution is an unknown affine transformation of the $d$-fold product of an…

Machine Learning · Computer Science 2023-11-03 Xinyuan Cao , Santosh S. Vempala

The sparse regression problem, also known as best subset selection problem, can be cast as follows: Given a set $S$ of $n$ points in $\mathbb{R}^d$, a point $y\in \mathbb{R}^d$, and an integer $2 \leq k \leq d$, find an affine combination…

Data Structures and Algorithms · Computer Science 2020-01-01 Jean Cardinal , Aurélien Ooms

To model modern large-scale datasets, we need efficient algorithms to infer a set of $P$ unknown model parameters from $N$ noisy measurements. What are fundamental limits on the accuracy of parameter inference, given finite signal-to-noise…

Machine Learning · Statistics 2016-09-07 Madhu Advani , Surya Ganguli

We present an alternating least squares type numerical optimization scheme to estimate conditionally-independent mixture models in $\mathbb{R}^n$, without parameterizing the distributions. Following the method of moments, we tackle an…

Numerical Analysis · Mathematics 2023-08-09 Yifan Zhang , Joe Kileel

In this paper, we consider the mixture of sparse linear regressions model. Let ${\beta}^{(1)},\ldots,{\beta}^{(L)}\in\mathbb{C}^n$ be $ L $ unknown sparse parameter vectors with a total of $ K $ non-zero coefficients. Noisy linear…

Information Theory · Computer Science 2018-08-03 Dong Yin , Ramtin Pedarsani , Yudong Chen , Kannan Ramchandran

This paper studies the sparse identification problem of unknown sparse parameter vectors in stochastic dynamic systems. Firstly, a novel sparse identification algorithm is proposed, which can generate sparse estimates based on least squares…

Optimization and Control · Mathematics 2024-04-02 Ziming Wang , Xinghua Zhu

We consider the problem of finding a sparse solution for an underdetermined linear system of equations when the known parameters on both sides of the system are subject to perturbation. This problem is particularly relevant to…

Systems and Control · Computer Science 2016-06-16 Reza Arablouei