English
Related papers

Related papers: A Max-Norm Constrained Minimization Approach to 1-…

200 papers

We consider the problem of completing a matrix with categorical-valued entries from partial observations. This is achieved by extending the formulation and theory of one-bit matrix completion. We recover a low-rank matrix $X$ by maximizing…

Numerical Analysis · Computer Science 2015-07-03 Yang Cao , Yao Xie

We consider recovery of low-rank matrices from noisy data by shrinkage of singular values, in which a single, univariate nonlinearity is applied to each of the empirical singular values. We adopt an asymptotic framework, in which the matrix…

Statistics Theory · Mathematics 2016-05-17 Matan Gavish , David L. Donoho

We consider high-dimensional measurement errors with high-frequency data. Our objective is on recovering the high-dimensional cross-sectional covariance matrix of the random errors with optimality. In this problem, not all components of the…

Statistics Theory · Mathematics 2024-04-03 Jinyuan Chang , Qiao Hu , Cheng Liu , Cheng Yong Tang

We consider the multivariate response regression problem with a regression coefficient matrix of low, unknown rank. In this setting, we analyze a new criterion for selecting the optimal reduced rank. This criterion differs notably from the…

Methodology · Statistics 2018-10-30 Xin Bing , Marten Wegkamp

We consider the problems of compressed sensing and optimal denoising for signals $\mathbf{x_0}\in\mathbb{R}^N$ that are monotone, i.e., $\mathbf{x_0}(i+1) \geq \mathbf{x_0}(i)$, and sparsely varying, i.e., $\mathbf{x_0}(i+1) >…

Statistics Theory · Mathematics 2017-01-03 Eftychios A. Pnevmatikakis

We consider the problem of minimizing a sum of $n$ functions over a convex parameter set $\mathcal{C} \subset \mathbb{R}^p$ where $n\gg p\gg 1$. In this regime, algorithms which utilize sub-sampling techniques are known to be effective. In…

Machine Learning · Statistics 2015-12-03 Murat A. Erdogdu , Andrea Montanari

This letter proposes to estimate low-rank matrices by formulating a convex optimization problem with non-convex regularization. We employ parameterized non-convex penalty functions to estimate the non-zero singular values more accurately…

Computer Vision and Pattern Recognition · Computer Science 2016-04-14 Ankit Parekh , Ivan W. Selesnick

Missing values arise in most real-world data sets due to the aggregation of multiple sources and intrinsically missing information (sensor failure, unanswered questions in surveys...). In fact, the very nature of missing values usually…

Machine Learning · Statistics 2022-02-04 Alexis Ayme , Claire Boyer , Aymeric Dieuleveut , Erwan Scornet

Majorization-minimization algorithms consist of successively minimizing a sequence of upper bounds of the objective function. These upper bounds are tight at the current estimate, and each iteration monotonically drives the objective…

Optimization and Control · Mathematics 2015-02-03 Julien Mairal

The maximum-entropy sampling problem is a fundamental and challenging combinatorial-optimization problem, with application in spatial statistics. It asks to find a maximum-determinant order-$s$ principal submatrix of an order-$n$ covariance…

Optimization and Control · Mathematics 2020-02-03 Zhongzhu Chen , Marcia Fampa , Amélie Lambert , Jon Lee

Precision matrix is of significant importance in a wide range of applications in multivariate analysis. This paper considers adaptive minimax estimation of sparse precision matrices in the high dimensional setting. Optimal rates of…

Statistics Theory · Mathematics 2012-12-13 T. Tony Cai , Weidong Liu , Harrison H. Zhou

The task of estimating a matrix given a sample of observed entries is known as the \emph{matrix completion problem}. Most works on matrix completion have focused on recovering an unknown real-valued low-rank matrix from a random sample of…

Statistics Theory · Mathematics 2014-08-27 Olga Klopp , Jean Lafond , Eric Moulines , Joseph Salmon

In recent years, there has been a growing interest in mathematical models leading to the minimization, in a symmetric matrix space, of a Bregman divergence coupled with a regularization term. We address problems of this type within a…

Optimization and Control · Mathematics 2022-06-10 A. Benfenati , E. Chouzenoux , J. -C. Pesquet

Max-norm regularizer has been extensively studied in the last decade as it promotes an effective low-rank estimation for the underlying data. However, such max-norm regularized problems are typically formulated and solved in a batch manner,…

Machine Learning · Statistics 2016-05-17 Jie Shen , Huan Xu , Ping Li

In this work, we develop a new complexity metric for an important class of low-rank matrix optimization problems in both symmetric and asymmetric cases, where the metric aims to quantify the complexity of the nonconvex optimization…

Optimization and Control · Mathematics 2023-07-24 Haixiang Zhang , Baturalp Yalcin , Javad Lavaei , Somayeh Sojoudi

The compressive sensing (CS) and 1-bit CS demonstrate superior efficiency in signal acquisition and resource conservation, while 1-bit CS achieves maximum resource efficiency through sign-only measurements. With the emergence of massive…

Methodology · Statistics 2025-05-06 Erbo Li , Qi Qin , Yifan Sun , Liping Zhu

An unknown $m$ by $n$ matrix $X_0$ is to be estimated from noisy measurements $Y=X_0+Z$, where the noise matrix $Z$ has i.i.d. Gaussian entries. A popular matrix denoising scheme solves the nuclear norm penalization problem $\operatorname…

Statistics Theory · Mathematics 2014-11-05 David Donoho , Matan Gavish

We study a class of statistical inverse problems with non-linear pointwise operators motivated by concrete statistical applications. A two-step procedure is proposed, where the first step smoothes the data and inverts the non-linearity.…

Statistics Theory · Mathematics 2016-11-08 Kolyan Ray , Johannes Schmidt-Hieber

In this paper, we propose a new max-margin based discriminative feature learning method. Specifically, we aim at learning a low-dimensional feature representation, so as to maximize the global margin of the data and make the samples from…

Machine Learning · Computer Science 2017-04-04 Changsheng Li , Qingshan Liu , Weishan Dong , Xin Zhang , Lin Yang

We consider the problem of noiseless and noisy low-rank tensor completion from a set of random linear measurements. In our derivations, we assume that the entries of the tensor belong to a finite field of arbitrary size and that…

Information Theory · Computer Science 2011-04-05 Amin Emad , Olgica Milenkovic
‹ Prev 1 8 9 10 Next ›