English
Related papers

Related papers: A Block Coordinate Descent Method for Sensor Netwo…

200 papers

We study the community detection and recovery problem in partially-labeled stochastic block models (SBM). We develop a fast linearized message-passing algorithm to reconstruct labels for SBM (with $n$ nodes, $k$ blocks, $p,q$ intra and…

Statistics Theory · Mathematics 2016-03-23 T. Tony Cai , Tengyuan Liang , Alexander Rakhlin

This paper studies the problem of determining the sensor locations in a large sensor network using relative distance (range) measurements only. Our work follows from a seminal paper by Khan et al. [1] where a distributed algorithm, known as…

Information Theory · Computer Science 2013-01-15 Yingfei Diao , Zhiyun Lin , Minyue Fu , Huanshui Zhang

In this paper we propose a distributed version of a randomized block-coordinate descent method for minimizing the sum of a partially separable smooth convex function and a fully separable non-smooth convex function. Under the assumption of…

Optimization and Control · Mathematics 2015-11-23 Ion Necoara , Dragos Clipici

We propose a class of convex relaxations to solve the sensor network localization problem, based on a maximum likelihood (ML) formulation. This class, as well as the tightness of the relaxations, depends on the noise probability density…

Information Theory · Computer Science 2017-09-18 Andrea Simonetto , Geert Leus

Optimization problems with rank constraints arise in many applications, including matrix regression, structured PCA, matrix completion and matrix decomposition problems. An attractive heuristic for solving such problems is to factorize the…

Statistics Theory · Mathematics 2015-09-11 Yudong Chen , Martin J. Wainwright

Consider a semidefinite program (SDP) involving an $n\times n$ positive semidefinite matrix $X$. The Burer-Monteiro method uses the substitution $X=Y Y^T$ to obtain a nonconvex optimization problem in terms of an $n\times p$ matrix $Y$.…

Optimization and Control · Mathematics 2020-03-03 Diego Cifuentes

We consider semidefinite programs (SDPs) with equality constraints. The variable to be optimized is a positive semidefinite matrix $X$ of size $n$. Following the Burer--Monteiro approach, we optimize a factor $Y$ of size $n \times p$…

Optimization and Control · Mathematics 2019-05-30 Nicolas Boumal , Vladislav Voroninski , Afonso S. Bandeira

We demonstrate that distributed block coordinate descent can quickly solve kernel regression and classification problems with millions of data points. Armed with this capability, we conduct a thorough comparison between the full kernel, the…

Machine Learning · Computer Science 2016-02-18 Stephen Tu , Rebecca Roelofs , Shivaram Venkataraman , Benjamin Recht

In this paper, we propose a novel model to recover a low-rank tensor by simultaneously performing double nuclear norm regularized low-rank matrix factorizations to the all-mode matricizations of the underlying tensor. An block successive…

Computer Vision and Pattern Recognition · Computer Science 2020-05-07 Haijin Zeng , Xiaozhen Xie , Jifeng Ning

Tensor optimization is crucial to massive machine learning and signal processing tasks. In this paper, we consider tensor optimization with a convex and well-conditioned objective function and reformulate it into a nonconvex optimization…

Optimization and Control · Mathematics 2022-02-18 Shuang Li , Qiuwei Li

The problem of minimizing a sum of local convex objective functions over a networked system captures many important applications and has received much attention in the distributed optimization field. Most of existing work focuses on…

Optimization and Control · Mathematics 2019-01-09 Fatemeh Mansoori , Ermin Wei

Distribution network reconfiguration (DNR) is a tool used by operators to balance line load flows and mitigate losses. As distributed generation and flexible load adoption increases, the impact of DNR on the security, efficiency, and…

Given a symmetric nonnegative matrix $A$, symmetric nonnegative matrix factorization (symNMF) is the problem of finding a nonnegative matrix $H$, usually with much fewer columns than $A$, such that $A \approx HH^T$. SymNMF can be used for…

Numerical Analysis · Computer Science 2016-10-07 Arnaud Vandaele , Nicolas Gillis , Qi Lei , Kai Zhong , Inderjit Dhillon

We develop a new consensus-based distributed algorithm for solving learning problems with feature partitioning and non-smooth convex objective functions. Such learning problems are not separable, i.e., the associated objective functions…

Signal Processing · Electrical Eng. & Systems 2022-08-25 Cristiano Gratton , Naveen K. D. Venkategowda , Reza Arablouei , Stefan Werner

In this paper, we study the low-rank matrix minimization problem, where the loss function is convex but nonsmooth and the penalty term is defined by the cardinality function. We first introduce an exact continuous relaxation, that is, both…

Optimization and Control · Mathematics 2024-08-20 Quan Yu , Xinzhen Zhang

Affine matrix rank minimization problem is a fundamental problem with a lot of important applications in many fields. It is well known that this problem is combinatorial and NP-hard in general. In this paper, a continuous promoting low rank…

Optimization and Control · Mathematics 2017-05-02 Angang Cui , Jigen Peng , Haiyang Li , Chengyi Zhang , Yongchao Yu

Originally developed for imputing missing entries in low rank, or approximately low rank matrices, matrix completion has proven widely effective in many problems where there is no reason to assume low-dimensional linear structure in the…

Statistics Theory · Mathematics 2021-05-06 Yunhua Xiang , Tianyu Zhang , Xu Wang , Ali Shojaie , Noah Simon

Distributed training of $l_1$ regularized classifiers has received great attention recently. Most existing methods approach this problem by taking steps obtained from approximating the objective by a quadratic approximation that is…

Machine Learning · Computer Science 2016-11-25 Dhruv Mahajan , S. Sathiya Keerthi , S. Sundararajan

Low-rank matrix is desired in many machine learning and computer vision problems. Most of the recent studies use the nuclear norm as a convex surrogate of the rank operator. However, all singular values are simply added together by the…

Computer Vision and Pattern Recognition · Computer Science 2015-07-07 Zhao Kang , Chong Peng , Jie Cheng , Qiang Chen

We propose a new method based on sparse optimal discriminant clustering (SODC), incorporating a penalty term into the scoring matrix based on convex clustering. With the addition of this penalty term, it is expected to improve the accuracy…

Methodology · Statistics 2025-10-15 Mayu Hiraishi , Kensuke Tanioka , Hiroshi Yadohisa
‹ Prev 1 4 5 6 7 8 10 Next ›