English
Related papers

Related papers: Simple and fast convex relaxation method for coope…

200 papers

We consider minimizing high-dimensional smooth nonconvex objectives using only noisy pairwise comparisons. Unlike classical zeroth-order methods limited by the ambient dimension $d$, we propose Noisy-Comparison Random Search (NCRS), a…

Optimization and Control · Mathematics 2026-01-30 Taha El Bakkali , Rayane Bouftini , Qiuyi Zhang , Omar Saadi

Federated learning is a communication-efficient training process that alternates between local training at the edge devices and averaging the updated local model at the central server. Nevertheless, it is impractical to achieve a perfect…

Machine Learning · Computer Science 2019-11-04 Fan Ang , Li Chen , Nan Zhao , Yunfei Chen , Weidong Wang , F. Richard Yu

Although many convex relaxations of clustering have been proposed in the past decade, current formulations remain restricted to spherical Gaussian or discriminative models and are susceptible to imbalanced clusters. To address these…

Machine Learning · Computer Science 2013-09-27 Hao Cheng , Xinhua Zhang , Dale Schuurmans

We consider the problem of estimating the states of weakly coupled linear systems from sampled measurements. We assume that the total capacity available to the sensors to transmit their samples to a network manager in charge of the…

Systems and Control · Computer Science 2016-10-25 Xudong Chen , M. -A. Belabbas , Tamer Basar

This paper studies 3-D distributed network localization using mixed types of local relative measurements. Each node holds a local coordinate frame without a common orientation and can only measure one type of information (relative position,…

Signal Processing · Electrical Eng. & Systems 2023-12-19 Xu Fang , Xiaolei Li , Lihua Xie

The problem of matrix sensing, or trace regression, is a problem wherein one wishes to estimate a low-rank matrix from linear measurements perturbed with noise. A number of existing works have studied both convex and nonconvex approaches to…

Statistics Theory · Mathematics 2025-06-26 Joshua Agterberg , René Vidal

This paper considers a large class of problems where we seek to recover a low rank matrix and/or sparse vector from some set of measurements. While methods based on convex relaxations suffer from a (possibly large) estimator bias, and other…

Machine Learning · Statistics 2021-09-28 April Sagan , John E. Mitchell

Signal estimation problems with smoothness and sparsity priors can be naturally modeled as quadratic optimization with $\ell_0$-"norm" constraints. Since such problems are non-convex and hard-to-solve, the standard approach is, instead, to…

Machine Learning · Statistics 2020-10-20 Alper Atamturk , Andres Gomez , Shaoning Han

An effective approach for energy conservation in wireless sensor networks is scheduling sleep intervals for extraneous nodes while the remaining nodes stay active to provide continuous service. For the sensor network to operate successfully…

Artificial Intelligence · Computer Science 2010-11-09 Seyed Hossein Khasteh , Saeid Bagheri Shouraki , Ali Akbar Kiaei

Cross-correlation is a popular signal processing technique used in numerous location tracking systems for obtaining reliable range information. However, its efficient design and practical implementation has not yet been achieved on mote…

Other Computer Science · Computer Science 2016-06-14 Prasant Misra , Wen Hu , Mingrui Yang , Marco Duarte , Sanjay Jha

This paper introduces a general multi-class approach to weakly supervised classification. Inferring the labels and learning the parameters of the model is usually done jointly through a block-coordinate descent algorithm such as…

Machine Learning · Computer Science 2012-07-03 Armand Joulin , Francis Bach

Seriation seeks to reconstruct a linear order between variables using unsorted, pairwise similarity information. It has direct applications in archeology and shotgun gene sequencing for example. We write seriation as an optimization problem…

Optimization and Control · Mathematics 2015-02-09 Fajwel Fogel , Rodolphe Jenatton , Francis Bach , Alexandre d'Aspremont

Finding efficient and provable methods to solve non-convex optimization problems is an outstanding challenge in machine learning and optimization theory. A popular approach used to tackle non-convex problems is to use convex relaxation…

Machine Learning · Statistics 2016-10-31 Mohammad Gheshlaghi Azar , Eva Dyer , Konrad Kording

This paper studies the problem of determining the sensor locations in a large sensor network using relative distance (range) measurements only. Our work follows from a seminal paper by Khan et al. [1] where a distributed algorithm, known as…

Information Theory · Computer Science 2013-01-15 Yingfei Diao , Zhiyun Lin , Minyue Fu , Huanshui Zhang

When training an estimator such as a neural network for tasks like image denoising, it is often preferred to train one estimator and apply it to all noise levels. The de facto training protocol to achieve this goal is to train the estimator…

Machine Learning · Computer Science 2020-07-20 Abhiram Gnansambandam , Stanley H. Chan

We provide a unifying framework for distributed convex optimization over time-varying networks, in the presence of constraints and uncertainty, features that are typically treated separately in the literature. We adopt a proximal…

Optimization and Control · Mathematics 2017-05-24 Kostas Margellos , Alessandro Falsone , Simone Garatti , Maria Prandini

We consider the problem of sensor localization in a wireless network in a multipath environment, where time and angle of arrival information are available at each sensor. We propose a distributed algorithm based on belief propagation, which…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-09-28 Mei Leng , Wee Peng Tay , Tony Q. S. Quek

This paper proposes a precise signal recovery method with multilayered non-convex regularization, enhancing sparsity/low-rankness for high-dimensional signals including images and videos. In optimization-based signal recovery, multilayered…

Signal Processing · Electrical Eng. & Systems 2024-09-24 Akari Katsuma , Seisuke Kyochi , Shunsuke Ono , Ivan Selesnick

In this work we study the problem of unconstrained convex-optimization in a fully distributed multi-agent setting which includes asynchronous computation and lossy communication. In particular, we extend a recently proposed algorithm named…

Optimization and Control · Mathematics 2017-07-31 Nicoletta Bof , Ruggero Carli , Giuseppe Notarstefano , Luca Schenato , Damiano Varagnolo

In this paper, we develop a class of decentralized algorithms for solving a convex resource allocation problem in a network of $n$ agents, where the agent objectives are decoupled while the resource constraints are coupled. The agents…

Optimization and Control · Mathematics 2018-12-18 Angelia Nedić , Alex Olshevsky , Wei Shi