English
Related papers

Related papers: Atomic norm denoising with applications to line sp…

200 papers

Semidefinite programs (SDPs) -- some of the most useful and versatile optimization problems of the last few decades -- are often pathological: the optimal values of the primal and dual problems may differ and may not be attained. Such SDPs…

Optimization and Control · Mathematics 2019-10-23 Gabor Pataki

In this paper, we propose two algorithms for solving linear inverse problems when the observations are corrupted by noise. A proper data fidelity term (log-likelihood) is introduced to reflect the statistics of the noise (e.g. Gaussian,…

Applications · Statistics 2011-03-14 François-Xavier Dupé , Jalal Fadili , Jean-Luc Starck

Estimation of Markov Random Field and covariance models from high-dimensional data represents a canonical problem that has received a lot of attention in the literature. A key assumption, widely employed, is that of {\em sparsity} of the…

Optimization and Control · Mathematics 2018-05-16 Davoud Ataee Tarzanagh , George Michailidis

The atomic norm provides a generalization of the $\ell_1$-norm to continuous parameter spaces. When applied as a sparse regularizer for line spectral estimation the solution can be obtained by solving a convex optimization problem. This…

Numerical Analysis · Mathematics 2019-06-24 Thomas Lundgaard Hansen , Tobias Lindstrøm Jensen

Inverse optimization refers to the inference of unknown parameters of an optimization problem based on knowledge of its optimal solutions. This paper considers inverse optimization in the setting where measurements of the optimal solutions…

Optimization and Control · Mathematics 2017-12-27 Anil Aswani , Zuo-Jun Max Shen , Auyon Siddiq

We introduce a new framework for unifying and systematizing the performance analysis of first-order black-box optimization algorithms for unconstrained convex minimization. The low-cost iteration complexity enjoyed by first-order algorithms…

Optimization and Control · Mathematics 2021-06-23 Sandra S. Y. Tan , Antonios Varvitsiotis , Vincent Y. F. Tan

In applications throughout science and engineering one is often faced with the challenge of solving an ill-posed inverse problem, where the number of available measurements is smaller than the dimension of the model to be estimated. However…

Optimization and Control · Mathematics 2012-10-30 Venkat Chandrasekaran , Benjamin Recht , Pablo A. Parrilo , Alan S. Willsky

The cone of positive-semidefinite (PSD) matrices is fundamental in convex optimization, and we extend this notion to tensors, defining PSD tensors, which correspond to separable quantum states. We study the convex optimization problem over…

Optimization and Control · Mathematics 2025-11-10 Liding Xu , Ye-Chao Liu , Sebastian Pokutta

We propose a homogeneous primal-dual interior-point method to solve sum-of-squares optimization problems by combining non-symmetric conic optimization techniques and polynomial interpolation. The approach optimizes directly over the…

Optimization and Control · Mathematics 2018-12-24 Dávid Papp , Sercan Yıldız

The stochastic block model (SBM) is a popular tool for community detection in networks, but fitting it by maximum likelihood (MLE) involves a computationally infeasible optimization problem. We propose a new semidefinite programming (SDP)…

Machine Learning · Computer Science 2016-03-17 Arash A. Amini , Elizaveta Levina

We consider the problem of discrete-time signal denoising, focusing on a specific family of non-linear convolution-type estimators. Each such estimator is associated with a time-invariant filter which is obtained adaptively, by solving a…

Statistics Theory · Mathematics 2018-06-13 Dmitrii Ostrovskii , Zaid Harchaoui

Frequency recovery/estimation from discrete samples of superimposed sinusoidal signals is a classic yet important problem in statistical signal processing. Its research has recently been advanced by atomic norm techniques which exploit…

Information Theory · Computer Science 2016-05-31 Zai Yang , Lihua Xie

Despite the numerous uses of semidefinite programming (SDP) and its universal solvability via interior point methods (IPMs), it is rarely applied to practical large-scale problems. This mainly owes to the computational cost of IPMs that…

Optimization and Control · Mathematics 2024-03-19 Yifan Ran , Stefan Vlaski , Wei Dai

In this paper we investigate the numerical solution of stochastic partial differential equations (SPDEs) for a wider class of stochastic equations. We focus on non-diagonal colored noise instead of the usual space-time white noise. By…

Numerical Analysis · Mathematics 2013-11-12 Dirk Blömker , Minoo Kamrani

We give sublinear-time approximation algorithms for some optimization problems arising in machine learning, such as training linear classifiers and finding minimum enclosing balls. Our algorithms can be extended to some kernelized versions…

Machine Learning · Computer Science 2010-10-22 Kenneth L. Clarkson , Elad Hazan , David P. Woodruff

In this study, the problem of computing a sparse representation of multi-dimensional visual data is considered. In general, such data e.g., hyperspectral images, color images or video data consists of signals that exhibit strong local…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Alexandros Gkillas , Dimitris Ampeliotis , Kostas Berberidis

The semidefinite programming (SDP) relaxation has proven to be extremely strong for many hard discrete optimization problems. This is in particular true for the quadratic assignment problem (QAP), arguably one of the hardest NP-hard…

Optimization and Control · Mathematics 2015-12-18 Danilo Elias Oliveira , Henry Wolkowicz , Yangyang Xu

In this paper, we utilize stochastic optimization to reduce the space complexity of convex composite optimization with a nuclear norm regularizer, where the variable is a matrix of size $m \times n$. By constructing a low-rank estimate of…

Machine Learning · Computer Science 2015-12-08 Lijun Zhang , Tianbao Yang , Rong Jin , Zhi-Hua Zhou

In this paper, we propose the use of denoising for microphone classification, to enable its usage for several key application domains that involve noisy conditions. We describe the proposed analysis pipeline and the baseline algorithm for…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-04 L. Cuccovillo , A. Giganti , P. Bestagini , P. Aichroth , S. Tubaro

Semidefinite programming (SDP) is a unifying framework that generalizes both linear programming and quadratically-constrained quadratic programming, while also yielding efficient solvers, both in theory and in practice. However, there exist…

Data Structures and Algorithms · Computer Science 2022-10-24 Elena Grigorescu , Young-San Lin , Sandeep Silwal , Maoyuan Song , Samson Zhou