English
Related papers

Related papers: On the Sample Complexity and Optimization Landscap…

200 papers

We study the sample complexity of stochastic convex optimization when problem parameters, e.g., the distance to optimality, are unknown. We pursue two strategies. First, we develop a reliable model selection method that avoids overfitting…

Machine Learning · Computer Science 2025-06-16 Jared Lawrence , Ari Kalinsky , Hannah Bradfield , Yair Carmon , Oliver Hinder

Inspired by the quantum computing algorithms for Linear Algebra problems [HHL,TaShma] we study how the simulation on a classical computer of this type of "Phase Estimation algorithms" performs when we apply it to solve the Eigen-Problem of…

Data Structures and Algorithms · Computer Science 2017-04-07 Michael Ben-Or , Lior Eldar

Quadratic systems of equations appear in several applications. The results in this paper are motivated by quadratic systems of equations that describe equilibrium behavior of physical infrastructure networks like the power and gas grids.…

Optimization and Control · Mathematics 2017-03-28 Krishnamurthy Dvijotham , Hung Nguyen , Konstantin Turitsyn

Reconstructing an infinite-dimensional signal from a finite set of measurements is a fundamental problem in approximation theory and signal processing. While the generalized sampling (GS) framework provides a robust methodology for…

Functional Analysis · Mathematics 2026-05-25 Luca Finotti , Matteo Santacesaria

We consider a problem of considerable practical interest: the recovery of a data matrix from a sampling of its entries. Suppose that we observe m entries selected uniformly at random from a matrix M. Can we complete the matrix and recover…

Information Theory · Computer Science 2008-05-30 Emmanuel J. Candes , Benjamin Recht

This paper considers the problem of recovering the permutation of an n-dimensional random vector X observed in Gaussian noise. First, a general expression for the probability of error is derived when a linear decoder (i.e., linear estimator…

Information Theory · Computer Science 2021-05-10 Minoh Jeong , Alex Dytso , Martina Cardone

We consider the quadratic optimization problem $$F_n^{W,h}:= \sup_{x \in S^{n-1}} ( x^T W x/2 + h^T x )\,, $$ with $W$ a (random) matrix and $h$ a random external field. We study the probabilities of large deviation of $F_n^{W,h}$ for $h$ a…

Probability · Mathematics 2015-06-22 Amir Dembo , Ofer Zeitouni

The machine learning random Fourier feature method for data in high dimension is computationally and theoretically attractive since the optimization is based on a convex standard least squares problem and independent sampling of Fourier…

Numerical Analysis · Mathematics 2026-05-19 Xin Huang , Aku Kammonen , Anamika Pandey , Mattias Sandberg , Erik von Schwerin , Anders Szepessy , Raúl Tempone

In this work, we consider two-stage quadratic optimization problems under ellipsoidal uncertainty. In the first stage, one needs to decide upon the values of a subset of optimization variables (control variables). In the second stage, the…

Optimization and Control · Mathematics 2023-01-05 Olga Kuryatnikova , Bissan Ghaddar , Daniel K. Molzahn

The problem of recovering a signal from its phaseless Fourier transform measurements, called Fourier phase retrieval, arises in many applications in engineering and science. Fourier phase retrieval poses fundamental theoretical and…

Information Theory · Computer Science 2017-11-08 Tamir Bendory , Robert Beinert , Yonina C. Eldar

We study convex relaxation algorithms for phase retrieval on imaging problems. We show that structural assumptions on the signal and the observations, such as sparsity, smoothness or positivity, can be exploited to both speed-up convergence…

Optimization and Control · Mathematics 2014-04-09 Fajwel Fogel , Irène Waldspurger , Alexandre d'Aspremont

Following a polynomial approach, many robust fixed-order controller design problems can be formulated as optimization problems whose set of feasible solutions is modelled by parametrized polynomial matrix inequalities (PMI). These…

Optimization and Control · Mathematics 2012-06-01 Didier Henrion , Jean Bernard Lasserre

We consider the problem of recovering a real-valued $n$-dimensional signal from $m$ phaseless, linear measurements and analyze the amplitude-based non-smooth least squares objective. We establish local convergence of subgradient descent…

Machine Learning · Computer Science 2021-08-31 Paul Hand , Oscar Leong , Vladislav Voroninski

Convex maximization encompasses a broad class of optimization problems and is generally NP-hard, even for low-rank objectives. This paper investigates structural conditions under which convex maximization becomes polynomially solvable. From…

Optimization and Control · Mathematics 2026-05-01 Shaoning Han , Liangju Li , Yongchun Li

Quadratic constraints (QCs) are widely used to characterize nonlinearities and uncertainties, but generic analytical characterizations can be conservative on bounded domains. This paper develops a framework for constructing verified…

Machine Learning · Computer Science 2026-05-21 Elias Khalife , Mazen Farhood , Pierre-Loic Garoche

This paper considers the optimization problem in the form of $\min_{X \in \mathcal{F}_v} f(x) + \lambda \|X\|_1,$ where $f$ is smooth, $\mathcal{F}_v = \{X \in \mathbb{R}^{n \times q} : X^T X = I_q, v \in \mathrm{span}(X)\}$, and $v$ is a…

Optimization and Control · Mathematics 2023-07-21 Wen Huang , Meng Wei , Kyle A. Gallivan , Paul Van Dooren

The article is devoted to the resampling approach application to the reliability problems. This approach to reliability problems was first proposed by Ivnitsky (1967). Resampling is intensive statistical computer method, which is…

Applications · Statistics 2013-04-25 Maxim Fioshin , Helen Fioshina

We consider the task of recovering two real or complex $m$-vectors from phaseless Fourier measurements of their circular convolution. Our method is a novel convex relaxation that is based on a lifted matrix recovery formulation that allows…

Information Theory · Computer Science 2019-05-14 Ali Ahmed , Alireza Aghasi , Paul Hand

This note presents a unified analysis of the recovery of simple objects from random linear measurements. When the linear functionals are Gaussian, we show that an s-sparse vector in R^n can be efficiently recovered from 2s log n…

Information Theory · Computer Science 2012-03-01 Emmanuel Candes , Benjamin Recht

We consider the problem of estimation of a low-rank matrix from a limited number of noisy rank-one projections. In particular, we propose two fast, non-convex \emph{proper} algorithms for matrix recovery and support them with rigorous…

Machine Learning · Statistics 2017-05-23 Mohammadreza Soltani , Chinmay Hegde
‹ Prev 1 8 9 10 Next ›