English
Related papers

Related papers: Recovering the Optimal Solution by Dual Random Pro…

200 papers

In this paper we consider resource allocation problem stated as a convex minimization problem with linear constraints. To solve this problem, we use gradient and accelerated gradient descent applied to the dual problem and prove the…

Optimization and Control · Mathematics 2019-10-01 Anastasiya Ivanova , Pavel Dvurechensky , Alexander Gasnikov , Dmitry Kamzolov

We propose a framework for modeling and solving low-rank optimization problems to certifiable optimality. We introduce symmetric projection matrices that satisfy $Y^2=Y$, the matrix analog of binary variables that satisfy $z^2=z$, to model…

Optimization and Control · Mathematics 2021-12-22 Dimitris Bertsimas , Ryan Cory-Wright , Jean Pauphilet

Reverse engineering deep ReLU networks is a critical problem in understanding the complex behavior and interpretability of neural networks. In this research, we present a novel method for reconstructing deep ReLU networks by leveraging…

Machine Learning · Computer Science 2023-12-11 Mehrab Hamidi

In this paper, we consider the alignment between an upstream dimensionality reduction task of learning a low-dimensional representation of a set of high-dimensional data and a downstream optimization task of solving a stochastic program…

Machine Learning · Computer Science 2024-03-13 Long He , Ho-Yin Mak

In this paper, we propose a new algorithm for recovery of low-rank matrices from compressed linear measurements. The underlying idea of this algorithm is to closely approximate the rank function with a smooth function of singular values,…

Information Theory · Computer Science 2016-11-18 Mohammadreza Malek-Mohammadi , Massoud Babaie-Zadeh , Mikael Skoglund

We study the problem of estimating a low-rank positive semidefinite (PSD) matrix from a set of rank-one measurements using sensing vectors composed of i.i.d. standard Gaussian entries, which are possibly corrupted by arbitrary outliers.…

Information Theory · Computer Science 2016-12-21 Yuanxin Li , Yue Sun , Yuejie Chi

We present the viewpoint that optimization problems encountered in machine learning can often be interpreted as minimizing a convex functional over a function space, but with a non-convex constraint set introduced by model parameterization.…

Machine Learning · Computer Science 2020-04-21 Yongqiang Cai , Qianxiao Li , Zuowei Shen

We introduce visual deprojection: the task of recovering an image or video that has been collapsed along a dimension. Projections arise in various contexts, such as long-exposure photography, where a dynamic scene is collapsed in time to…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Guha Balakrishnan , Adrian V. Dalca , Amy Zhao , John V. Guttag , Fredo Durand , William T. Freeman

In this paper, we study the problem of matrix recovery, which aims to restore a target matrix of authentic samples from grossly corrupted observations. Most of the existing methods, such as the well-known Robust Principal Component Analysis…

Computer Vision and Pattern Recognition · Computer Science 2018-11-12 Xingyu Xie , Jianlong Wu , Guangcan Liu , Jun Wang

In this paper, we consider the resource allocation problem in a network with a large number of connections which are used by a huge number of users. The resource allocation problem under discussion is a maximization problem with linear…

Optimization and Control · Mathematics 2021-02-09 Anastasiya Ivanova , Dmitry Pasechnyuk , Pavel Dvurechensky , Alexander Gasnikov , Evgeniya Vorontsova

Random projection is widely used as a method of dimension reduction. In recent years, its combination with standard techniques of regression and classification has been explored. Here we examine its use with principal component analysis…

Methodology · Statistics 2012-04-13 Qi Ding , Eric D. Kolaczyk

The random sampling task performed by Google's Sycamore processor gave us a glimpse of the "Quantum Supremacy era". This has definitely shed some spotlight on the power of random quantum circuits in this abstract task of sampling outputs…

Quantum Physics · Physics 2024-01-23 Keerthi Kumaran , Manas Sajjan , Sangchul Oh , Sabre Kais

In this paper we present a new algorithmic realization of a projection-based scheme for general convex constrained optimization problem. The general idea is to transform the original optimization problem to a sequence of feasibility…

Optimization and Control · Mathematics 2019-11-12 Aviv Gibali , Karl-Heinz Küfer , Daniel Reem , Philipp Süss

The article proposes an n-dimensional mathematical model of the visual representation of a linear programming problem. This model makes it possible to use artificial neural networks to solve multidimensional linear optimization problems,…

Optimization and Control · Mathematics 2022-08-18 Nikolay A. Olkhovsky , Leonid B. Sokolinsky

Dual decomposition has been successfully employed in a variety of distributed convex optimization problems solved by a network of computing and communicating nodes. Often, when the cost function is separable but the constraints are coupled,…

Optimization and Control · Mathematics 2017-09-18 Andrea Simonetto , Hadi Jamali-Rad

In this paper, we present a method for denoising and reconstruction of low-dimensional manifold in high-dimensional space. We suggest a multidimensional extension of the Locally Optimal Projection algorithm which was introduced by Lipman et…

Numerical Analysis · Mathematics 2022-11-17 Shira Faigenbaum-Golovin , David Levin

Random projection (RP) is a powerful dimension reduction technique widely used in the analysis of high dimensional data. We demonstrate how this technique can be used to improve the computational efficiency of gravitational wave searches…

General Relativity and Quantum Cosmology · Physics 2019-06-11 Sumeet Kulkarni , Khun Sang Phukon , Amit Reza , Sukanta Bose , Anirban Dasgupta , Dilip Krishnaswamy , Anand S. Sengupta

The problem of low-rank matrix reconstruction arises in various applications in communications and signal processing. The state of the art research largely focuses on the recovery techniques that utilize affine maps satisfying the…

Signal Processing · Electrical Eng. & Systems 2020-04-07 Wei Zhang , Taejoon Kim , Guojun Xiong , Shu-Hung Leung

Deep learning-based models have demonstrated remarkable success in solving illposed inverse problems; however, many fail to strictly adhere to the physical constraints imposed by the measurement process. In this work, we introduce a…

Machine Learning · Computer Science 2025-05-22 Jorge Bacca

A novel algorithm for the recovery of low-rank matrices acquired via compressive linear measurements is proposed and analyzed. The algorithm, a variation on the iterative hard thresholding algorithm for low-rank recovery, is designed to…

Numerical Analysis · Mathematics 2018-10-30 Simon Foucart , Srinivas Subramanian