English
Related papers

Related papers: Fast Exact Matrix Completion: A Unified Optimizati…

200 papers

The low-rank matrix completion problem can be succinctly stated as follows: given a subset of the entries of a matrix, find a low-rank matrix consistent with the observations. While several low-complexity algorithms for matrix completion…

Information Theory · Computer Science 2010-06-11 Wei Dai , Ely Kerman , Olgica Milenkovic

Optimization problems with rank constraints arise in many applications, including matrix regression, structured PCA, matrix completion and matrix decomposition problems. An attractive heuristic for solving such problems is to factorize the…

Statistics Theory · Mathematics 2015-09-11 Yudong Chen , Martin J. Wainwright

We consider the problem of minimizing a convex objective which is the sum of a smooth part, with Lipschitz continuous gradient, and a nonsmooth part. Inspired by various applications, we focus on the case when the nonsmooth part is a…

Optimization and Control · Mathematics 2013-08-28 Ting Kei Pong

The dynamic matrix inverse problem is to maintain the inverse of a matrix undergoing element and column updates. It is the main subroutine behind the best algorithms for many dynamic problems whose complexity is not yet well-understood,…

Data Structures and Algorithms · Computer Science 2019-05-14 Jan van den Brand , Danupon Nanongkai , Thatchaphol Saranurak

In this paper, we show how to transform any optimization problem that arises from fitting a machine learning model into one that (1) detects and removes contaminated data from the training set while (2) simultaneously fitting the trimmed…

Machine Learning · Statistics 2017-02-07 Aleksandr Aravkin , Damek Davis

A fast metasurface optimization strategy for finite-size metasurfaces modeled using integral equations is presented. The metasurfaces considered are constructed from finite patterned metallic claddings supported by grounded dielectric…

Numerical Analysis · Mathematics 2023-06-16 Jordan Budhu , Anthony Grbic

We consider a generalization of low-rank matrix completion to the case where the data belongs to an algebraic variety, i.e. each data point is a solution to a system of polynomial equations. In this case the original matrix is possibly…

Machine Learning · Statistics 2017-03-29 Greg Ongie , Rebecca Willett , Robert D. Nowak , Laura Balzano

We propose a novel solution framework for inverse mixed-integer optimization based on analytic center concepts from interior point methods. We characterize the optimality gap of a given solution, provide structural results, and propose…

Optimization and Control · Mathematics 2025-04-08 Samir Elhedhli , Göksu Ece Okur

This paper introduces a novel algorithm to approximate the matrix with minimum nuclear norm among all matrices obeying a set of convex constraints. This problem may be understood as the convex relaxation of a rank minimization problem, and…

Optimization and Control · Mathematics 2008-10-21 Jian-Feng Cai , Emmanuel J. Candes , Zuowei Shen

In this paper, we propose a new algorithm for recovery of low-rank matrices from compressed linear measurements. The underlying idea of this algorithm is to closely approximate the rank function with a smooth function of singular values,…

Information Theory · Computer Science 2016-11-18 Mohammadreza Malek-Mohammadi , Massoud Babaie-Zadeh , Mikael Skoglund

We propose a framework called ReFInE to directly obtain integral image estimates from a very small number of spatially multiplexed measurements of the scene without iterative reconstruction of any auxiliary image, and demonstrate their…

Computer Vision and Pattern Recognition · Computer Science 2016-01-28 Kuldeep Kulkarni , Pavan Turaga

Multipoint polynomial evaluation and interpolation are fundamental for modern symbolic and numerical computing. The known algorithms solve both problems over any field of constants in nearly linear arithmetic time, but the cost grows to…

Numerical Analysis · Mathematics 2017-04-19 Victor Y. Pan

We consider the problem of reconstructing a low-rank matrix from a small subset of its entries. In this paper, we describe the implementation of an efficient algorithm called OptSpace, based on singular value decomposition followed by local…

Numerical Analysis · Computer Science 2013-01-30 Raghunandan H. Keshavan , Sewoong Oh

In this paper we develop a new framework that captures the common landscape underlying the common non-convex low-rank matrix problems including matrix sensing, matrix completion and robust PCA. In particular, we show for all above problems…

Machine Learning · Computer Science 2017-04-04 Rong Ge , Chi Jin , Yi Zheng

In modern engineering scenarios, there is often a strict upper bound on the number of algorithm iterations that can be performed within a given time limit. This raises the question of optimal algorithmic configuration for a fixed and finite…

Optimization and Control · Mathematics 2024-12-31 Yushun Zhang , Dmitry Rybin , Zhi-Quan Luo

Consider a movie recommendation system where apart from the ratings information, side information such as user's age or movie's genre is also available. Unlike standard matrix completion, in this setting one should be able to predict…

Machine Learning · Computer Science 2013-06-05 Prateek Jain , Inderjit S. Dhillon

Matrix completion is a classical problem in data science wherein one attempts to reconstruct a low-rank matrix while only observing some subset of the entries. Previous authors have phrased this problem as a nuclear norm minimization…

Machine Learning · Computer Science 2019-04-19 Christian Parkinson , Kevin Huynh , Deanna Needell

This paper proposes a new framework for the optimization of excitation inputs for system identification. The optimization problem considered is to maximize a reduced Fisher information matrix in any of the classical D-, E-, or A-optimal…

Optimization and Control · Mathematics 2016-11-17 Ian R. Manchester

We present a performant gradient method for smooth convex optimization, drawing inspiration from several recent advances in the field. Our algorithm, the Adaptive Subgame Perfect Gradient Method (ASPGM) is based on the notion of subgame…

Optimization and Control · Mathematics 2026-02-13 Alan Luner , Benjamin Grimmer

This paper studies noisy low-rank matrix completion: given partial and noisy entries of a large low-rank matrix, the goal is to estimate the underlying matrix faithfully and efficiently. Arguably one of the most popular paradigms to tackle…

Machine Learning · Statistics 2019-10-08 Yuxin Chen , Yuejie Chi , Jianqing Fan , Cong Ma , Yuling Yan