English
Related papers

Related papers: Robust computation of linear models by convex rela…

200 papers

This paper deals with sparse phase retrieval, i.e., the problem of estimating a vector from quadratic measurements under the assumption that few components are nonzero. In particular, we consider the problem of finding the sparsest vector…

Information Theory · Computer Science 2014-02-25 Fabien Lauer , Henrik Ohlsson

This document introduces a strategy to solve linear optimization problems. The strategy is based on the bounding condition each constraint produces on each one of the problem's dimension. The solution of a linear optimization problem is…

Optimization and Control · Mathematics 2018-09-24 Gerardo L. Febres

Rare data in a large-scale database are called outliers that reveal significant information in the real world. The subspace-based outlier detection is regarded as a feasible approach in very high dimensional space. However, the outliers…

Artificial Intelligence · Computer Science 2014-05-06 Zhana Bao

Constrained optimization problems appear in a wide variety of challenging real-world problems, where constraints often capture the physics of the underlying system. Classic methods for solving these problems rely on iterative algorithms…

Systems and Control · Electrical Eng. & Systems 2023-06-13 Meiyi Li , Soheil Kolouri , Javad Mohammadi

The real-life data have a complex and non-linear structure due to their nature. These non-linearities and the large number of features can usually cause problems such as the empty-space phenomenon and the well-known curse of dimensionality.…

Machine Learning · Computer Science 2025-03-13 Kadir Özçoban , Murat Manguoğlu , Emrullah Fatih Yetkin

We study the basic problem of robust subspace recovery. That is, we assume a data set that some of its points are sampled around a fixed subspace and the rest of them are spread in the whole ambient space, and we aim to recover the fixed…

Machine Learning · Statistics 2015-03-19 Teng Zhang , Gilad Lerman

Suppose a given observation matrix can be decomposed as the sum of a low-rank matrix and a sparse matrix (outliers), and the goal is to recover these individual components from the observed sum. Such additive decompositions have…

Machine Learning · Statistics 2010-12-07 Daniel Hsu , Sham M. Kakade , Tong Zhang

Unlike the matrix case, computing low-rank approximations of tensors is NP-hard and numerically ill-posed in general. Even the best rank-1 approximation of a tensor is NP-hard. In this paper, we use convex optimization to develop…

Statistics Theory · Mathematics 2016-09-14 Anil Aswani

A convex optimization model predicts an output from an input by solving a convex optimization problem. The class of convex optimization models is large, and includes as special cases many well-known models like linear and logistic…

Machine Learning · Computer Science 2020-06-19 Akshay Agrawal , Shane Barratt , Stephen Boyd

In high-dimensional classification problems, a commonly used approach is to first project the high-dimensional features into a lower dimensional space, and base the classification on the resulting lower dimensional projections. In this…

Statistics Theory · Mathematics 2025-08-05 Xin Bing , Marten Wegkamp

Near isometric orthogonal embeddings to lower dimensions are a fundamental tool in data science and machine learning. In this paper, we present the construction of such embeddings that minimizes the maximum distortion for a given set of…

Machine Learning · Statistics 2017-12-15 Kshiteej Sheth , Dinesh Garg , Anirban Dasgupta

This two-part paper is concerned with the problem of minimizing a linear objective function subject to a bilinear matrix inequality (BMI) constraint. In this part, we first consider a family of convex relaxations which transform BMI…

Optimization and Control · Mathematics 2018-09-27 Mohsen Kheirandishfard , Fariba Zohrizadeh , Ramtin Madani

Best subset selection in linear regression is well known to be nonconvex and computationally challenging to solve, as the number of possible subsets grows rapidly with increasing dimensionality of the problem. As a result, finding the…

Machine Learning · Statistics 2025-04-01 Vikram Singh , Min Sun

This paper introduces new techniques for using convex optimization to fit input-output data to a class of stable nonlinear dynamical models. We present an algorithm that guarantees consistent estimates of models in this class when a small…

Optimization and Control · Mathematics 2013-03-19 Mark M. Tobenkin , Ian R. Manchester , Alexandre Megretski

We present the viewpoint that optimization problems encountered in machine learning can often be interpreted as minimizing a convex functional over a function space, but with a non-convex constraint set introduced by model parameterization.…

Machine Learning · Computer Science 2020-04-21 Yongqiang Cai , Qianxiao Li , Zuowei Shen

A computationally efficient method to solve non-convex programming problems with linear equality constraints is presented. The proposed method is based on a recursively feasible and descending sequential convex programming procedure proven…

Optimization and Control · Mathematics 2018-10-25 Josep Virgili-Llop , Marcello Romano

Determining the vanishing points (VPs) in a Manhattan world, as a fundamental task in many 3D vision applications, consists of jointly inferring the line-VP association and locating each VP. Existing methods are, however, either sub-optimal…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Bangyan Liao , Zhenjun Zhao , Haoang Li , Yi Zhou , Yingping Zeng , Hao Li , Peidong Liu

In high-dimensional regression, we attempt to estimate a parameter vector $\beta_0\in\mathbb{R}^p$ from $n\lesssim p$ observations $\{(y_i,x_i)\}_{i\leq n}$ where $x_i\in\mathbb{R}^p$ is a vector of predictors and $y_i$ is a response…

Statistics Theory · Mathematics 2022-02-08 Michael Celentano , Andrea Montanari

Recently, data-driven techniques have demonstrated remarkable effectiveness in addressing challenges related to MR imaging inverse problems. However, these methods still exhibit certain limitations in terms of interpretability and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Huayu Wang , Chen Luo , Taofeng Xie , Qiyu Jin , Guoqing Chen , Zhuo-Xu Cui , Dong Liang

This work studies the Tensor Robust Principal Component Analysis (TRPCA) problem, which aims to exactly recover the low-rank and sparse components from their sum. Our model is motivated by the recently proposed linear transforms based…

Machine Learning · Computer Science 2019-07-22 Canyi Lu , Pan Zhou