English
Related papers

Related papers: Dual Principal Component Pursuit

200 papers

Linear subspace representations of appearance variation are pervasive in computer vision. This paper addresses the problem of robustly matching such subspaces (computing the similarity between them) when they are used to describe the scope…

Computer Vision and Pattern Recognition · Computer Science 2014-02-03 Ognjen Arandjelovic

We study nonlinear regression of real valued data in an individual sequence manner, where we provide results that are guaranteed to hold without any statistical assumptions. We address the convergence and undertraining issues of…

Machine Learning · Computer Science 2014-10-08 N. Denizcan Vanli , Muhammed O. Sayin , Suleyman S. Kozat

Deep learning has been widely used for solving image reconstruction tasks but its deployability has been held back due to the shortage of high-quality training data. Unsupervised learning methods, such as the deep image prior (DIP),…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Riccardo Barbano , Javier Antorán , Johannes Leuschner , José Miguel Hernández-Lobato , Bangti Jin , Željko Kereta

In this paper, we consider the decentralized optimization problems with generalized orthogonality constraints, where both the objective function and the constraint exhibit a distributed structure. Such optimization problems, albeit…

Optimization and Control · Mathematics 2024-09-10 Lei Wang , Nachuan Xiao , Xin Liu

DBSCAN is a popular density-based clustering algorithm that has many different applications in practice. However, the running time of DBSCAN in high-dimensional space or general metric space ({\em e.g.,} clustering a set of texts by using…

Data Structures and Algorithms · Computer Science 2025-01-07 Guanlin Mo , Shihong Song , Hu Ding

Minimizing a convex function of a measure with a sparsity-inducing penalty is a typical problem arising, e.g., in sparse spikes deconvolution or two-layer neural networks training. We show that this problem can be solved by discretizing the…

Optimization and Control · Mathematics 2020-11-04 Lenaic Chizat

Rare data in a large-scale database are called outliers that reveal significant information in the real world. The subspace-based outlier detection is regarded as a feasible approach in very high dimensional space. However, the outliers…

Artificial Intelligence · Computer Science 2014-05-06 Zhana Bao

Robust model fitting is a core algorithm in a large number of computer vision applications. Solving this problem efficiently for datasets highly contaminated with outliers is, however, still challenging due to the underlying computational…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Giang Truong , Huu Le , David Suter , Erchuan Zhang , Syed Zulqarnain Gilani

We study a class of convex-concave min-max problems in which the coupled component of the objective is linear in at least one of the two decision vectors. We identify such problem structure as interpolating between the bilinearly and…

Optimization and Control · Mathematics 2025-07-10 Ronak Mehta , Jelena Diakonikolas , Zaid Harchaoui

The real-life data have a complex and non-linear structure due to their nature. These non-linearities and the large number of features can usually cause problems such as the empty-space phenomenon and the well-known curse of dimensionality.…

Machine Learning · Computer Science 2025-03-13 Kadir Özçoban , Murat Manguoğlu , Emrullah Fatih Yetkin

We propose a new randomized optimization method for high-dimensional problems which can be seen as a generalization of coordinate descent to random subspaces. We show that an adaptive sampling strategy for the random subspace significantly…

Optimization and Control · Mathematics 2019-12-19 Jonathan Lacotte , Mert Pilanci , Marco Pavone

We derive a parallel sampling algorithm for computational inverse problems that present an unknown linear forcing term and a vector of nonlinear parameters to be recovered. It is assumed that the data is noisy and that the linear part of…

Numerical Analysis · Mathematics 2022-03-24 Darko Volkov

Random projection has been widely used in data classification. It maps high-dimensional data into a low-dimensional subspace in order to reduce the computational cost in solving the related optimization problem. While previous studies are…

Machine Learning · Computer Science 2014-02-24 Lijun Zhang , Mehrdad Mahdavi , Rong Jin , Tianbao Yang , Shenghuo Zhu

One of the most powerful methods of color image recognition is the two-dimensional principle component analysis (2DQPCA) approach, which is based on quaternion representation and preserves color information very well. However, the current…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Zhi-Gang Jia , Zi-Jin Qiu , Qian-Yu Wang , Mei-Xiang Zhao , Dan-Dan Zhu

We consider the following classification problem: Given a population of individuals characterized by a set of attributes represented as a vector in ${\mathbb R}^N$, the goal is to find a hyperplane in ${\mathbb R}^N$ that separates two sets…

Machine Learning · Computer Science 2025-07-04 Argimiro Arratia , Mahmoud El Daou , Henryk Gzyl

Incomplete multi-view clustering (IMVC) is an unsupervised approach, among which IMVC via contrastive learning has received attention due to its excellent performance. The previous methods have the following problems: 1) Over-reliance on…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Kaiwu Zhang , Shiqiang Du , Baokai Liu , Shengxia Gao

We propose the first general and scalable framework to design certifiable algorithms for robust geometric perception in the presence of outliers. Our first contribution is to show that estimation using common robust costs, such as truncated…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Heng Yang , Luca Carlone

In this paper, we consider the problem of preserving privacy in the online learning setting. We study the problem in the online convex programming (OCP) framework---a popular online learning setting with several interesting theoretical and…

Machine Learning · Computer Science 2015-03-19 Prateek Jain , Pravesh Kothari , Abhradeep Thakurta

Many computer vision problems (e.g., camera calibration, image alignment, structure from motion) are solved with nonlinear optimization methods. It is generally accepted that second order descent methods are the most robust, fast, and…

Computer Vision and Pattern Recognition · Computer Science 2014-05-06 Xuehan Xiong , Fernando De la Torre

Many real-world problems can be formulated as geometric optimization problems in high dimensions, especially in the fields of machine learning and data mining. Moreover, we often need to take into account of outliers when optimizing the…

Computational Geometry · Computer Science 2020-05-04 Hu Ding