English
Related papers

Related papers: Algorithms and Hardness for Robust Subspace Recove…

200 papers

Matrix rank minimization (RM) problems recently gained extensive attention due to numerous applications in machine learning, system identification and graphical models. In RM problem, one aims to find the matrix with the lowest rank that…

Information Theory · Computer Science 2011-02-22 Amin Khajehnejad , Samet Oymak , Babak Hassibi

In many applications, when building linear regression models, it is important to account for the presence of outliers, i.e., corrupted input data points. Such problems can be formulated as mixed-integer optimization problems involving cubic…

Optimization and Control · Mathematics 2023-07-13 Andrés Gómez , José Neto

Addressing the Out-of-Distribution (OoD) segmentation task is a prerequisite for perception systems operating in an open-world environment. Large foundational models are frequently used in downstream tasks, however, their potential for OoD…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Nazir Nayal , Youssef Shoeb , Fatma Güney

This paper studies sparse linear regression analysis with outliers in the responses. A parameter vector for modeling outliers is added to the standard linear regression model and then the sparse estimation problem for both coefficients and…

Statistics Theory · Mathematics 2015-05-21 Shota Katayama , Hironori Fujisawa

Geometric perception problems are fundamental tasks in robotics and computer vision. In real-world applications, they often encounter the inevitable issue of outliers, preventing traditional algorithms from making correct estimates. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Lei Sun

Robust mean estimation is the problem of estimating the mean $\mu \in \mathbb{R}^d$ of a $d$-dimensional distribution $D$ from a list of independent samples, an $\epsilon$-fraction of which have been arbitrarily corrupted by a malicious…

Computational Complexity · Computer Science 2019-06-05 Samuel B. Hopkins , Jerry Li

One fundamental goal of high-dimensional statistics is to detect or recover planted structure (such as a low-rank matrix) hidden in noisy data. A growing body of work studies low-degree polynomials as a restricted model of computation for…

Statistics Theory · Mathematics 2022-06-22 Tselil Schramm , Alexander S. Wein

Smoothed analysis is a powerful paradigm in overcoming worst-case intractability in unsupervised learning and high-dimensional data analysis. While polynomial time smoothed analysis guarantees have been obtained for worst-case intractable…

Data Structures and Algorithms · Computer Science 2019-04-25 Aditya Bhaskara , Aidao Chen , Aidan Perreault , Aravindan Vijayaraghavan

This short communication addresses the problem of elliptic localization with outlier measurements. Outliers are prevalent in various location-enabled applications, and can significantly compromise the positioning performance if not…

Signal Processing · Electrical Eng. & Systems 2024-09-04 Wenxin Xiong , Yuming Chen , Jiajun He , Zhang-Lei Shi , Keyuan Hu , Hing Cheung So , Chi-Sing Leung

Robust density estimation refers to the consistent estimation of the density function even when the data is contaminated by outliers. We find that existing forest density estimation at a certain point is inherently resistant to the outliers…

Machine Learning · Statistics 2025-01-28 Hongwei Wen , Annika Betken , Tao Huang

Outlier-robust estimation is a fundamental problem and has been extensively investigated by statisticians and practitioners. The last few years have seen a convergence across research fields towards "algorithmic robust statistics", which…

Machine Learning · Statistics 2022-12-19 Luca Carlone

We study the problem of estimating the means of well-separated mixtures when an adversary may add arbitrary outliers. While strong guarantees are available when the outlier fraction is significantly smaller than the minimum mixing weight,…

Density ratio estimation is a vital tool in both machine learning and statistical community. However, due to the unbounded nature of density ratio, the estimation procedure can be vulnerable to corrupted data points, which often pushes the…

Machine Learning · Statistics 2017-11-07 Song Liu , Akiko Takeda , Taiji Suzuki , Kenji Fukumizu

We explore the connection between outlier-robust high-dimensional statistics and non-convex optimization in the presence of sparsity constraints, with a focus on the fundamental tasks of robust sparse mean estimation and robust sparse PCA.…

Machine Learning · Computer Science 2022-11-15 Yu Cheng , Ilias Diakonikolas , Rong Ge , Shivam Gupta , Daniel M. Kane , Mahdi Soltanolkotabi

Interpreting objects with basic geometric primitives has long been studied in computer vision. Among geometric primitives, superquadrics are well known for their ability to represent a wide range of shapes with few parameters. However, as…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Weixiao Liu , Yuwei Wu , Sipu Ruan , Gregory S. Chirikjian

We develop efficient algorithms for estimating low-degree moments of unknown distributions in the presence of adversarial outliers. The guarantees of our algorithms improve in many cases significantly over the best previous ones, obtained…

Data Structures and Algorithms · Computer Science 2017-12-27 Pravesh K. Kothari , David Steurer

Multi-dimensional scaling (MDS) plays a central role in data-exploration, dimensionality reduction and visualization. State-of-the-art MDS algorithms are not robust to outliers, yielding significant errors in the embedding even when only a…

Computer Vision and Pattern Recognition · Computer Science 2018-02-08 Leonid Blouvshtein , Daniel Cohen-Or

Learning from data in the presence of outliers is a fundamental problem in statistics. Until recently, no computationally efficient algorithms were known to compute the mean of a high dimensional distribution under natural assumptions in…

Data Structures and Algorithms · Computer Science 2021-01-22 Yeshwanth Cherapanamjeri , Sidhanth Mohanty , Morris Yau

We study the problem of robustly estimating the mean of a $d$-dimensional distribution given $N$ examples, where most coordinates of every example may be missing and $\varepsilon N$ examples may be arbitrarily corrupted. Assuming each…

Data Structures and Algorithms · Computer Science 2021-05-04 Lunjia Hu , Omer Reingold

We adapt a manifold sampling algorithm for the nonsmooth, nonconvex formulations of learning that arise when imposing robustness to outliers present in the training data. We demonstrate the approach on objectives based on trimmed loss.…

Optimization and Control · Mathematics 2018-07-10 Matt Menickelly , Stefan M. Wild