English
Related papers

Related papers: Implementing Robust M-Estimators with Certifiable …

200 papers

In computed tomography (CT), the relative trajectories of a sample, a detector, and a signal source are traditionally considered to be known, since they are caused by the intentional preprogrammed movement of the instrument parts. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-11 Mark Griguletskii , Mikhail Chekanov , Oleg Shipitko

We adapt a manifold sampling algorithm for the nonsmooth, nonconvex formulations of learning that arise when imposing robustness to outliers present in the training data. We demonstrate the approach on objectives based on trimmed loss.…

Optimization and Control · Mathematics 2018-07-10 Matt Menickelly , Stefan M. Wild

We consider a fundamental problem in unsupervised learning called \emph{subspace recovery}: given a collection of $m$ points in $\mathbb{R}^n$, if many but not necessarily all of these points are contained in a $d$-dimensional subspace $T$…

Computational Complexity · Computer Science 2013-12-05 Moritz Hardt , Ankur Moitra

In this article, we present a method for increasing adaptivity of an existing robust estimation algorithm by learning two parameters to better fit the residual distribution. The analyzed method uses these two parameters to calculate weights…

Robotics · Computer Science 2023-06-27 Shounak Das , Jason Gross

Approximate subgraph matching (ASM) is a task that determines the approximate presence of a given query graph in a large target graph. Being an NP-hard problem, ASM is critical in graph analysis with a myriad of applications ranging from…

Machine Learning · Computer Science 2026-03-20 Kaiyang Li , Shihao Ji , Zhipeng Cai , Wei Li

Given an undirected node-weighted graph, the Maximum-Weight Connected Subgraph problem (MWCS) is to identify a subset of nodes of maximalsum of weights that induce a connected subgraph. MWCS is closely related to the well-studied Prize…

Data Structures and Algorithms · Computer Science 2014-12-03 Mohammed El-Kebir , Gunnar W. Klau

This paper considers general rank-constrained optimization problems that minimize a general objective function $f(X)$ over the set of rectangular $n\times m$ matrices that have rank at most $r$. To tackle the rank constraint and also to…

Information Theory · Computer Science 2021-09-07 Zhihui Zhu , Qiuwei Li , Gongguo Tang , Michael B. Wakin

Optimization problems with norm-bounding constraints arise in a variety of applications, including portfolio optimization, machine learning, and feature selection. A common approach to these problems involves relaxing the norm constraint…

Optimization and Control · Mathematics 2025-05-08 Danial Davarnia , Mohammadreza Kiaghadi

Estimating the orientations of nodes in a pose graph from relative angular measurements is challenging because the variables live on a manifold product with nontrivial topology and the maximum-likelihood objective function is non-convex and…

Robotics · Computer Science 2012-11-14 Luca Carlone , Andrea Censi

In this paper, we investigate the matrix estimation problem in the multi-response regression model with measurement errors. A nonconvex error-corrected estimator based on a combination of the amended loss function and the nuclear norm…

Statistics Theory · Mathematics 2022-09-19 Xin Li , Dongya Wu

This paper considers the problem of minimizing the sum of a smooth function and the Schatten-$p$ norm of the matrix. Our contribution involves proposing accelerated iteratively reweighted nuclear norm methods designed for solving the…

Optimization and Control · Mathematics 2024-06-27 Hao Wang , Ye Wang , Xiangyu Yang

Minimum Weight Cycle (MWC) is the problem of finding a simple cycle of minimum weight in a graph $G=(V,E)$. This is a fundamental graph problem with classical sequential algorithms that run in $\tilde{O}(n^3)$ and $\tilde{O}(mn)$ time where…

Data Structures and Algorithms · Computer Science 2024-05-24 Vignesh Manoharan , Vijaya Ramachandran

The placement problem in Very Large-Scale Integration (VLSI) circuits is a critical step in chip design. Its primary goal is to optimize the wirelength of circuit components within a confined area while adhering to nonoverlapping…

Optimization and Control · Mathematics 2026-05-06 Yi-Shuang Yue , Yu-Hong Dai , Haijun Yu

We consider the regression problem of estimating functions on $\mathbb{R}^D$ but supported on a $d$-dimensional manifold $ \mathcal{M} \subset \mathbb{R}^D $ with $ d \ll D $. Drawing ideas from multi-resolution analysis and nonlinear…

Machine Learning · Statistics 2021-01-14 Wenjing Liao , Mauro Maggioni , Stefano Vigogna

Sharpness-aware minimization (SAM) has emerged as a highly effective technique to improve model generalization, but its underlying principles are not fully understood. We investigate m-sharpness, where SAM performance improves monotonically…

Machine Learning · Computer Science 2026-04-03 Haocheng Luo , Mehrtash Harandi , Dinh Phung , Trung Le

While optimizing convex objective (loss) functions has been a powerhouse for machine learning for at least two decades, non-convex loss functions have attracted fast growing interests recently, due to many desirable properties such as…

Machine Learning · Statistics 2018-02-14 Chao Qu , Yan Li , Huan Xu

Many applications of generalised linear models (GLMs) can be improved by applying constraints that impose assumptions on the associations or improve consistency of the estimators. Yet, there are still barriers to the implementation and…

Methodology · Statistics 2026-02-19 Pierre Masselot , Devon Nenon , Jacopo Vanoli , Zaid Chalabi , Antonio Gasparrini

Few-shot image classification is a challenging task in the field of machine learning, involving the identification of new categories using a limited number of labeled samples. In recent years, methods based on local descriptors have made…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Bingchen Yan

Multiple rotation averaging plays a crucial role in computer vision and robotics domains. The conventional optimization-based methods optimize a nonlinear cost function based on certain noise assumptions, while most previous learning-based…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Shiqi Li , Jihua Zhu , Yifan Xie , Naiwen Hu , Mingchen Zhu , Zhongyu Li , Di Wang

Label quality issues, such as noisy labels and imbalanced class distributions, have negative effects on model performance. Automatic reweighting methods identify problematic samples with label quality issues by recognizing their negative…

Human-Computer Interaction · Computer Science 2023-12-11 Weikai Yang , Yukai Guo , Jing Wu , Zheng Wang , Lan-Zhe Guo , Yu-Feng Li , Shixia Liu