English
Related papers

Related papers: Robust Learning of Trimmed Estimators via Manifold…

200 papers

Fully robust versions of the elastic net estimator are introduced for linear and logistic regression. The algorithms to compute the estimators are based on the idea of repeatedly applying the non-robust classical estimators to data subsets…

Methodology · Statistics 2017-03-16 Fatma Sevinc Kurnaz , Irene Hoffmann , Peter Filzmoser

We present an adaptive approach for robust learning from corrupted training sets. We identify corrupted and non-corrupted samples with latent Bernoulli variables and thus formulate the learning problem as maximization of the likelihood…

Machine Learning · Statistics 2024-06-17 Aleksandr Karakulev , Dave Zachariah , Prashant Singh

The performance of a machine learning system is usually evaluated by using i.i.d.\ observations with true labels. However, acquiring ground truth labels is expensive, while obtaining unlabeled samples may be cheaper. Stratified sampling can…

Machine Learning · Computer Science 2019-07-29 Tiancheng Yu , Xiyu Zhai , Suvrit Sra

This paper studies continuous-time stochastic control problems whose controlled states are fully non-Markovian and depend on unknown model parameters. Such problems arise naturally in path-dependent stochastic differential equations,…

Machine Learning · Statistics 2026-05-29 Dorival Leão , Alberto Ohashi , Simone Scotti , Adolfo M. D da Silva

There has been great interest in enhancing the robustness of neural network classifiers to defend against adversarial perturbations through adversarial training, while balancing the trade-off between robust accuracy and standard accuracy.…

Machine Learning · Computer Science 2022-10-24 Chester Holtz , Tsui-Wei Weng , Gal Mishne

We study the data deletion problem for convex models. By leveraging techniques from convex optimization and reservoir sampling, we give the first data deletion algorithms that are able to handle an arbitrarily long sequence of adversarial…

Machine Learning · Statistics 2020-07-07 Seth Neel , Aaron Roth , Saeed Sharifi-Malvajerdi

Most reinforcement learning algorithms take advantage of an experience replay buffer to repeatedly train on samples the agent has observed in the past. Not all samples carry the same amount of significance and simply assigning equal…

Machine Learning · Computer Science 2023-11-02 Shivakanth Sujit , Somjit Nath , Pedro H. M. Braga , Samira Ebrahimi Kahou

This paper proposes novel algorithm for non-convex multimodal constrained optimisation problems. It is based on sequential solving restrictions of problem to sections of feasible set by random subspaces (in general, manifolds) of low…

Optimization and Control · Mathematics 2023-03-28 Dmitry A. Pasechnyuk , Alexander Gornov

Robust Optimization has traditionally taken a pessimistic, or worst-case viewpoint of uncertainty which is motivated by a desire to find sets of optimal policies that maintain feasibility under a variety of operating conditions. In this…

Machine Learning · Statistics 2017-11-22 Matthew Norton , Akiko Takeda , Alexander Mafusalov

Tensor regression is an important tool for tensor data analysis, but existing works have not considered the impact of outliers, making them potentially sensitive to such data points. This paper proposes a low tubal rank robust regression…

Methodology · Statistics 2026-05-11 Zihao Song , Jicai Liu , Heng Lian , Weihua Zhao

Parameter estimation of mixture regression model using the expectation maximization (EM) algorithm is highly sensitive to outliers. Here we propose a fast and efficient robust mixture regression algorithm, called Component-wise Adaptive…

Methodology · Statistics 2021-04-20 Wennan Chang , Xinyu Zhou , Yong Zang , Chi Zhang , Sha Cao

Forecasting multivariate time series is a computationally intensive task challenged by extreme or redundant samples. Recent resampling methods aim to increase training efficiency by reweighting samples based on their running losses.…

Machine Learning · Computer Science 2024-06-21 Jiang You , Arben Cela , René Natowicz , Jacob Ouanounou , Patrick Siarry

We present a robust framework to perform linear regression with missing entries in the features. By considering an elliptical data distribution, and specifically a multivariate normal model, we are able to conditionally formulate a…

Machine Learning · Computer Science 2022-11-10 Alireza Aghasi , MohammadJavad Feizollahi , Saeed Ghadimi

We propose a new methodology for parameterized constrained robust optimization, an important class of optimization problems under uncertainty, based on learning with a self-supervised penalty-based loss function. Whereas supervised learning…

Optimization and Control · Mathematics 2025-03-10 Wyame Benslimane , Paul Grigas

Most existing robust fitting methods are designed for classical models, such as lines, circles, and planes. In contrast, fewer methods have been developed to robustly handle non-classical models, such as spiral curves, procedural character…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Zongliang Zhang , Shuxiang Li , Xingwang Huang , Zongyue Wang

Extrinsic calibration is essential for multi-sensor fusion, existing methods rely on structured targets or fully-excited data, limiting real-world applicability. Online calibration further suffers from weak excitation, leading to unreliable…

Robotics · Computer Science 2025-08-11 Baorun Li , Chengrui Zhu , Siyi Du , Bingran Chen , Jie Ren , Wenfei Wang , Yong Liu , Jiajun Lv

Most value function learning algorithms in reinforcement learning are based on the mean squared (projected) Bellman error. However, squared errors are known to be sensitive to outliers, both skewing the solution of the objective and…

Machine Learning · Computer Science 2023-04-19 Andrew Patterson , Victor Liao , Martha White

In this paper, we consider a statistical problem of learning a linear model from noisy samples. Existing work has focused on approximating the least squares solution by using leverage-based scores as an importance sampling distribution.…

Machine Learning · Statistics 2016-02-11 Siheng Chen , Rohan Varma , Aarti Singh , Jelena Kovačević

We present a robust multiple manifolds structure learning (RMMSL) scheme to robustly estimate data structures under the multiple low intrinsic dimensional manifolds assumption. In the local learning stage, RMMSL efficiently estimates local…

Machine Learning · Computer Science 2012-06-22 Dian Gong , Xuemei Zhao , Gerard Medioni

We consider training decision trees using noisily labeled data, focusing on loss functions that can lead to robust learning algorithms. Our contributions are threefold. First, we offer novel theoretical insights on the robustness of many…

Machine Learning · Computer Science 2024-01-24 Jonathan Wilton , Nan Ye