English
Related papers

Related papers: Matrix Sensing with Kernel Optimal Loss: Robustnes…

200 papers

Distributional shifts pose a significant challenge to achieving robustness in contemporary machine learning. To overcome this challenge, robust satisficing (RS) seeks a robust solution to an unspecified distributional shift while achieving…

Machine Learning · Computer Science 2023-08-17 Artun Saday , Yaşar Cahit Yıldırım , Cem Tekin

We generalized a modified exponentialized estimator by pushing the robust-optimal (RO) index $\lambda$ to $-\infty$ for achieving robustness to outliers by optimizing a quasi-Minimin function. The robustness is realized and controlled…

Machine Learning · Computer Science 2023-10-19 Zhiguang Wang , Tim Oates , James Lo

Many works have investigated radio map and path loss prediction in wireless networks using deep learning, in particular using convolutional neural networks. However, most assume perfect environment information, which is unrealistic in…

Signal Processing · Electrical Eng. & Systems 2026-02-13 Fabian Jaensch , Çağkan Yapar , Giuseppe Caire , Begüm Demir

High-dimensional matrix regression has been studied in various aspects, such as statistical properties, computational efficiency and application to specific instances including multivariate regression, system identification and matrix…

Statistics Theory · Mathematics 2024-03-06 Xin Li , Dongya Wu

Recently, deep learning-based algorithms are widely adopted due to the advantage of being able to establish anomaly detection models without or with minimal domain knowledge of the task. Instead, to train the artificial neural network more…

Machine Learning · Computer Science 2023-04-17 YeongHyeon Park

We consider the task of robust non-linear regression in the presence of both inlier noise and outliers. Assuming that the unknown non-linear function belongs to a Reproducing Kernel Hilbert Space (RKHS), our goal is to estimate the set of…

Machine Learning · Computer Science 2017-08-02 George Papageorgiou , Pantelis Bouboulis , Sergios Theodoridis

Deep neural networks are workhorse models in machine learning with multiple layers of non-linear functions composed in series. Their loss function is highly non-convex, yet empirically even gradient descent minimisation is sufficient to…

Disordered Systems and Neural Networks · Physics 2020-03-18 Simon Becker , Yao Zhang , Alpha A. Lee

Subset selection is a fundamental problem in combinatorial optimization, which has a wide range of applications such as influence maximization and sparse regression. The goal is to select a subset of limited size from a ground set in order…

Neural and Evolutionary Computing · Computer Science 2026-04-22 Yiheng Xu , Danxuan Liu , Bin Zhang , Weiyong Yang , Chao Qian

In presence of sparse noise we propose kernel regression for predicting output vectors which are smooth over a given graph. Sparse noise models the training outputs being corrupted either with missing samples or large perturbations. The…

Machine Learning · Statistics 2018-11-07 Arun Venkitaraman , Pascal Frossard , Saikat Chatterjee

In compressed sensing one measures sparse signals directly in a compressed form via a linear transform and then reconstructs the original signal. However, it is often the case that the linear transform itself is known only approximately, a…

Information Theory · Computer Science 2013-11-13 Florent Krzakala , Marc Mézard , Lenka Zdeborová

Whether or not a local minimum of a cost function has a strongly convex neighborhood greatly influences the asymptotic convergence rate of optimizers. In this article, we rigorously analyze the prevalence of this property for the mean…

Machine Learning · Computer Science 2025-04-15 Felix Benning , Steffen Dereich

We study the problem of robustly learning Gaussian Single Index Models (SIMs) in the presence of heavy-tailed noise and a constant fraction of adversarially corrupted covariates and responses. Prior work on robust recovery has considered…

Machine Learning · Computer Science 2026-05-29 Santanu Das , Sagnik Chatterjee , Jatin Batra

Noise robust compressive sensing algorithm is considered. This algorithm allows an efficient signal reconstruction in the presence of different types of noise due to the possibility to change minimization norm. For instance, the commonly…

Information Theory · Computer Science 2015-02-23 Maja Lakicevic , Mitar Moracanin , Nadja Djerkovic

This paper is concerned with low-rank matrix optimization, which has found a wide range of applications in machine learning. This problem in the special case of matrix sensing has been studied extensively through the notion of Restricted…

Optimization and Control · Mathematics 2023-03-17 Ziye Ma , Somayeh Sojoudi

This paper presents research findings on handling faulty measurements (i.e., outliers) of global navigation satellite systems (GNSS) for vehicle localization under adverse signal conditions in field applications, where raw GNSS data are…

Robotics · Computer Science 2025-10-16 Haoming Zhang

We prove that the empirical risk of most well-known loss functions factors into a linear term aggregating all labels with a term that is label free, and can further be expressed by sums of the loss. This holds true even for non-smooth,…

Machine Learning · Computer Science 2016-02-11 Giorgio Patrini , Frank Nielsen , Richard Nock , Marcello Carioni

High-dimensional linear regression under heavy-tailed noise or outlier corruption is challenging, both computationally and statistically. Convex approaches have been proven statistically optimal but suffer from high computational costs,…

Statistics Theory · Mathematics 2023-05-11 Yinan Shen , Jingyang Li , Jian-Feng Cai , Dong Xia

The present study proposes incorporating non-parametric knowledge into the diffusion least-mean-squares algorithm in the framework of a maximum a posteriori (MAP) estimation. The proposed algorithm leads to a robust estimation of an unknown…

Machine Learning · Computer Science 2023-12-05 Soheil Ashkezari-Toussi , Hadi sadoghi-Yazdi

This paper deals with robust regression and subspace estimation and more precisely with the problem of minimizing a saturated loss function. In particular, we focus on computational complexity issues and show that an exact algorithm with…

Machine Learning · Computer Science 2019-04-22 Fabien Lauer

Neural networks have been widely used as predictive models to fit data distribution, and they could be implemented through learning a collection of samples. In many applications, however, the given dataset may contain noisy samples or…

Neural and Evolutionary Computing · Computer Science 2017-05-30 Dianhui Wang , Ming Li
‹ Prev 1 3 4 5 6 7 10 Next ›