English
Related papers

Related papers: Robust Hierarchical-Optimization RLS Against Spars…

200 papers

A new approach to nonlinear modelling is presented which, by incorporating the global behaviour of the model, lifts shortcomings of both least squares and total least squares parameter estimates. Although ubiquitous in practice, a least…

chao-dyn · Physics 2009-10-31 Patrick E. McSharry , Leonard A. Smith

One of the main problems studied in statistics is the fitting of models. Ideally, we would like to explain a large dataset with as few parameters as possible. There have been numerous attempts at automatizing this process. Most notably, the…

Computation · Statistics 2018-09-24 Marc Härkönen , Tomonari Sei , Yoshihiro Hirose

It is well-known that the noise associated with the collection of an astronomical image by a CCD camera is, in large part, Poissonian. One would expect, therefore, that computational approaches that incorporate this a priori information…

Astrophysics · Physics 2009-11-10 R. Vio , J. Bardsley , W. Wamsteker

The Broad Learning System (BLS) has gained significant attention for its computational efficiency and less network parameters compared to deep learning structures. However, the standard BLS relies on the pseudoinverse solution, which…

Systems and Control · Electrical Eng. & Systems 2025-11-25 Zijing Li

Nonlinear estimation in robotics and vision is typically plagued with outliers due to wrong data association, or to incorrect detections from signal processing and machine learning methods. This paper introduces two unifying formulations…

Computer Vision and Pattern Recognition · Computer Science 2021-07-05 Pasquale Antonante , Vasileios Tzoumas , Heng Yang , Luca Carlone

Cellwise contamination remains a challenging problem for data scientists, particularly in research fields that require the selection of sparse features. Traditional robust methods may not be feasible nor efficient in dealing with such…

Methodology · Statistics 2024-03-04 Peng Su , Garth Tarr , Samuel Muller , Suojin Wang

Least-squares refitting is widely used in high dimensional regression to reduce the prediction bias of l1-penalized estimators (e.g., Lasso and Square-Root Lasso). We present theoretical and numerical results that provide new insights into…

Methodology · Statistics 2013-06-04 Johannes Lederer

We study a functional linear regression model that deals with functional responses and allows for both functional covariates and high-dimensional vector covariates. The proposed model is flexible and nests several functional regression…

Statistics Theory · Mathematics 2022-08-24 Daren Wang , Zifeng Zhao , Yi Yu , Rebecca Willett

We propose a general framework for reconstructing transform-sparse images from undersampled (squared)-magnitude data corrupted with outliers. This framework is implemented using a multi-layered approach, combining multiple initializations…

Recovering intrinsic data structure from corrupted observations plays an important role in various tasks in the communities of machine learning and signal processing. In this paper, we propose a novel model, named log-sum heuristic recovery…

Numerical Analysis · Computer Science 2014-08-13 Yue Deng , Qionghai Dai , Risheng Liu , Zengke Zhang , Sanqing Hu

In this paper, we consider robust system identification under sparse outliers and random noises. In this problem, system parameters are observed through a Toeplitz matrix. All observations are subject to random noises and a few are…

Information Theory · Computer Science 2013-05-28 Weiyu Xu , Erwei Bai , Myung Cho

We propose a new algorithm for the problem of recovering data that adheres to multiple, heterogeneous low-dimensional structures from linear observations. Focusing on data matrices that are simultaneously row-sparse and low-rank, we propose…

Machine Learning · Computer Science 2024-01-19 Christian Kümmerle , Johannes Maly

Phase retrieval has been mainly considered in the presence of Gaussian noise. However, the performance of the algorithms proposed under the Gaussian noise model severely degrades when grossly corrupted data, i.e., outliers, exist. This…

Information Theory · Computer Science 2017-11-22 Cheng Qian , Xiao Fu , Nicholas D. Sidiropoulos , Lei Huang , Junhao Xie

Concerning bivariate least squares linear regression, the classical results obtained for extreme structural models in earlier attempts are reviewed using a new formalism in terms of deviation (matrix) traces which, for homoscedastic data,…

Instrumentation and Methods for Astrophysics · Physics 2017-11-17 R. Caimmi

The least trimmed squares (LTS) is a reasonable formulation of robust regression whereas it suffers from high computational cost due to the nonconvexity and nonsmoothness of its objective function. The most frequently used FAST-LTS…

Computation · Statistics 2024-10-08 Shotaro Yagishita

Model selection and sparse recovery are two important problems for which many regularization methods have been proposed. We study the properties of regularization methods in both problems under the unified framework of regularized least…

Statistics Theory · Mathematics 2009-09-03 Jinchi Lv , Yingying Fan

We consider the high-dimensional linear regression model and assume that a fraction of the measurements are altered by an adversary with complete knowledge of the data and the underlying distribution. We are interested in a scenario where…

Statistics Theory · Mathematics 2023-12-11 Stanislav Minsker , Mohamed Ndaoud , Lang Wang

We develop a constructive approach to estimating sparse, high-dimensional linear regression models. The approach is a computational algorithm motivated from the KKT conditions for the $\ell_0$-penalized least squares solutions. It generates…

Computation · Statistics 2017-01-19 Jian Huang , Yuling Jiao , Yanyan Liu , Xiliang Lu

Sparsity promoting norms are frequently used in high dimensional regression. A limitation of such Lasso-type estimators is that the optimal regularization parameter depends on the unknown noise level. Estimators such as the concomitant…

Machine Learning · Statistics 2020-09-04 Quentin Bertrand , Mathurin Massias , Alexandre Gramfort , Joseph Salmon

In this paper, the estimation problem for sparse reduced rank regression (SRRR) model is considered. The SRRR model is widely used for dimension reduction and variable selection with applications in signal processing, econometrics, etc. The…

Machine Learning · Statistics 2018-03-21 Ziping Zhao , Daniel P. Palomar