English
Related papers

Related papers: A statistical and computational theory for robust …

200 papers

Phase retrieval (PR) is a popular research topic in signal processing and machine learning. However, its performance degrades significantly when the measurements are corrupted by noise or outliers. To address this limitation, we propose a…

Optimization and Control · Mathematics 2025-05-30 Jun Fan , Ailing Yan , Xianchao Xiu , Wanquan Liu

Motivated by a growing list of nontraditional statistical estimation problems of the piecewise kind, this paper provides a survey of known results supplemented with new results for the class of piecewise linear-quadratic programs. These are…

Optimization and Control · Mathematics 2018-08-16 Ying Cui , Tsung-Hui Chang , Mingyi Hong , Jong-Shi Pang

Large-scale dynamic inverse problems are often ill-posed due to model complexity and the high dimensionality of the unknown parameters. Regularization is commonly employed to mitigate ill-posedness by incorporating prior information and…

Numerical Analysis · Mathematics 2026-01-21 Aryeh Keating , Mirjeta Pasha

Sparse estimation methods are aimed at using or obtaining parsimonious representations of data or models. They were first dedicated to linear variable selection but numerous extensions have now emerged such as structured sparsity or kernel…

Machine Learning · Computer Science 2011-11-24 Francis Bach , Rodolphe Jenatton , Julien Mairal , Guillaume Obozinski

This paper discusses a general framework for smoothing parameter estimation for models with regular likelihoods constructed in terms of unknown smooth functions of covariates. Gaussian random effects and parametric terms may also be…

Methodology · Statistics 2016-05-10 Simon N. Wood , Natalya Pya , Benjamin Säfken

Smoothing of noisy sample covariances is an important component in functional data analysis. We propose a novel covariance smoothing method based on penalized splines and associated software. The proposed method is a bivariate spline…

Methodology · Statistics 2017-04-07 Luo Xiao , Cai Li , William Checkley , Ciprian M. Crainiceanu

Kalman filtering and smoothing algorithms are used in many areas, including tracking and navigation, medical applications, and financial trend filtering. One of the basic assumptions required to apply the Kalman smoothing framework is that…

Optimization and Control · Mathematics 2014-03-21 Aleksandr Y. Aravkin , James V. Burke

Coping with outliers contaminating dynamical processes is of major importance in various applications because mismatches from nominal models are not uncommon in practice. In this context, the present paper develops novel fixed-lag and…

Systems and Control · Computer Science 2018-11-29 Shahrokh Farahmand , Georgios B. Giannakis , Daniele Angelosante

A first proposal of a sparse and cellwise robust PCA method is presented. Robustness to single outlying cells in the data matrix is achieved by substituting the squared loss function for the approximation error by a robust version. The…

Computation · Statistics 2024-08-29 Pia Pfeiffer , Laura Vana-Gür , Peter Filzmoser

We consider the problem of state estimation in dynamical systems and propose a different mechanism for handling unmodeled system uncertainties. Instead of injecting random process noise, we assign different weights to measurements so that…

Information Theory · Computer Science 2020-09-08 Yaron Shulami , Daniel Sigalov

Modern technologies are generating ever-increasing amounts of data. Making use of these data requires methods that are both statistically sound and computationally efficient. Typically, the statistical and computational aspects are treated…

Methodology · Statistics 2022-09-15 Mahsa Taheri , Néhémy Lim , Johannes Lederer

This paper proposes a novel convex optimization framework for designing robust Kalman filters that guarantee a user-specified steady-state error while maximizing process and sensor noise. The proposed framework simultaneously determines the…

Systems and Control · Electrical Eng. & Systems 2024-03-06 Himanshu Prabhat , Raktim Bhattacharya

We employ the variational formulation and the Euler-Lagrange equations to study the steady-state error in linear non-causal estimators (smoothers). We give a complete description of the steady-state error for inputs that are polynomial in…

Optimization and Control · Mathematics 2008-02-04 D. Ezri , B. Z. Bobrovsky , Z. Schuss

Solving l1 regularized optimization problems is common in the fields of computational biology, signal processing and machine learning. Such l1 regularization is utilized to find sparse minimizers of convex functions. A well-known example is…

Numerical Analysis · Computer Science 2016-07-04 Eran Treister , Javier S. Turek , Irad Yavneh

We propose a new sparsity-smoothness penalty for high-dimensional generalized additive models. The combination of sparsity and smoothness is crucial for mathematical theory as well as performance for finite-sample data. We present a…

Machine Learning · Statistics 2009-11-18 Lukas Meier , Sara van de Geer , Peter Bühlmann

Molecular profiling data (e.g., gene expression) has been used for clinical risk prediction and biomarker discovery. However, it is necessary to integrate other prior knowledge like biological pathways or gene interaction networks to…

Genomics · Quantitative Biology 2016-09-22 Wenwen Min , Juan Liu , Shihua Zhang

In this work, we propose an optimization framework for estimating a sparse robust one-dimensional subspace. Our objective is to minimize both the representation error and the penalty, in terms of the l1-norm criterion. Given that the…

Machine Learning · Statistics 2024-03-07 Xiao Ling , Paul Brooks

This paper presents a new filter for state-space models based on Bellman's dynamic-programming principle, allowing for nonlinearity, non-Gaussianity and degeneracy in the observation and/or state-transition equations. The resulting Bellman…

Methodology · Statistics 2025-02-18 Rutger-Jan Lange

We propose a new class of filtering and smoothing methods for inference in high-dimensional, nonlinear, non-Gaussian, spatio-temporal state-space models. The main idea is to combine the ensemble Kalman filter and smoother, developed in the…

Methodology · Statistics 2019-03-22 Matthias Katzfuss , Jonathan R. Stroud , Christopher K. Wikle

We introduce a derivative-free computational framework for approximating solutions to nonlinear PDE-constrained inverse problems. The aim is to merge ideas from iterative regularization with ensemble Kalman methods from Bayesian inference…

Optimization and Control · Mathematics 2016-01-20 Marco A. Iglesias