English
Related papers

Related papers: Perturbation-Based Regularization for Signal Estim…

200 papers

Randomized regularized Kaczmarz algorithms have recently been proposed to solve tensor recovery models with {\it consistent} linear measurements. In this work, we propose a novel algorithm based on the randomized extended Kaczmarz algorithm…

Numerical Analysis · Mathematics 2021-12-17 Kui Du , Xiao-Hui Sun

We present a sample- and time-efficient differentially private algorithm for ordinary least squares, with error that depends linearly on the dimension and is independent of the condition number of $X^\top X$, where $X$ is the design matrix.…

Machine Learning · Computer Science 2024-04-25 Gavin Brown , Jonathan Hayase , Samuel Hopkins , Weihao Kong , Xiyang Liu , Sewoong Oh , Juan C. Perdomo , Adam Smith

In this work, we propose a high-order regularization method to solve the ill-conditioned problems in robot localization. Numerical solutions to robot localization problems are often unstable when the problems are ill-conditioned. A typical…

Robotics · Computer Science 2025-05-07 Xinghua Liu , Ming Cao

This work introduces a reduced order modeling (ROM) framework for the solution of parameterized second-order linear elliptic partial differential equations formulated on unfitted geometries. The goal is to construct efficient…

Numerical Analysis · Mathematics 2025-10-14 Margarita Chasapi , Pablo Antolin , Annalisa Buffa

The randomized row method is a popular representative of the iterative algorithm because of its efficiency in solving the overdetermined and consistent systems of linear equations. In this paper, we present an extended randomized multiple…

Numerical Analysis · Mathematics 2024-11-06 Nian-Ci Wu , Chengzhi Liu , Yatian Wang , Qian Zuo

In this paper, we establish universal approximation theorems for neural networks applied to general nonlinear ill-posed operator equations. In addition to the approximation error, the measurement error is also taken into account in our…

Numerical Analysis · Mathematics 2025-11-21 Lan Wang , Qiao Zhu , Bangti Jin , Ye Zhang

We introduce a general framework to handle structured models (sparse and block-sparse with possibly overlapping blocks). We discuss new methods for their recovery from incomplete observation, corrupted with deterministic and stochastic…

Statistics Theory · Mathematics 2013-02-28 Anatoli Juditsky , Fatma Kılınç Karzan , Arkadi Nemirovski , Boris Polyak

We study weighted Tikhonov regularization for large-scale linear discrete ill-posed problems with random noise. Under a polynomial upper-bound assumption on the generalized eigenvalues of the discrete forward operator, we derive stochastic…

Numerical Analysis · Mathematics 2026-05-19 Duan-Peng Ling , Wenlong Zhang

This paper addresses the challenge of probabilistic parameter estimation given measurement uncertainty in real-time. We provide a general formulation and apply this to pose estimation for an autonomous visual landing system. We present…

Tikhonov regularization is a popular approach to obtain a meaningful solution for ill-conditioned linear least squares problems. A relatively simple way of choosing a good regularization parameter is given by Morozov's discrepancy…

Numerical Analysis · Mathematics 2020-06-24 Jeffrey Cornelis , Nick Schenkels , Wim Vanroose

Most of the literature on the solution of linear ill-posed operator equations, or their discretization, focuses only on the infinite-dimensional setting or only on the solution of the algebraic linear system of equations obtained by…

Numerical Analysis · Mathematics 2018-12-05 Ronny Ramlau , Lothar Reichel

The problem of numerical differentiation can be thought of as an inverse problem by considering it as solving a Volterra equation. It is well known that such inverse integral problems are ill-posed and one requires regularization methods to…

Numerical Analysis · Mathematics 2020-04-15 Abinash Nayak

Parametric prediction error methods constitute a classical approach to the identification of linear dynamic systems with excellent large-sample properties. A more recent regularized approach, inspired by machine learning and Bayesian…

Systems and Control · Computer Science 2017-10-12 Johan Wågberg , Dave Zachariah , Thomas B. Schön

The paper investigates the problem of estimating the state of a time-varying system with a linear measurement model; in particular, the paper considers the case where the number of measurements available can be smaller than the number of…

Systems and Control · Electrical Eng. & Systems 2021-04-07 Guido Cavraro , Emiliano Dall'Anese , Joshua Comden , Andrey Bernstein

Sparsity promoting regularization is an important technique for signal reconstruction and several other ill-posed problems. Theoretical investigation typically bases on the assumption that the unknown solution has a sparse representation…

Numerical Analysis · Mathematics 2013-11-11 Jens Flemming , Markus Hegland

Ordinary Differential Equations are a simple but powerful framework for modeling complex systems. Parameter estimation from times series can be done by Nonlinear Least Squares (or other classical approaches), but this can give…

Methodology · Statistics 2014-10-29 Quentin Clairon , Nicolas Brunel

This paper aims to develop and analyze a numerical scheme for solving the backward problem of semilinear subdiffusion equations. We establish the existence, uniqueness, and conditional stability of the solution to the inverse problem by…

Numerical Analysis · Mathematics 2025-05-07 Xu Wu , Jiang Yang , Zhi Zhou

We present a new algorithm for solving optimization problems with objective functions that are the sum of a smooth function and a (potentially) nonsmooth regularization function, and nonlinear equality constraints. The algorithm may be…

Optimization and Control · Mathematics 2024-04-12 Yutong Dai , Xiaoyi Qu , Daniel P. Robinson

When determining the parameters of a parametric planar shape based on a single low-resolution image, common estimation paradigms lead to inaccurate parameter estimates. The reason behind poor estimation results is that standard estimation…

Computer Vision and Pattern Recognition · Computer Science 2019-01-30 Wojciech Chojnacki , Zygmunt L. Szpak

We study the problem of estimating an unknown deterministic signal that is observed through an unknown deterministic data matrix under additive noise. In particular, we present a minimax optimization framework to the least squares problems,…

Systems and Control · Computer Science 2014-04-28 N. Denizcan Vanli , Mehmet A. Donmez , Suleyman S. Kozat