English
Related papers

Related papers: Subspace projection regularization for large-scale…

200 papers

The electrical impedance tomography (EIT) problem of estimating the unknown conductivity distribution inside a domain from boundary current or voltage measurements requires the solution of a nonlinear inverse problem. Sparsity promoting…

Numerical Analysis · Mathematics 2024-05-27 Daniela Calvetti , Monica Pragliola , Erkki Somersalo

Bayesian posterior distributions arising in modern applications, including inverse problems in partial differential equation models in tomography and subsurface flow, are often computationally intractable due to the large computational cost…

Machine Learning · Statistics 2023-02-10 Tapio Helin , Andrew Stuart , Aretha Teckentrup , Konstantinos Zygalakis

In this work we deal with parametric inverse problems, which consist in recovering a finite number of parameters describing the structure of an unknown object, from indirect measurements. State-of-the-art methods for approximating a…

Numerical Analysis · Mathematics 2021-12-22 Paolo Massa , Sara Garbarino , Federico Benvenuto

We present a data-assisted iterative regularization method for solving ill-posed inverse problems. The proposed approach, termed \texttt{IRMGL+\(\Psi\)}, integrates classical iterative techniques with a data-driven regularization term…

Numerical Analysis · Mathematics 2025-10-28 Harshit Bajpai , Gaurav Mittal , Ankik Kumar Giri

Parameter-space regularization in neural network optimization is a fundamental tool for improving generalization. However, standard parameter-space regularization methods make it challenging to encode explicit preferences about desired…

Machine Learning · Statistics 2023-12-29 Tim G. J. Rudner , Sanyam Kapoor , Shikai Qiu , Andrew Gordon Wilson

Problems in signal processing and medical imaging often lead to calculating sparse solutions to under-determined linear systems. Methodologies for solving this problem are presented as background to the method used in this work where the…

Numerical Analysis · Computer Science 2009-07-21 R. Broughton , I. Coope , P. Renaud , R. Tappenden

Estimation of parameters that obey specific constraints is crucial in statistics and machine learning; for example, when parameters are required to satisfy boundedness, monotonicity, or linear inequalities. Traditional approaches impose…

Methodology · Statistics 2026-04-03 Lachlan Astfalck , Deborshee Sen , Sayan Patra , Edward Cripps , David Dunson

Random projection, a dimensionality reduction technique, has been found useful in recent years for reducing the size of optimization problems. In this paper, we explore the use of sparse sub-gaussian random projections to approximate…

Optimization and Control · Mathematics 2024-06-21 Monse Guedes-Ayala , Pierre-Louis Poirion , Lars Schewe , Akiko Takeda

Scalable Gaussian process (GP) inference is essential for sequential decision-making tasks, yet improving GP scalability remains a challenging problem with many open avenues of research. This paper focuses on iterative GPs, where iterative…

Machine Learning · Computer Science 2025-11-21 Alan Yufei Dong , Jihao Andreas Lin , José Miguel Hernández-Lobato

This paper addresses the problem of single image super-resolution (SR), which consists of recovering a high resolution image from its blurred, decimated and noisy version. The existing algorithms for single image SR use different strategies…

Computer Vision and Pattern Recognition · Computer Science 2016-05-03 Ningning Zhao , Qi Wei , Adrian Basarab , Nicolas Dobigeon , Denis Kouame , Jean-Yves Tourneret

We investigate the regularizing behavior of an iterative Krylov subspace method for the solution of linear inverse problems in precisions lower than double. Recent works have considered the projection of iterated Tikhonov methods using…

Numerical Analysis · Mathematics 2025-12-02 Chelsea Drum , James. G. Nagy , Lucas Onisk

The recovery of sparse generative models from few noisy measurements is an important and challenging problem. Many deterministic algorithms rely on some form of $\ell_1$-$\ell_2$ minimization to combine the computational convenience of the…

Numerical Analysis · Mathematics 2020-03-20 Daniela Calvetti , Monica Pragliola , Erkki Somersalo

Gaussian multiplicative noise is commonly used as a stochastic regularisation technique in training of deterministic neural networks. A recent paper reinterpreted the technique as a specific algorithm for approximate inference in Bayesian…

Machine Learning · Statistics 2017-11-09 Jiri Hron , Alexander G. de G. Matthews , Zoubin Ghahramani

To address the challenges of reliable statistical inference in high-dimensional models, we introduce the Synthetic-data Regularized Estimator (SRE). Unlike traditional regularization methods, the SRE regularizes the complex target model via…

Statistics Theory · Mathematics 2025-03-18 Weihao Li , Dongming Huang

The performance of Gaussian Process (GP) regression is often hampered by the curse of dimensionality, which inflates computational cost and reduces predictive power in high-dimensional problems. Variable selection is thus crucial for…

Methodology · Statistics 2025-11-24 Minshen Xu , Shiwei Lan , Lulu Kang

Optimizing expensive-to-evaluate black-box functions of discrete (and potentially continuous) design parameters is a ubiquitous problem in scientific and engineering applications. Bayesian optimization (BO) is a popular, sample-efficient…

Machine Learning · Computer Science 2022-10-20 Samuel Daulton , Xingchen Wan , David Eriksson , Maximilian Balandat , Michael A. Osborne , Eytan Bakshy

Estimating the values of unknown parameters from corrupted measured data faces a lot of challenges in ill-posed problems. In such problems, many fundamental estimation methods fail to provide a meaningful stabilized solution. In this work,…

Information Theory · Computer Science 2017-01-11 Mohamed Suliman , Tarig Ballal , Tareq Y. Al-Naffouri

Dropout-based regularization methods can be regarded as injecting random noise with pre-defined magnitude to different parts of the neural network during training. It was recently shown that Bayesian dropout procedure not only improves…

Machine Learning · Statistics 2017-11-07 Kirill Neklyudov , Dmitry Molchanov , Arsenii Ashukha , Dmitry Vetrov

Shape constrained regression analysis has applications in dose-response modeling, environmental risk assessment, disease screening and many other areas. Incorporating the shape constraints can improve estimation efficiency and avoid…

Methodology · Statistics 2013-06-19 Lizhen Lin , David B. Dunson

We consider a framework for determining and estimating the conditional pairwise relationships of variables when the observed samples are contaminated with measurement error in high dimensional settings. Assuming the true underlying…

Methodology · Statistics 2019-07-05 Michael Byrd , Linh Nghiem , Monnie McGee