English
Related papers

Related papers: Adaptive regularization parameter selection for hi…

200 papers

Tensors are ubiquitous in science and engineering and tensor factorization approaches have become important tools for the characterization of higher order structure. Factorizations includes the outer-product rank Canonical Polyadic…

Machine Learning · Statistics 2023-10-05 Jesper Løve Hinrich , Morten Mørup

Design optimisation potentially leads to lightweight aircraft structures with lower environmental impact. Due to the high number of design variables and constraints, these problems are ordinarily solved using gradient-based optimisation…

Computational Engineering, Finance, and Science · Computer Science 2024-01-23 Hauke Maathuis , Roeland De Breuker , Saullo G. P. Castro

Accurate determination of the regularization parameter in inverse problems still represents an analytical challenge, owing mainly to the considerable difficulty to separate the unknown noise from the signal. We present a new approach for…

Numerical Analysis · Mathematics 2019-07-24 Eitan Levin , Alexander Y. Meltzer

In this paper we study the topic of signal restoration using complexity regularization, quantifying the compression bit-cost of the signal estimate. While complexity-regularized restoration is an established concept, solid practical methods…

Information Theory · Computer Science 2018-11-14 Yehuda Dar , Michael Elad , Alfred M. Bruckstein

Inverse problems and, in particular, inferring unknown or latent parameters from data are ubiquitous in engineering simulations. A predominant viewpoint in identifying unknown parameters is Bayesian inference where both prior information…

Computation · Statistics 2022-08-31 Vahid Keshavarzzadeh , Robert M. Kirby , Akil Narayan

Tensor decomposition is an effective approach to compress over-parameterized neural networks and to enable their deployment on resource-constrained hardware platforms. However, directly applying tensor compression in the training process is…

Machine Learning · Computer Science 2019-05-28 Cole Hawkins , Zheng Zhang

High-order tensor methods that employ local Taylor models of degree $p$ within adaptive regularization frameworks (AR$p$) have recently received significant attention, due to their optimal/improved global and local rates of convergence, for…

Optimization and Control · Mathematics 2025-12-23 Coralia Cartis , Raphael Hauser , Yang Liu , Karl Welzel , Wenqi Zhu

We propose a new stopping criterion for Krylov subspace iterative regularization of large-scale ill-posed inverse problems. Our stopping criterion accurately filters the data using a generalization of the Picard parameter that was…

Numerical Analysis · Mathematics 2017-07-14 Eitan Levin , Alexander Y. Meltzer

Beamforming in ultrasound imaging has significant impact on the quality of the final image, controlling its resolution and contrast. Despite its low spatial resolution and contrast, delay-and-sum is still extensively used nowadays in…

Computer Vision and Pattern Recognition · Computer Science 2016-05-20 Teodora Szasz , Adrian Basarab , Denis Kouamé

Optimization techniques have been widely used in deformable registration, allowing for the incorporation of similarity metrics with regularization mechanisms. These regularization mechanisms are designed to mitigate the effects of trivial…

Computer Vision and Pattern Recognition · Computer Science 2014-04-10 Martin Rajchl , John S. H. Baxter , Wu Qiu , Ali R. Khan , Aaron Fenster , Terry M. Peters , Jing Yuan

Fabrication process variations are a major source of yield degradation in the nano-scale design of integrated circuits (IC), microelectromechanical systems (MEMS) and photonic circuits. Stochastic spectral methods are a promising technique…

Computational Engineering, Finance, and Science · Computer Science 2016-11-08 Zheng Zhang , Tsui-Wei Weng , Luca Daniel

Low rank approximation is a commonly occurring problem in many computer vision and machine learning applications. There are two common ways of optimizing the resulting models. Either the set of matrices with a given rank can be explicitly…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Marcus Valtonen Örnhag , Carl Olsson , Anders Heyden

In this paper we consider the estimation of unknown parameters in Bayesian inverse problems. In most cases of practical interest, there are several barriers to performing such estimation, This includes a numerical approximation of a…

Methodology · Statistics 2025-02-07 Neil K. Chada , Ajay Jasra , Mohamed Maama , Raul Tempone

We explore anisotropic regularisation methods in the spirit of [Holler & Kunisch, 14]. Based on ground truth data, we propose a bilevel optimisation strategy to compute the optimal regularisation parameters of such a model for the…

Numerical Analysis · Mathematics 2016-02-04 Martin Benning , Carola-Bibiane Schönlieb , Tuomo Valkonen , Verner Vlačić

We consider the problem of computationally-efficient prediction from high dimensional and highly correlated predictors in challenging settings where accurate variable selection is effectively impossible. Direct application of penalization…

Statistics Theory · Mathematics 2017-12-08 Minerva Mukhopadhyay , David B. Dunson

Low rank tensor ring model is powerful for image completion which recovers missing entries in data acquisition and transformation. The recently proposed tensor ring (TR) based completion algorithms generally solve the low rank optimization…

Machine Learning · Statistics 2021-04-07 Zhen Long , Ce Zhu , Jiani Liu , Yipeng Liu

We propose a Bayesian inference framework to estimate uncertainties in inverse scattering problems. Given the observed data, the forward model and their uncertainties, we find the posterior distribution over a finite parameter field…

Numerical Analysis · Mathematics 2020-11-17 Ana Carpio , Sergei Iakunin , Georg Stadler

We develop a data-driven algorithm for automatically selecting the regularisation parameter in Bayesian inversion under random tree Besov priors. One of the key challenges in Bayesian inversion is the construction of priors that are both…

Statistics Theory · Mathematics 2026-01-21 Hanne Kekkonen , Andreas Tataris

We highlight some recent new delevelopments concerning the sparse representation of possibly high-dimensional functions exhibiting strong anisotropic features and low regularity in isotropic Sobolev or Besov scales. Specifically, we focus…

Numerical Analysis · Mathematics 2014-09-30 Wolfgang Dahmen , Chunyan Huang , Gitta Kutyniok , Wang-Q Lim , Christoph Schwab , Gerrit Welper

Proper regularization is crucial in inverse problems to achieve high-quality reconstruction, even with an ill-conditioned measurement system. This is particularly true for three-dimensional photoacoustic tomography, which is computationally…

Optimization and Control · Mathematics 2024-09-26 Chao Wang , Alexandre H. Thiery