English
Related papers

Related papers: On regularization methods based on dynamic program…

200 papers

Regularization plays a key role in a variety of optimization formulations of inverse problems. A recurring theme in regularization approaches is the selection of regularization parameters, and their effect on the solution and on the optimal…

Optimization and Control · Mathematics 2018-08-23 Aleksandr Y. Aravkin , James V. Burke , Michael P. Friedlander

We study the Lorentz and Dirac algebra, including antisymmetric $\epsilon$ tensors and the $\gamma_5$ matrix, in implicit gauge-invariant regularization/renormalization methods defined in fixed integer dimensions. They include constrained…

High Energy Physics - Phenomenology · Physics 2018-09-26 A. M. Bruque , A. L. Cherchiglia , M. Perez-Victoria

This paper develops algorithms for high-dimensional stochastic control problems based on deep learning and dynamic programming. Unlike classical approximate dynamic programming approaches, we first approximate the optimal policy by means of…

Probability · Mathematics 2021-09-21 Côme Huré , Huyên Pham , Achref Bachouch , Nicolas Langrené

This paper deals with speeding up the convergence of a class of two-step iterative methods for solving linear systems of equations. To implement the acceleration technique, the residual norm associated with computed approximations for each…

Numerical Analysis · Mathematics 2024-04-24 Fatemeh P. A. Beik , Michele Benzi , Mehdi Najafi-Kalyani

We propose a physics-based regularization technique for function learning, inspired by statistical mechanics. By drawing an analogy between optimizing the parameters of an interpolator and minimizing the energy of a system, we introduce…

Machine Learning · Computer Science 2025-08-20 Abhisek Ganguly , Alessandro Gabbana , Vybhav Rao , Sauro Succi , Santosh Ansumali

This article is an overview of supervised machine learning problems for regression and classification. Topics include: kernel methods, training by stochastic gradient descent, deep learning architecture, losses for classification,…

Machine Learning · Computer Science 2019-10-04 Adam M Oberman

Learning maps between data samples is fundamental. Applications range from representation learning, image translation and generative modeling, to the estimation of spatial deformations. Such maps relate feature vectors, or map between…

Computer Vision and Pattern Recognition · Computer Science 2021-06-18 Hastings Greer , Roland Kwitt , Francois-Xavier Vialard , Marc Niethammer

We propose an unsupervised approach for learning end-to-end reconstruction operators for ill-posed inverse problems. The proposed method combines the classical variational framework with iterative unrolling, which essentially seeks to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Subhadip Mukherjee , Marcello Carioni , Ozan Öktem , Carola-Bibiane Schönlieb

This work is concerned with linear inverse problems where a distributed parameter is known a priori to only take on values from a given discrete set. This property can be promoted in Tikhonov regularization with the aid of a suitable convex…

Optimization and Control · Mathematics 2018-04-19 Christian Clason , Thi Bich Tram Do

We propose algorithms and software for computing projections onto the intersection of multiple convex and non-convex constraint sets. The software package, called SetIntersectionProjection, is intended for the regularization of inverse…

Mathematical Software · Computer Science 2019-03-08 Bas Peters , Felix J. Herrmann

Regularization techniques are widely used to improve the generality, robustness, and efficiency of deep convolutional neural networks (DCNNs). In this paper, we propose a novel approach of regulating DCNN convolutional kernels by a…

Machine Learning · Computer Science 2019-11-28 Seyed Mehdi Ayyoubzadeh , Xiaolin Wu

In this paper we extend a recent idea of formulating and regularizing inverse problems as minimization problems, so without using a forward operator, thus avoiding explicit evaluation of a parameter-to-state map. We do so by rephrasing…

Numerical Analysis · Mathematics 2020-04-28 Kha Van Huynh , Barbara Kaltenbacher

We describe a method to discretize optimization problems arising in the regularization of linear inverse problem having compact forward operator defined on 3-D valed measures, compactly supported on a fixed set. The criterion is a quadratic…

Optimization and Control · Mathematics 2025-05-05 L Baratchart , D P Hardin , C Villalobos-Guillén

Calculus via regularizations and rough paths are two methods to approach stochastic integration and calculus close to pathwise calculus. The origin of rough paths theory is purely deterministic, calculus via regularization is based on…

Probability · Mathematics 2021-06-16 André Gomes , Alberto Ohashi , Francesco Russo , Alan Teixeira

For solving linear ill-posed problems regularization methods are required when the right hand side is with some noise. In the present paper regularized solutions are obtained by implicit iteration methods in Hilbert scales. % By exploiting…

Numerical Analysis · Mathematics 2015-05-20 Qinian Jin , Ulrich Tautenhahn

Dynamic inverse problems are challenging to solve due to the need to identify and incorporate appropriate regularization in both space and time. Moreover, the very large scale nature of such problems in practice presents an enormous…

Numerical Analysis · Mathematics 2025-01-23 Toluwani Okunola , Mirjeta Pasha , Misha Kilmer , Melina Freitag

We derive an efficient stochastic algorithm for inverse problems that present an unknown linear forcing term and a set of nonlinear parameters to be recovered. It is assumed that the data is noisy and that the linear part of the problem is…

Numerical Analysis · Mathematics 2019-09-17 Darko Volkov

Equivariant and invariant machine learning models exploit symmetries and structural patterns in data to improve sample efficiency. While empirical studies suggest that data-driven methods such as regularization and data augmentation can…

Machine Learning · Statistics 2025-06-17 Hao Duan , Guido Montúfar

The aim of this paper is to investigate the use of an entropic projection method for the iterative regularization of linear ill-posed problems. We derive a closed form solution for the iterates and analyze their convergence behaviour both…

Optimization and Control · Mathematics 2020-01-29 Martin Burger , Elena Resmerita , Martin Benning

Regularization is a powerful technique for extracting useful information from noisy data. Typically, it is implemented by adding some sort of norm constraint to an objective function and then exactly optimizing the modified objective…

Data Structures and Algorithms · Computer Science 2011-04-28 Michael W. Mahoney , Lorenzo Orecchia