English
Related papers

Related papers: A randomized progressive iterative regularization …

200 papers

Photoacoustic imaging (PAI) suffers from inherent limitations that can degrade the quality of reconstructed results, such as noise, artifacts and incomplete data acquisition caused by sparse sampling or partial array detection. In this…

Optics · Physics 2025-01-07 Yu Zhang , Shuang Li , Yibing Wang , Yu Sun , Wenyi Xiang

We propose a physics-based regularization technique for function learning, inspired by statistical mechanics. By drawing an analogy between optimizing the parameters of an interpolator and minimizing the energy of a system, we introduce…

Machine Learning · Computer Science 2025-08-20 Abhisek Ganguly , Alessandro Gabbana , Vybhav Rao , Sauro Succi , Santosh Ansumali

This paper considers a noisy data structure recovery problem. The goal is to investigate the following question: Given a noisy observation of a permuted data set, according to which permutation was the original data sorted? The focus is on…

Information Theory · Computer Science 2020-11-24 Minoh Jeong , Alex Dytso , Martina Cardone , H. Vincent Poor

Stochastic gradient descent is one of the most successful approaches for solving large-scale problems, especially in machine learning and statistics. At each iteration, it employs an unbiased estimator of the full gradient computed from one…

Numerical Analysis · Mathematics 2018-12-05 Bangti Jin , Xiliang Lu

Given a matrix the seriation problem consists in permuting its rows in such way that all its columns have the same shape, for example, they are monotone increasing. We propose a statistical approach to this problem where the matrix of…

Statistics Theory · Mathematics 2016-08-02 Nicolas Flammarion , Cheng Mao , Philippe Rigollet

In this paper, a two-step regularization method is used to solve an ill-posed spherical pseudo-differential equation in the presence of noisy data. For the first step of regularization we approximate the data by means of a spherical…

Numerical Analysis · Mathematics 2015-01-05 Hui Cao , Sergei V. Pereverzyev , Ian H. Sloan , Pavlo Tkachenko

Learning approaches have recently become very popular in the field of inverse problems. A large variety of methods has been established in recent years, ranging from bi-level learning to high-dimensional machine learning techniques. Most…

Optimization and Control · Mathematics 2017-04-05 Martin Benning , Guy Gilboa , Joana Sarah Grah , Carola-Bibiane Schönlieb

Deep Neural Networks have achieved remarkable success relying on the developing availability of GPUs and large-scale datasets with increasing network depth and width. However, due to the expensive computation and intensive memory,…

Machine Learning · Computer Science 2020-09-07 E Zhenqian , Gao Weiguo

In this paper, we investigate regularization of linear inverse problems with irregular noise. In particular, we consider the case that the noise can be preprocessed by certain adjoint embedding operators. By introducing the consequent…

Numerical Analysis · Mathematics 2024-01-30 Xinyan Li , Simon Hubmer , Shuai Lu , Ronny Ramlau

This paper deals with the geometric multi-model fitting from noisy, unstructured point set data (e.g., laser scanned point clouds). We formulate multi-model fitting problem as a sequential decision making process. We then use a deep…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Zongliang Zhang , Hongbin Zeng , Jonathan Li , Yiping Chen , Chenhui Yang , Cheng Wang

We reformulate the gain correction problem of the radio interferometry as an optimization problem with regularization, which is solved efficiently with an iterative algorithm. Combining this new method with our previously proposed imaging…

Instrumentation and Methods for Astrophysics · Physics 2024-12-05 Shiro Ikeda , Takeshi Nakazato , Takashi Tsukagoshi , Tsutomu T. Takeuchi , Masayuki Yamaguchi

An adaptive regularization strategy for stabilizing Newton-like iterations on a coarse mesh is developed in the context of adaptive finite element methods for nonlinear PDE. Existence, uniqueness and approximation properties are known for…

Numerical Analysis · Mathematics 2015-01-27 Sara Pollock

Regularization for optimization is a crucial technique to avoid overfitting in machine learning. In order to obtain the best performance, we usually train a model by tuning the regularization parameters. It becomes costly, however, when a…

Machine Learning · Computer Science 2020-08-18 Jingfeng Wu , Vladimir Braverman , Lin F. Yang

We present an adaptive regularization algorithm that can be effectively applied to the optimization problem in deep learning framework. Our regularization algorithm aims to take into account the fitness of data to the current state of model…

Machine Learning · Computer Science 2019-09-02 Junghee Cho , Junseok Kwon , Byung-Woo Hong

The truncated singular value decomposition may be used to find the solution of linear discrete ill-posed problems in conjunction with Tikhonov regularization and requires the estimation of a regularization parameter that balances between…

Numerical Analysis · Mathematics 2022-08-16 Rosemary A. Renaut , Anthony W. Helmstetter , Saeed Vatankhah

In many astronomical problems one often needs to determine the upper and/or lower boundary of a given data set. An automatic and objective approach consists in fitting the data using a generalised least-squares method, where the function to…

Instrumentation and Methods for Astrophysics · Physics 2015-05-13 N. Cardiel

In performative learning, the data distribution reacts to the deployed model - for example, because strategic users adapt their features to game it - which creates a more complex dynamic than in classical supervised learning. One should…

Machine Learning · Computer Science 2025-10-15 Edwige Cyffers , Alireza Mirrokni , Marco Mondelli

The multivariate linear regression model with shuffled data and additive Gaussian noise arises in various correspondence estimation and matching problems. Focusing on the denoising aspect of this problem, we provide a characterization the…

Machine Learning · Statistics 2017-04-26 Ashwin Pananjady , Martin J. Wainwright , Thomas A. Courtade

Constrained optimization problems appear in a wide variety of challenging real-world problems, where constraints often capture the physics of the underlying system. Classic methods for solving these problems rely on iterative algorithms…

Systems and Control · Electrical Eng. & Systems 2023-06-13 Meiyi Li , Soheil Kolouri , Javad Mohammadi

We propose a variational regularization approach based on a multiscale representation called cylindrical shearlets aimed at dynamic imaging problems, especially dynamic tomography. The intuitive idea of our approach is to integrate a…

Numerical Analysis · Mathematics 2025-08-05 Tatiana A. Bubba , Tommi Heikkilä , Demetrio Labate , Luca Ratti