English
Related papers

Related papers: Uniform multi-penalty regularization for linear il…

200 papers

In high-dimensional and/or non-parametric regression problems, regularization (or penalization) is used to control model complexity and induce desired structure. Each penalty has a weight parameter that indicates how strongly the structure…

Machine Learning · Statistics 2017-03-30 Jean Feng , Noah Simon

The strong correlation between neurons or filters can significantly weaken the generalization ability of neural networks. Inspired by the well-known Tammes problem, we propose a novel diversity regularization method to address this issue,…

Machine Learning · Computer Science 2021-03-24 Zhennan Wang , Canqun Xiang , Wenbin Zou , Chen Xu

This work unifies the analysis of various randomized methods for solving linear and nonlinear inverse problems by framing the problem in a stochastic optimization setting. By doing so, we show that many randomized methods are variants of a…

Numerical Analysis · Mathematics 2023-06-21 Jonathan Wittmer , C. G. Krishnanunni , Hai V. Nguyen , Tan Bui-Thanh

We study variational regularisation methods for inverse problems with imperfect forward operators whose errors can be modelled by order intervals in a partial order of a Banach lattice. We carry out analysis with respect to existence and…

Numerical Analysis · Mathematics 2020-12-25 Leon Bungert , Martin Burger , Yury Korolev , Carola-Bibiane Schoenlieb

This paper is devoted to the understanding of regularisation process in the shape optimization approach to the so-called Dirichlet inverse obstacle problem for elliptic operators. More precisely, we study two different regularisations of…

Optimization and Control · Mathematics 2024-04-05 Fabien Caubet , Marc Dambrine , Jérémi Dardé

The notion of developing statistical methods in machine learning which are robust to adversarial perturbations in the underlying data has been the subject of increasing interest in recent years. A common feature of this work is that the…

Statistics Theory · Mathematics 2017-02-28 Dimitris Bertsimas , Martin S. Copenhaver

In this article we develop and analyze novel iterative regularization techniques for the solution of systems of nonlinear ill--posed operator equations. The basic idea consists in considering separately each equation of this system and…

Numerical Analysis · Mathematics 2020-11-20 M. Haltmeier , A. Leitao , O. Scherzer

These lecture notes for a graduate class present the regularization theory for linear and nonlinear ill-posed operator equations in Hilbert spaces. Covered are the general framework of regularization methods and their analysis via spectral…

Functional Analysis · Mathematics 2021-02-09 Christian Clason

In this work, we describe a new approach that uses deep neural networks (DNN) to obtain regularization parameters for solving inverse problems. We consider a supervised learning approach, where a network is trained to approximate the…

Numerical Analysis · Mathematics 2021-04-15 Babak Maboudi Afkham , Julianne Chung , Matthias Chung

This review provides an introduction to - and overview of - the current state of the art in neural-network based regularization methods for inverse problems in imaging. It aims to introduce readers with a solid knowledge in applied…

Optimization and Control · Mathematics 2023-12-25 Andreas Habring , Martin Holler

Robust estimators for generalized linear models (GLMs) are not easy to develop due to the nature of the distributions involved. Recently, there has been growing interest in robust estimation methods, particularly in contexts involving a…

Methodology · Statistics 2025-07-08 Marina Valdora , Claudio Agostinelli

This paper presents a novel framework for nonconvex enhancement of minimization induced (MI) penalties while preserving the overall convexity of associated regularization models. MI penalties enable the adaptation to certain signal…

Optimization and Control · Mathematics 2025-09-09 Hiroki Kuroda

Classifying the training data correctly without over-fitting is one of the goals in machine learning. In this paper, we propose a generalization-memorization mechanism, including a generalization-memorization decision and a memory modeling…

Machine Learning · Computer Science 2024-04-09 Zhen Wang , Yuan-Hai Shao

Regularization methods improve the stability of ill-posed inverse problems by introducing some a priori characteristics for the solution such as smoothness or sharpness. In this contribution, we propose a multidimensional, scale-dependent…

Geophysics · Physics 2023-01-27 Wouter Deleersnyder , Benjamin Maveau , David Dudal , Thomas Hermans

We consider determining $\R$-minimizing solutions of linear ill-posed problems $A x = y$, where $A: {\mathscr X} \to {\mathscr Y}$ is a bounded linear operator from a Banach space ${\mathscr X}$ to a Hilbert space ${\mathscr Y}$ and…

Numerical Analysis · Mathematics 2023-07-05 Qinian Jin , Wei Wang

This work studies the multi-task functional linear regression models where both the covariates and the unknown regression coefficients (called slope functions) are curves. For slope function estimation, we employ penalized splines to…

Statistics Theory · Mathematics 2023-08-02 Shiyuan He , Hanxuan Ye , Kejun He

We study multi-parameter Tikhonov regularization, i.e., with multiple penalties. Such models are useful when the sought-for solution exhibits several distinct features simultaneously. Two choice rules, i.e., discrepancy principle and…

Numerical Analysis · Mathematics 2011-03-29 Kazufumi Ito , Bangti Jin , Tomoya Takeuchi

We introduce a new paradigm for solving regularized variational problems. These are typically formulated to address ill-posed inverse problems encountered in signal and image processing. The objective function is traditionally defined by…

Optimization and Control · Mathematics 2021-04-22 Jean-Christophe Pesquet , Audrey Repetti , Matthieu Terris , Yves Wiaux

Numerous real-world applications of uncertain multiobjective optimization problems (UMOPs) can be found in science, engineering, business, and management. To handle the solution of uncertain optimization problems, robust optimization is a…

Optimization and Control · Mathematics 2025-03-11 Shubham Kumar , Nihar Kumar Mahatoa , Debdas Ghosh

We study in this paper a smoothness regularization method for functional linear regression and provide a unified treatment for both the prediction and estimation problems. By developing a tool on simultaneous diagonalization of two positive…

Statistics Theory · Mathematics 2012-11-13 Ming Yuan , T. Tony Cai