English
Related papers

Related papers: An automatic L1-based regularization method for th…

200 papers

We describe two algorithms to efficiently solve regularized linear least squares systems based on sketching. The algorithms compute preconditioners for $\min \|Ax-b\|^2_2 + \lambda \|x\|^2_2$, where $A\in\mathbb{R}^{m\times n}$ and…

Numerical Analysis · Mathematics 2022-03-15 Maike Meier , Yuji Nakatsukasa

In this work we present a novel optimization strategy for image reconstruction tasks under analysis-based image regularization, which promotes sparse and/or low-rank solutions in some learned transform domain. We parameterize such…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Iaroslav Koshelev , Stamatios Lefkimmiatis

Nonlinear optimisation techniques are commonly employed to minimise complex cost functions, with their effectiveness determined largely by the structure of the underlying error landscape. These methods require initial parameter values, and…

Signal Processing · Electrical Eng. & Systems 2026-03-19 Tilo Strutz

We study a regularization framework that combines a convex fidelity term with multiple $\ell_1$-based regularizers, each linked to a distinct linear transform. This multi-penalty model enhances flexibility in promoting structured sparsity.…

Numerical Analysis · Mathematics 2026-02-02 Qianru Liu , Rui Wang , Yuesheng Xu

We compute precise asymptotic expressions for the learning curves of least squares random feature (RF) models with either a separable strongly convex regularization or the $\ell_1$ regularization. We propose a novel multi-level application…

Machine Learning · Statistics 2023-03-02 David Bosch , Ashkan Panahi , Ayca Özcelikkale , Devdatt Dubhash

In this work, we consider compressible single-phase flow problems in a porous media containing a fracture. In the latter, a non-linear pressure-velocity relation is prescribed. Using a non-overlapping domain decomposition procedure, we…

We learn parameterized nonlinear elasticity on curved surfaces using a physics-informed neural network that enforces governing equations and boundary conditions directly through the loss function, enabling a single trained model to…

Biological Physics · Physics 2026-04-15 Yankang Liu , Ke Zhang , Maziar Raissi , Roya Zandi

Due to the growing ubiquity of unlabeled data, learning with unlabeled data is attracting increasing attention in machine learning. In this paper, we propose a novel semi-supervised kernel learning method which can seamlessly combine…

Machine Learning · Computer Science 2012-03-19 Qi Mao , Ivor W. Tsang

This paper proposes a new algorithm for linear system identification from noisy measurements. The proposed algorithm balances a data fidelity term with a norm induced by the set of single pole filters. We pose a convex optimization problem…

Optimization and Control · Mathematics 2012-04-04 Parikshit Shah , Badri Narayan Bhaskar , Gongguo Tang , Benjamin Recht

Physics-informed neural networks have emerged as a powerful tool in the scientific machine learning community, with applications to both forward and inverse problems. While they have shown considerable empirical success, significant…

Optimization and Control · Mathematics 2025-12-11 Federica Caforio , Martin Holler , Matthias Höfler

In this paper we present a new fast and accurate method for Radial Basis Function (RBF) approximation, including interpolation as a special case, which enables us to effectively find the optimal value of the RBF shape parameter. In…

Numerical Analysis · Mathematics 2023-11-09 Roberto Cavoretto , Alessandra De Rossi , Sandro Lancellotti

In this work, we investigate data fitting problems with random noises. A randomized progressive iterative regularization method is proposed. It works well for large-scale matrix computations and converges in expectation to the least-squares…

Numerical Analysis · Mathematics 2025-06-05 Dakang Cen , Wenlong Zhang , Junbin Zhong

This paper presents a novel approach to construct regularizing operators for severely ill-posed Fredholm integral equations of the first kind by introducing parametrized discretization. The optimal values of discretization and…

Numerical Analysis · Mathematics 2023-09-12 Vladimir V Kryzhniy

As one of the most popular linear subspace learning methods, the Linear Discriminant Analysis (LDA) method has been widely studied in machine learning community and applied to many scientific applications. Traditional LDA minimizes the…

Machine Learning · Computer Science 2019-07-02 Feiping Nie , Hua Wang , Zheng Wang , Heng Huang

Due to their importance in various emerging applications, efficient algorithms for solving minimax problems have recently received increasing attention. However, many existing algorithms require prior knowledge of the problem parameters in…

Optimization and Control · Mathematics 2025-06-24 Junnan Yang , Huiling Zhang , Zi Xu

High-dimensional datasets often contain multiple meaningful clusterings in different subspaces. For example, objects can be clustered either by color, weight, or size, revealing different interpretations of the given dataset. A variety of…

Machine Learning · Computer Science 2025-04-08 Collin Leiber , Dominik Mautz , Claudia Plant , Christian Böhm

We propose an unrolled algorithm approach for learning spatially adaptive parameter maps in the framework of convolutional synthesis-based $\ell_1$ regularization. More precisely, we consider a family of pre-trained convolutional filters…

Machine Learning · Computer Science 2025-10-23 Andreas Kofler , Luca Calatroni , Christoph Kolbitsch , Kostas Papafitsoros

The estimation of parameters from data is a common problem in many areas of the physical sciences, and frequently used algorithms rely on sets of simulated data which are fit to data. In this article, an analytic solution for…

Data Analysis, Statistics and Probability · Physics 2022-09-27 Daniel Britzger

Inverse problems and regularization theory is a central theme in contemporary signal processing, where the goal is to reconstruct an unknown signal from partial indirect, and possibly noisy, measurements of it. A now standard method for…

Optimization and Control · Mathematics 2014-12-09 Samuel Vaiter , Gabriel Peyré , Jalal M. Fadili

Bayesian methods are actively used for parameter identification and uncertainty quantification when solving nonlinear inverse problems with random noise. However, there are only few theoretical results justifying the Bayesian approach.…

Statistics Theory · Mathematics 2020-02-04 Vladimir Spokoiny