English
Related papers

Related papers: On the Sample Complexity of Learning for Blind Inv…

200 papers

This paper deals with the numerical approximation of the biharmonic inverse source problem in an abstract setting in which the measurement data is finite-dimensional. This unified framework in particular covers the conforming and…

Numerical Analysis · Mathematics 2021-06-15 Devika Shylaja , M. T. Nair

We introduce a learning-based algorithm to obtain a measurement matrix for compressive sensing related recovery problems. The focus lies on matrices with a constant modulus constraint which typically represent a network of analog phase…

Signal Processing · Electrical Eng. & Systems 2021-10-15 Michael Koller , Wolfgang Utschick

Machine learning techniques for the solution of inverse problems have become an attractive approach in the last decade, while their theoretical foundations are still in their infancy. In this chapter we want to pursue the study of…

Numerical Analysis · Mathematics 2025-12-10 Martin Burger , Samira Kabri , Gitta Kutyniok , Yunseok Lee , Lukas Weigand

Consider estimating a structured signal $\mathbf{x}_0$ from linear, underdetermined and noisy measurements $\mathbf{y}=\mathbf{A}\mathbf{x}_0+\mathbf{z}$, via solving a variant of the lasso algorithm: $\hat{\mathbf{x}}=\arg\min_\mathbf{x}\{…

Optimization and Control · Mathematics 2014-01-28 Christos Thrampoulidis , Samet Oymak , Babak Hassibi

We develop a minimax theory for operator learning, where the goal is to estimate an unknown operator between separable Hilbert spaces from finitely many noisy input-output samples. For uniformly bounded Lipschitz operators, we prove…

Statistics Theory · Mathematics 2026-03-06 Ben Adcock , Gregor Maier , Rahul Parhi

Linear Least Squares is a very well known technique for parameter estimation, which is used even when sub-optimal, because of its very low computational requirements and the fact that exact knowledge of the noise statistics is not required.…

Statistics Theory · Mathematics 2018-10-16 Michael Krikheli , Amir Leshem

This paper introduces a novel approach to learning sparsity-promoting regularizers for solving linear inverse problems. We develop a bilevel optimization framework to select an optimal synthesis operator, denoted as $B$, which regularizes…

Machine Learning · Statistics 2026-03-03 Giovanni S. Alberti , Ernesto De Vito , Tapio Helin , Matti Lassas , Luca Ratti , Matteo Santacesaria

Self-supervised learning can significantly improve the performance of downstream tasks, however, the dimensions of learned representations normally lack explicit physical meanings. In this work, we propose a novel self-supervised approach…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-19 Yifan Sun , Xihong Wu

We provide a unified treatment of a broad class of noisy structure recovery problems, known as structured normal means problems. In this setting, the goal is to identify, from a finite collection of Gaussian distributions with different…

Machine Learning · Statistics 2016-01-27 Akshay Krishnamurthy

While many approaches exist in the literature to learn low-dimensional representations for data collections in multiple modalities, the generalizability of multi-modal nonlinear embeddings to previously unseen data is a rather overlooked…

Machine Learning · Computer Science 2021-05-05 Semih Kaya , Elif Vural

We construct least squares formulations of PDEs with inhomogeneous essential boundary conditions, where boundary residuals are not measured in unpractical fractional Sobolev norms, but which formulations nevertheless are shown to yield a…

Numerical Analysis · Mathematics 2025-05-12 Harald Monsuur , Robin Smeets , Rob Stevenson

The remarkable performance of deep neural networks (DNNs) currently makes them the method of choice for solving linear inverse problems. They have been applied to super-resolve and restore images, as well as to reconstruct MR and CT images.…

Image and Video Processing · Electrical Eng. & Systems 2021-06-01 Marija Vella , João F. C. Mota

Class imbalance remains a major challenge in machine learning, especially in multi-class problems with long-tailed distributions. Existing methods, such as data resampling, cost-sensitive techniques, and logistic loss modifications, though…

Machine Learning · Computer Science 2025-12-30 Corinna Cortes , Anqi Mao , Mehryar Mohri , Yutao Zhong

We consider the Bayesian approach to linear inverse problems when the underlying operator depends on an unknown parameter. Allowing for finite dimensional as well as infinite dimensional parameters, the theory covers several models with…

Statistics Theory · Mathematics 2018-09-05 Mathias Trabs

This work is concerned with the following fundamental question in scientific machine learning: Can deep-learning-based methods solve noise-free inverse problems to near-perfect accuracy? Positive evidence is provided for the first time,…

Image and Video Processing · Electrical Eng. & Systems 2022-07-13 Martin Genzel , Ingo Gühring , Jan Macdonald , Maximilian März

We develop a new unsupervised symmetry learning method that starts with raw data and provides the minimal generator of an underlying Lie group of symmetries, together with a symmetry-equivariant representation of the data, which turns the…

Machine Learning · Computer Science 2025-07-08 Onur Efe , Arkadas Ozakin

The prevailing approach to aligning Large Language Models (LLMs) typically relies on human or AI feedback and assumes access to specific types of preference datasets. In our work, we question the efficacy of such datasets and explore…

Machine Learning · Computer Science 2024-03-19 Hao Sun

Inverse problems and regularization theory is a central theme in contemporary signal processing, where the goal is to reconstruct an unknown signal from partial indirect, and possibly noisy, measurements of it. A now standard method for…

Optimization and Control · Mathematics 2014-12-09 Samuel Vaiter , Gabriel Peyré , Jalal M. Fadili

This article addresses the issue of estimating observation parameters (response and error parameters) in inverse problems. The focus is on cases where regularization is introduced in a Bayesian framework and the prior is modeled by a…

Machine Learning · Statistics 2026-02-13 Jean-François Giovannelli

Inverse problems are often ill-posed and require optimization schemes with strong stability and convergence guarantees. While learning-based approaches such as deep unrolling and meta-learning achieve strong empirical performance, they…

Signal Processing · Electrical Eng. & Systems 2026-05-28 Le Minh Triet Tran , Sarah Reynaud , Ronan Fablet , Adrien Merlini , François Rousseau , Mai Quyen Pham