English
Related papers

Related papers: Optimal Reconstruction from Linear Queries

200 papers

Autoencoders are frequently used for anomaly detection, both in the unsupervised and semi-supervised settings. They rely on the assumption that when trained using the reconstruction loss, they will be able to reconstruct normal data more…

Machine Learning · Computer Science 2025-01-24 Roel Bouman , Tom Heskes

Generalized sampling is a recently developed linear framework for sampling and reconstruction in separable Hilbert spaces. It allows one to recover any element in any finite-dimensional subspace given finitely many of its samples with…

Numerical Analysis · Mathematics 2013-01-15 Ben Adcock , Anders C. Hansen , Clarice Poon

Levenshtein first introduced the sequence reconstruction problem in $2001$. In the realm of combinatorics, the sequence reconstruction problem is equivalent to determining the value of $N(n,d,t)$, which represents the maximum size of the…

Information Theory · Computer Science 2026-04-16 Xiang Wang , Weijun Fang , Han Li , Fang-Wei Fu

Deep neural networks generalize well despite being heavily overparameterized, in apparent contradiction with classical learning theory based on uniform convergence over fixed hypothesis spaces. Uniform bounds over the entire parameter space…

Machine Learning · Statistics 2026-05-15 Hubert Leroux , Jean Marcus , Julien Roger

We define an online learning and optimization problem with discrete and irreversible decisions contributing toward a coverage target. In each period, a decision-maker selects facilities to open, receives information on the success of each…

Machine Learning · Computer Science 2026-03-06 Alexandre Jacquillat , Michael Lingzhi Li

Reconstructing an image from noisy and incomplete measurements is a central task in several image processing applications. In recent years, state-of-the-art reconstruction methods have been developed based on recent advances in deep…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Christoph Angermann , Simon Göppel , Markus Haltmeier

Solving inverse problems with iterative algorithms is popular, especially for large data. Due to time constraints, the number of possible iterations is usually limited, potentially affecting the achievable accuracy. Given an error one is…

Numerical Analysis · Computer Science 2018-02-16 Raja Giryes , Yonina C. Eldar , Alex M. Bronstein , Guillermo Sapiro

We consider the problem of online linear regression on individual sequences. The goal in this paper is for the forecaster to output sequential predictions which are, after $T$ time rounds, almost as good as the ones output by the best…

Machine Learning · Statistics 2019-01-17 Sébastien Gerchinovitz , Jia Yuan Yu

Error bound analysis, which estimates the distance of a point to the solution set of an optimization problem using the optimality residual, is a powerful tool for the analysis of first-order optimization algorithms. In this paper, we use…

Optimization and Control · Mathematics 2020-07-01 Jiawei Zhang , Zhiquan Luo

Machine learning methods are commonly used to solve inverse problems, wherein an unknown signal must be estimated from few indirect measurements generated via a known acquisition procedure. In particular, neural networks perform well…

Machine Learning · Computer Science 2025-12-05 Hannah Laus , Suzanna Parkinson , Vasileios Charisopoulos , Felix Krahmer , Rebecca Willett

We consider the Bayesian optimal filtering problem: i.e. estimating some conditional statistics of a latent time-series signal from an observation sequence. Classical approaches often rely on the use of assumed or estimated transition and…

Machine Learning · Statistics 2023-03-16 Adrian N. Bishop , Edwin V. Bonilla

We introduce Neural Optimal Design of Experiments, a learning-based framework for optimal experimental design in inverse problems that avoids classical bilevel optimization and indirect sparsity regularization. NODE jointly trains a neural…

Machine Learning · Computer Science 2026-01-08 John E. Darges , Babak Maboudi Afkham , Matthias Chung

$D$-optimal designs originate in statistics literature as an approach for optimal experimental designs. In numerical analysis points and weights resulting from maximal determinants turned out to be useful for quadrature and interpolation.…

Numerical Analysis · Mathematics 2024-12-04 Felix Bartel , Lutz Kämmerer , Kateryna Pozharska , Martin Schäfer , Tino Ullrich

In this paper we derive information theoretic performance bounds to sensing and reconstruction of sparse phenomena from noisy projections. We consider two settings: output noise models where the noise enters after the projection and input…

Information Theory · Computer Science 2011-12-22 Shuchin Aeron , Venkatesh Saligrama , Manqi Zhao

We study the problem of reconstructing a convex body using only a finite number of measurements of outer normal vectors. More precisely, we suppose that the normal vectors are measured at independent random locations uniformly distributed…

Computational Geometry · Computer Science 2014-02-21 Hiba Abdallah , Quentin Mérigot

We investigate the inverse source problem for the wave equation, arising in photo- and thermoacoustic tomography. There exist quite a few theoretically exact inversion formulas explicitly expressing solution of this problem in terms of the…

Analysis of PDEs · Mathematics 2018-08-01 Ngoc Do , Leonid Kunyansky

Recovery of the sparsity pattern (or support) of an unknown sparse vector from a small number of noisy linear measurements is an important problem in compressed sensing. In this paper, the high-dimensional setting is considered. It is shown…

Information Theory · Computer Science 2013-02-06 Galen Reeves , Michael Gastpar

We perform a study on kernel regression for large-dimensional data (where the sample size $n$ is polynomially depending on the dimension $d$ of the samples, i.e., $n\asymp d^{\gamma}$ for some $\gamma >0$ ). We first build a general tool to…

Machine Learning · Statistics 2024-07-01 Weihao Lu , Haobo Zhang , Yicheng Li , Manyun Xu , Qian Lin

Maximum likelihood iteration is one of the most commonly used reconstruction algorithms in quantum tomography. The main appeal of the method is that it is easy to implement and that it converges reliably to a physically meaningful density…

Quantum Physics · Physics 2025-08-21 Florian Oberender

We revisit the study of optimal regret rates in bandit combinatorial optimization---a fundamental framework for sequential decision making under uncertainty that abstracts numerous combinatorial prediction problems. We prove that the…

Machine Learning · Computer Science 2017-02-27 Alon Cohen , Tamir Hazan , Tomer Koren