English
Related papers

Related papers: Adaptive algorithms in sampling recovery

200 papers

Consider a Markov decision process (MDP) that admits a set of state-action features, which can linearly express the process's probabilistic transition model. We propose a parametric Q-learning algorithm that finds an approximate-optimal…

Machine Learning · Computer Science 2019-06-07 Lin F. Yang , Mengdi Wang

Running machine learning algorithms on large and rapidly growing volumes of data is often computationally expensive, one common trick to reduce the size of a data set, and thus reduce the computational cost of machine learning algorithms,…

Machine Learning · Computer Science 2022-01-25 Shaojie Tang , Jing Yuan

Adaptive sampling algorithms are modern and efficient methods that dynamically adjust the sample size throughout the optimization process. However, they may encounter difficulties in risk-averse settings, particularly due to the challenge…

Optimization and Control · Mathematics 2025-02-17 Sandra Pieraccini , Tommaso Vanzan

In matrix recovery from random linear measurements, one is interested in recovering an unknown $M$-by-$N$ matrix $X_0$ from $n<MN$ measurements $y_i=Tr(A_i^T X_0)$ where each $A_i$ is an $M$-by-$N$ measurement matrix with i.i.d random…

Information Theory · Computer Science 2021-09-21 Elad Romanov , Matan Gavish

We develop and analyze a method for stochastic simulation optimization based on Gaussian process models within a trust-region framework. We focus on settings where the variance of the objective function is large, making accurate estimation…

Optimization and Control · Mathematics 2026-03-10 Mickael Binois , Jeffrey Larson

The calculation of the error threshold of quantum error correcting codes typically proceeds as follows. First, syndromes are measured. Then, a decoder infers the error chain and the corresponding correction is applied. The threshold is then…

Quantum Physics · Physics 2026-03-09 Sun Woo P. Kim

Algorithms which compute locally optimal continuous designs often rely on a finite design space or on repeatedly solving a complex non-linear program. Both methods require extensive evaluations of the Jacobian Df of the underlying model.…

Methodology · Statistics 2021-01-18 Philipp Seufert , Jan Schwientek , Michael Bortz

We consider the recovery of real-valued bandlimited functions from the absolute values of their samples, possibly spaced nonuniformly. We show that such a reconstruction is always possible if the function is sampled at more than twice its…

Numerical Analysis · Mathematics 2012-01-17 Gaurav Thakur

Optimal sampling of non band-limited functions is an issue of great importance that has attracted considerable attention. We propose to tackle this problem through the use of a frequency warping: First, by a nonlinear shrinking of…

Classical Analysis and ODEs · Mathematics 2017-03-07 Stefan Lafon , Jacques Lévy Véhel , Jacques Peyrière

A significant hurdle for analyzing large sample data is the lack of effective statistical computing and inference methods. An emerging powerful approach for analyzing large sample data is subsampling, by which one takes a random subsample…

Methodology · Statistics 2015-11-24 Rong Zhu , Ping Ma , Michael W. Mahoney , Bin Yu

Decision trees are widely used for their low computational cost, good predictive performance, and ability to assess the importance of features. Though often used in practice for feature selection, the theoretical guarantees of these methods…

Machine Learning · Statistics 2023-03-09 Kiarash Banihashem , MohammadTaghi Hajiaghayi , Max Springer

We propose a manifold sampling algorithm for minimizing a nonsmooth composition $f= h\circ F$, where we assume $h$ is nonsmooth and may be inexpensively computed in closed form and $F$ is smooth but its Jacobian may not be available. We…

Optimization and Control · Mathematics 2022-01-14 Jeffrey Larson , Matt Menickelly , Baoyu Zhou

A new scaling and recovering algorithm is proposed for simultaneously computing the matrix $\varphi$-functions that arise in exponential integrator methods for the numerical solution of certain first-order systems of ordinary differential…

Numerical Analysis · Mathematics 2025-09-24 Awad H. Al-Mohy , Xiaobo Liu

This paper investigates the problem of recovering source terms in abstract initial value problems (IVP) commonly used to model various scientific phenomena in physics, chemistry, economics, and other fields. We consider source terms of the…

Dynamical Systems · Mathematics 2024-01-30 Akram Aldroubi , Le Gong , Ilya Krishtal , Brendan Miller , Sumati Thareja

To fast approximate maximum likelihood estimators with massive data, this paper studies the Optimal Subsampling Method under the A-optimality Criterion (OSMAC) for generalized linear models. The consistency and asymptotic normality of the…

Methodology · Statistics 2021-06-15 Mingyao Ai , Jun Yu , Huiming Zhang , HaiYing Wang

Adaptive sampling theory has shown that, with proper assumptions on the signal class, algorithms exist to reconstruct a signal in $\mathbb{R}^{d}$ with an optimal number of samples. We generalize this problem to the case of spatial signals,…

Machine Learning · Statistics 2017-02-20 John Lipor , Brandon Wong , Donald Scavia , Branko Kerkez , Laura Balzano

This paper employs a fully adaptive and semi-adaptive frequency sweep algorithm using the Loewner matrix-based state model for the electromagnetic simulation. The proposed algorithms use two Loewner matrix models with different or the same…

Signal Processing · Electrical Eng. & Systems 2025-04-15 Shilpa T. N. , Rakesh Sinha

We study the problem of recovering a structured signal from independently and identically drawn linear measurements. A convex penalty function $f(\cdot)$ is considered which penalizes deviations from the desired structure, and signal…

Statistics Theory · Mathematics 2019-06-21 Ehsan Abbasi , Fariborz Salehi , Babak Hassibi

We consider the problem of learning an unknown, possibly nonlinear operator between separable Hilbert spaces from supervised data. Inputs are drawn from a prescribed probability measure on the input space, and outputs are (possibly noisy)…

Numerical Analysis · Mathematics 2025-12-15 John Turnage , Matthew Lowery , John Jakeman , Zachary Morrow , Akil Narayan , Varun Shankar

The quality of numerical reconstructions for unknown parameters in inverse problems depends fundamentally on the selection of experimental data. To ensure a robust reconstruction, it is crucial to select data that are sensitive to the…

Numerical Analysis · Mathematics 2026-04-14 Kathrin Hellmuth , Christian Klingenberg , Qin Li