English
Related papers

Related papers: Preserving Randomness for Adaptive Algorithms

200 papers

In this paper we estimate the expected error of a stochastic approximation algorithm where the maximum of a function is found using finite differences of a stochastic representation of that function. An error estimate of $O(n^{-1/5})$ for…

Optimization and Control · Mathematics 2021-09-02 Miklos Rasonyi , Kinga Tikosi

We study the approximation of expectations $\operatorname{E}(f(X))$ for solutions $X$ of stochastic differential equations and functionals $f$ on the path space by means of Monte Carlo algorithms that only use random bits instead of random…

Numerical Analysis · Mathematics 2023-01-10 Michael B. Giles , Mario Hefter , Lukas Mayer , Klaus Ritter

We give three new algorithms for efficient in-place estimation, without using ancilla qubits, of average fidelity of a quantum logic gate acting on a d-dimensional system using much fewer random bits than what was known so far. Previous…

Quantum Physics · Physics 2019-01-23 Aditya Nema , Pranab Sen

Most commonly used \emph{adaptive} algorithms for univariate real-valued function approximation and global minimization lack theoretical guarantees. Our new locally adaptive algorithms are guaranteed to provide answers that satisfy a…

Numerical Analysis · Mathematics 2017-08-28 Sou-Cheng T. Choi , Yuhan Ding , Fred J. Hickernell , Xin Tong

The Expectation Maximization (EM) algorithm is of key importance for inference in latent variable models including mixture of regressors and experts, missing observations. This paper introduces a novel EM algorithm, called…

Machine Learning · Computer Science 2020-12-04 Gersende Fort , Eric Moulines , Hoi-To Wai

We propose an adaptive random quantum algorithm to obtain an optimized eigensolver. Specifically, we introduce a general method to parametrize and optimize the probability density function of a random number generator, which is the core of…

The ODE method has been a workhorse for algorithm design and analysis since the introduction of the stochastic approximation. It is now understood that convergence theory amounts to establishing robustness of Euler approximations for ODEs,…

Optimization and Control · Mathematics 2020-10-02 Shuhang Chen , Adithya Devraj , Andrey Bernstein , Sean Meyn

We consider the problem of computing the k-sparse approximation to the discrete Fourier transform of an n-dimensional signal. We show: * An O(k log n)-time randomized algorithm for the case where the input signal has at most k non-zero…

Data Structures and Algorithms · Computer Science 2012-04-09 Haitham Hassanieh , Piotr Indyk , Dina Katabi , Eric Price

We study the approximation of expectations $\E(f(X))$ for solutions $X$ of SDEs and functionals $f \colon C([0,1],\R^r) \to \R$ by means of restricted Monte Carlo algorithms that may only use random bits instead of random numbers. We…

Numerical Analysis · Mathematics 2019-01-21 Michael B. Giles , Mario Hefter , Lukas Mayer , Klaus Ritter

In the submodular cover problem, we are given a non-negative monotone submodular function $f$ over a ground set $E$ of items, and the goal is to choose a smallest subset $S \subseteq E$ such that $f(S) = Q$ where $Q = f(E)$. In the…

Data Structures and Algorithms · Computer Science 2018-11-01 Arpit Agarwal , Sepehr Assadi , Sanjeev Khanna

Non-linearity of a Boolean function indicates how far it is from any linear function. Despite there being several strong results about identifying a linear function and distinguishing one from a sufficiently non-linear function, we found a…

Quantum Physics · Physics 2021-12-28 Debajyoti Bera , Tharrmashastha Sapv

We give an efficient randomized algorithm for approximating an arbitrary element of $SU(2)$ by a product of Clifford+$T$ operators, up to any given error threshold $\epsilon>0$. Under a mild hypothesis on the distribution of primes, the…

Quantum Physics · Physics 2015-03-13 Peter Selinger

We consider the Stochastic Boolean Function Evaluation (SBFE) problem where the task is to efficiently evaluate a known Boolean function $f$ on an unknown bit string $x$ of length $n$. We determine $f(x)$ by sequentially testing the…

Data Structures and Algorithms · Computer Science 2022-08-09 Lisa Hellerstein , Devorah Kletenik , Naifeng Liu , R. Teal Witter

Numerical methods for random parametric PDEs can greatly benefit from adaptive refinement schemes, in particular when functional approximations are computed as in stochastic Galerkin and stochastic collocations methods. This work is…

Numerical Analysis · Mathematics 2023-05-03 Martin Eigel , Nando Farchmin , Sebastian Heidenreich , Philipp Trunschke

Datasets are often reused to perform multiple statistical analyses in an adaptive way, in which each analysis may depend on the outcomes of previous analyses on the same dataset. Standard statistical guarantees do not account for these…

Machine Learning · Computer Science 2017-06-19 Vitaly Feldman , Thomas Steinke

Quantum amplitude estimation is a key sub-routine of a number of quantum algorithms with various applications. We propose an adaptive algorithm for interval estimation of amplitudes. The quantum part of the algorithm is based only on…

Quantum Physics · Physics 2022-06-20 Yunpeng Zhao , Haiyan Wang , Kuai Xu , Yue Wang , Ji Zhu , Feng Wang

Gradient-based methods are well-suited for derivative-free optimization (DFO), where finite-difference (FD) estimates are commonly used as gradient surrogates. Traditional stochastic approximation methods, such as Kiefer-Wolfowitz (KW) and…

Optimization and Control · Mathematics 2025-03-03 Guo Liang , Guangwu Liu , Kun Zhang

We present an algorithm for the statistical learning setting with a bounded exp-concave loss in $d$ dimensions that obtains excess risk $O(d \log(1/\delta)/n)$ with probability at least $1 - \delta$. The core technique is to boost the…

Machine Learning · Computer Science 2016-10-17 Nishant A. Mehta

Due to the great difficulty in scalability, quantum computers are limited in the number of qubits during the early stages of the quantum computing regime. In addition to the required qubits for storing the corresponding eigenvector, suppose…

Quantum Physics · Physics 2013-11-15 Chen-Fu Chiang

One of the easiest randomized greedy optimization algorithms is the following evolutionary algorithm which aims at maximizing a boolean function $f:\{0,1\}^n \to {\mathbb R}$. The algorithm starts with a random search point $\xi \in…

Combinatorics · Mathematics 2017-11-16 Johannes Lengler , Angelika Steger
‹ Prev 1 2 3 10 Next ›