English
Related papers

Related papers: Kernelized Normalizing Constant Estimation: Bridgi…

200 papers

In this paper, we study error bounds for {\em Bayesian quadrature} (BQ), with an emphasis on noisy settings, randomized algorithms, and average-case performance measures. We seek to approximate the integral of functions in a {\em…

Machine Learning · Statistics 2023-02-13 Xu Cai , Chi Thanh Lam , Jonathan Scarlett

We propose a vector-valued regression problem whose solution is equivalent to the reproducing kernel Hilbert space (RKHS) embedding of the Bayesian posterior distribution. This equivalence provides a new understanding of kernel Bayesian…

Machine Learning · Statistics 2016-10-27 Yang Song , Jun Zhu , Yong Ren

Estimating the normalizing constant of an unnormalized probability distribution has important applications in computer science, statistical physics, machine learning, and statistics. In this work, we consider the problem of estimating the…

Data Structures and Algorithms · Computer Science 2020-06-25 Rong Ge , Holden Lee , Jianfeng Lu

We consider the problem of optimizing a grey-box objective function, i.e., nested function composed of both black-box and white-box functions. A general formulation for such grey-box problems is given, which covers the existing grey-box…

Machine Learning · Computer Science 2023-08-03 Wenjie Xu , Yuning Jiang , Bratislav Svetozarevic , Colin N. Jones

Bayesian Optimization (BO) is an effective approach for global optimization of black-box functions when function evaluations are expensive. Most prior works use Gaussian processes to model the black-box function, however, the use of kernels…

Machine Learning · Computer Science 2023-09-25 Dat Phan-Trong , Hung Tran-The , Sunil Gupta

A black-box optimization algorithm such as Bayesian optimization finds extremum of an unknown function by alternating inference of the underlying function and optimization of an acquisition function. In a high-dimensional space, such…

Quantum Physics · Physics 2021-05-03 Syun Izawa , Koki Kitai , Shu Tanaka , Ryo Tamura , Koji Tsuda

The reconstruction of low-rank matrix from its noisy observation finds its usage in many applications. It can be reformulated into a constrained nuclear norm minimization problem, where the bound $\eta$ of the constraint is explicitly given…

Optimization and Control · Mathematics 2022-04-14 Kexin Li , Hongwei Li , Raymond H. Chan , You-wei Wen

We prove that, to compute a Boolean function $f$ on $N$ variables with error probability $\epsilon$, any quantum black-box algorithm has to query at least $\frac{1 - 2\sqrt{\epsilon}}{2} \rho_f N = \frac{1 - 2\sqrt{\epsilon}}{2} \bar{S}_f$…

Quantum Physics · Physics 2007-05-23 Yaoyun Shi

Optimization of high-dimensional black-box functions is an extremely challenging problem. While Bayesian optimization has emerged as a popular approach for optimizing black-box functions, its applicability has been limited to…

Machine Learning · Statistics 2018-08-06 Zi Wang , Chengtao Li , Stefanie Jegelka , Pushmeet Kohli

Kernel density estimation on a finite interval poses an outstanding challenge because of the well-recognized bias at the boundaries of the interval. Motivated by an application in cancer research, we consider a boundary constraint linking…

Statistics Theory · Mathematics 2020-12-01 Matthew J. Colbrook , Zdravko I. Botev , Karsten Kuritz , Shev MacNamara

Black-box functions are broadly used to model complex problems that provide no explicit information but the input and output. Despite existing studies of black-box function optimization, the solution set satisfying an inequality with a…

Machine Learning · Computer Science 2022-03-28 Lihao Liu , Tianyue Feng , Xingyu Xing , Junyi Chen

The Deustch-Jozsa problem is one of the most basic ways to demonstrate the power of quantum computation. Consider a Boolean function f : {0,1}^n to {0,1} and suppose we have a black-box to compute f. The Deutsch-Jozsa problem is to…

Quantum Physics · Physics 2022-01-05 Alastair A. Abbott

We present a novel approach to Bayesian inference and general Bayesian computation that is defined through a sequential decision loop. Our method defines a recursive partitioning of the sample space. It neither relies on gradients nor…

Machine Learning · Statistics 2021-06-10 Erik Bodin , Zhenwen Dai , Neill D. F. Campbell , Carl Henrik Ek

We study the approximation of expectations $\E(f(X))$ for Gaussian random elements $X$ with values in a separable Hilbert space $H$ and Lipschitz continuous functionals $f \colon H \to \R$. We consider restricted Monte Carlo algorithms,…

Numerical Analysis · Mathematics 2018-02-15 Michael B. Giles , Mario Hefter , Lukas Mayer , Klaus Ritter

This work describes a Bayesian framework for reconstructing the boundaries that represent targeted features in an image, as well as the regularity (i.e., roughness vs. smoothness) of these boundaries.This regularity often carries crucial…

Numerical Analysis · Mathematics 2024-01-26 Babak Maboudi Afkham , Nicolai André Brogaard Riis , Yiqiu Dong , Per Christian Hansen

Many optimization problems in robotics involve the optimization of time-expensive black-box functions, such as those involving complex simulations or evaluation of real-world experiments. Furthermore, these functions are often stochastic as…

We consider black box optimization of an unknown function in the nonparametric Gaussian process setting when the noise in the observed function values can be heavy tailed. This is in contrast to existing literature that typically assumes…

Machine Learning · Computer Science 2019-09-17 Sayak Ray Chowdhury , Aditya Gopalan

We propose a novel calibration method for computer simulators, dealing with the problem of covariate shift. Covariate shift is the situation where input distributions for training and test are different, and ubiquitous in applications of…

Machine Learning · Statistics 2020-03-20 Keiichi Kisamori , Motonobu Kanagawa , Keisuke Yamazaki

Accurate uncertainty quantification is a critical challenge in machine learning. While neural networks are highly versatile and capable of learning complex patterns, they often lack interpretability due to their ``black box'' nature. On the…

Machine Learning · Computer Science 2025-11-18 Pragatheeswaran Vipulananthan , Kamal Premaratne , Dilip Sarkar , Manohar N. Murthi

We propose and analyze a kernelized version of Q-learning. Although a kernel space is typically infinite-dimensional, extensive study has shown that generalization is only affected by the effective dimension of the data. We incorporate such…

Machine Learning · Computer Science 2022-04-25 Shuang Liu , Hao Su
‹ Prev 1 2 3 10 Next ›