English
Related papers

Related papers: Bayesian Approach for Radial Kernel Parameter Tuni…

200 papers

Bayesian optimization is popular for optimizing time-consuming black-box objectives. Nonetheless, for hyperparameter tuning in deep neural networks, the time required to evaluate the validation error for even a few hyperparameter settings…

Machine Learning · Computer Science 2019-03-13 Jian Wu , Saul Toscano-Palmerin , Peter I. Frazier , Andrew Gordon Wilson

Bayesian inference provides a principled way of estimating the parameters of a stochastic process that is observed discretely in time. The overdamped Brownian motion of a particle confined in an optical trap is generally modelled by the…

Data Analysis, Statistics and Probability · Physics 2017-02-01 Sudipta Bera , Shuvojit Paul , Rajesh Singh , Dipanjan Ghosh , Avijit Kundu , Ayan Banerjee , R. Adhikari

Parameter estimation is crucial for modeling, tracking, and control of complex dynamical systems. However, parameter uncertainties can compromise system performance under a controller relying on nominal parameter values. Typically,…

Robotics · Computer Science 2020-02-20 Mouhyemen Khan , Abhijit Chatterjee

In this study, we applied Bayesian inference for extended X-ray absorption fine structure (EXAFS) to select an appropriate basis from among Fourier, wavelet and advanced Fourier bases, and we extracted a radial distribution function (RDF)…

Data Analysis, Statistics and Probability · Physics 2021-05-07 Yasuhiko Igarashi , Fabio Iesari , Hiroyuki Setoyama , Toshihiro Okajima , Hiroyuki Kumazoe , Ichiro Akai , Masato Okada

We describe a method for searching the optimal hyper-parameters in reservoir computing, which consists of a Gaussian process with Bayesian optimization. It provides an alternative to other frequently used optimization methods such as grid,…

Machine Learning · Computer Science 2017-06-15 Jan Yperman , Thijs Becker

Bayesian optimization techniques have been successfully applied to robotics, planning, sensor placement, recommendation, advertising, intelligent user interfaces and automatic algorithm configuration. Despite these successes, the approach…

Machine Learning · Statistics 2016-01-12 Ziyu Wang , Frank Hutter , Masrour Zoghi , David Matheson , Nando de Freitas

Much recent research has been conducted in the area of Bayesian learning, particularly with regard to the optimization of hyper-parameters via Gaussian process regression. The methodologies rely chiefly on the method of maximizing the…

Machine Learning · Statistics 2014-05-13 James Brofos

Electronic phased-array radars offer new possibilities for radar search pattern optimization by using bi-dimensional beam-forming and beam-steering. Radar search pattern optimization can be approximated as a set cover problem and solved…

Optimization and Control · Mathematics 2020-02-13 Yann Briheche , Frédéric Barbaresco , Fouad Bennis , Damien Chablat

Bayesian optimization is a methodology for global optimization of unknown and expensive objectives. It combines a surrogate Bayesian regression model with an acquisition function to decide where to evaluate the objective. Typical regression…

Machine Learning · Computer Science 2023-04-04 Afonso Eduardo , Michael U. Gutmann

We propose two localized Radial Basis Function (RBF) methods, the Radial Basis Function Partition of Unity method (RBF-PUM) and the Radial Basis Function generated Finite Differences method (RBF-FD), for solving financial derivative pricing…

Computational Finance · Quantitative Finance 2018-08-20 Slobodan Milovanović , Victor Shcherbakov

Nonlocal operators of fractional type are a popular modeling choice for applications that do not adhere to classical diffusive behavior; however, one major challenge in nonlocal simulations is the selection of model parameters. In this work…

Optimization and Control · Mathematics 2020-10-09 Olena Burkovska , Christian Glusa , Marta D'Elia

A radial basis function (RBF) method based on matrix-valued kernels is presented and analyzed for computing two types of vector decompositions on bounded domains: one where the normal component of the divergence-free part of the field is…

Numerical Analysis · Mathematics 2015-03-06 Edward J. Fuselier , Grady B. Wright

This paper addresses the problem of approximating a function of bounded variation from its scattered data. Radial basis function(RBF) interpolation methods are known to approximate only functions in their native spaces, and to date, there…

Numerical Analysis · Mathematics 2025-12-23 Rajesh Dachiraju

We address the problem of automatically finding the parameters of a statistical machine translation system that maximize BLEU scores while ensuring that decoding speed exceeds a minimum value. We propose the use of Bayesian Optimization to…

Computation and Language · Computer Science 2016-04-19 Daniel Beck , Adrià de Gispert , Gonzalo Iglesias , Aurelien Waite , Bill Byrne

Random Fourier features (RFF) represent one of the most popular and wide-spread techniques in machine learning to scale up kernel algorithms. Despite the numerous successful applications of RFFs, unfortunately, quite little is understood…

Machine Learning · Statistics 2019-02-12 Zoltan Szabo , Bharath K. Sriperumbudur

We present a Bayesian methodology for infinite as well as finite dimensional parameter identification for partial differential equation models. The Bayesian framework provides a rigorous mathematical framework for incorporating prior…

Quantitative Methods · Quantitative Biology 2016-05-17 Eduard Campillo-Funollet , Chandrasekhar Venkataraman , Anotida Madzvamuse

Bayesian methods have been very successful in quantifying uncertainty in physics-based problems in parameter estimation and prediction. In these cases, physical measurements y are modeled as the best fit of a physics-based model…

Data Analysis, Statistics and Probability · Physics 2015-02-06 Dave Higdon , Jordan D. McDonnell , Nicolas Schunck , Jason Sarich , Stefan M. Wild

Bayesian optimization has been proposed as a practical and efficient tool through which to tune parameters in many difficult settings. Recently, such techniques have been combined with real-time fMRI to propose a novel framework which turns…

Neurons and Cognition · Quantitative Biology 2016-06-10 Romy Lorenz , Ricardo P Monti , Ines R Violante , Aldo A Faisal , Christoforos Anagnostopoulos , Robert Leech , Giovanni Montana

Gaussian Process based Bayesian Optimization is a widely applied algorithm to learn and optimize under uncertainty, well-known for its sample efficiency. However, recently -- and more frequently -- research studies have empirically…

Machine Learning · Statistics 2025-05-20 Antonio Candelieri , Andrea Ponti , Francesco Archetti

We show theoretical similarities between the Least Squares Support Vector Regression (LS-SVR) model with a Radial Basis Functions (RBF) kernel and maximum a posteriori (MAP) inference on Bayesian RBF networks with a specific Gaussian prior…

Machine Learning · Statistics 2019-08-06 Diego P. P. Mesquita , Luis A. Freitas , João P. P. Gomes , César L. C. Mattos