English
Related papers

Related papers: Omnipresent Yet Overlooked: Heat Kernels in Combin…

200 papers

In this work, we broadly connect kernel-based filtering (e.g. approaches such as the bilateral filters and nonlocal means, but also many more) with general variational formulations of Bayesian regularized least squares, and the related…

Computer Vision and Pattern Recognition · Computer Science 2019-05-01 Frank Ong , Peyman Milanfar , Pascal Getreuer

Impactful applications such as materials discovery, hardware design, neural architecture search, or portfolio optimization require optimizing high-dimensional black-box functions with mixed and combinatorial input spaces. While Bayesian…

Machine Learning · Computer Science 2024-03-21 Leonard Papenmeier , Luigi Nardi , Matthias Poloczek

The quantization of gauge fields and gravitation on manifolds with boundary makes it necessary to study boundary conditions which involve both normal and tangential derivatives of the quantized field. The resulting one-loop divergences can…

High Energy Physics - Theory · Physics 2009-10-30 Ivan G. Avramidi , G. Esposito

High-dimensional black-box optimisation remains an important yet notoriously challenging problem. Despite the success of Bayesian optimisation methods on continuous domains, domains that are categorical, or that mix continuous and…

Machine Learning · Statistics 2021-06-11 Xingchen Wan , Vu Nguyen , Huong Ha , Binxin Ru , Cong Lu , Michael A. Osborne

It was reported that, if and only if the specific heat, correlation length, and dynamical exponents $\alpha, \nu$ and $z$, fulfill the condition $\alpha-z\nu>0$, the phase transitions can enable a quantum heat engine to approach Carnot…

Statistical Mechanics · Physics 2022-02-16 Jianhui Wang , Jizhou He , Yongli Ma

Quantum computing algorithms have been shown to produce performant quantum kernels for machine-learning classification problems. Here, we examine the performance of quantum kernels for regression problems of practical interest. For an…

Quantum Physics · Physics 2024-09-30 Xuyang Guo , Jun Dai , Roman V. Krems

Bayesian optimization (BO) is a leading method for optimizing expensive black-box optimization and has been successfully applied across various scenarios. However, BO suffers from the curse of dimensionality, making it challenging to scale…

Machine Learning · Computer Science 2025-04-03 Vu Viet Hoang , Hung The Tran , Sunil Gupta , Vu Nguyen

Bayesian optimization (BO) is an effective approach to optimize expensive black-box functions, that seeks to trade-off between exploitation (selecting parameters where the maximum is likely) and exploration (selecting parameters where we…

Machine Learning · Statistics 2021-10-19 Tristan Fauvel , Matthew Chalk

When using machine learning (ML) techniques, users typically need to choose a plethora of algorithm-specific parameters, referred to as hyperparameters. In this paper, we compare the performance of two algorithms, particle swarm…

Data Analysis, Statistics and Probability · Physics 2023-10-16 Laurits Tani , Christian Veelken

Bayesian Optimization (BO) is a powerful tool for optimizing complex non-linear systems. However, its performance degrades in high-dimensional problems with tightly coupled parameters and highly asymmetric objective landscapes, where…

Machine Learning · Computer Science 2026-02-12 Aashwin Mishra , Matt Seaberg , Ryan Roussel , Daniel Ratner , Apurva Mehta

Relevant combinatorial optimization problems (COPs) are often NP-hard. While they have been tackled mainly via handcrafted heuristics in the past, advances in neural networks have motivated the development of general methods to learn…

Machine Learning · Computer Science 2025-09-05 Tim Dernedde , Daniela Thyssens , Sören Dittrich , Maximilian Stubbemann , Lars Schmidt-Thieme

Bayesian optimization (BO) is a powerful approach for seeking the global optimum of expensive black-box functions and has proven successful for fine tuning hyper-parameters of machine learning models. However, BO is practically limited to…

Machine Learning · Statistics 2020-09-28 Riccardo Moriconi , Marc P. Deisenroth , K. S. Sesh Kumar

Combinatorial optimization with a smooth and convex objective function arises naturally in applications such as discrete mean-variance portfolio optimization, where assets must be traded in integer quantities. Although optimal solutions to…

Quantum Physics · Physics 2025-10-14 Sebastian Schlütter , Tomislav Maras , Alexander Dotterweich , Nico Piatkowski

In many high-throughput experimental design settings, such as those common in biochemical engineering, batched queries are more cost effective than one-by-one sequential queries. Furthermore, it is often not possible to directly choose…

Machine Learning · Computer Science 2019-04-18 Kevin K. Yang , Yuxin Chen , Alycia Lee , Yisong Yue

Model selection is an integral problem of model based optimization techniques such as Bayesian optimization (BO). Current approaches often treat model selection as an estimation problem, to be periodically updated with observations coming…

Machine Learning · Computer Science 2023-08-02 Manisha Senadeera , Santu Rana , Sunil Gupta , Svetha Venkatesh

Given the increasing importance of machine learning (ML) in our lives, several algorithmic fairness techniques have been proposed to mitigate biases in the outcomes of the ML models. However, most of these techniques are specialized to…

Multiple datasets containing different types of features may be available for a given task. For instance, users' profiles can be used to group users for recommendation systems. In addition, a model can also use users' historical behaviors…

Machine Learning · Computer Science 2016-05-10 Weixiang Shao , Xiaoxiao Shi , Philip S. Yu

Motivated by the success of Bayesian optimisation algorithms in the Euclidean space, we propose a novel approach to construct Intrinsic Bayesian optimisation (In-BO) on manifolds with a primary focus on complex constrained domains or…

Machine Learning · Statistics 2023-01-31 Yuan Liu , Mu Niu , Claire Miller

This study investigates the application of Bayesian Optimization (BO) for the hyperparameter tuning of neural networks, specifically targeting the enhancement of Convolutional Neural Networks (CNN) for image classification tasks. Bayesian…

Machine Learning · Computer Science 2024-10-30 Gabriele Onorato

The full optimization of a quantum heat engine requires operating at high power, high efficiency, and high stability (i.e. low power fluctuations). However, these three objectives cannot be simultaneously optimized - as indicated by the…

Quantum Physics · Physics 2023-05-04 Paolo Andrea Erdman , Alberto Rolandi , Paolo Abiuso , Martí Perarnau-Llobet , Frank Noé