English
Related papers

Related papers: BoGraph: Structured Bayesian Optimization From Log…

200 papers

In this paper we propose a Bayesian method for estimating architectural parameters of neural networks, namely layer size and network depth. We do this by learning concrete distributions over these parameters. Our results show that regular…

Machine Learning · Statistics 2019-01-29 Georgi Dikov , Patrick van der Smagt , Justin Bayer

Bounding volume hierarchies are ubiquitous acceleration structures in graphics, scientific computing, and data analytics. Their performance depends critically on data layout choices that affect cache utilization, memory bandwidth, and…

Programming Languages · Computer Science 2026-04-14 Christophe Gyurgyik , Alexander J Root , Fredrik Kjolstad

Hyperparameter optimization (HPO) plays a central role in the performance of deep learning models, yet remains computationally expensive and difficult to interpret, particularly for time-series forecasting. While Bayesian Optimization (BO)…

Machine Learning · Computer Science 2026-02-17 Ons Saadallah , Mátyás andó , Tamás Gábor Orosz

An algorithm for automated construction of a sparse Bayesian network given an unstructured probabilistic model and causal domain information from an expert has been developed and implemented. The goal is to obtain a network that explicitly…

Artificial Intelligence · Computer Science 2013-04-08 Sampath Srinivas , Stuart Russell , Alice M. Agogino

Robotic systems for manipulation tasks are increasingly expected to be easy to configure for new tasks. While in the past, robot programs were often written statically and tuned manually, the current, faster transition times call for…

Robotics · Computer Science 2023-10-03 Jonathan Styrud , Matthias Mayr , Erik Hellsten , Volker Krueger , Christian Smith

This article deals with the problem of distributed machine learning, in which agents update their models based on their local datasets, and aggregate the updated models collaboratively and in a fully decentralized manner. In this paper, we…

Machine Learning · Computer Science 2021-02-23 Tamara Alshammari , Sumudu Samarakoon , Anis Elgabli , Mehdi Bennis

Bayesian optimization (BO) recently became popular in robotics to optimize control parameters and parametric policies in direct reinforcement learning due to its data efficiency and gradient-free approach. However, its performance may be…

Robotics · Computer Science 2019-10-14 Noémie Jaquier , Leonel Rozo , Sylvain Calinon , Mathias Bürger

Learning the structure of Bayesian networks from data is known to be a computationally challenging, NP-hard problem. The literature has long investigated how to perform structure learning from data containing large numbers of variables,…

Computation · Statistics 2019-10-25 Marco Scutari , Claudia Vitolo , Allan Tucker

Score-based algorithms that learn the structure of Bayesian networks can be used for both exact and approximate solutions. While approximate learning scales better with the number of variables, it can be computationally expensive in the…

Machine Learning · Computer Science 2022-02-22 Zhigao Guo , Anthony C. Constantinou

Stochastic processes offer a flexible mathematical formalism to model and reason about systems. Most analysis tools, however, start from the premises that models are fully specified, so that any parameters controlling the system's dynamics…

Systems and Control · Computer Science 2017-01-11 Luca Bortolussi , Guido Sanguinetti

Probability estimation of tree topologies is one of the fundamental tasks in phylogenetic inference. The recently proposed subsplit Bayesian networks (SBNs) provide a powerful probabilistic graphical model for tree topology probability…

Populations and Evolution · Quantitative Biology 2024-09-10 Tianyu Xie , Musu Yuan , Minghua Deng , Cheng Zhang

Strong Branching (SB) is a cornerstone of all modern branching rules used in the Branch-and-Bound (BnB) algorithm, which is at the center of Mixed-Integer Programming solvers. In its full form, SB evaluates all variables to branch on and…

Optimization and Control · Mathematics 2024-04-08 Gioni Mexi , Somayeh Shamsi , Mathieu Besançon , Pierre Le Bodic

Bayesian Neural Networks (BNNs) offer a mathematically grounded framework to quantify the uncertainty of model predictions but come with a prohibitive computation cost for both training and inference. In this work, we show a novel network…

Machine Learning · Computer Science 2022-02-10 Duo Wang , Yiren Zhao , Ilia Shumailov , Robert Mullins

Bayesian Optimization (BO) is a powerful tool for optimizing complex non-linear systems. However, its performance degrades in high-dimensional problems with tightly coupled parameters and highly asymmetric objective landscapes, where…

Machine Learning · Computer Science 2026-02-12 Aashwin Mishra , Matt Seaberg , Ryan Roussel , Daniel Ratner , Apurva Mehta

In this paper, we propose Broad Neural Architecture Search (BNAS) where we elaborately design broad scalable architecture dubbed Broad Convolutional Neural Network (BCNN) to solve the above issue. On one hand, the proposed broad scalable…

Machine Learning · Statistics 2021-03-17 Zixiang Ding , Yaran Chen , Nannan Li , Dongbin Zhao , Zhiquan Sun , C. L. Philip Chen

Bayesian Optimization (BO) is used to find the global optima of black box functions. In this work, we propose a practical BO method of function compositions where the form of the composition is known but the constituent functions are…

Machine Learning · Computer Science 2023-05-02 Kunal Jain , Prabuchandran K. J. , Tejas Bodas

This paper proposes a scalable Bayesian optimization (BO) framework for dense base-station (BS) configuration design. BO can find an optimal BS configuration by iterating parameter search, channel simulation, and probabilistic modeling of…

Information Theory · Computer Science 2026-02-19 Kakeru Takamori , Koya Sato

We combine Bayesian networks (BNs) and structural reliability methods (SRMs) to create a new computational framework, termed enhanced Bayesian network (eBN), for reliability and risk analysis of engineering structures and infrastructure.…

Applications · Statistics 2012-03-28 Daniel Straub , Armen Der Kiureghian

This paper studies the problem of globally optimizing a variable of interest that is part of a causal model in which a sequence of interventions can be performed. This problem arises in biology, operational research, communications and,…

Machine Learning · Statistics 2020-05-27 Virginia Aglietti , Xiaoyu Lu , Andrei Paleyes , Javier González

Bayesian Optimisation (BO) is a family of methods for finding optimal parameters when the underlying function to be optimised is unknown. BO is used, for example, for hyperparameter tuning in machine learning and as an expert support tool…

Human-Computer Interaction · Computer Science 2026-01-05 Tanmay Chakraborty , Marion Koelle , Jörg Schlötterer , Nadine Schlicker , Christian Wirth , Christin Seifert