English
Related papers

Related papers: Attentive Neural Processes and Batch Bayesian Opti…

200 papers

Bayesian optimization (BO) has shown impressive results in a variety of applications within low-to-moderate dimensional Euclidean spaces. However, extending BO to high-dimensional settings remains a significant challenge. We address this…

Machine Learning · Statistics 2024-03-11 Shouri Hu , Jiawei Li , Zhibo Cai

Bayesian Neural Networks (BNNs) provide principled estimates of model and data uncertainty by encoding parameters as distributions. This makes them key enablers for reliable AI that can be deployed on safety critical edge systems. These…

Emerging Technologies · Computer Science 2024-11-13 Prabodh Katti , Bashir M. Al-Hashimi , Bipin Rajendran

Modeling natural phenomena with artificial neural networks (ANNs) often provides highly accurate predictions. However, ANNs often suffer from over-parameterization, complicating interpretation and raising uncertainty issues. Bayesian neural…

Machine Learning · Statistics 2025-03-14 Eirik Høyheim , Lars Skaaret-Lund , Solve Sæbø , Aliaksandr Hubin

Digital network twin (DNT) is a promising paradigm to replicate real-world cellular networks toward continual assessment, proactive management, and what-if analysis. Existing discussions have been focusing on using only deep learning…

Networking and Internet Architecture · Computer Science 2023-11-22 Yuru Zhang , Ming Zhao , Qiang Liu

Experimental (design) optimization is a key driver in designing and discovering new products and processes. Bayesian Optimization (BO) is an effective tool for optimizing expensive and black-box experimental design processes. While Bayesian…

Machine Learning · Computer Science 2024-02-28 Arun Kumar A , Alistair Shilton , Sunil Gupta , Santu Rana , Stewart Greenhill , Svetha Venkatesh

In this paper, we introduce BNN-DP, an efficient algorithmic framework for analysis of adversarial robustness of Bayesian Neural Networks (BNNs). Given a compact set of input points $T\subset \mathbb{R}^n$, BNN-DP computes lower and upper…

Machine Learning · Computer Science 2023-06-21 Steven Adams , Andrea Patane , Morteza Lahijanian , Luca Laurenti

Insufficient data volume and quality are particularly pressing challenges in the adoption of modern subsymbolic AI. To alleviate these challenges, AI simulation uses virtual training environments in which AI agents can be safely and…

Artificial Intelligence · Computer Science 2025-09-01 Xiaoran Liu , Istvan David

We consider optimal experimental design (OED) problems in selecting the most informative observation sensors to estimate model parameters in a Bayesian framework. Such problems are computationally prohibitive when the…

Computational Engineering, Finance, and Science · Computer Science 2024-09-10 Jinwoo Go , Peng Chen

Gaussian Processes are used in many applications to model spatial phenomena. Within this context, a key issue is to decide the set of locations where to take measurements so as to obtain a better approximation of the underlying function.…

Emerging Technologies · Computer Science 2019-01-31 Lorenzo Bottarelli , Alessandro Farinelli

Modern scientific and engineering design increasingly involves distributed optimization, where agents such as laboratories, simulations, or industrial partners pursue related goals under differing conditions. These agents often face…

Machine Learning · Statistics 2025-10-21 Zihan Wang , Yi-Ping Chen , Tuba Dolar , Wei Chen

Bayesian Optimization (BO) is a sample-efficient optimization algorithm widely employed across various applications. In some challenging BO tasks, input uncertainty arises due to the inevitable randomness in the optimization process, such…

Machine Learning · Computer Science 2023-11-07 Lin Yang , Junlong Lyu , Wenlong Lyu , Zhitang Chen

Physical dynamical systems can be viewed as natural information processors: their systems preserve, transform, and disperse input information. This perspective motivates learning not only from data generated by such systems, but also how to…

Machine Learning · Computer Science 2026-03-05 Felix Köster , Atsushi Uchida

Probabilistic programming systems enable users to encode model structure and naturally reason about uncertainties, which can be leveraged towards improved Bayesian optimization (BO) methods. Here we present a probabilistic program embedding…

Artificial Intelligence · Computer Science 2019-02-06 Alexander Lavin

Batch Bayesian optimisation (BO) has been successfully applied to hyperparameter tuning using parallel computing, but it is wasteful of resources: workers that complete jobs ahead of others are left idle. We address this problem by…

Machine Learning · Statistics 2019-05-29 Ahsan S. Alvi , Binxin Ru , Jan Calliess , Stephen J. Roberts , Michael A. Osborne

The performance of deep (reinforcement) learning systems crucially depends on the choice of hyperparameters. Their tuning is notoriously expensive, typically requiring an iterative training process to run for numerous steps to convergence.…

Machine Learning · Computer Science 2021-01-19 Vu Nguyen , Sebastian Schulze , Michael A Osborne

Active queue control aims to improve the overall communication network throughput while providing lower delay and small packet loss rate. The basic idea is to actively trigger packet dropping (or marking provided by explicit congestion…

Neural and Evolutionary Computing · Computer Science 2017-11-20 Mansour Sheikhan , Ehsan Hemmati , Reza Shahnazi

Modern manufacturing demands high flexibility and reconfigurability to adapt to dynamic production needs. Model-based Engineering (MBE) supports rapid production line design, but final reconfiguration requires simulations and validation.…

Bayesian Optimization Mixed-Precision Neural Architecture Search (BOMP-NAS) is an approach to quantization-aware neural architecture search (QA-NAS) that leverages both Bayesian optimization (BO) and mixed-precision quantization (MP) to…

Machine Learning · Computer Science 2023-01-30 David van Son , Floran de Putter , Sebastian Vogel , Henk Corporaal

Underwater acoustic sensor networks (UASNs) drive toward strong environmental adaptability, intelligence, and multifunctionality. However, due to unique UASN characteristics, such as long propagation delay, dynamic channel quality, and high…

Networking and Internet Architecture · Computer Science 2024-10-29 Shanshan Song , Bingwen Huangfu , Jiani Guo , Jun Liu , Junhong Cui , Xuemin , Shen

Improving energy efficiency by monitoring system behavior and predicting future energy scenarios in light of increased penetration of renewable energy sources are becoming increasingly important, especially for energy systems that…

Systems and Control · Electrical Eng. & Systems 2025-03-12 Haozhen Cheng , Jan Stock , André Xhonneux , Hüseyin K. Çakmak , Veit Hagenmeyer