English
Related papers

Related papers: An Information-Theoretic Framework for Unifying Ac…

200 papers

Bayesian Optimization (BO) has shown significant success in tackling expensive low-dimensional black-box optimization problems. Many optimization problems of interest are high-dimensional, and scaling BO to such settings remains an…

Machine Learning · Statistics 2022-06-02 Eric Han , Ishank Arora , Jonathan Scarlett

In this work, we introduce a novel method for solving the set inversion problem by formulating it as a binary classification problem. Aiming to develop a fast algorithm that can work effectively with high-dimensional and computationally…

Machine Learning · Computer Science 2021-06-01 Binh T. Nguyen , Duy M. Nguyen , Lam Si Tung Ho , Vu Dinh

Accuracy and generalization capabilities are key objectives when learning dynamical system models. To obtain such models from limited data, current works exploit prior knowledge and assumptions about the system. However, the fusion of…

Machine Learning · Statistics 2025-08-22 Björn Volkmann , Jan-Hendrik Ewering , Michael Meindl , Simon F. G. Ehlers , Thomas Seel

Bayesian optimization (BO) has become an effective approach for black-box function optimization problems when function evaluations are expensive and the optimum can be achieved within a relatively small number of queries. However, many…

Machine Learning · Statistics 2018-08-06 Zi Wang , Clement Gehring , Pushmeet Kohli , Stefanie Jegelka

Algorithm selection and hyperparameter tuning remain two of the most challenging tasks in machine learning. Automated machine learning (AutoML) seeks to automate these tasks to enable widespread use of machine learning by non-experts. This…

Machine Learning · Computer Science 2019-05-22 Chengrun Yang , Yuji Akimoto , Dae Won Kim , Madeleine Udell

Bayesian optimization (BO) is a popular approach for expensive black-box optimization, with applications including parameter tuning, experimental design, robotics. BO usually models the objective function by a Gaussian process (GP), and…

Machine Learning · Statistics 2020-01-22 Chao Qian , Hang Xiong , Ke Xue

Recommender systems (RSs) play a crucial role in shaping our digital interactions, influencing how we access and engage with information across various domains. Traditional research has predominantly centered on maximizing recommendation…

Machine Learning · Computer Science 2025-02-20 Hongxu Wang , Zhu Sun , Yingpeng Du , Lu Zhang , Tiantian He , Yew-Soon Ong

Learning the structure of Bayesian networks (BNs) from data is challenging, especially for datasets involving a large number of variables. The recently proposed divide-and-conquer (D\&D) strategies present a promising approach for learning…

Machine Learning · Computer Science 2025-07-01 Shengcai Liu , Hui Ou-yang , Zhiyuan Wang , Cheng Chen , Qijun Cai , Yew-Soon Ong , Ke Tang

We develop the framework of Indirect Query Bayesian Optimization (IQBO), a new class of Bayesian optimization problems where the integrated feedback is given via a conditional expectation of the unknown function $f$ to be optimized. The…

Machine Learning · Computer Science 2025-08-14 Mengyan Zhang , Shahine Bouabid , Cheng Soon Ong , Seth Flaxman , Dino Sejdinovic

The central goal of active learning is to gather data that maximises downstream predictive performance, but popular approaches have limited flexibility in customising this data acquisition to different downstream problems and losses. We…

Machine Learning · Computer Science 2026-05-11 Zhuoyue Huang , Freddie Bickford Smith , Tom Rainforth

Active learning is an effective technique for reducing the labeling cost by improving data efficiency. In this work, we propose a novel batch acquisition strategy for active learning in the setting where the model training is performed in a…

Machine Learning · Computer Science 2020-10-20 Zalán Borsos , Marco Tagliasacchi , Andreas Krause

Modern scientific and engineering design increasingly involves distributed optimization, where agents such as laboratories, simulations, or industrial partners pursue related goals under differing conditions. These agents often face…

Machine Learning · Statistics 2025-10-21 Zihan Wang , Yi-Ping Chen , Tuba Dolar , Wei Chen

The interplay between Machine Learning (ML) and Constrained Optimization (CO) has recently been the subject of increasing interest, leading to a new and prolific research area covering (e.g.) Decision Focused Learning and Constrained…

Machine Learning · Computer Science 2022-10-26 Mattia Silvestri , Allegra De Filippo , Michele Lombardi , Michela Milano

While perception tasks such as visual object recognition and text understanding play an important role in human intelligence, the subsequent tasks that involve inference, reasoning and planning require an even higher level of intelligence.…

Machine Learning · Statistics 2016-09-06 Hao Wang , Dit-Yan Yeung

Sparse Gaussian Processes are a key component of high-throughput Bayesian optimisation (BO) loops -- an increasingly common setting where evaluation budgets are large and highly parallelised. By using representative subsets of the available…

Machine Learning · Computer Science 2022-07-14 Henry B. Moss , Sebastian W. Ober , Victor Picheny

Optimisation problems often have multiple conflicting objectives that can be computationally and/or financially expensive. Mono-surrogate Bayesian optimisation (BO) is a popular model-based approach for optimising such black-box functions.…

Machine Learning · Computer Science 2022-08-11 George De Ath , Tinkle Chugh , Alma A. M. Rahat

Federated Unlearning (FU) is emerging as a powerful tool that enables the selective removal of client data to effectively address data contamination and meet strict privacy regulations in mobile edge computing (MEC) systems. Although FU has…

Networking and Internet Architecture · Computer Science 2026-05-22 Zihao Ding , Beining Wu , Jun Huang

Bayesian optimization (BO) offers an efficient pipeline for optimizing black-box functions with the help of a Gaussian process prior and an acquisition function (AF). Recently, in the context of single-objective BO, learning-based AFs…

Machine Learning · Computer Science 2025-05-30 Yu-Heng Hung , Kai-Jie Lin , Yu-Heng Lin , Chien-Yi Wang , Cheng Sun , Ping-Chun Hsieh

Despite enormous progress in object detection and classification, the problem of incorporating expected contextual relationships among object instances into modern recognition systems remains a key challenge. In this work we propose…

Computer Vision and Pattern Recognition · Computer Science 2017-01-11 Ehsan Jahangiri , Erdem Yoruk , Rene Vidal , Laurent Younes , Donald Geman

In this work we discuss the problem of active learning. We present an approach that is based on A-optimal experimental design of ill-posed problems and show how one can optimally label a data set by partially probing it, and use it to train…

Machine Learning · Computer Science 2022-11-28 Tue Boesen , Eldad Haber