English
Related papers

Related papers: A Data Driven Sequential Learning Framework to Acc…

200 papers

Tuning control policies manually to meet high-level objectives is often time-consuming. Bayesian optimization provides a data-efficient framework for automating this process using numerical evaluations of an objective function. However,…

Machine Learning · Computer Science 2026-03-26 Lukas Theiner , Maik Pfefferkorn , Yongpeng Zhao , Sebastian Hirt , Rolf Findeisen

In this work, we study Bayesian quantum parameter estimation given a finite number of uses of the process encoding one or more unknown physical quantities. For multiple uses, it is conventional to classify quantum metrological protocols as…

Quantum Physics · Physics 2026-02-11 Erik L. André , Jessica Bavaresco , Mohammad Mehboudi

We introduce a unified probabilistic framework for solving sequential decision making problems ranging from Bayesian optimisation to contextual bandits and reinforcement learning. This is accomplished by a probabilistic model-based approach…

Deep generative models have emerged as a popular machine learning-based approach for inverse design problems in the life sciences. However, these problems often require sampling new designs that satisfy multiple properties of interest in…

We present a multi-objective Bayesian optimisation algorithm that allows the user to express preference-order constraints on the objectives of the type "objective A is more important than objective B". These preferences are defined based on…

Machine Learning · Computer Science 2019-11-14 Majid Abdolshah , Alistair Shilton , Santu Rana , Sunil Gupta , Svetha Venkatesh

Despite enormous progress in object detection and classification, the problem of incorporating expected contextual relationships among object instances into modern recognition systems remains a key challenge. In this work we propose…

Computer Vision and Pattern Recognition · Computer Science 2017-01-11 Ehsan Jahangiri , Erdem Yoruk , Rene Vidal , Laurent Younes , Donald Geman

Deep learning has been widely used in various applications from different fields such as computer vision, natural language processing, etc. However, the training models are often manually developed via many costly experiments. This manual…

Machine Learning · Computer Science 2022-11-22 Thanh Phuong Pham

We present GO-CBED, a goal-oriented Bayesian framework for sequential causal experimental design. Unlike conventional approaches that select interventions aimed at inferring the full causal model, GO-CBED directly maximizes the expected…

Machine Learning · Computer Science 2025-07-11 Zheyu Zhang , Jiayuan Dong , Jie Liu , Xun Huan

Recent advances in learnable evolutionary algorithms have demonstrated the importance of leveraging population distribution information and historical evolutionary trajectories. While significant progress has been made in continuous…

Neural and Evolutionary Computing · Computer Science 2024-12-10 Jiaxiang Huang , Licheng Jiao

We develop a new computational approach for "focused" optimal Bayesian experimental design with nonlinear models, with the goal of maximizing expected information gain in targeted subsets of model parameters. Our approach considers…

Computation · Statistics 2019-03-28 Chi Feng , Youssef M. Marzouk

Adjustable hyperparameters of machine learning models typically impact various key trade-offs such as accuracy, fairness, robustness, or inference cost. Our goal in this paper is to find a configuration that adheres to user-specified limits…

Machine Learning · Computer Science 2023-12-05 Bracha Laufer-Goldshtein , Adam Fisch , Regina Barzilay , Tommi Jaakkola

There is significant growth and interest in the use of synthetic data as an enabler for machine learning in environments where the release of real data is restricted due to privacy or availability constraints. Despite a large number of…

Machine Learning · Computer Science 2020-11-25 Harrison Wilde , Jack Jewson , Sebastian Vollmer , Chris Holmes

In industrial machine learning pipelines, data often arrive in parts. Particularly in the case of deep neural networks, it may be too expensive to train the model from scratch each time, so one would rather use a previously learned model…

Machine Learning · Statistics 2018-03-29 Max Kochurov , Timur Garipov , Dmitry Podoprikhin , Dmitry Molchanov , Arsenii Ashukha , Dmitry Vetrov

One of the most tedious tasks in the application of machine learning is model selection, i.e. hyperparameter selection. Fortunately, recent progress has been made in the automation of this process, through the use of sequential model-based…

Machine Learning · Computer Science 2014-02-05 Alexandre Lacoste , Hugo Larochelle , François Laviolette , Mario Marchand

Sequential Bayesian optimal experimental design (SBOED) for PDE-governed inverse problems is computationally challenging, especially for infinite-dimensional random field parameters. High-fidelity approaches require repeated forward and…

Optimization and Control · Mathematics 2026-01-12 Kaichen Shen , Peng Chen

Optimization problems have been the subject of statistical physics approximations. A specially relevant and general scenario is provided by optimization methods considering tradeoffs between cost and efficiency, where optimal solutions…

Statistical Mechanics · Physics 2015-09-16 Luís F. Seoane , Ricard V. Solé

Despite the successful implementations of physics-informed neural networks in different scientific domains, it has been shown that for complex nonlinear systems, achieving an accurate model requires extensive hyperparameter tuning, network…

Computational Engineering, Finance, and Science · Computer Science 2022-11-30 Milad Ramezankhani , Amir Nazemi , Apurva Narayan , Heinz Voggenreiter , Mehrtash Harandi , Rudolf Seethaler , Abbas S. Milani

Bayesian optimization (BO) is a popular method to optimize expensive black-box functions. It efficiently tunes machine learning algorithms under the implicit assumption that hyperparameter evaluations cost approximately the same. In…

Machine Learning · Computer Science 2020-11-25 Gauthier Guinet , Valerio Perrone , Cédric Archambeau

We present an integrated prediction-optimization (PredOpt) framework to efficiently solve sequential decision-making problems by predicting the values of binary decision variables in an optimal solution. We address the key issues of…

Machine Learning · Computer Science 2023-11-14 Dogacan Yilmaz , İ. Esra Büyüktahtakın

The design of mobile autonomous robots is challenging due to the limited on-board resources such as processing power and energy. A promising approach is to generate intelligent schedules that reduce the resource consumption while…