English
Related papers

Related papers: Transfer Learning in Bayesian Optimization for Air…

200 papers

Latent space model plays a crucial role in network analysis, and accurate estimation of latent variables is essential for downstream tasks such as link prediction. However, the large number of parameters to be estimated presents a…

Methodology · Statistics 2025-09-22 Kuangnan Fang , Ruixuan Qin , Xinyan Fan

In complex large-scale systems such as climate, important effects are caused by a combination of confounding processes that are not fully observable. The identification of sources from observations of system state is vital for attribution…

Machine Learning · Statistics 2023-03-22 Joseph Hart , Mamikon Gulian , Indu Manickam , Laura Swiler

Aerodynamic analysis during aircraft design usually involves methods of varying accuracy and spatial resolution, which all have their advantages and disadvantages. It is therefore desirable to create data-driven models which effectively…

Machine Learning · Computer Science 2025-07-29 Alexander Barklage , Philipp Bekemeyer

Quantile regression is increasingly encountered in modern big data applications due to its robustness and flexibility. We consider the scenario of learning the conditional quantiles of a specific target population when the available data…

Statistics Theory · Mathematics 2024-02-27 Jun Jin , Jun Yan , Robert H. Aseltine , Kun Chen

Discrete optimization belongs to the set of $\mathcal{NP}$-hard problems, spanning fields such as mixed-integer programming and combinatorial optimization. A current standard approach to solving convex discrete optimization problems is the…

Machine Learning · Computer Science 2024-02-28 Kyle Mana , Fernando Acero , Stephen Mak , Parisa Zehtabi , Michael Cashmore , Daniele Magazzeni , Manuela Veloso

Addressing real-world optimization challenges requires not only advanced metaheuristics but also continuous refinement of their internal mechanisms. This paper explores the integration of machine learning in the form of neural surrogate…

Neural and Evolutionary Computing · Computer Science 2026-03-31 Tomohiro Harada , Enrique Alba , Gabriel Luque

Transfer optimization enables data-efficient optimization of a target task by leveraging experiential priors from related source tasks. This is especially useful in multiobjective optimization settings where a set of trade-off solutions is…

Neural and Evolutionary Computing · Computer Science 2024-07-11 Jiao Liu , Abhishek Gupta , Yew-Soon Ong

Hyperparameter tuning is a challenging problem especially when the system itself involves uncertainty. Due to noisy function evaluations, optimization under uncertainty can be computationally expensive. In this paper, we present a novel…

Machine Learning · Computer Science 2025-10-09 Akash Yadav , Ruda Zhang

Meta-learning methods perform well on new within-distribution tasks but often fail when adapting to out-of-distribution target tasks, where transfer from source tasks can induce negative transfer. We propose a causally-aware Bayesian…

Machine Learning · Computer Science 2026-02-24 Lotta Mäkinen , Jorge Loría , Samuel Kaski

We describe a method for Bayesian optimization by which one may incorporate data from multiple systems whose quantitative interrelationships are unknown a priori. All general (nonreal-valued) features of the systems are associated with…

Machine Learning · Computer Science 2020-01-06 Steven Atkinson , Sayan Ghosh , Natarajan Chennimalai-Kumar , Genghis Khan , Liping Wang

Multi-objective optimization aims to solve problems with competing objectives. Evaluating such problems is often slow or expensive, limiting the budget of evaluations. In many applications, historical data from related optimization tasks is…

Machine Learning · Computer Science 2026-05-12 Leonard Papenmeier , Petru Tighineanu

The performance of many machine learning models depends on their hyper-parameter settings. Bayesian Optimization has become a successful tool for hyper-parameter optimization of machine learning algorithms, which aims to identify optimal…

Machine Learning · Computer Science 2020-08-04 Lidan Wang , Franck Dernoncourt , Trung Bui

Bayesian inverse modeling is important for a better understanding of hydrological processes. However, this approach can be computationally demanding, as it usually requires a large number of model evaluations. To address this issue, one can…

Computation · Statistics 2020-02-24 Jiangjiang Zhang , Qiang Zheng , Dingjiang Chen , Laosheng Wu , Lingzao Zeng

Bayesian optimization (BO) is a sample efficient approach to automatically tune the hyperparameters of machine learning models. In practice, one frequently has to solve similar hyperparameter tuning problems sequentially. For example, one…

Machine Learning · Computer Science 2021-02-26 Samuel Horváth , Aaron Klein , Peter Richtárik , Cédric Archambeau

The design and optimization of optical components, such as Bragg gratings, are critical for applications in telecommunications, sensing, and photonic circuits. To overcome the limitations of traditional design methods that rely heavily on…

Optics · Physics 2025-05-07 M. R. Mahani , Igor A. Nechepurenko , Thomas Flisgen , Andreas Wicht

We develop a fast and scalable computational framework to solve large-scale and high-dimensional Bayesian optimal experimental design problems. In particular, we consider the problem of optimal observation sensor placement for Bayesian…

Numerical Analysis · Mathematics 2020-11-09 Keyi Wu , Peng Chen , Omar Ghattas

Deep neural networks are vulnerable to adversarial examples -- minor perturbations added to a model's input which cause the model to output an incorrect prediction. We introduce a new method for improving the efficacy of adversarial attacks…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Chris Miller , Soroush Vosoughi

The estimation of unknown values of parameters (or hidden variables, control variables) that characterise a physical system often relies on the comparison of measured data with synthetic data produced by some numerical simulator of the…

Machine Learning · Computer Science 2019-01-28 Xi Chen , Mike Hobson

Bayesian coresets have emerged as a promising approach for implementing scalable Bayesian inference. The Bayesian coreset problem involves selecting a (weighted) subset of the data samples, such that the posterior inference using the…

Machine Learning · Statistics 2021-03-01 Jacky Y. Zhang , Rajiv Khanna , Anastasios Kyrillidis , Oluwasanmi Koyejo

Many control problems require repeated tuning and adaptation of controllers across distinct closed-loop tasks, where data efficiency and adaptability are critical. We propose a hierarchical Bayesian optimization (BO) framework that is…

Systems and Control · Electrical Eng. & Systems 2026-03-27 Sebastian Hirt , Lukas Theiner , Maik Pfefferkorn , Rolf Findeisen
‹ Prev 1 3 4 5 6 7 10 Next ›