English
Related papers

Related papers: Multi-Task Surrogate-Assisted Search with Bayesian…

200 papers

Bayesian optimization is a powerful global optimization technique for expensive black-box functions. One of its shortcomings is that it requires auxiliary optimization of an acquisition function at each iteration. This auxiliary…

Machine Learning · Statistics 2014-02-28 Ziyu Wang , Babak Shakibi , Lin Jin , Nando de Freitas

Bayesian optimization (BO) has for sequential optimization of expensive black-box functions demonstrated practicality and effectiveness in many real-world settings. Meta-Bayesian optimization (meta-BO) focuses on improving the sample…

Cross-Disciplinary Cold-start Knowledge Tracing (CDCKT) faces a critical challenge: insufficient student interaction data in the target discipline prevents effective knowledge state modeling and performance prediction. Existing…

Information Retrieval · Computer Science 2025-11-26 Yulong Deng , Zheng Guan , Min He , Xue Wang , Jie Liu , Zheng Li

Answer selection (AS) is a critical subtask of the open-domain question answering (QA) problem. The present paper proposes a method called RLAS-BIABC for AS, which is established on attention mechanism-based long short-term memory (LSTM)…

Computation and Language · Computer Science 2023-01-10 Hamid Gharagozlou , Javad Mohammadzadeh , Azam Bastanfard , Saeed Shiry Ghidary

Surrogate models provide efficient alternatives to computationally demanding real world processes but often require large datasets for effective training. A promising solution to this limitation is the transfer of pre-trained surrogate…

Machine Learning · Computer Science 2025-05-14 Shuaiqun Pan , Diederick Vermetten , Manuel López-Ibáñez , Thomas Bäck , Hao Wang

Bayesian optimization (BO) is a model-based approach to sequentially optimize expensive black-box functions, such as the validation error of a deep neural network with respect to its hyperparameters. In many real-world scenarios, the…

Machine Learning · Statistics 2019-10-17 Valerio Perrone , Iaroslav Shcherbatyi , Rodolphe Jenatton , Cedric Archambeau , Matthias Seeger

We revisit the classical problem of Bayesian ensembles and address the challenge of learning optimal combinations of Bayesian models in an online, continual learning setting. To this end, we reinterpret existing approaches such as Bayesian…

Machine Learning · Computer Science 2026-01-26 Daniel Waxman , Fernando Llorente , Petar M. Djurić

Bayesian optimization is an elegant solution to the hyperparameter optimization problem in machine learning. Building a reliable and robust Bayesian optimization service requires careful testing methodology and sound statistical analysis.…

Machine Learning · Computer Science 2016-05-23 Ian Dewancker , Michael McCourt , Scott Clark , Patrick Hayes , Alexandra Johnson , George Ke

We study the problem of incorporating prior knowledge into a deep Transformer-based model,i.e.,Bidirectional Encoder Representations from Transformers (BERT), to enhance its performance on semantic textual matching tasks. By probing and…

Computation and Language · Computer Science 2021-02-23 Tingyu Xia , Yue Wang , Yuan Tian , Yi Chang

Evolutionary transfer multiobjective optimization (ETMO) has been becoming a hot research topic in the field of evolutionary computation, which is based on the fact that knowledge learning and transfer across the related optimization…

Neural and Evolutionary Computing · Computer Science 2021-11-09 Songbai Liu , Qiuzhen Lin , Kay Chen Tan , Qing Li

Transfer learning for Bayesian optimisation has generally assumed a strong similarity between optimisation tasks, with at least a subset having similar optimal inputs. This assumption can reduce computational costs, but it is violated in a…

Machine Learning · Computer Science 2024-04-22 Sigrid Passano Hellan , Christopher G. Lucas , Nigel H. Goddard

Transfer Optimization has gained a remarkable attention from the Swarm and Evolutionary Computation community in the recent years. It is undeniable that the concepts underlying Transfer Optimization are formulated on solid grounds. However,…

Neural and Evolutionary Computing · Computer Science 2022-11-14 Eneko Osaba , Javier Del Ser , Ponnuthurai N. Suganthan

Bayesian inference often faces a trade-off between computational speed and sampling accuracy. We propose an adaptive workflow that integrates rapid amortized inference with gold-standard MCMC techniques to achieve a favorable combination of…

Machine Learning · Computer Science 2026-02-19 Chengkun Li , Aki Vehtari , Paul-Christian Bürkner , Stefan T. Radev , Luigi Acerbi , Marvin Schmitt

Data-driven evolutionary algorithms has shown surprising results in addressing expensive optimization problems through robust surrogate modeling. Though promising, existing surrogate modeling schemes may encounter limitations in complex…

Neural and Evolutionary Computing · Computer Science 2025-12-18 Xian-Rong Zhang , Yue-Jiao Gong , Zeyuan Ma , Jun Zhang

Bayesian optimization (BO) is a popular approach for optimizing expensive-to-evaluate black-box objective functions. An important challenge in BO is its application to high-dimensional search spaces due in large part to the curse of…

Machine Learning · Computer Science 2025-05-27 Wei-Ting Tang , Joel A. Paulson

Multi-Objective Evolutionary Algorithms (MOEAs) have proven effective at solving Multi-Objective Optimisation Problems (MOOPs). However, their performance can be significantly hindered when applied to computationally intensive industrial…

Neural and Evolutionary Computing · Computer Science 2026-01-30 Tiwonge Msulira Banda , Alexandru-Ciprian Zăvoianu

Black-box optimization problems, which are common in many real-world applications, require optimization through input-output interactions without access to internal workings. This often leads to significant computational resources being…

Neural and Evolutionary Computing · Computer Science 2024-03-25 Hao Hao , Xiaoqun Zhang , Aimin Zhou

Bilevel optimization, a hierarchical mathematical framework where one optimization problem is nested within another, has emerged as a powerful tool for modeling complex decision-making processes in various fields such as economics,…

Machine Learning · Computer Science 2024-12-25 Omer Ekmekcioglu , Nursen Aydin , Juergen Branke

Bayesian Optimization is a popular approach for optimizing expensive black-box functions. Its key idea is to use a surrogate model to approximate the objective and, importantly, quantify the associated uncertainty that allows a sequential…

Machine Learning · Statistics 2025-02-05 Haoxian Chen , Henry Lam

Evolutionary multitasking (EMT) has emerged as a popular topic of evolutionary computation over the past decade. It aims to concurrently address multiple optimization tasks within limited computing resources, leveraging inter-task knowledge…

Neural and Evolutionary Computing · Computer Science 2026-02-11 Yanchi Li , Wenyin Gong , Tingyu Zhang , Fei Ming , Shuijia Li , Qiong Gu , Yew-Soon Ong
‹ Prev 1 4 5 6 7 8 10 Next ›