English
Related papers

Related papers: Offline Multi-Task Multi-Objective Data-Driven Evo…

200 papers

Heuristic optimisation algorithms explore the search space by sampling solutions, evaluating their fitness, and biasing the search in the direction of promising solutions. However, in many cases, this fitness function involves executing…

Neural and Evolutionary Computing · Computer Science 2024-10-07 Pablo S. Naharro , Pablo Toharia , Antonio LaTorre , José-María Peña

Discovering configurations that are both high-utility and structurally diverse under expensive black-box evaluation and strict query budgets remains a central challenge in data-driven discovery. Many classical optimizers concentrate on…

Quantum Physics · Physics 2026-02-11 Saisubramaniam Gopalakrishnan , Dagnachew Birru

Solving complex problems requires continuous effort in developing theory and practice to cope with larger, more difficult scenarios. Working with surrogates is normal for creating a proxy that realistically models the problem into the…

Neural and Evolutionary Computing · Computer Science 2026-02-10 Tomohiro Harada , Enrique Alba , Gabriel Luque

Offline design optimization problem arises in numerous science and engineering applications including material and chemical design, where expensive online experimentation necessitates the use of in silico surrogate functions to predict and…

Machine Learning · Computer Science 2025-03-05 Minh Hoang , Azza Fadhel , Aryan Deshwal , Janardhan Rao Doppa , Trong Nghia Hoang

MATSuMoTo is the MATLAB Surrogate Model Toolbox for computationally expensive, black-box, global optimization problems that may have continuous, mixed-integer, or pure integer variables. Due to the black-box nature of the objective…

Optimization and Control · Mathematics 2014-04-17 Juliane Mueller

In this contribution, we develop an efficient surrogate modeling framework for simulation-based optimization of enhanced oil recovery, where we particularly focus on polymer flooding. The computational approach is based on an adaptive…

Numerical Analysis · Mathematics 2022-03-04 Tim Keil , Hendrik Kleikamp , Rolf J Lorentzen , Micheal B Oguntola , Mario Ohlberger

Data-driven black-box model-based optimization (MBO) problems arise in a great number of practical application scenarios, where the goal is to find a design over the whole space maximizing a black-box target function based on a static…

Machine Learning · Computer Science 2023-10-20 Mingcheng Chen , Haoran Zhao , Yuxiang Zhao , Hulei Fan , Hongqiao Gao , Yong Yu , Zheng Tian

In this paper, we introduce a novel approach for addressing the multi-objective optimization problem in large language model merging via black-box multi-objective optimization algorithms. The goal of model merging is to combine multiple…

Computation and Language · Computer Science 2024-11-26 Bingdong Li , Zixiang Di , Yanting Yang , Hong Qian , Peng Yang , Hao Hao , Ke Tang , Aimin Zhou

Multiobjective simulation optimization (MOSO) problems are optimization problems with multiple conflicting objectives, where evaluation of at least one of the objectives depends on a black-box numerical code or real-world experiment, which…

Optimization and Control · Mathematics 2025-01-13 Tyler H. Chang , Stefan M. Wild

In offline multi-objective optimization (MOO), we leverage an offline dataset of designs and their associated labels to simultaneously minimize multiple objectives. This setting more closely mirrors complex real-world problems compared to…

Computational Engineering, Finance, and Science · Computer Science 2025-02-21 Ye Yuan , Can Chen , Christopher Pal , Xue Liu

Optimization problems with nonlinear cost functions and combinatorial constraints appear in many real-world applications but remain challenging to solve efficiently compared to their linear counterparts. To bridge this gap, we propose…

Machine Learning · Computer Science 2023-07-20 Aaron Ferber , Taoan Huang , Daochen Zha , Martin Schubert , Benoit Steiner , Bistra Dilkina , Yuandong Tian

Machine unlearning seeks to remove the influence of designated training data while preserving performance on the remaining data. Approximate unlearning can be viewed as a local editing problem; in min-max unlearning, the key local object is…

Machine Learning · Computer Science 2026-05-08 Junhao Cai , Dohun Kim , Dowon Kim , Sung Il Choi , Chengjun Jin , Juhyun Park , Changhee Joo

Optimal well placement and well injection-production are crucial for the reservoir development to maximize the financial profits during the project lifetime. Meta-heuristic algorithms have showed good performance in solving complex,…

Neural and Evolutionary Computing · Computer Science 2022-12-16 Guodong Chen , Xin Luo , Jimmy Jiu Jiao , Xiaoming Xue

Solving optimization problems with unknown parameters often requires learning a predictive model to predict the values of the unknown parameters and then solving the problem using these values. Recent work has shown that including the…

Machine Learning · Computer Science 2020-10-23 Kai Wang , Bryan Wilder , Andrew Perrault , Milind Tambe

The goal in offline data-driven decision-making is synthesize decisions that optimize a black-box utility function, using a previously-collected static dataset, with no active interaction. These problems appear in many forms: offline…

Machine Learning · Computer Science 2022-11-28 Han Qi , Yi Su , Aviral Kumar , Sergey Levine

The multi-task learning (MTL) paradigm can be traced back to an early paper of Caruana (1997) in which it was argued that data from multiple tasks can be used with the aim to obtain a better performance over learning each task…

Machine Learning · Computer Science 2021-12-10 Andrea Ponti

Recent research explores optimization using large language models (LLMs) by either iteratively seeking next-step solutions from LLMs or directly prompting LLMs for an optimizer. However, these approaches exhibit inherent limitations,…

Optimization and Control · Mathematics 2024-03-06 Zeyuan Ma , Hongshu Guo , Jiacheng Chen , Guojun Peng , Zhiguang Cao , Yining Ma , Yue-Jiao Gong

Bayesian optimization (BO) is well known to be sample-efficient for solving black-box problems. However, the BO algorithms can sometimes get stuck in suboptimal solutions even with plenty of samples. Intrinsically, such suboptimal problem…

Machine Learning · Computer Science 2025-01-24 Zhendong Guo , Yew-Soon Ong , Tiantian He , Haitao Liu

To leverage the copious amount of data from source tasks and overcome the scarcity of the target task samples, representation learning based on multi-task pretraining has become a standard approach in many applications. However, up until…

Machine Learning · Computer Science 2023-06-06 Yiping Wang , Yifang Chen , Kevin Jamieson , Simon S. Du

Offline optimization has recently emerged as an increasingly popular approach to mitigate the prohibitively expensive cost of online experimentation. The key idea is to learn a surrogate of the black-box function that underlines the target…

Machine Learning · Computer Science 2025-03-07 Manh Cuong Dao , Phi Le Nguyen , Thao Nguyen Truong , Trong Nghia Hoang