English
Related papers

Related papers: Pareto Driven Surrogate (ParDen-Sur) Assisted Opti…

200 papers

Manufacturing advanced materials and products with a specific property or combination of properties is often warranted. To achieve that it is crucial to find out the optimum recipe or processing conditions that can generate the ideal…

Machine Learning · Computer Science 2023-04-20 Hamed Khosravi , Taofeeq Olajire , Ahmed Shoyeb Raihan , Imtiaz Ahmed

Generating simulated training data needed for constructing sufficiently accurate surrogate models to be used for efficient optimization or parameter identification can incur a huge computational effort in the offline phase. We consider a…

Numerical Analysis · Mathematics 2024-04-03 Phillip Semler , Martin Weiser

Expensive multi-objective optimization problems (EMOPs) are common in real-world scenarios where evaluating objective functions is costly and involves extensive computations or physical experiments. Current Pareto set learning methods for…

Machine Learning · Computer Science 2025-03-18 Minh-Duc Nguyen , Phuong Mai Dinh , Quang-Huy Nguyen , Long P. Hoang , Dung D. Le

The computational models for geophysical flows are computationally very expensive to employ in multi-query tasks such as data assimilation, uncertainty quantification, and hence surrogate models sought to alleviate the computational burden…

Computational Physics · Physics 2022-01-10 Suraj Pawar , Omer San , Gary G. Yen

Data-driven evolutionary multi-objective optimization (EMO) has been recognized as an effective approach for multi-objective optimization problems with expensive objective functions. The current research is mainly developed for problems…

Neural and Evolutionary Computing · Computer Science 2022-05-31 Renzhi Chen , Ke Li

Surrogate Optimization (SO) algorithms have shown promise for optimizing expensive black-box functions. However, their performance is heavily influenced by hyperparameters related to sampling and surrogate fitting, which poses a challenge…

Machine Learning · Computer Science 2023-10-13 Nazanin Nezami , Hadis Anahideh

Multi-task learning (MTL), which aims to improve performance by learning multiple tasks simultaneously, inherently presents an optimization challenge due to multiple objectives. Hence, multi-objective optimization (MOO) approaches have been…

Artificial Intelligence · Computer Science 2021-10-08 Simyung Chang , KiYoon Yoo , Jiho Jang , Nojun Kwak

Hyperparameter tuning is an omnipresent problem in machine learning as it is an integral aspect of obtaining the state-of-the-art performance for any model. Most often, hyperparameters are optimized just by training a model on a grid of…

Machine Learning · Computer Science 2019-06-28 Hadi S. Jomaa , Josif Grabocka , Lars Schmidt-Thieme

Classification, recommendation, and ranking problems often involve competing goals with additional constraints (e.g., to satisfy fairness or diversity criteria). Such optimization problems are quite challenging, often involving non-convex…

Machine Learning · Computer Science 2021-02-16 Gurpreet Singh , Soumyajit Gupta , Matthew Lease , Clint Dawson

Stochastic Multi-Objective Optimization (SMOO) is critical for decision-making trading off multiple potentially conflicting objectives in uncertain environments. SMOO aims at identifying the Pareto frontier, which contains all mutually…

Machine Learning · Computer Science 2026-04-02 Jinzhao Li , Nan Jiang , Yexiang Xue

Multi-objective optimization is a widely studied problem in diverse fields, such as engineering and finance, that seeks to identify a set of non-dominated solutions that provide optimal trade-offs among competing objectives. However, the…

Neural and Evolutionary Computing · Computer Science 2024-01-15 Arash Heidari , Sebastian Rojas Gonzalez , Tom Dhaene , Ivo Couckuyt

Production optimization in stress-sensitive unconventional reservoirs is governed by a nonlinear trade-off between pressure-driven flow and stress-induced degradation of fracture conductivity and matrix permeability. While higher drawdown…

Machine Learning · Computer Science 2026-04-02 Mahammad Valiyev , Jodel Cornelio , Behnam Jafarpour

Bayesian optimization (BO) has well-documented merits for optimizing black-box functions with an expensive evaluation cost. Such functions emerge in applications as diverse as hyperparameter tuning, drug discovery, and robotics. BO hinges…

Machine Learning · Statistics 2026-05-28 Qin Lu , Konstantinos D. Polyzos , Bingcong Li , Georgios B. Giannakis

This paper presents a methodological framework for training, self-optimising, and self-organising surrogate models to approximate and speed up multiobjective optimisation of technical systems based on multiphysics simulations. At the hand…

Machine Learning · Computer Science 2024-04-04 Diego Botache , Jens Decke , Winfried Ripken , Abhinay Dornipati , Franz Götz-Hahn , Mohamed Ayeb , Bernhard Sick

Deep generative models have recently shown success in solving complex engineering design problems where models predict solutions that address the design requirements specified as input. However, there remains a challenge in aligning such…

Machine Learning · Computer Science 2025-02-06 Hyunmin Cheong , Mohammadmehdi Ataei , Amir Hosein Khasahmadi , Pradeep Kumar Jayaraman

The Dragonfly network, with its high-radix and low-diameter structure, is a leading interconnect in high-performance computing. A major challenge is workload interference on shared network links. Parallel discrete event simulation (PDES) is…

Machine Learning · Computer Science 2025-11-17 Xin Wang , Pietro Lodi Rizzini , Sourav Medya , Zhiling Lan

\noindent Hyper-parameter selection is a central practical problem in modern machine learning, governing regularization strength, model capacity, and robustness choices. Cross-validation is often computationally prohibitive at scale, while…

Machine Learning · Statistics 2025-12-24 Hedibert Lopes , Nick Polson , Vadim Sokolov

Learning controller parameters from closed-loop data has been shown to improve closed-loop performance. Bayesian optimization, a widely used black-box and sample-efficient learning method, constructs a probabilistic surrogate of the…

Machine Learning · Computer Science 2025-12-15 Sebastian Hirt , Valentinus Suwanto , Hendrik Alsmeier , Maik Pfefferkorn , Rolf Findeisen

Bayesian hyperparameter optimization relies heavily on Gaussian Process (GP) surrogates, due to robust distributional posteriors and strong performance on limited training samples. GPs however underperform in categorical hyperparameter…

Machine Learning · Computer Science 2025-09-23 Riccardo Doyle

Recent advancements in the realm of deep generative models focus on generating samples that satisfy multiple desired properties. However, prevalent approaches optimize these property functions independently, thus omitting the trade-offs…

Machine Learning · Computer Science 2024-07-08 Yinghua Yao , Yuangang Pan , Jing Li , Ivor Tsang , Xin Yao