English
Related papers

Related papers: FoMEMO: Towards Foundation Models for Expensive Mu…

200 papers

In recent years, multi-objective optimization (MOO) emerges as a foundational problem underpinning many multi-agent multi-task learning applications. However, existing algorithms in MOO literature remain limited to centralized learning…

Machine Learning · Computer Science 2024-01-09 Haibo Yang , Zhuqing Liu , Jia Liu , Chaosheng Dong , Michinari Momma

Over the last three decades, a large number of evolutionary algorithms have been developed for solving multiobjective optimization problems. However, there lacks an up-to-date and comprehensive software platform for researchers to properly…

Neural and Evolutionary Computing · Computer Science 2017-10-19 Ye Tian , Ran Cheng , Xingyi Zhang , Yaochu Jin

Multi-fidelity Bayesian optimization (MFBO) accelerates the search for the global optimum of black-box functions by integrating inexpensive, low-fidelity approximations. The central task of an MFBO policy is to balance the cost-efficiency…

Machine Learning · Computer Science 2026-02-03 Md Abir Hossen , Mohammad Ali Javidian , Vignesh Narayanan , Jason M. O'Kane , Pooyan Jamshidi

Decomposition has become an increasingly popular technique for evolutionary multi-objective optimization (EMO). A decomposition-based EMO algorithm is usually designed to approximate a whole Pareto-optimal front (PF). However, in practice,…

Neural and Evolutionary Computing · Computer Science 2018-10-02 Ke Li , Renzhi Chen , Dragan Savic , Xin Yao

Time series forecasting underpins vital decision-making across various sectors, yet raw predictions from sophisticated models often harbor systematic errors and biases. We examine the Forecast-Then-Optimize (FTO) framework, pioneering its…

Machine Learning · Computer Science 2025-06-17 Jinhang Jiang , Nan Wu , Ben Liu , Mei Feng , Xin Ji , Karthik Srinivasan

Aligning Large Language Models (LLMs) with human values often involves balancing multiple, conflicting objectives such as helpfulness and harmlessness. Training these models is computationally intensive, and centralizing the process raises…

Machine Learning · Computer Science 2026-03-27 Fatemeh Nourzad , Amirhossein Roknilamouki , Eylem Ekici , Jia Liu , Ness Shroff

Software configuration tuning is essential for optimizing a given performance objective (e.g., minimizing latency). Yet, due to the software's intrinsically complex configuration landscape and expensive measurement, there has been a rather…

Software Engineering · Computer Science 2024-03-18 Pengzhou Chen , Tao Chen , Miqing Li

Multi-objective Bayesian optimization (MOBO) provides a principled framework for optimizing expensive black-box functions with multiple objectives. However, existing MOBO methods often struggle with coverage, scalability with respect to the…

Machine Learning · Computer Science 2026-04-20 Yaohong Yang , Sammie Katt , Samuel Kaski

Multiobjective simulation optimization (MOSO) problems are optimization problems with multiple conflicting objectives, where evaluation of at least one of the objectives depends on a black-box numerical code or real-world experiment, which…

Optimization and Control · Mathematics 2025-01-13 Tyler H. Chang , Stefan M. Wild

This work aims at developing new methodologies to optimize computational costly complex systems (e.g., aeronautical engineering systems). The proposed surrogate-based method (often called Bayesian optimization) uses adaptive sampling to…

Many crucial scientific problems involve designing novel molecules with desired properties, which can be formulated as a black-box optimization problem over the discrete chemical space. In practice, multiple conflicting objectives and…

Machine Learning · Computer Science 2023-11-03 Yiheng Zhu , Jialu Wu , Chaowen Hu , Jiahuan Yan , Chang-Yu Hsieh , Tingjun Hou , Jian Wu

Automated machine learning has gained a lot of attention recently. Building and selecting the right machine learning models is often a multi-objective optimization problem. General purpose machine learning software that simultaneously…

Machine Learning · Computer Science 2019-08-15 Steven Gardner , Oleg Golovidov , Joshua Griffin , Patrick Koch , Wayne Thompson , Brett Wujek , Yan Xu

The pre-trained foundation models (PFMs) have become essential for facilitating large-scale multimodal learning. Researchers have effectively employed the ``pre-train, prompt, and predict'' paradigm through prompt learning to induce…

Computation and Language · Computer Science 2025-12-24 Xiang Chen , Yixin Ou , Quan Feng , Lei Li , Piji Li , Haibo Ye , Sheng-Jun Huang , Shuofei Qiao , Shumin Deng , Huajun Chen , Ningyu Zhang

Manufacturing advanced materials and products with a specific property or combination of properties is often warranted. To achieve that it is crucial to find out the optimum recipe or processing conditions that can generate the ideal…

Machine Learning · Computer Science 2023-04-20 Hamed Khosravi , Taofeeq Olajire , Ahmed Shoyeb Raihan , Imtiaz Ahmed

Foundation models (FMs) have emerged as a transformative paradigm in medical image analysis, offering the potential to provide generalizable, task-agnostic solutions across a wide range of clinical tasks and imaging modalities. Their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Karma Phuntsho , Abdullah , Kyungmi Lee , Ickjai Lee , Euijoon Ahn

Multiobjective optimization plays an increasingly important role in modern applications, where several objectives are often of equal importance. The task in multiobjective optimization and multiobjective optimal control is therefore to…

Optimization and Control · Mathematics 2019-06-24 Stefan Banholzer , Bennet Gebken , Michael Dellnitz , Sebastian Peitz , Stefan Volkwein

Automatic code summarization is beneficial to daily software development since it could help reduce the requirement of manual writing. Currently, artificial intelligence is undergoing a paradigm shift. The foundation models pretrained on…

Software Engineering · Computer Science 2022-03-15 Jian Gu , Pasquale Salza , Harald C. Gall

Aligning large language models (LLMs) with diverse and multifaceted user preferences is a fundamental challenge in personalized AI systems. Existing multi-objective alignment methods either rely on costly training or require pre-trained…

Computation and Language · Computer Science 2026-05-26 Linhao Luo , Thuy-Trang Vu , Van-Anh Nguyen , Junae Kim , Gholamreza Haffari , Dinh Phung

Modern machine learning tasks often require considering not just one but multiple objectives. For example, besides the prediction quality, this could be the efficiency, robustness or fairness of the learned models, or any of their…

Machine Learning · Computer Science 2022-08-30 Peter Súkeník , Christoph H. Lampert

Real-world problems are often multi-objective with decision-makers unable to specify a priori which trade-off between the conflicting objectives is preferable. Intuitively, building machine learning solutions in such cases would entail…

Machine Learning · Computer Science 2021-10-20 Timo M. Deist , Monika Grewal , Frank J. W. M. Dankers , Tanja Alderliesten , Peter A. N. Bosman