English
Related papers

Related papers: Diversity By Design: Leveraging Distribution Match…

200 papers

In this experience report, we apply deep active learning to the field of design optimization to reduce the number of computationally expensive numerical simulations. We are interested in optimizing the design of structural components, where…

Machine Learning · Computer Science 2024-03-21 Jens Decke , Christian Gruhl , Lukas Rauch , Bernhard Sick

Bayesian optimization (BO) has emerged during the last few years as an effective approach to optimizing black-box functions where direct queries of the objective are expensive. In this paper we consider the case where direct access to the…

Machine Learning · Statistics 2017-04-13 Javier Gonzalez , Zhenwen Dai , Andreas Damianou , Neil D. Lawrence

The dynamic of real-world optimization problems raises new challenges to the traditional particle swarm optimization (PSO). Responding to these challenges, the dynamic optimization has received considerable attention over the past decade.…

Neural and Evolutionary Computing · Computer Science 2019-03-27 Ahlem Aboud , Raja Fdhila , Adel M. Alimi

Preferential Bayesian optimization (PBO) is a variant of Bayesian optimization that observes relative preferences (e.g., pairwise comparisons) instead of direct objective values, making it especially suitable for human-in-the-loop…

Machine Learning · Computer Science 2025-05-19 Koki Iwai , Yusuke Kumagae , Yuki Koyama , Masahiro Hamasaki , Masataka Goto

Black-box global optimization aims at minimizing an objective function whose analytical form is not known. To do so, many state-of-the-art methods rely on sampling-based strategies, where sampling distributions are built in an iterative…

Optimization and Control · Mathematics 2024-09-30 Thomas Guilmeau , Emilie Chouzenoux , Víctor Elvira

Reliability-based design optimization (RBDO) is traditionally formulated as a nested optimization and reliability problem. Although surrogate models are generally employed to improve efficiency, the approach remains computationally…

Computation · Statistics 2026-04-08 M. Moustapha , B. Sudret

Dynamic mechanism design is a challenging extension to ordinary mechanism design in which the mechanism designer must make a sequence of decisions over time in the face of possibly untruthful reports of participating agents. Optimizing…

Computer Science and Game Theory · Computer Science 2025-02-18 Michael Curry , Vinzenz Thoma , Darshan Chakrabarti , Stephen McAleer , Christian Kroer , Tuomas Sandholm , Niao He , Sven Seuken

Diffusion models are a class of flexible generative models trained with an approximation to the log-likelihood objective. However, most use cases of diffusion models are not concerned with likelihoods, but instead with downstream objectives…

Machine Learning · Computer Science 2024-01-08 Kevin Black , Michael Janner , Yilun Du , Ilya Kostrikov , Sergey Levine

Offline reinforcement learning (RL) refers to the problem of learning policies entirely from a large batch of previously collected data. This problem setting offers the promise of utilizing such datasets to acquire policies without any…

Machine Learning · Computer Science 2020-11-24 Tianhe Yu , Garrett Thomas , Lantao Yu , Stefano Ermon , James Zou , Sergey Levine , Chelsea Finn , Tengyu Ma

Model-based offline reinforcement learning (RL) aims to find highly rewarding policy, by leveraging a previously collected static dataset and a dynamics model. While the dynamics model learned through reuse of the static dataset, its…

Machine Learning · Computer Science 2022-11-01 Kaiyang Guo , Yunfeng Shao , Yanhui Geng

Traditional optimization algorithms search for a single global optimum that maximizes (or minimizes) the objective function. Multimodal optimization algorithms search for the highest peaks in the search space that can be more than one.…

Neural and Evolutionary Computing · Computer Science 2020-12-18 Konstantinos Chatzilygeroudis , Antoine Cully , Vassilis Vassiliades , Jean-Baptiste Mouret

Optimization is instrumental for improving operations of large-scale socio-technical infrastructures of Smart Cities, for instance, energy and traffic systems. In particular, understanding the performance of multi-agent discrete-choice…

Multiagent Systems · Computer Science 2025-06-06 Amal Aldawsari , Evangelos Pournaras

Offline preference optimization methods are efficient for large language models (LLMs) alignment. Direct Preference optimization (DPO)-like learning, one of the most popular approaches, stands out for its efficiency in reward modeling.…

Machine Learning · Computer Science 2026-05-26 Xiaobo Wang , Zixia Jia , Jiaqi Li , Qi Liu , Zilong Zheng

Balancing competing objectives is omnipresent across disciplines, from drug design to autonomous systems. Multi-objective Bayesian optimization is a promising solution for such expensive, black-box problems: it fits probabilistic surrogates…

Machine Learning · Computer Science 2026-05-13 Xinyu Zhang , Conor Hassan , Julien Martinelli , Daolang Huang , Samuel Kaski

The pursuit of universal black-box optimization (BBO) algorithms is a longstanding goal. However, unlike domains such as language or vision, where scaling structured data has driven generalization, progress in offline BBO remains hindered…

Machine Learning · Computer Science 2025-06-10 Rong-Xi Tan , Ming Chen , Ke Xue , Yao Wang , Yaoyuan Wang , Sheng Fu , Chao Qian

This paper proposes a two-step framework for techno-economic analysis of a demand-side flexibility service in distribution networks. Step one applies optimization-based modelling to propose a generic problem formulation which determines the…

Systems and Control · Electrical Eng. & Systems 2022-01-10 Timur Sayfutdinov , Charalampos Patsios , David Greenwood , Meltem Peker , Ilias Sarantakos

Deep learning models, even the-state-of-the-art ones, are highly vulnerable to adversarial examples. Adversarial training is one of the most efficient methods to improve the model's robustness. The key factor for the success of adversarial…

Machine Learning · Computer Science 2023-06-05 Anh Bui , Trung Le , He Zhao , Quan Tran , Paul Montague , Dinh Phung

Efficiently solving multi-objective optimization problems for simulation optimization of important scientific and engineering applications such as materials design is becoming an increasingly important research topic. This is due largely to…

Artificial Intelligence · Computer Science 2023-06-27 Eric Hans Lee , Bolong Cheng , Michael McCourt

This paper proposes a novel approach to construct data-driven online solutions to optimization problems (P) subject to a class of distributionally uncertain dynamical systems. The introduced framework allows for the simultaneous learning of…

Systems and Control · Electrical Eng. & Systems 2024-07-23 Dan Li , Dariush Fooladivanda , Sonia Martinez

Benchmark Design in Black-Box Optimization (BBO) is a fundamental yet open-ended topic. Early BBO benchmarks are predominantly human-crafted, introducing expert bias and constraining diversity. Automating this design process can relieve the…

Neural and Evolutionary Computing · Computer Science 2026-02-03 Chen Wang , Sijie Ma , Zeyuan Ma , Yue-Jiao Gong