English
Related papers

Related papers: Amortized Active Generation of Pareto Sets

200 papers

We present a general strategy for turning generative models into candidate solution samplers for batch Bayesian optimization (BO). The use of generative models for BO enables large batch scaling as generative sampling, optimization of…

Machine Learning · Statistics 2026-05-15 Rafael Oliveira , Daniel M. Steinberg , Edwin V. Bonilla

Modern generative models are usually designed to match target distributions directly in the data space, where the intrinsic dimension of data can be much lower than the ambient dimension. We argue that this discrepancy may contribute to the…

Machine Learning · Computer Science 2020-07-02 Zijun Zhang , Ruixiang Zhang , Zongpeng Li , Yoshua Bengio , Liam Paull

Auto-bidding is essential in facilitating online advertising by automatically placing bids on behalf of advertisers. Generative auto-bidding, which generates bids based on an adjustable condition using models like transformers and…

Artificial Intelligence · Computer Science 2025-06-04 Yewen Li , Shuai Mao , Jingtong Gao , Nan Jiang , Yunjian Xu , Qingpeng Cai , Fei Pan , Peng Jiang , Bo An

Probabilistic programming languages (PPLs) are a powerful modeling tool, able to represent any computable probability distribution. Unfortunately, probabilistic program inference is often intractable, and existing PPLs mostly rely on…

Artificial Intelligence · Computer Science 2016-10-19 Daniel Ritchie , Paul Horsfall , Noah D. Goodman

The development of artificial intelligence (AI) for science has led to the emergence of learning-based research paradigms, necessitating a compelling reevaluation of the design of multi-objective optimization (MOO) methods. The new…

Machine Learning · Computer Science 2023-11-02 Linxi Yang , Xinmin Yang , Liping Tang

Pareto front profiling in multi-objective optimization (MOO), i.e., finding a diverse set of Pareto optimal solutions, is challenging, especially with expensive objectives that require training a neural network. Typically, in MOO for neural…

Machine Learning · Computer Science 2025-02-06 Rhea Sanjay Sukthanker , Arber Zela , Benedikt Staffler , Samuel Dooley , Josif Grabocka , Frank Hutter

Hyperparameter optimization (HPO) is important to leverage the full potential of machine learning (ML). In practice, users are often interested in multi-objective (MO) problems, i.e., optimizing potentially conflicting objectives, like…

Machine Learning · Computer Science 2024-01-12 Joseph Giovanelli , Alexander Tornede , Tanja Tornede , Marius Lindauer

Preference handling and optimization are indispensable means for addressing non-trivial applications in Answer Set Programming (ASP). However, their implementation becomes difficult whenever they bring about a significant increase in…

Logic in Computer Science · Computer Science 2011-07-29 Martin Gebser , Roland Kaminski , Torsten Schaub

Multi-objective preference alignment of large language models (LLMs) is critical for developing AI systems that are more configurable, personalizable, helpful, and safe. However, optimizing model outputs to satisfy diverse objectives with…

Computation and Language · Computer Science 2025-03-04 Raghav Gupta , Ryan Sullivan , Yunxuan Li , Samrat Phatale , Abhinav Rastogi

Multi-preference optimization enriches language-model alignment beyond pairwise preferences by contrasting entire sets of helpful and undesired responses, thereby enabling richer training signals for large language models. During self-play…

Machine Learning · Computer Science 2025-06-10 Taneesh Gupta , Rahul Madhavan , Xuchao Zhang , Chetan Bansal , Saravan Rajmohan

Exploration-Exploitation (E{\&}E) algorithms are commonly adopted to deal with the feedback-loop issue in large-scale online recommender systems. Most of existing studies believe that high uncertainty can be a good indicator of potential…

Information Retrieval · Computer Science 2022-05-31 Kailun Wu , Zhangming Chan , Weijie Bian , Lejian Ren , Shiming Xiang , Shuguang Han , Hongbo Deng , Bo Zheng

Preference optimization has become a central paradigm for aligning large language models with human feedback. Direct Preference Optimization (DPO) simplifies reinforcement learning from human feedback by directly optimizing pairwise…

Machine Learning · Computer Science 2026-05-05 Inoussa Mouiche

Demand response for residential users is essential to the realization of modern smart grids. This paper proposes a multiobjective approach to designing a demand response program that considers the energy costs of residential users and the…

Systems and Control · Electrical Eng. & Systems 2026-01-15 Wei-Yu Chiu , Jui-Ting Hsieh , Chia-Ming Chen

Accurate exploration of protein conformational ensembles is essential for uncovering function but remains hard because molecular-dynamics (MD) simulations suffer from high computational costs and energy-barrier trapping. This paper presents…

Machine Learning · Computer Science 2025-11-14 Yuancheng Sun , Yuxuan Ren , Zhaoming Chen , Xu Han , Kang Liu , Qiwei Ye

Generating feasible Pareto fronts for constrained bi-objective continuous optimization is central to multi-criteria decision-making. Existing methods usually rely on iterative scalarization, evolutionary search, or problem-specific solvers,…

Artificial Intelligence · Computer Science 2026-05-13 Peipei Xu , SiYuan Ma , Yaohua Liu , Yu Wu , Guanliang Liu , Yang Zhang , Yong Liu

Recent advancements in the realm of deep generative models focus on generating samples that satisfy multiple desired properties. However, prevalent approaches optimize these property functions independently, thus omitting the trade-offs…

Machine Learning · Computer Science 2024-07-08 Yinghua Yao , Yuangang Pan , Jing Li , Ivor Tsang , Xin Yao

Parent selection in evolutionary algorithms for multi-objective optimisation is usually performed by dominance mechanisms or indicator functions that prefer non-dominated points. We propose to refine the parent selection on evolutionary…

Neural and Evolutionary Computing · Computer Science 2018-09-05 Edgar Covantes Osuna , Wanru Gao , Frank Neumann , Dirk Sudholt

In this study, a nondominated-solution-based multi-objective greedy method is proposed and applied to a sensor selection problem based on the multiple indices of the optimal design of experiments. The proposed method simultaneously…

Signal Processing · Electrical Eng. & Systems 2023-06-21 Kumi Nakai , Yasuo Sasaki , Takayuki Nagata , Keigo Yamada , Yuji Saito , Taku Nonomura

We introduce an order-invariant reinforcement learning framework for black-box combinatorial optimization. Classical estimation-of-distribution algorithms (EDAs) often rely on learning explicit variable dependency graphs, which can be…

Machine Learning · Computer Science 2026-01-30 Olivier Goudet , Quentin Suire , Adrien Goëffon , Frédéric Saubion , Sylvain Lamprier

The pursuit of optimal trade-offs in high-dimensional search spaces under stringent computational constraints poses a fundamental challenge for contemporary multi-objective optimization. We develop NeuroPareto, a cohesive architecture that…

Machine Learning · Computer Science 2026-04-15 Rong Fu , Chunlei Meng , Youjin Wang , Haoyu Zhao , Jiaxuan Lu , Kun Liu , JiaBao Dou , Simon James Fong