English
Related papers

Related papers: Preference-Guided Diffusion for Multi-Objective Of…

200 papers

Optimizing complex and high-dimensional black-box functions is ubiquitous in science and engineering fields. Unfortunately, the online evaluation of these functions is restricted due to time and safety constraints in most cases. In offline…

Machine Learning · Computer Science 2024-07-03 Taeyoung Yun , Sujin Yun , Jaewoo Lee , Jinkyoo Park

Diffusion models are a class of flexible generative models trained with an approximation to the log-likelihood objective. However, most use cases of diffusion models are not concerned with likelihoods, but instead with downstream objectives…

Machine Learning · Computer Science 2024-01-08 Kevin Black , Michael Janner , Yilun Du , Ilya Kostrikov , Sergey Levine

We present a review that unifies decision-support methods for exploring the solutions produced by multi-objective optimization (MOO) algorithms. As MOO is applied to solve diverse problems, approaches for analyzing the trade-offs offered by…

Artificial Intelligence · Computer Science 2023-11-21 Zuzanna Osika , Jazmin Zatarain Salazar , Diederik M. Roijers , Frans A. Oliehoek , Pradeep K. Murukannaiah

Diffusion-based planning, learning, and control methods present a promising branch of powerful and expressive decision-making solutions. Given the growing interest, such methods have undergone numerous refinements over the past years.…

Machine Learning · Computer Science 2025-02-19 Dom Huh , Prasant Mohapatra

Recent advances in motion planning for autonomous driving have led to models capable of generating high-quality trajectories. However, most existing planners tend to fix their policy after supervised training, leading to consistent but…

Robotics · Computer Science 2025-08-26 Fan Ding , Xuewen Luo , Hwa Hui Tew , Ruturaj Reddy , Xikun Wang , Junn Yong Loo

Achieving global optimality in nonlinear model predictive control (NMPC) is challenging due to the non-convex nature of the underlying optimization problem. Since commonly employed local optimization techniques depend on carefully chosen…

Systems and Control · Electrical Eng. & Systems 2025-06-19 Tzu-Yuan Huang , Armin Lederer , Nicolas Hoischen , Jan Brüdigam , Xuehua Xiao , Stefan Sosnowski , Sandra Hirche

Recent advances in diffusion models have shown remarkable potential in the conditional generation of novel molecules. These models can be guided in two ways: (i) explicitly, through additional features representing the condition, or (ii)…

Machine Learning · Computer Science 2025-03-12 Yuchen Shen , Chenhao Zhang , Sijie Fu , Chenghui Zhou , Newell Washburn , Barnabás Póczos

Real-world problems are often multi-objective with decision-makers unable to specify a priori which trade-off between the conflicting objectives is preferable. Intuitively, building machine learning solutions in such cases would entail…

Machine Learning · Computer Science 2021-10-20 Timo M. Deist , Monika Grewal , Frank J. W. M. Dankers , Tanja Alderliesten , Peter A. N. Bosman

Classifier guidance -- using the gradients of an image classifier to steer the generations of a diffusion model -- has the potential to dramatically expand the creative control over image generation and editing. However, currently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Bram Wallace , Akash Gokul , Stefano Ermon , Nikhil Naik

In light of the widespread success of generative models, a significant amount of research has gone into speeding up their sampling time. However, generative models are often sampled multiple times to obtain a diverse set incurring a cost…

Machine Learning · Computer Science 2023-11-27 Gabriele Corso , Yilun Xu , Valentin de Bortoli , Regina Barzilay , Tommi Jaakkola

Post-training of language models, either through reinforcement learning, preference optimization or supervised finetuning, tends to sharpen the output probability distribution and reduce the diversity of generated responses. This is…

Computation and Language · Computer Science 2025-05-23 Jack Lanchantin , Angelica Chen , Shehzaad Dhuliawala , Ping Yu , Jason Weston , Sainbayar Sukhbaatar , Ilia Kulikov

Many real-world problems require trading off multiple competing objectives. However, these objectives are often in different units and/or scales, which can make it challenging for practitioners to express numerical preferences over…

In this work we are interested in stochastic particle methods for multi-objective optimization. The problem is formulated using parametrized, single-objective sub-problems which are solved simultaneously. To this end a consensus based…

Optimization and Control · Mathematics 2022-08-03 Giacomo Borghi , Michael Herty , Lorenzo Pareschi

Gasoline blending scheduling uses resource allocation and operation sequencing to meet a refinery's production requirements. The presence of nonlinearity, integer constraints, and a large number of decision variables adds complexity to this…

Artificial Intelligence · Computer Science 2024-02-23 Wenxuan Fang , Wei Du , Renchu He , Yang Tang , Yaochu Jin , Gary G. Yen

In multi-task learning, multiple tasks are solved jointly, sharing inductive bias between them. Multi-task learning is inherently a multi-objective problem because different tasks may conflict, necessitating a trade-off. A common compromise…

Machine Learning · Computer Science 2019-01-14 Ozan Sener , Vladlen Koltun

Diffusion models have demonstrated remarkable success in various visual generation tasks, including image, video, and 3D content generation. Preference optimization (PO) is a prominent and growing area of research that aims to align these…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Fu-Yun Wang , Keqiang Sun , Yao Teng , Xihui Liu , Jiale Yuan , Jiaming Song , Hongsheng Li

Direct Preference Optimization (DPO) aligns text-to-image (T2I) generation models with human preferences using pairwise preference data. Although substantial resources are expended in collecting and labeling datasets, a critical aspect is…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Yunhong Lu , Qichao Wang , Hengyuan Cao , Xiaoyin Xu , Min Zhang

Guidance is a cornerstone of modern diffusion models, playing a pivotal role in conditional generation and enhancing the quality of unconditional samples. However, current approaches to guidance scheduling--determining the appropriate…

Most existing studies on evolutionary multi-objective optimization focus on approximating the whole Pareto-optimal front. Nevertheless, rather than the whole front, which demands for too many points (especially in a high-dimensional space),…

Neural and Evolutionary Computing · Computer Science 2017-01-24 Ke Li , Kalyanmoy Deb , Xin Yao

Design problems in industrial engineering often involve a large number of design variables with multiple objectives, under complex nonlinear constraints. The algorithms for multiobjective problems can be significantly different from the…

Optimization and Control · Mathematics 2013-03-27 Xin-She Yang