English

Pareto-Conditioned Diffusion Models for Offline Multi-Objective Optimization

Machine Learning 2026-02-16 v2 Artificial Intelligence

Abstract

Multi-objective optimization (MOO) arises in many real-world applications where trade-offs between competing objectives must be carefully balanced. In the offline setting, where only a static dataset is available, the main challenge is generalizing beyond observed data. We introduce Pareto-Conditioned Diffusion (PCD), a novel framework that formulates offline MOO as a conditional sampling problem. By conditioning directly on desired trade-offs, PCD avoids the need for explicit surrogate models. To effectively explore the Pareto front, PCD employs a reweighting strategy that focuses on high-performing samples and a reference-direction mechanism to guide sampling towards novel, promising regions beyond the training data. Experiments on standard offline MOO benchmarks show that PCD achieves highly competitive performance and, importantly, demonstrates greater consistency across diverse tasks than existing offline MOO approaches.

Keywords

Cite

@article{arxiv.2602.00737,
  title  = {Pareto-Conditioned Diffusion Models for Offline Multi-Objective Optimization},
  author = {Jatan Shrestha and Santeri Heiskanen and Kari Hepola and Severi Rissanen and Pekka Jääskeläinen and Joni Pajarinen},
  journal= {arXiv preprint arXiv:2602.00737},
  year   = {2026}
}

Comments

Accepted at ICLR 2026 (Oral). Project website: https://sites.google.com/view/pcd-iclr26

R2 v1 2026-07-01T09:29:27.942Z