English

GimmBO: Interactive Generative Image Model Merging via Bayesian Optimization

Computer Vision and Pattern Recognition 2026-01-27 v1 Graphics

Abstract

Fine-tuning-based adaptation is widely used to customize diffusion-based image generation, leading to large collections of community-created adapters that capture diverse subjects and styles. Adapters derived from the same base model can be merged with weights, enabling the synthesis of new visual results within a vast and continuous design space. To explore this space, current workflows rely on manual slider-based tuning, an approach that scales poorly and makes weight selection difficult, even when the candidate set is limited to 20-30 adapters. We propose GimmBO to support interactive exploration of adapter merging for image generation through Preferential Bayesian Optimization (PBO). Motivated by observations from real-world usage, including sparsity and constrained weight ranges, we introduce a two-stage BO backend that improves sampling efficiency and convergence in high-dimensional spaces. We evaluate our approach with simulated users and a user study, demonstrating improved convergence, high success rates, and consistent gains over BO and line-search baselines, and further show the flexibility of the framework through several extensions.

Keywords

Cite

@article{arxiv.2601.18585,
  title  = {GimmBO: Interactive Generative Image Model Merging via Bayesian Optimization},
  author = {Chenxi Liu and Selena Ling and Alec Jacobson},
  journal= {arXiv preprint arXiv:2601.18585},
  year   = {2026}
}
R2 v1 2026-07-01T09:20:35.549Z