English
Related papers

Related papers: Bridging Model-Based Optimization and Generative M…

200 papers

Diffusion models have significantly advanced generative AI, but they encounter difficulties when generating complex combinations of multiple objects. As the final result heavily depends on the initial seed, accurately ensuring the desired…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Federico Betti , Lorenzo Baraldi , Lorenzo Baraldi , Rita Cucchiara , Nicu Sebe

Bridge models in image restoration construct a diffusion process from degraded to clear images. However, existing methods typically require training a bridge model from scratch for each specific type of degradation, resulting in high…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Hanting Wang , Tao Jin , Wang Lin , Shulei Wang , Hai Huang , Shengpeng Ji , Zhou Zhao

The diffusion model has shown success in generating high-quality and diverse solutions to trajectory optimization problems. However, diffusion models with neural networks inevitably make prediction errors, which leads to constraint…

Machine Learning · Computer Science 2024-06-04 Anjian Li , Zihan Ding , Adji Bousso Dieng , Ryne Beeson

This tutorial provides an in-depth guide on inference-time guidance and alignment methods for optimizing downstream reward functions in diffusion models. While diffusion models are renowned for their generative modeling capabilities,…

Artificial Intelligence · Computer Science 2025-01-22 Masatoshi Uehara , Yulai Zhao , Chenyu Wang , Xiner Li , Aviv Regev , Sergey Levine , Tommaso Biancalani

Diffusion Models represent a significant advancement in generative modeling, employing a dual-phase process that first degrades domain-specific information via Gaussian noise and restores it through a trainable model. This framework enables…

Neural and Evolutionary Computing · Computer Science 2024-11-21 Benedikt Hartl , Yanbo Zhang , Hananel Hazan , Michael Levin

Biological systems in nature have evolved for millions of years to adapt and survive the environment. Many features they developed can be inspirational and beneficial for solving technical problems in modern industries. This leads to a…

Computation and Language · Computer Science 2022-04-22 Qihao Zhu , Xinyu Zhang , Jianxi Luo

In this paper we describe a novel framework for diffusion-based generative modeling on constrained spaces. In particular, we introduce manual bridges, a framework that expands the kinds of constraints that can be practically used to form…

Machine Learning · Computer Science 2025-02-28 Saeid Naderiparizi , Xiaoxuan Liang , Berend Zwartsenberg , Frank Wood

Diffusion models have shown promising generative capabilities across diverse domains, yet aligning their outputs with desired reward functions remains a challenge, particularly in cases where reward functions are non-differentiable. Some…

Machine Learning · Computer Science 2025-06-04 Xiner Li , Masatoshi Uehara , Xingyu Su , Gabriele Scalia , Tommaso Biancalani , Aviv Regev , Sergey Levine , Shuiwang Ji

By framing reinforcement learning as a sequence modeling problem, recent work has enabled the use of generative models, such as diffusion models, for planning. While these models are effective in predicting long-horizon state trajectories…

Discrete diffusion models have demonstrated great promise in modeling various sequence data, ranging from human language to biological sequences. Inspired by the success of RL in language models, there is growing interest in further…

Machine Learning · Computer Science 2026-02-03 Jiaqi Han , Austin Wang , Minkai Xu , Wenda Chu , Meihua Dang , Haotian Ye , Huayu Chen , Yisong Yue , Stefano Ermon

Offline reinforcement learning (RL) enables agents to learn policies from fixed datasets, avoiding costly or unsafe environment interactions. However, its effectiveness is often limited by dataset sparsity and the lack of transition overlap…

Artificial Intelligence · Computer Science 2025-07-22 Lu Guo , Yixiang Shan , Zhengbang Zhu , Qifan Liang , Lichang Song , Ting Long , Weinan Zhang , Yi Chang

Diffusion and flow-based generative models have achieved remarkable success in domains such as image synthesis, video generation, and natural language modeling. In this work, we extend these advances to weight space learning by leveraging…

Machine Learning · Computer Science 2025-10-17 Daniel Saragih , Deyu Cao , Tejas Balaji

High-level autonomous driving requires motion planners capable of modeling multimodal future uncertainties while remaining robust in closed-loop interactions. Although diffusion-based planners are effective at modeling complex trajectory…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Hao Gao , Shaoyu Chen , Yifan Zhu , Yuehao Song , Wenyu Liu , Qian Zhang , Xinggang Wang

Topology Optimization seeks to find the best design that satisfies a set of constraints while maximizing system performance. Traditional iterative optimization methods like SIMP can be computationally expensive and get stuck in local…

Machine Learning · Computer Science 2023-03-20 Giorgio Giannone , Faez Ahmed

Generative models frequently suffer miscalibration, wherein statistics of the sampling distribution, such as the fraction of generations in a given class, deviate from desired values. We frame calibration as a constrained optimization…

Machine Learning · Statistics 2026-05-29 Henry D. Smith , Nathaniel L. Diamant , Brian L. Trippe

Diffusion models have been widely utilized for image restoration. However, previous blind image restoration methods still need to assume the type of degradation model while leaving the parameters to be optimized, limiting their real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Siwei Tu , Weidong Yang , Ben Fei

Generative design refers to computational design methods that can automatically conduct design exploration under constraints defined by designers. Among many approaches, topology optimization-based generative designs aim to explore diverse…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Seowoo Jang , Soyoung Yoo , Namwoo Kang

This study investigates human-computer interface generation based on diffusion models to overcome the limitations of traditional template-based design and fixed rule-driven methods. It first analyzes the key challenges of interface…

Human-Computer Interaction · Computer Science 2026-01-13 Rui Liu , Liuqingqing Yang , Runsheng Zhang , Shixiao Wang

Diffusion models have shown remarkable progress in various generative tasks such as image and video generation. This paper studies the problem of leveraging pretrained diffusion models for performing discriminative tasks. Specifically, we…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Yinqi Li , Hong Chang , Ruibing Hou , Shiguang Shan , Xilin Chen

The future networks pose intense demands for intelligent and customized designs to cope with the surging network scale, dynamically time-varying environments, diverse user requirements, and complicated manual configuration. However,…

Networking and Internet Architecture · Computer Science 2023-08-01 Yudong Huang , Minrui Xu , Xinyuan Zhang , Dusit Niyato , Zehui Xiong , Shuo Wang , Tao Huang