English
Related papers

Related papers: Diffusion Tree Sampling: Scalable inference-time a…

200 papers

Diffusion models have shown promising generative capabilities across diverse domains, yet aligning their outputs with desired reward functions remains a challenge, particularly in cases where reward functions are non-differentiable. Some…

Machine Learning · Computer Science 2025-06-04 Xiner Li , Masatoshi Uehara , Xingyu Su , Gabriele Scalia , Tommaso Biancalani , Aviv Regev , Sergey Levine , Shuiwang Ji

This tutorial provides an in-depth guide on inference-time guidance and alignment methods for optimizing downstream reward functions in diffusion models. While diffusion models are renowned for their generative modeling capabilities,…

Artificial Intelligence · Computer Science 2025-01-22 Masatoshi Uehara , Yulai Zhao , Chenyu Wang , Xiner Li , Aviv Regev , Sergey Levine , Tommaso Biancalani

The iterative and stochastic nature of diffusion models enables test-time scaling, whereby spending additional compute during denoising generates higher-fidelity samples. Increasing the number of denoising steps is the primary scaling axis,…

Machine Learning · Computer Science 2025-09-09 Vignav Ramesh , Morteza Mardani

Graph generation is a fundamental problem in graph learning with broad applications across Web-scale systems, knowledge graphs, and scientific domains such as drug and material discovery. Recent approaches leverage diffusion models for…

Machine Learning · Computer Science 2026-03-18 Jiachi Zhao , Zehong Wang , Yamei Liao , Chuxu Zhang , Yanfang Ye

Tree search has recently emerged as a powerful framework for aligning generative models with task-specific rewards at test time. Applying tree search to Masked Diffusion Language Models, however, introduces two key challenges: (i) parallel…

Computation and Language · Computer Science 2025-09-30 Zichao Yu , Ming Li , Wenyi Zhang , Weiguo Gao

Reinforcement learning with stochastic optimal control offers a promising framework for diffusion fine-tuning, where a pre-trained diffusion model is optimized to generate paths that lead to a reward-tilted distribution. While these…

Machine Learning · Computer Science 2025-09-30 Sophia Tang , Yuchen Zhu , Molei Tao , Pranam Chatterjee

Optimizing the noise samples of diffusion and flow models is an increasingly popular approach to align these models to target rewards at inference time. However, we observe that these approaches are usually restricted to differentiable or…

Machine Learning · Computer Science 2026-03-17 Niklas Schweiger , Daniel Cremers , Karnik Ram

Diffusion models excel in generative tasks, but aligning them with specific objectives while maintaining their versatility remains challenging. Existing fine-tuning methods often suffer from reward over-optimization, while approximate…

Machine Learning · Computer Science 2025-04-18 Sunwoo Kim , Minkyu Kim , Dongmin Park

Limited transferability hinders the performance of deep learning models when applied to new application scenarios. Recently, unsupervised domain adaptation (UDA) has achieved significant progress in addressing this issue via learning…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Yulong Zhang , Shuhao Chen , Yu Zhang , Jiangang Lu

Diffusion models have recently emerged as a powerful tool for planning. However, unlike Monte Carlo Tree Search (MCTS)-whose performance naturally improves with inference-time computation scaling-standard diffusion-based planners offer only…

Artificial Intelligence · Computer Science 2026-01-30 Jaesik Yoon , Hyeonseo Cho , Doojin Baek , Yoshua Bengio , Sungjin Ahn

Diffusion language models (DLMs) have recently emerged as a compelling alternative to autoregressive generation, offering parallel generation and improved global coherence. During inference, DLMs generate text by iteratively denoising…

Accurate prediction of pedestrian trajectories is crucial for improving the safety of autonomous driving. However, this task is generally nontrivial due to the inherent stochasticity of human motion, which naturally requires the predictor…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Ge Sun , Sheng Wang , Lei Zhu , Ming Liu , Jun Ma

In this work, we focus on the alignment problem of diffusion models with a continuous reward function, which represents specific objectives for downstream tasks, such as increasing darkness or improving the aesthetics of images. The central…

Machine Learning · Computer Science 2024-10-03 Zhiwei Tang , Jiangweizhi Peng , Jiasheng Tang , Mingyi Hong , Fan Wang , Tsung-Hui Chang

Discrete diffusion models have recently emerged as strong alternatives to autoregressive language models, matching their performance through large-scale training. However, inference-time control remains relatively underexplored. In this…

Machine Learning · Computer Science 2026-04-09 Meihua Dang , Jiaqi Han , Minkai Xu , Kai Xu , Akash Srivastava , Stefano Ermon

Stochastic forecasting is critical for efficient decision-making in uncertain systems, such as energy markets and finance, where estimating the full distribution of future scenarios is essential. We propose Diffusion Scenario Tree (DST), a…

Machine Learning · Computer Science 2026-02-16 Stelios Zarifis , Ioannis Kordonis , Petros Maragos

We study inference-time alignment for diffusion-based generative models, aiming to steer a base model toward high-reward outputs without updating its weights. Recent Sequential Monte Carlo (SMC)-based steering methods approximate…

Machine Learning · Computer Science 2026-05-26 Weixin Wang , Yu Yang , Wei Deng , Pan Xu

Diffusion models have gained attention in speech enhancement tasks, providing an alternative to conventional discriminative methods. However, research on target speech extraction under multi-speaker noisy conditions remains relatively…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-08 Leying Zhang , Yao Qian , Linfeng Yu , Heming Wang , Hemin Yang , Long Zhou , Shujie Liu , Yanmin Qian

Diffusion models have recently emerged as a powerful approach for trajectory planning. However, their inherently non-sequential nature limits their effectiveness in long-horizon reasoning tasks at test time. The recently proposed Monte…

Artificial Intelligence · Computer Science 2025-10-27 Jaesik Yoon , Hyeonseo Cho , Yoshua Bengio , Sungjin Ahn

The efficient Test-Time Scaling (TTS) paradigm offers a promising perspective for enhancing the generation performance of diffusion models. However, current solutions are limited to a static, pre-defined noise pool and suffer from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Gang Dai , Yining Huang , Yiming Xia , Guohao Chen , Shuaicheng Niu

Diffusion models have become a leading paradigm for image super-resolution (SR), but existing methods struggle to guarantee both the high-frequency perceptual quality and the low-frequency structural fidelity of generated images. Although…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Hexin Zhang , Dong Li , Jie Huang , Bingzhou Wang , Xueyang Fu , Zhengjun Zha
‹ Prev 1 2 3 10 Next ›