English
Related papers

Related papers: Diffusion Tree Sampling: Scalable inference-time a…

200 papers

A common recipe to improve diffusion models at test-time so that samples score highly against a user-specified reward is to introduce the gradient of the reward into the dynamics of the diffusion itself. This procedure is often ill posed,…

Diffusion models and flow matching have demonstrated remarkable success in text-to-image generation. While many existing alignment methods primarily focus on fine-tuning pre-trained generative models to maximize a given reward function,…

Machine Learning · Statistics 2026-02-03 Yidong Ouyang , Liyan Xie , Hongyuan Zha , Guang Cheng

Planning with pretrained diffusion models has emerged as a promising approach for solving test-time guided control problems. Standard gradient guidance typically performs optimally under convex, differentiable reward landscapes. However, it…

Artificial Intelligence · Computer Science 2025-11-11 Hyeonseong Jeon , Cheolhong Min , Jaesik Park

Diffusion models are state-of-the-art generative models, yet their samples often fail to satisfy application objectives such as safety constraints or domain-specific validity. Existing techniques for alignment require gradients, internal…

Decision trees and diffusion models are ostensibly disparate model classes, one discrete and hierarchical, the other continuous and dynamic. This work unifies the two by establishing a crisp mathematical correspondence between hierarchical…

Machine Learning · Computer Science 2026-05-22 Sai Niranjan Ramachandran , Suvrit Sra

Adapting pretrained diffusion models to downstream objectives such as inverse problems often requires expensive test-time guidance or optimization. We propose a principled framework for generating high-quality reward-aligned samples at…

Machine Learning · Computer Science 2026-05-22 Kushagra Pandey , Farrin Marouf Sofian , Jan Niklas Groeneveld , Felix Draxler , Stephan Mandt

The performance of text-to-image diffusion models may be improved at test-time by scaling computation to search for a generated image that maximizes a given reward function. While existing trajectory level exploration methods improve the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Qingtao Yu , Changlin Song , Minghao Sun , Zhengyang Yu , Vinay Kumar Verma , Soumya Roy , Sumit Negi , Hongdong Li , Dylan Campbell

Diffusion models are the mainstream approach for time series generation tasks. However, existing diffusion models for time series generation require retraining the entire framework to introduce specific conditional guidance. There also…

Machine Learning · Computer Science 2025-09-25 Mingchun Sun , Rongqiang Zhao , Hengrui Hu , Songyu Ding , Jie Liu

Diffusion models have emerged as an expressive family of generative models rivaling GANs in sample quality and autoregressive models in likelihood scores. Standard diffusion models typically require hundreds of forward passes through the…

Machine Learning · Computer Science 2022-02-14 Daniel Watson , William Chan , Jonathan Ho , Mohammad Norouzi

Inference-time controllable generation is essential for real-world applications of unconditional diffusion models. However, most existing techniques focus on individual samples, struggling in applications that require the sample population…

Machine Learning · Computer Science 2026-05-11 Hao Luan , See-Kiong Ng , Chun Kai Ling

Diffusion models have gained attention for their success in modeling complex distributions, achieving impressive perceptual quality in SR tasks. However, existing diffusion-based SR methods often suffer from high computational costs,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Rui Qin , Qijie Wang , Ming Sun , Haowei Zhu , Chao Zhou , Bin Wang

Diffusion models have been successful on a range of conditional generation tasks including molecular design and text-to-image generation. However, these achievements have primarily depended on task-specific conditional training or…

Machine Learning · Statistics 2024-11-26 Luhuan Wu , Brian L. Trippe , Christian A. Naesseth , David M. Blei , John P. Cunningham

Monte Carlo Tree Search (MCTS) based methods provide promising approaches for generating synthetic data to enhance the self-training of Large Language Model (LLM) based multi-agent systems (MAS). These methods leverage Q-values to estimate…

Computation and Language · Computer Science 2026-04-27 Wentao Shi , Zichun Yu , Fuli Feng , Xiangnan He , Chenyan Xiong

While plan-and-infill decoding in Masked Diffusion Models (MDMs) shows promise for mathematical and code reasoning, performance remains highly sensitive to slot infilling order, often yielding substantial output variance. We introduce…

Artificial Intelligence · Computer Science 2026-05-28 Joshua Ong Jun Leang , Yu Zhao , Mihaela Cătălina Stoian , Wenda Li , Shay B. Cohen , Eleonora Giunchiglia

Test-time adaptation harnesses test inputs to improve the accuracy of a model trained on source data when tested on shifted target data. Existing methods update the source model by (re-)training on each target domain. While effective,…

Machine Learning · Computer Science 2023-06-22 Jin Gao , Jialing Zhang , Xihui Liu , Trevor Darrell , Evan Shelhamer , Dequan Wang

The new paradigm of test-time scaling has yielded remarkable breakthroughs in Large Language Models (LLMs) (e.g. reasoning models) and in generative vision models, allowing models to allocate additional computation during inference to…

Machine Learning · Computer Science 2025-08-14 Luca Eyring , Shyamgopal Karthik , Alexey Dosovitskiy , Nataniel Ruiz , Zeynep Akata

Inference-time scaling has achieved remarkable success in language models, yet its adaptation to diffusion models remains underexplored. We observe that the efficacy of recent Sequential Monte Carlo (SMC)-based methods largely stems from…

Machine Learning · Computer Science 2025-08-19 Xun Su , Jianming Huang , Yang Yusen , Zhongxi Fang , Hiroyuki Kasai

Combining the merits of both denoising diffusion probabilistic models and gradient boosting, the diffusion boosting paradigm is introduced for tackling supervised learning problems. We develop Diffusion Boosted Trees (DBT), which can be…

Machine Learning · Statistics 2024-06-05 Xizewen Han , Mingyuan Zhou

As the marginal cost of scaling computation (data and parameters) during model pre-training continues to increase substantially, test-time scaling (TTS) has emerged as a promising direction for improving generative model performance by…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Haoran He , Jiajun Liang , Xintao Wang , Pengfei Wan , Di Zhang , Kun Gai , Ling Pan

Training-free guidance enables controlled generation in diffusion and flow models, but most methods rely on gradients and assume differentiable objectives. This work focuses on training-free guidance addressing challenges from…

Machine Learning · Computer Science 2025-06-12 Yingqing Guo , Yukang Yang , Hui Yuan , Mengdi Wang