English
Related papers

Related papers: Composition and Control with Distilled Energy Diff…

200 papers

We present unbiased, finite--variance estimators of energy derivatives for real--space diffusion Monte Carlo calculations within the fixed--node approximation. The derivative $d_\lambda E$ is fully consistent with the dependence…

Materials Science · Physics 2021-05-20 Jesse van Rhijn , Claudia Filippi , Stefania De Palo , Saverio Moroni

In the pursuit of developing expressive music performance models using artificial intelligence, this paper introduces DExter, a new approach leveraging diffusion probabilistic models to render Western classical piano performances. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-24 Huan Zhang , Shreyan Chowdhury , Carlos Eduardo Cancino-Chacón , Jinhua Liang , Simon Dixon , Gerhard Widmer

As Diffusion Models have shown promising performance, a lot of efforts have been made to improve the controllability of Diffusion Models. However, how to train Diffusion Models to have the disentangled latent spaces and how to naturally…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Wonwoong Cho , Hareesh Ravi , Midhun Harikumar , Vinh Khuc , Krishna Kumar Singh , Jingwan Lu , David I. Inouye , Ajinkya Kale

Quantum Monte Carlo (QMC) methods represent a powerful family of computational techniques for tackling complex quantum many-body problems and performing calculations of stationary state properties. QMC is among the most accurate and…

Materials Science · Physics 2025-01-08 Alfonso Annarelli , Dario Alfè , Andrea Zen

Sequential Monte Carlo (SMC) methods have recently shown successful results for conditional sampling of generative diffusion models. In this paper we propose a new diffusion posterior SMC sampler achieving improved statistical efficiencies,…

Machine Learning · Statistics 2025-08-25 Zheng Zhao

Inference-time scaling has achieved remarkable success in language models, yet its adaptation to diffusion models remains underexplored. We observe that the efficacy of recent Sequential Monte Carlo (SMC)-based methods largely stems from…

Machine Learning · Computer Science 2025-08-19 Xun Su , Jianming Huang , Yang Yusen , Zhongxi Fang , Hiroyuki Kasai

Fixed-node diffusion Monte Carlo (DMC) is a stochastic algorithm for finding the lowest energy many-fermion wave function with the same nodal surface as a chosen trial function. It has proved itself among the most accurate methods available…

Condensed Matter · Physics 2009-10-31 W. M. C. Foulkes , Randolph Q. Hood , R. J. Needs

Score distillation sampling~(SDS) has been widely adopted to overcome the absence of unseen views in reconstructing 3D objects from a \textbf{single} image. It leverages pre-trained 2D diffusion models as teacher to guide the reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Xuanyu Yi , Zike Wu , Qingshan Xu , Pan Zhou , Joo-Hwee Lim , Hanwang Zhang

Inference-time control of diffusion models aims to steer model outputs to satisfy new constraints without retraining. Previous approaches have mostly relied on heuristic guidance or have been coupled with Sequential Monte Carlo (SMC) for…

Sequential Monte Carlo methods, also known as particle methods, are a popular set of techniques for approximating high-dimensional probability distributions and their normalizing constants. These methods have found numerous applications in…

Computation · Statistics 2021-06-23 Jeremy Heng , Adrian N. Bishop , George Deligiannidis , Arnaud Doucet

We present a novel way of performing kinetic Monte Carlo simulations which does not require an {\it a priori} list of diffusion processes and their associated energetics and reaction rates. Rather, at any time during the simulation,…

Materials Science · Physics 2009-11-11 Oleg Trushin , Altaf Karim , Abdelkader Kara , Talat S. Rahman

Recent work has framed constrained text generation with autoregressive language models as a probabilistic inference problem. Among these, Zhao et al. (2024) introduced a promising approach based on twisted Sequential Monte Carlo, which…

Machine Learning · Computer Science 2025-11-26 Sooyeon Kim , Giung Nam , Byoungwoo Park , Juho Lee

We study a sequential Monte Carlo algorithm to sample from the Gibbs measure with a non-convex energy function at a low temperature. We use the practical and popular geometric annealing schedule, and use a Langevin diffusion at each…

Statistics Theory · Mathematics 2026-01-13 Ruiyu Han , Gautam Iyer , Dejan Slepčev

It is well known that training a denoising score-based diffusion models requires tens of thousands of epochs and a substantial number of image data to train the model. In this paper, we propose to increase the efficiency in training…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Andrew S. Na , William Gao , Justin W. L. Wan

Controlling complex physics systems is important in diverse domains. While diffusion-based methods have demonstrated advantages over classical model-based approaches and myopic sequential learning methods in achieving global trajectory…

Systems and Control · Electrical Eng. & Systems 2026-02-03 Hongyi Chen , Jingtao Ding , Jianhai Shu , Xinchun Yu , Xiaojun Liang , Yong Li , Xiao-Ping Zhang

Image diffusion distillation achieves high-fidelity generation with very few sampling steps. However, applying these techniques directly to video diffusion often results in unsatisfactory frame quality due to the limited visual quality in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Yuanhao Zhai , Kevin Lin , Zhengyuan Yang , Linjie Li , Jianfeng Wang , Chung-Ching Lin , David Doermann , Junsong Yuan , Lijuan Wang

Significant advances have been made in the sampling efficiency of diffusion models and flow matching models, driven by Consistency Distillation (CD), which trains a student model to mimic the output of a teacher model at a later timestep.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yunpeng Liu , Boxiao Liu , Yi Zhang , Xingzhong Hou , Guanglu Song , Yu Liu , Haihang You

Piecewise deterministic Markov process samplers are attractive alternatives to Metropolis--Hastings algorithms. A central design question is how to incorporate partial velocity refreshment to ensure ergodicity without injecting excessive…

Probability · Mathematics 2026-02-20 Hirofumi Shiba , Kengo Kamatani

Diffusion models (DMs) have emerged as powerful image priors in Bayesian computational imaging. Two primary strategies have been proposed for leveraging DMs in this context: Plug-and-Play methods, which are zero-shot and highly flexible but…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Charlesquin Kemajou Mbakam , Jonathan Spence , Marcelo Pereyra

We propose a Monte Carlo sampler from the reverse diffusion process. Unlike the practice of diffusion models, where the intermediary updates -- the score functions -- are learned with a neural network, we transform the score matching…

Machine Learning · Statistics 2024-03-14 Xunpeng Huang , Hanze Dong , Yifan Hao , Yi-An Ma , Tong Zhang