English
Related papers

Related papers: Tilt Matching for Scalable Sampling and Fine-Tunin…

200 papers

We introduce a novel approach based on stochastic optimization to find the optimal sampling distribution for the data-driven stability analysis of switched linear systems. Our goal is to address limitations of existing approaches, in…

Optimization and Control · Mathematics 2025-09-01 Alexis Vuille , Guillaume O. Berger , Raphaël M. Jungers

We address the problem of fine-tuning diffusion models for reward-guided generation in biomolecular design. While diffusion models have proven highly effective in modeling complex, high-dimensional data distributions, real-world…

As deep learning models grow in complexity and the volume of training data increases, reducing storage and computational costs becomes increasingly important. Dataset distillation addresses this challenge by synthesizing a compact set of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Zhe Li , Sarah Cechnicka , Cheng Ouyang , Katharina Breininger , Peter Schüffler , Bernhard Kainz

Recent advances in few-step diffusion distillation have enabled efficient image generation, yet aligning these models with human preferences remains challenging. We propose Reward-Tilted Distribution Matching Distillation (RTDMD), a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yushi Huang , Xiangxin Zhou , Ruoyu Wang , Chi Zhang , Jun Zhang , Tianyu Pang

Recent advancements in flow-matching have enabled high-quality text-to-image generation. However, the deterministic nature of flow-matching models makes them poorly suited for reinforcement learning, a key tool for improving image quality…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Benjamin Yu , Jackie Liu , Justin Cui

Persistence-based topological optimization deforms a point cloud $X \subset \mathbb{R}^d$ by minimizing objectives of the form $L(X) = \ell(\mathrm{Dgm}(X))$, where $\mathrm{Dgm}(X)$ is a persistence diagram. In practice, optimization is…

Computational Geometry · Computer Science 2026-05-13 Abderrahim Bendahi , Alexandre Duplessis , Arnaud Fickinger

While flow matching is elegant, its reliance on single-sample conditional velocities leads to high-variance training targets that destabilize optimization and slow convergence. By explicitly characterizing this variance, we identify 1) a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Donglin Yang , Yongxing Zhang , Xin Yu , Liang Hou , Xin Tao , Pengfei Wan , Xiaojuan Qi , Renjie Liao

Sampling from unnormalized multimodal distributions with limited density evaluations remains a fundamental challenge in machine learning and natural sciences. Successful approaches construct a bridge between a tractable reference and the…

Masked diffusion large language models (dLLMs) are a promising alternative to autoregressive generation. While reinforcement learning (RL) methods have recently been adapted to dLLM fine-tuning, their objectives typically depend on…

Machine Learning · Computer Science 2026-05-20 Yuyuan Chen , Shiyi Wang , Peter Potaptchik , Jaeyeon Kim , Michael S. Albergo

In this paper, we propose a stochastic optimization method that adaptively controls the sample size used in the computation of gradient approximations. Unlike other variance reduction techniques that either require additional storage or the…

Optimization and Control · Mathematics 2017-11-01 Raghu Bollapragada , Richard Byrd , Jorge Nocedal

Aligning diffusion models with user preferences has been a key challenge. Existing methods for aligning diffusion models either require retraining or are limited to differentiable reward functions. To address these limitations, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Po-Hung Yeh , Kuang-Huei Lee , Jun-Cheng Chen

Modeling stochastic dynamics from discrete observations is a key interdisciplinary challenge. Existing methods often fail to estimate the continuous evolution of probability densities from trajectories or face the curse of dimensionality.…

Computational Engineering, Finance, and Science · Computer Science 2025-12-02 Ruikun Li , Jiazhen Liu , Huandong Wang , Qingmin Liao , Yong Li

Reward fine-tuning has become a common approach for aligning pretrained diffusion and flow models with human preferences in text-to-image generation. Among reward-gradient-based methods, Adjoint Matching (AM) provides a principled…

Machine Learning · Computer Science 2026-05-19 Jeongwoo Shin , Dongsoo Shin , Yuchen Zhu , Wei Guo , Yongxin Chen , Joonseok Lee , Jaewoong Choi , Jaemoo Choi

Stochastic equations play an important role in computational science, due to their ability to treat a wide variety of complex statistical problems. However, current algorithms are strongly limited by their sampling variance, which scales…

Numerical Analysis · Mathematics 2017-01-04 Bogdan Opanchuk , Simon Kiesewetter , Peter D. Drummond

We present Direct Reward Fine-Tuning (DRaFT), a simple and effective method for fine-tuning diffusion models to maximize differentiable reward functions, such as scores from human preference models. We first show that it is possible to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Kevin Clark , Paul Vicol , Kevin Swersky , David J Fleet

Recent advances in denoising diffusion models have enabled rapid generation of optimized structures for topology optimization. However, these models often rely on surrogate predictors to enforce physical constraints, which may fail to…

Machine Learning · Computer Science 2025-08-05 Euihyun Kim , Keun Park , Yeoneung Kim

Reconstructing near-wall turbulence from wall-based measurements is a critical yet inherently ill-posed problem in wall-bounded flows, where limited sensing and spatially heterogeneous flow-wall coupling challenge deterministic estimation…

Fluid Dynamics · Physics 2025-04-22 Meet Hemant Parikh , Xiantao Fan , Jian-Xun Wang

Adapting large-scale foundation flow and diffusion generative models to optimize task-specific objectives while preserving prior information is crucial for real-world applications such as molecular design, protein docking, and creative…

Machine Learning · Computer Science 2025-12-01 Riccardo De Santi , Marin Vlastelica , Ya-Ping Hsieh , Zebang Shen , Niao He , Andreas Krause

Adapting a pretrained diffusion model to new objectives at inference time remains an open problem in generative modeling. Existing steering methods suffer from inaccurate value estimation, especially at high noise levels, which biases…

Machine Learning · Computer Science 2025-06-27 Vineet Jain , Kusha Sareen , Mohammad Pedramfar , Siamak Ravanbakhsh

Generative models inspired by dynamical transport of measure -- such as flows and diffusions -- construct a continuous-time map between two probability densities. Conventionally, one of these is the target density, only accessible through…

Machine Learning · Computer Science 2024-09-24 Michael S. Albergo , Mark Goldstein , Nicholas M. Boffi , Rajesh Ranganath , Eric Vanden-Eijnden