中文
相关论文

相关论文: Score-Regularized Joint Sampling with Importance W…

200 篇论文

Flow matching models generate samples by numerically integrating a learned velocity field, with each integration step requiring a neural network evaluation. Fast generation therefore requires using a small fixed evaluation budget…

机器学习 · 计算机科学 2026-05-13 Aditi Gupta , Soon Hoe Lim , Annan Yu , N. Benjamin Erichson

We propose a deterministic sampling framework using Score-Based Transport Modeling for sampling an unnormalized target density $\pi$ given only its score $\nabla \log \pi$. Our method approximates the Wasserstein gradient flow on…

机器学习 · 计算机科学 2025-10-21 Vasily Ilin , Peter Sushko , Jingwei Hu

Stochastic variance reduced methods have gained a lot of interest recently for empirical risk minimization due to its appealing run time complexity. When the data size is large and disjointly stored on different machines, it becomes…

机器学习 · 计算机科学 2020-08-26 Shicong Cen , Huishuai Zhang , Yuejie Chi , Wei Chen , Tie-Yan Liu

Score-based modeling through stochastic differential equations (SDEs) has provided a new perspective on diffusion models, and demonstrated superior performance on continuous data. However, the gradient of the log-likelihood function, i.e.,…

机器学习 · 计算机科学 2023-03-07 Haoran Sun , Lijun Yu , Bo Dai , Dale Schuurmans , Hanjun Dai

This paper presents a robust version of the stratified sampling method when multiple uncertain input models are considered for stochastic simulation. Various variance reduction techniques have demonstrated their superior performance in…

最优化与控制 · 数学 2023-06-16 Seung Min Baik , Eunshin Byon , Young Myoung Ko

Adaptive importance sampling for stochastic optimization is a promising approach that offers improved convergence through variance reduction. In this work, we propose a new framework for variance reduction that enables the use of mixtures…

机器学习 · 计算机科学 2019-04-01 Zalán Borsos , Sebastian Curi , Kfir Y. Levy , Andreas Krause

Rectified Flow offers a simple and effective approach to high-quality generative modeling by learning a velocity field. However, we identify a limitation in directly modeling the velocity with an unconstrained neural network: the learned…

机器学习 · 计算机科学 2025-10-21 Xixi Hu , Runlong Liao , Keyang Xu , Bo Liu , Yeqing Li , Eugene Ie , Hongliang Fei , Qiang Liu

We study variance reduction for score estimation and diffusion-based sampling in settings where the clean (target) score is available or can be approximated. Starting from the Target Score Identity (TSI), which expresses the noisy marginal…

机器学习 · 统计学 2026-01-26 Alois Duston , Tan Bui-Thanh

Diffusion models, which convert noise into new data instances by learning to reverse a diffusion process, have become a cornerstone in contemporary generative modeling. In this work, we develop non-asymptotic convergence theory for a…

机器学习 · 计算机科学 2024-08-06 Gen Li , Yuting Wei , Yuejie Chi , Yuxin Chen

An adaptive sampling approach for efficient detection of bifurcation boundaries in parametrized fluid flow problems is presented herein. The study extends the machine-learning approach of Silvester~(J. Comput. Phys., 553 (2026), 114743),…

流体动力学 · 物理学 2026-02-19 Anshima Singh , David J. Silvester

Covariate-shift generalization, a typical case in out-of-distribution (OOD) generalization, requires a good performance on the unknown test distribution, which varies from the accessible training distribution in the form of covariate shift.…

机器学习 · 计算机科学 2023-10-18 Renzhe Xu , Xingxuan Zhang , Zheyan Shen , Tong Zhang , Peng Cui

We introduce Adjoint Sampling, a highly scalable and efficient algorithm for learning diffusion processes that sample from unnormalized densities, or energy functions. It is the first on-policy approach that allows significantly more…

A sequential importance sampling algorithm is developed for the distribution that results when a matrix of independent, but not identically distributed, Bernoulli random variables is conditioned on a given sequence of row and column sums.…

统计计算 · 统计学 2013-01-18 Matthew T. Harrison , Jeffrey W. Miller

Score Distillation Sampling (SDS) has emerged as the de facto approach for text-to-content generation in non-image domains. In this paper, we reexamine the SDS process and introduce a straightforward interpretation that demystifies the…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Oren Katzir , Or Patashnik , Daniel Cohen-Or , Dani Lischinski

We introduce a methodology for performing parameter inference in high-dimensional, non-linear diffusion processes. We illustrate its applicability for obtaining insights into the evolution of and relationships between species, including…

Score matching is a popular method for estimating unnormalized statistical models. However, it has been so far limited to simple, shallow models or low-dimensional data, due to the difficulty of computing the Hessian of log-density…

机器学习 · 计算机科学 2019-06-28 Yang Song , Sahaj Garg , Jiaxin Shi , Stefano Ermon

We introduce path-sampled integrated gradients (PS-IG), a framework that generalizes feature attribution by computing the expected value over baselines sampled along the linear interpolation path. We prove that PS-IG is mathematically…

机器学习 · 计算机科学 2026-04-17 Firuz Kamalov , Fadi Thabtah , R. Sivaraj , Neda Abdelhamid

Distribution matching (DM) is a versatile domain-invariant representation learning technique that has been applied to tasks such as fair classification, domain adaptation, and domain translation. Non-parametric DM methods struggle with…

机器学习 · 计算机科学 2025-06-18 Ziyu Gong , Jim Lim , David I. Inouye

Despite the strong theoretical guarantees that variance-reduced finite-sum optimization algorithms enjoy, their applicability remains limited to cases where the memory overhead they introduce (SAG/SAGA), or the periodic full gradient…

最优化与控制 · 数学 2021-03-24 Ayoub El Hanchi , David A. Stephens

Lack of standardization and various intrinsic parameters for magnetic resonance (MR) image acquisition results in heterogeneous images across different sites and devices, which adversely affects the generalization of deep neural networks.…