中文
相关论文

相关论文: Score-based generative models are provably robust:…

200 篇论文

Score-based diffusion models have emerged as powerful techniques for generating samples from high-dimensional data distributions. These models involve a two-phase process: first, injecting noise to transform the data distribution into a…

机器学习 · 计算机科学 2024-10-21 Runjia Li , Qiwei Di , Quanquan Gu

Conformal prediction (CP) provides model-agnostic uncertainty quantification with guaranteed coverage, but conventional methods often produce overly conservative uncertainty sets, especially in multi-dimensional settings. This limitation…

机器学习 · 计算机科学 2025-02-12 Minxing Zheng , Shixiang Zhu

A curious phenomenon observed in some dynamical generative models is the following: despite learning errors in the score function or the drift vector field, the generated samples appear to shift \emph{along} the support of the data…

机器学习 · 计算机科学 2025-08-12 Nisha Chandramoorthy , Adriaan de Clercq

Estimating the confidence of large language model (LLM) outputs is essential for real-world applications requiring high user trust. Black-box uncertainty quantification (UQ) methods, relying solely on model API access, have gained…

The shape of an object is an important characteristic for many vision problems such as segmentation, detection and tracking. Being independent of appearance, it is possible to generalize to a large range of objects from only small amounts…

机器学习 · 统计学 2018-12-14 Alessandro Di Martino , Erik Bodin , Carl Henrik Ek , Neill D. F. Campbell

While the manifold hypothesis is widely adopted in modern machine learning, complex data is often better modeled as stratified spaces -- unions of manifolds (strata) of varying dimensions. Stratified learning is challenging due to varying…

机器学习 · 统计学 2026-04-14 Randy Martinez , Rong Tang , Lizhen Lin

We give an improved theoretical analysis of score-based generative modeling. Under a score estimate with small $L^2$ error (averaged across timesteps), we provide efficient convergence guarantees for any data distribution with second-order…

机器学习 · 计算机科学 2023-02-03 Hongrui Chen , Holden Lee , Jianfeng Lu

This paper presents a nonparametric statistical modeling method for quantifying uncertainty in stochastic gradient systems with isotropic diffusion. The central idea is to apply the diffusion maps algorithm to a training data set to produce…

动力系统 · 数学 2015-02-10 Tyrus Berry , John Harlim

Machine learning models are increasingly trained or fine-tuned on synthetic data. Recursively training on such data has been observed to significantly degrade performance in a wide range of tasks, often characterized by a progressive drift…

机器学习 · 统计学 2026-02-19 Nail B. Khelifa , Richard E. Turner , Ramji Venkataramanan

In this paper, we study a physics-informed algorithm for Wasserstein Generative Adversarial Networks (WGANs) for uncertainty quantification in solutions of partial differential equations. By using groupsort activation functions in…

数值分析 · 数学 2022-08-10 Yihang Gao , Michael K. Ng

Score-based generative models (SGMs) have recently demonstrated impressive results in terms of both sample quality and distribution coverage. However, they are usually applied directly in data space and often require thousands of network…

机器学习 · 统计学 2021-12-03 Arash Vahdat , Karsten Kreis , Jan Kautz

Multi-modal medical image completion has been extensively applied to alleviate the missing modality issue in a wealth of multi-modal diagnostic tasks. However, for most existing synthesis methods, their inferences of missing modalities can…

图像与视频处理 · 电气工程与系统科学 2022-07-08 Xiangxi Meng , Yuning Gu , Yongsheng Pan , Nizhuan Wang , Peng Xue , Mengkang Lu , Xuming He , Yiqiang Zhan , Dinggang Shen

Uncertainty quantification is essential in safety-critical settings--from autonomous driving to aviation, finance, and health--where decisions must rely on conservative bounds rather than point estimates. Predictor-level intervals (e.g.,…

机器学习 · 计算机科学 2026-05-18 Ruirui Liu , Xuejie Hou , Yiping Jiang , Hui Ren

Generative models can be categorized into two types: explicit generative models that define explicit density forms and allow exact likelihood inference, such as score-based diffusion models (SDMs) and normalizing flows; implicit generative…

机器学习 · 统计学 2023-07-06 Jingwei Zhang , Han Shi , Jincheng Yu , Enze Xie , Zhenguo Li

Design-based inference, also known as randomization-based or finite-population inference, provides a principled framework for trustworthy statistical inference by attributing randomness solely to the design mechanism (e.g., treatment…

统计方法学 · 统计学 2026-04-17 Siyu Heng , Yanxin Shen , Zijian Guo

Stochastic Gradient Descent (SGD) is an important algorithm in machine learning. With constant learning rates, it is a stochastic process that, after an initial phase of convergence, generates samples from a stationary distribution. We show…

机器学习 · 统计学 2017-09-12 Stephan Mandt , Matthew D. Hoffman , David M. Blei

We introduce an approach for analyzing the responses of dynamical systems to external perturbations that combines score-based generative modeling with the Generalized Fluctuation-Dissipation Theorem (GFDT). The methodology enables accurate…

数据分析、统计与概率 · 物理学 2024-11-11 Ludovico Theo Giorgini , Katherine Deck , Tobias Bischoff , Andre Souza

Calibrating a Reynolds-averaged Navier-Stokes (RANS) model against data leads to an improvement. Determining {\it a priori} if such an improvement generalizes to flows outside the calibration data is an outstanding challenge. This work…

流体动力学 · 物理学 2023-03-07 Xinyi Huang , Naman Jain , Mahdi Abkar , Robert Kunz , Xiang Yang

Score-based diffusion modeling is a generative machine learning algorithm that can be used to sample from complex distributions. They achieve this by learning a score function, i.e., the gradient of the log-probability density of the data,…

机器学习 · 计算机科学 2025-12-17 Dibyajyoti Chakraborty , Haiwen Guan , Jason Stock , Troy Arcomano , Guido Cervone , Romit Maulik

Generative modeling typically concerns transporting a single source distribution to a target distribution via simple probability flows. However, in fields like computer graphics and single-cell genomics, samples themselves can be viewed as…

机器学习 · 计算机科学 2025-05-20 Doron Haviv , Aram-Alexandre Pooladian , Dana Pe'er , Brandon Amos