中文
相关论文

相关论文: Total Variation Guarantees for Sampling with Stoch…

200 篇论文

In this paper, we propose a stochastic optimization method that adaptively controls the sample size used in the computation of gradient approximations. Unlike other variance reduction techniques that either require additional storage or the…

最优化与控制 · 数学 2017-11-01 Raghu Bollapragada , Richard Byrd , Jorge Nocedal

We deal with stochastic differential equations with jumps. In order to obtain an accurate approximation scheme, it is usual to replace the "small jumps" by a Brownian motion. In this paper, we prove that for every fixed time $t$, the…

概率论 · 数学 2023-10-17 Vlad Bally , Yifeng Qin

We provide full theoretical guarantees for the convergence behaviour of diffusion-based generative models under the assumption of strongly log-concave data distributions while our approximating class of functions used for score estimation…

机器学习 · 计算机科学 2025-02-18 Stefano Bruno , Ying Zhang , Dong-Young Lim , Ömer Deniz Akyildiz , Sotirios Sabanis

We investigate Learning from Label Proportions (LLP), a partial information setting where examples in a training set are grouped into bags, and only aggregate label values in each bag are available. Despite the partial observability, the…

机器学习 · 计算机科学 2025-06-02 Robert Busa-Fekete , Travis Dick , Claudio Gentile , Haim Kaplan , Tomer Koren , Uri Stemmer

Many generative models have to combat $\textit{missing modes}$. The conventional wisdom to this end is by reducing through training a statistical distance (such as $f$-divergence) between the generated distribution and provided data…

机器学习 · 统计学 2019-10-28 Peilin Zhong , Yuchen Mo , Chang Xiao , Pengyu Chen , Changxi Zheng

We consider the problem of sampling from a target distribution, which is \emph {not necessarily logconcave}, in the context of empirical risk minimization and stochastic optimization as presented in Raginsky et al. (2017). Non-asymptotic…

统计理论 · 数学 2021-02-03 Ngoc Huy Chau , Éric Moulines , Miklos Rásonyi , Sotirios Sabanis , Ying Zhang

Elliptical slice sampling is a widely used gradient-free Markov chain Monte Carlo algorithm that is tuning-free and capable of adapting to local characteristics of the target distribution. However, its primary limitation is that sampling…

统计计算 · 统计学 2026-05-22 Nicholas Marco , Surya T. Tokdar

Changepoint localization aims to provide confidence sets for a changepoint (if one exists). Existing methods either relying on strong parametric assumptions or providing only asymptotic guarantees or focusing on a particular kind of…

统计理论 · 数学 2026-02-18 Swapnaneel Bhattacharyya , Aaditya Ramdas

Importance sampling has become an indispensable strategy to speed up optimization algorithms for large-scale applications. Improved adaptive variants - using importance values defined by the complete gradient information which changes…

机器学习 · 计算机科学 2017-11-08 Sebastian U. Stich , Anant Raj , Martin Jaggi

As an example of the recently-introduced concept of rate of innovation, signals that are linear combinations of a finite number of Diracs per unit time can be acquired by linear filtering followed by uniform sampling. However, in reality,…

应用统计 · 统计学 2009-03-09 Vincent Y. F. Tan , Vivek K. Goyal

The aim of this paper is to provide several novel upper bounds on the excess risk with a primal focus on classification problems. We suggest two approaches and the obtained bounds are represented via the distribution dependent local…

统计理论 · 数学 2018-03-13 Nikita Zhivotovskiy

Mirror Descent is a popular algorithm, that extends Gradients Descent (GD) beyond the Euclidean geometry. One of its benefits is to enable strong convergence guarantees through smooth-like analyses, even for objectives with exploding or…

最优化与控制 · 数学 2024-04-19 Hadrien Hendrikx

The challenges posed by complex stochastic models used in computational ecology, biology and genetics have stimulated the development of approximate approaches to statistical inference. Here we focus on Synthetic Likelihood (SL), a…

统计方法学 · 统计学 2017-06-09 Matteo Fasiolo , Simon N. Wood , Florian Hartig , Mark V. Bravington

Reconstructing an infinite-dimensional signal from a finite set of measurements is a fundamental problem in approximation theory and signal processing. While the generalized sampling (GS) framework provides a robust methodology for…

泛函分析 · 数学 2026-05-25 Luca Finotti , Matteo Santacesaria

Stochastic differential equations (SDEs) or diffusions are continuous-valued continuous-time stochastic processes widely used in the applied and mathematical sciences. Simulating paths from these processes is usually an intractable problem,…

统计计算 · 统计学 2020-05-27 Qi Wang , Vinayak Rao , Yee Whye Teh

In this paper we consider the unconstrained minimization problem of a smooth function in ${\mathbb{R}}^n$ in a setting where only function evaluations are possible. We design a novel randomized derivative-free algorithm --- the stochastic…

最优化与控制 · 数学 2019-05-08 El Houcine Bergou , Eduard Gorbunov , Peter Richtárik

Motion planning under differential constraints is a classic problem in robotics. To date, the state of the art is represented by sampling-based techniques, with the Rapidly-exploring Random Tree algorithm as a leading example. Yet, the…

机器人学 · 计算机科学 2015-03-03 Edward Schmerling , Lucas Janson , Marco Pavone

With the proliferation of generative AI and the increasing volume of generative data (also called as synthetic data), assessing the fidelity of generative data has become a critical concern. In this paper, we propose a discriminative…

机器学习 · 统计学 2024-05-27 Lan Tao , Shirong Xu , Chi-Hua Wang , Namjoon Suh , Guang Cheng

This paper investigates total variation minimization in one spatial dimension for the recovery of gradient-sparse signals from undersampled Gaussian measurements. Recently established bounds for the required sampling rate state that uniform…

信息论 · 计算机科学 2022-04-12 Martin Genzel , Maximilian März , Robert Seidel

We study maximum likelihood estimation for spatial generalized linear mixed models with Gaussian process approximations using a stochastic Newton-Raphson algorithm. We consider two Gaussian Process approximations in this context: spectral…

统计方法学 · 统计学 2026-05-19 Samuel I. Watson , Yixin Wang , Emanuele Giorgi