中文
相关论文

相关论文: A companion for the Kiefer--Wolfowitz--Blum stocha…

200 篇论文

We study a class of weakly identifiable location-scale mixture models for which the maximum likelihood estimates based on $n$ i.i.d. samples are known to have lower accuracy than the classical $n^{- \frac{1}{2}}$ error. We investigate…

统计理论 · 数学 2021-11-17 Raaz Dwivedi , Nhat Ho , Koulik Khamaru , Martin J. Wainwright , Michael I. Jordan , Bin Yu

Stochastic Boolean Function Evaluation is the problem of determining the value of a given Boolean function f on an unknown input x, when each bit of x_i of x can only be determined by paying an associated cost c_i. The assumption is that x…

数据结构与算法 · 计算机科学 2013-08-12 Amol Deshpande , Lisa Hellerstein , Devorah Kletenik

We present and study a novel algorithm for the computation of 2-Wasserstein population barycenters of absolutely continuous probability measures on Euclidean space. The proposed method can be seen as a stochastic gradient descent procedure…

最优化与控制 · 数学 2023-10-24 Julio Backhoff-Veraguas , Joaquin Fontbona , Gonzalo Rios , Felipe Tobar

We consider the fundamental problem of ReLU regression, where the goal is to output the best fitting ReLU with respect to square loss given access to draws from some unknown distribution. We give the first efficient, constant-factor…

机器学习 · 计算机科学 2020-09-30 Ilias Diakonikolas , Surbhi Goel , Sushrut Karmalkar , Adam R. Klivans , Mahdi Soltanolkotabi

The push-sum algorithm is probably the most important distributed averaging approach over directed graphs, which has been applied to various problems including distributed optimization. This paper establishes the explicit absolute…

最优化与控制 · 数学 2023-04-20 Yixuan Lin , Ji Liu

We propose a new algorithm---Stochastic Proximal Langevin Algorithm (SPLA)---for sampling from a log concave distribution. Our method is a generalization of the Langevin algorithm to potentials expressed as the sum of one stochastic smooth…

机器学习 · 统计学 2020-06-17 Adil Salim , Dmitry Kovalev , Peter Richtárik

We study numerically a coagulation-fragmentation model derived by Niwa and further elaborated by Degond et al., where a unique equilibrium distribution of group sizes is shown to exist in both cases of continuous and discrete group size…

数学物理 · 物理学 2018-06-25 Pierre Degond , Maximilian Engel

This paper tackles the challenge of parameter calibration in stochastic models, particularly in scenarios where the likelihood function is unavailable in an analytical form. We introduce a gradient-based simulated parameter estimation…

机器学习 · 统计学 2025-03-25 Zehao Li , Yijie Peng

Recently, much progress has been made on particle swarm optimization (PSO). A number of works have been devoted to analyzing the convergence of the underlying algorithms. Nevertheless, in most cases, rather simplified hypotheses are used.…

最优化与控制 · 数学 2016-11-15 Quan Yuan , George Yin

An usual problem in statistics consists in estimating the minimizer of a convex function. When we have to deal with large samples taking values in high dimensional spaces, stochastic gradient algorithms and their averaged versions are…

统计理论 · 数学 2022-01-12 Antoine Godichon-Baggioni

The computation of the maximum likelihood (ML) estimator for heteroscedastic regression models is considered. The traditional Newton algorithms for the problem require matrix multiplications and inversions, which are bottlenecks in modern…

统计计算 · 统计学 2016-08-24 Hien D. Nguyen , Luke R. Lloyd-Jones , Geoffrey J. McLachlan

We consider stochastic variational inequality problems where the mapping is monotone over a compact convex set. We present two robust variants of stochastic extragradient algorithms for solving such problems. Of these, the first scheme…

最优化与控制 · 数学 2014-03-25 Farzad Yousefian , Angelia Nedic , Uday V. Shanbhag

Let g : $\Omega$ = [0, 1] d $\rightarrow$ R denote a Lipschitz function that can be evaluated at each point, but at the price of a heavy computational time. Let X stand for a random variable with values in $\Omega$ such that one is able to…

概率论 · 数学 2021-07-29 Lucie Bernard , Albert Cohen , Arnaud Guyader , Florent Malrieu

The majority of machine learning methods can be regarded as the minimization of an unavailable risk function. To optimize the latter, given samples provided in a streaming fashion, we define a general stochastic Newton algorithm and its…

统计理论 · 数学 2023-06-30 Claire Boyer , Antoine Godichon-Baggioni

We develop a stochastic trust-region algorithm for minimizing the sum of a possibly nonconvex Lipschitz-smooth function that can only be evaluated stochastically and a nonsmooth, deterministic, convex function. This algorithm, which we call…

最优化与控制 · 数学 2025-10-06 Robert J. Baraldi , Aurya Javeed , Drew P. Kouri , Katya Scheinberg

Stochastic gradient descent with momentum (SGDM) is the dominant algorithm in many optimization scenarios, including convex optimization instances and non-convex neural network training. Yet, in the stochastic setting, momentum interferes…

最优化与控制 · 数学 2023-06-28 Junhyung Lyle Kim , Panos Toulis , Anastasios Kyrillidis

A new algorithm for the approximation and simulation of twofold iterated stochastic integrals together with the corresponding L\'{e}vy areas driven by a multidimensional Brownian motion is proposed. The algorithm is based on a truncated…

概率论 · 数学 2021-01-26 Jan Mrongowius , Andreas Rößler

We demonstrate that for strongly log-convex densities whose potentials are discontinuous on manifolds, the ULA algorithm converges with stepsize bias of order $1/2$ in Wasserstein-p distance. Our resulting bound is then of the same order as…

概率论 · 数学 2023-12-05 Tim Johnston , Sotirios Sabanis

We propose a hybrid resampling method to approximate finitely supported Wasserstein barycenters on large-scale datasets, which can be combined with any exact solver. Nonasymptotic bounds on the expected error of the objective value as well…

统计计算 · 统计学 2021-05-28 Florian Heinemann , Axel Munk , Yoav Zemel

Cr\'epey, Frikha, and Louzi (2025) introduced a multilevel stochastic approximation scheme to compute the value-at-risk of a financial loss that is only simulatable by Monte Carlo. The best complexity of the scheme is in…

风险管理 · 定量金融 2026-04-14 Stéphane Crépey , Noufel Frikha , Azar Louzi , Jonathan Spence