中文
相关论文

相关论文: Total Variation Guarantees for Sampling with Stoch…

200 篇论文

In the context of finite sums minimization, variance reduction techniques are widely used to improve the performance of state-of-the-art stochastic gradient methods. Their practical impact is clear, as well as their theoretical properties.…

最优化与控制 · 数学 2024-08-07 Cheik Traoré , Vassilis Apidopoulos , Saverio Salzo , Silvia Villa

Consider the detection of a sparse change in high-dimensional time-series. We introduce Sparsity Likelihood-based (SL-based) score and the change-points detection procedure in multivariate normal model with general covariance structure.…

统计方法学 · 统计学 2025-07-30 Jingyan Huang

We study the almost sure convergence of the Stochastic Approximation algorithm to the fixed point $x^\star$ of a nonlinear operator under a negative drift condition and a general noise sequence with finite $p$-th moment for some $p > 1$.…

最优化与控制 · 数学 2026-02-23 Quang Dinh Thien Nguyen , Duc Anh Nguyen , Hoang Huy Nguyen , Siva Theja Maguluri

Stochastic particle-optimization sampling (SPOS) is a recently-developed scalable Bayesian sampling framework that unifies stochastic gradient MCMC (SG-MCMC) and Stein variational gradient descent (SVGD) algorithms based on Wasserstein…

机器学习 · 统计学 2018-11-21 Jianyi Zhang , Yang Zhao , Changyou Chen

In this work, an adaptive predictive control scheme for linear systems with unknown parameters and bounded additive disturbances is proposed. In contrast to related adaptive control approaches that robustly consider the parametric…

系统与控制 · 电气工程与系统科学 2025-03-03 Johannes Teutsch , Christopher Narr , Sebastian Kerz , Dirk Wollherr , Marion Leibold

Sampling-based algorithms are classical approaches to perform Bayesian inference in inverse problems. They provide estimators with the associated credibility intervals to quantify the uncertainty on the estimators. Although these methods…

统计方法学 · 统计学 2023-11-28 Pierre-Antoine Thouvenin , Audrey Repetti , Pierre Chainais

Most existing approximate Thompson Sampling (TS) algorithms for multi-armed bandits use Stochastic Gradient Langevin Dynamics (SGLD) or its variants in each round to sample from the posterior, relaxing the need for conjugacy assumptions…

机器学习 · 计算机科学 2025-10-07 Weixin Wang , Haoyang Zheng , Guang Lin , Wei Deng , Pan Xu

Let $X_1,X_2,...,X_n$ be a sequence of independent or locally dependent random variables taking values in $\mathbb{Z}_+$. In this paper, we derive sharp bounds, via a new probabilistic method, for the total variation distance between the…

统计理论 · 数学 2010-10-11 Michael V. Boutsikas , Eutichia Vaggelatou

We consider the problem of inference in discrete probabilistic models, that is, distributions over subsets of a finite ground set. These encompass a range of well-known models in machine learning, such as determinantal point processes and…

机器学习 · 计算机科学 2018-07-10 Alkis Gotovos , Hamed Hassani , Andreas Krause , Stefanie Jegelka

The paper suggests a generalization of the Sign-Perturbed Sums (SPS) finite sample system identification method for the identification of closed-loop observable stochastic linear systems in state-space form. The solution builds on the…

系统与控制 · 电气工程与系统科学 2024-06-11 Szabolcs Szentpéteri , Balázs Csanád Csáji

We show that Neural ODEs, an emerging class of time-continuous neural networks, can be verified by solving a set of global-optimization problems. For this purpose, we introduce Stochastic Lagrangian Reachability (SLR), an abstraction-based…

机器学习 · 计算机科学 2021-11-16 Sophie Gruenbacher , Ramin Hasani , Mathias Lechner , Jacek Cyranka , Scott A. Smolka , Radu Grosu

Slice sampling is a well-established Markov chain Monte Carlo method for (approximate) sampling of target distributions which are only known up to a normalizing constant. The method is based on choosing a new state on a slice, i.e., a…

统计计算 · 统计学 2025-12-22 Kevin Bitterlich , Daniel Rudolf , Björn Sprungk

Simultaneous Localization and Planning (SLAP) under process and measurement uncertainties is a challenge. It involves solving a stochastic control problem modeled as a Partially Observed Markov Decision Process (POMDP) in a general…

机器人学 · 计算机科学 2016-08-12 Mohammadhussein Rafieisakhaei , Suman Chakravorty , P. R. Kumar

The aim of this paper is to address optimality of stochastic control strategies via dynamic programming subject to total variation distance ambiguity on the conditional distribution of the controlled process. We formulate the stochastic…

最优化与控制 · 数学 2014-02-06 Ioannis Tzortzis , Charalambos D. Charalambous , Themistoklis Charalambous

We consider an infinite-dimensional stochastic clustering model on $\mathbb{R}$. In discrete time, each point of a unit-intensity simple point process moves halfway toward either of its left or right neighbors, chosen uniformly at random.…

概率论 · 数学 2026-03-10 Partha S. Dey , S. Rasoul Etesami , Aditya S. Gopalan

This paper investigates group distributionally robust optimization (GDRO) with the goal of learning a model that performs well over $m$ different distributions. First, we formulate GDRO as a stochastic convex-concave saddle-point problem,…

机器学习 · 计算机科学 2024-11-21 Lijun Zhang , Haomin Bai , Peng Zhao , Tianbao Yang , Zhi-Hua Zhou

The paper introduces robust independence tests with non-asymptotically guaranteed significance levels for stochastic linear time-invariant systems, assuming that the observed outputs are synchronous, which means that the systems are driven…

机器学习 · 统计学 2023-08-07 Ambrus Tamás , Dániel Ágoston Bálint , Balázs Csanád Csáji

In this work, we present a novel robustness measure for continuous-time stochastic trajectories with respect to Signal Temporal Logic (STL) specifications. We show the soundness of the measure and develop a monitor for reasoning about…

形式语言与自动机理论 · 计算机科学 2023-05-30 Roland B. Ilyes , Qi Heng Ho , Morteza Lahijanian

Variance-reduced stochastic gradient methods have gained popularity in recent times. Several variants exist with different strategies for the storing and sampling of gradients and this work concerns the interactions between these two…

最优化与控制 · 数学 2022-10-19 Martin Morin , Pontus Giselsson

Stochastic optimization has found wide applications in minimizing objective functions in machine learning, which motivates a lot of theoretical studies to understand its practical success. Most of existing studies focus on the convergence…

人工智能 · 计算机科学 2023-07-19 Yunwen Lei