English
Related papers

Related papers: Approximation Based Variance Reduction for Reparam…

200 papers

In this work, an adaptive predictive control scheme for linear systems with unknown parameters and bounded additive disturbances is proposed. In contrast to related adaptive control approaches that robustly consider the parametric…

Systems and Control · Electrical Eng. & Systems 2025-03-03 Johannes Teutsch , Christopher Narr , Sebastian Kerz , Dirk Wollherr , Marion Leibold

Previous work has shown that high-quality control variates for lattice Monte Carlo methods may be constructed from lattice Schwinger-Dyson relations. This paper extends that method to theories with lattice fermions, using the Thirring model…

High Energy Physics - Lattice · Physics 2024-04-17 Scott Lawrence

In many applications we seek to maximize an expectation with respect to a distribution over discrete variables. Estimating gradients of such objectives with respect to the distribution parameters is a challenging problem. We analyze…

Machine Learning · Statistics 2019-06-18 Evgeny Andriyash , Arash Vahdat , Bill Macready

The stochastic gradient descent (SGD) method is a widely used approach for solving stochastic optimization problems, but its convergence is typically slow. Existing variance reduction techniques, such as SAGA, improve convergence by…

Optimization and Control · Mathematics 2025-11-21 Fabio Nobile , Matteo Raviola , Nathan Schaeffer

While the optimization landscape of policy gradient methods has been recently investigated for partially observed linear systems in terms of both static output feedback and dynamical controllers, they only provide convergence guarantees to…

Optimization and Control · Mathematics 2023-04-25 Feiran Zhao , Xingyun Fu , Keyou You

We provide a functional view of distributional robustness motivated by robust statistics and functional analysis. This results in two practical computational approaches for approximate distributionally robust nonlinear optimization based on…

Systems and Control · Electrical Eng. & Systems 2021-10-27 Yassine Nemmour , Bernhard Schölkopf , Jia-Jie Zhu

Policy gradient methods have achieved remarkable successes in solving challenging reinforcement learning problems. However, it still often suffers from the large variance issue on policy gradient estimation, which leads to poor sample…

Machine Learning · Statistics 2018-02-26 Hao Liu , Yihao Feng , Yi Mao , Dengyong Zhou , Jian Peng , Qiang Liu

In randomized controlled trials without interference, regression adjustment is widely used to enhance the efficiency of treatment effect estimation. This paper extends this efficiency principle to settings with network interference, where a…

Methodology · Statistics 2025-02-18 Xinyuan Fan , Chenlei Leng , Weichi Wu

Most studies in multiparameter estimation assume the dynamics is fixed and focus on identifying the optimal probe state and the optimal measurements. In practice, however, controls are usually available to alter the dynamics, which provides…

Quantum Physics · Physics 2017-10-30 Jing Liu , Haidong Yuan

We provide non-asymptotic, relative deviation bounds for the eigenvalues of empirical covariance and Gram matrices in general settings. Unlike typical uniform bounds, which may fail to capture the behavior of smaller eigenvalues, our…

Probability · Mathematics 2025-05-28 Daniel Barzilai , Ohad Shamir

It is difficult to use subsampling with variational inference in hierarchical models since the number of local latent variables scales with the dataset. Thus, inference in hierarchical models remains a challenge at large scale. It is…

Machine Learning · Computer Science 2021-11-08 Abhinav Agrawal , Justin Domke

Bayesian nonparametric regression under a rescaled Gaussian process prior offers smoothness-adaptive function estimation with near minimax-optimal error rates. Hierarchical extensions of this approach, equipped with stochastic variable…

Statistics Theory · Mathematics 2020-12-15 Sheng Jiang , Surya T. Tokdar

Stochastic simulation is a widely used method for estimating quantities in models of chemical reaction networks where uncertainty plays a crucial role. However, reducing the statistical uncertainty of the corresponding estimators requires…

Quantitative Methods · Quantitative Biology 2019-06-13 Michael Backenköhler , Luca Bortolussi , Verena Wolf

We provide a set of probabilistic laws for estimating the quadratic variation of continuous semimartingales with realized range-based variance -- a statistic that replaces every squared return of realized variance with a normalized squared…

Econometrics · Economics 2026-01-29 Kim Christensen , Mark Podolskij

In structured additive distributional regression, the conditional distribution of the response variables given the covariate information and the vector of model parameters is modelled using a P-parametric probability density function where…

Computation · Statistics 2025-02-06 Gianmarco Callegher , Thomas Kneib , Johannes Söding , Paul Wiemann

We discuss a class of difference-based estimators for the autocovariance in nonparametric regression when the signal is discontinuous (change-point regression), possibly highly fluctuating, and the errors form a stationary $m$-dependent…

Methodology · Statistics 2016-08-09 Inder Tecuapetla-Gómez , Axel Munk

Variational inference in probabilistic graphical models aims to approximate fundamental quantities such as marginal distributions and the partition function. Popular approaches are the Bethe approximation, tree-reweighted, and other types…

Machine Learning · Statistics 2025-02-06 Harald Leisenberger , Franz Pernkopf

While many areas of machine learning have benefited from the increasing availability of large and varied datasets, the benefit to causal inference has been limited given the strong assumptions needed to ensure identifiability of causal…

Machine Learning · Computer Science 2022-01-02 Wenshuo Guo , Serena Wang , Peng Ding , Yixin Wang , Michael I. Jordan

In this article, we consider a stochastic linear quadratic control problem with partial observation. A near optimal control in the weak formulation is characterized. The main features of this paper are the presence of the control in the…

Optimization and Control · Mathematics 2026-02-27 Jingrui Sun , Jiaqiang Wen , Jie Xiong , Wen Xu

We propose an adaptive importance sampling scheme for the simulation of rare events when the underlying dynamics is given by a diffusion. The scheme is based on a Gibbs variational principle that is used to determine the optimal (i.e.…

Probability · Mathematics 2019-07-24 Carsten Hartmann , Omar Kebiri , Lara Neureither , Lorenz Richter
‹ Prev 1 8 9 10 Next ›