English
Related papers

Related papers: Affine matrix scrambling achieves smoothness-depen…

200 papers

We present a novel method for approximately equilibrating a matrix $A \in {\bf R}^{m \times n}$ using only multiplication by $A$ and $A^T$. Our method is based on convex optimization and projected stochastic gradient descent, using an…

Optimization and Control · Mathematics 2016-02-23 Steven Diamond , Stephen Boyd

We study the integration problem over the $s$-dimensional unit cube on four types of Banach spaces of integrands. First we consider Haar wavelet spaces, consisting of functions whose Haar wavelet coefficients exhibit a certain decay…

Numerical Analysis · Mathematics 2026-01-21 Michael Gnewuch , Josef Dick , Lev Markhasin , Winfried Sickel

We study numerical integration of smooth functions defined over the $s$-dimensional unit cube. A recent work by Dick et al. (2019) has introduced so-called extrapolated polynomial lattice rules, which achieve the almost optimal rate of…

Numerical Analysis · Mathematics 2020-07-15 Takashi Goda

With new accelerator hardware for DNN, the computing power for AI applications has increased rapidly. However, as DNN algorithms become more complex and optimized for specific applications, latency requirements remain challenging, and it is…

Machine Learning · Computer Science 2021-05-10 Matthias Wess , Matvey Ivanov , Anvesh Nookala , Christoph Unger , Alexander Wendt , Axel Jantsch

This study investigates the performance of median-of-means sampling compared to traditional mean-of-means sampling for computing the Keister function integral using Randomized Quasi-Monte Carlo (RQMC) methods. The research tests both…

Methodology · Statistics 2025-01-22 Bocheng Zhang

An important feature of kernel mean embeddings (KME) is that the rate of convergence of the empirical KME to the true distribution KME can be bounded independently of the dimension of the space, properties of the distribution and smoothness…

Statistics Theory · Mathematics 2025-04-17 Geoffrey Wolfer , Pierre Alquier

We propose an autoregressive framework for modelling dynamic networks with dependent edges. It encompasses models that accommodate, for example, transitivity, degree heterogenenity, and other stylized features often observed in real network…

Statistics Theory · Mathematics 2026-03-25 Jinyuan Chang , Qin Fang , Eric D. Kolaczyk , Peter W. MacDonald , Qiwei Yao

Convergence rates are established for an inexact accelerated alternating direction method of multipliers (I-ADMM) for general separable convex optimization with a linear constraint. Both ergodic and non-ergodic iterates are analyzed.…

Numerical Analysis · Mathematics 2021-07-20 William W. Hager , Hongchao Zhang

In this paper, we study the convergence of the Adaptive Moment Estimation (Adam) algorithm under unconstrained non-convex smooth stochastic optimizations. Despite the widespread usage in machine learning areas, its theoretical properties…

Optimization and Control · Mathematics 2023-11-06 Yusu Hong , Junhong Lin

We study the convergence rate of randomly truncated stochastic algorithms, which consist in the truncation of the standard Robbins-Monro procedure on an increasing sequence of compact sets. Such a truncation is often required in practice to…

Probability · Mathematics 2010-04-08 Jérôme Lelong

We study the convergence rate of randomly truncated stochastic algorithms, which consist in the truncation of the standard Robbins-Monro procedure on an increasing sequence of compact sets. Such a truncation is often required in practice to…

Probability · Mathematics 2010-03-23 Jérôme Lelong

This paper deals with a general class of transformation models that contains many important semiparametric regression models as special cases. It develops a self-induced smoothing for the maximum rank correlation estimator, resulting in…

Methodology · Statistics 2013-02-28 Junyi Zhang , Zhezhen Jin , Yongzhao Shao , Zhiliang Ying

Randomized quasi-Monte Carlo (RQMC) sampling can bring orders of magnitude reduction in variance compared to plain Monte Carlo (MC) sampling. The extent of the efficiency gain varies from problem to problem and can be hard to predict. This…

Computation · Statistics 2017-06-26 Art B. Owen

We revisit the problem of computing submatrices of the Cram\'er-Rao bound (CRB), which lower bounds the variance of any unbiased estimator of a vector parameter $\vth$. We explore iterative methods that avoid direct inversion of the Fisher…

Information Theory · Computer Science 2015-06-04 Paul Tune

We establish epigraphical and uniform laws of large numbers for sample-based approximations of law invariant risk functionals. These sample-based approximation schemes include Monte Carlo (MC) and certain randomized quasi-Monte Carlo…

Optimization and Control · Mathematics 2025-07-01 Olena Melnikov , Johannes Milz

We introduce \emph{coarse scrambling}, a novel randomization for digital sequences that permutes blocks of digits in a mixed-radix representation. This construction is designed to preserve the powerful $(0,\boldsymbol{e},d)$-sequence…

Numerical Analysis · Mathematics 2025-10-03 Kosuke Suzuki

Many statistical applications require an estimate of a covariance matrix and/or its inverse. When the matrix dimension is large compared to the sample size, which happens frequently, the sample covariance matrix is known to perform poorly…

Statistics Theory · Mathematics 2012-07-24 Olivier Ledoit , Michael Wolf

Randomized smoothing has emerged as a potent certifiable defense against adversarial attacks by employing smoothing noises from specific distributions to ensure the robustness of a smoothed classifier. However, the utilization of Monte…

Machine Learning · Computer Science 2025-04-01 Devansh Bhardwaj , Kshitiz Kaushik , Sarthak Gupta

A new multivariate density estimator for stationary sequences is obtained by Fourier inversion of the thresholded empirical characteristic function. This estimator does not depend on the choice of parameters related to the smoothness of the…

Statistics Theory · Mathematics 2023-05-24 Sinda Ammous , Jérôme Dedecker , Céline Duval

In recent years, artificial neural networks have developed into a powerful tool for addressing a multitude of problems for which classical solution approaches reach their limits. However, it is still unclear why gradient descent…

Machine Learning · Computer Science 2026-05-20 Arnulf Jentzen , Timo Kröger