English
Related papers

Related papers: A Note on Regularized Shannon's Sampling Formulae

200 papers

We consider the problem of finite sample corrections for entropy estimation. New estimates of the Shannon entropy are proposed and their systematic error (the bias) is computed analytically. We find that our results cover correction…

Statistical Mechanics · Physics 2009-11-10 Thomas Schürmann

In non-linear estimations, it is common to assess sampling uncertainty by bootstrap inference. For complex models, this can be computationally intensive. This paper combines optimization with resampling: turning stochastic optimization into…

Econometrics · Economics 2022-05-09 Jean-Jacques Forneron

We review the alternative proposals introduced recently in the literature to update the standard formula to estimate the uncertainty on the mean of repeated measurements, and we compare their performances on synthetic examples with normal…

Data Analysis, Statistics and Probability · Physics 2022-09-13 Pascal Pernot , Jean-Paul Berthet

In high-dimensional statistical inference, sparsity regularizations have shown advantages in consistency and convergence rates for coefficient estimation. We consider a generalized version of Sparse-Group Lasso which captures both…

Machine Learning · Statistics 2020-08-12 Xinyu Zhang

In this paper, we derive an explicit sample size formula based a mixed criterion of absolute and relative errors for estimating means of Poisson random variables.

Statistics Theory · Mathematics 2008-04-21 Xinjia Chen

We present a detailed derivation of some estimators of Shannon entropy for discrete distributions. They hold for finite samples of N points distributed into M "boxes", with N and M -> oo, but N/M < oo. In the high sampling regime (<< 1…

Data Analysis, Statistics and Probability · Physics 2011-11-09 P. Grassberger

Reconstructing a band-limited function from its finite sample data is a fundamental task in signal analysis. A Gaussian regularized Shannon sampling series has been proved to be able to achieve exponential convergence for uniform sampling.…

Signal Processing · Electrical Eng. & Systems 2022-10-10 Yunfei Yang , Haizhang Zhang

Estimating equations arise in a wide range of statistical applications, including longitudinal and clustered data analysis, survival analysis, econometrics, and semiparametric inference. In high-dimensional settings, adding…

Computation · Statistics 2026-05-27 Weihua Shi , Yixuan Li , Yi Lian , Archer Y. Yang , Yue Zhao

We obtain bounds on estimation error rates for regularization procedures of the form \begin{equation*} \hat f \in {\rm argmin}_{f\in F}\left(\frac{1}{N}\sum_{i=1}^N\left(Y_i-f(X_i)\right)^2+\lambda \Psi(f)\right) \end{equation*} when $\Psi$…

Statistics Theory · Mathematics 2017-01-04 Guillaume Lecué , Shahar Mendelson

Sampling is often a necessary evil to reduce the processing and storage costs of distributed tracing. In this work, we describe a scalable and adaptive sampling approach that can preserve events of interest better than the widely used…

Data Structures and Algorithms · Computer Science 2021-07-19 Otmar Ertl

Modern technologies are generating ever-increasing amounts of data. Making use of these data requires methods that are both statistically sound and computationally efficient. Typically, the statistical and computational aspects are treated…

Methodology · Statistics 2022-09-15 Mahsa Taheri , Néhémy Lim , Johannes Lederer

The Shannon entropy, and related quantities such as mutual information, can be used to quantify uncertainty and relevance. However, in practice, it can be difficult to compute these quantities for arbitrary probability distributions,…

Computation · Statistics 2017-10-11 Brendon J. Brewer

Estimating entropies from limited data series is known to be a non-trivial task. Naive estimations are plagued with both systematic (bias) and statistical errors. Here, we present a new 'balanced estimator' for entropy functionals Shannon,…

Statistical Mechanics · Physics 2008-04-30 Juan A. Bonachela , Haye Hinrichsen , Miguel A. Munoz

For the general parametric regression models with covariates contaminated with normal measurement errors, this paper proposes an accelerated version of the classical simulation extrapolation algorithm to estimate the unknown parameters in…

Methodology · Statistics 2021-07-13 Kanwal Ayub , Weixing Song

In this article we study the problem of recovering the unknown solution of a linear ill-posed problem, via iterative regularization methods. We review the problem of projection-regularization from a statistical point of view. A basic…

Statistics Theory · Mathematics 2007-06-13 Ana K. Fermin , Carenne Ludena

Rigorous assessment of uncertainty is crucial to the utility of DNS results. Uncertainties in the computed statistics arise from two sources: finite statistical sampling and the discretization of the Navier-Stokes equations. Due to the…

Fluid Dynamics · Physics 2015-06-17 Todd A. Oliver , Nicholas Malaya , Rhys Ulerich , Robert D. Moser

The paper introduces a new estimation method for the standard linear regression model. The procedure is not driven by the optimisation of any objective function rather, it is a simple weighted average of slopes from observation pairs. The…

Econometrics · Economics 2024-02-27 Felix Chan , Laszlo Matyas

We derive some regularity estimates of the solution to a time fractional diffusion equation, that are useful for numerical analysis, and partially unravel the singularity structure of the solution with respect to the time variable.

Analysis of PDEs · Mathematics 2017-04-04 Binjie Li , Xiaoping Xie

An algorithm is proposed, analyzed, and tested for solving continuous nonlinear-equality-constrained optimization problems where the objective and constraint functions are defined by expectations or averages over large, finite numbers of…

Optimization and Control · Mathematics 2026-05-14 Frank E. Curtis , Lingjun Guo , Daniel P. Robinson

A new approach of obtaining stratified random samples from statistically dependent random variables is described. The proposed method can be used to obtain samples from the input space of a computer forward model in estimating expectations…

Methodology · Statistics 2019-11-25 Anirban Mondal , Abhijit Mandal