English
Related papers

Related papers: Integration by parts and representation of informa…

200 papers

We study the problem of estimating at a central server the mean of a set of vectors distributed across several nodes (one vector per node). When the vectors are high-dimensional, the communication cost of sending entire vectors may be…

Machine Learning · Computer Science 2021-10-18 Divyansh Jhunjhunwala , Ankur Mallick , Advait Gadhikar , Swanand Kadhe , Gauri Joshi

The flexibility and wide applicability of the Fisher randomization test (FRT) makes it an attractive tool for assessment of causal effects of interventions from modern-day randomized experiments that are increasing in size and complexity.…

Methodology · Statistics 2020-04-21 Xiaokang Luo , Tirthankar Dasgupta , Minge Xie , Regina Liu

Point estimators may not exist, need not be unique, and their distributions are not parameter invariant. Generalized estimators provide distributions that are parameter invariant, unique, and exist when point estimates do not. Comparing…

Statistics Theory · Mathematics 2022-11-04 Paul W. Vos

The importance of the quantum Fisher information metric is testified by the number of applications that this has in very different fields, ranging from hypothesis testing to metrology, passing through thermodynamics. Still, from the rich…

Quantum Physics · Physics 2024-04-30 Matteo Scandi , Paolo Abiuso , Jacopo Surace , Dario De Santis

We consider non-linear regression models corrupted by generic noise when the regression functions form a non-linear subspace of L^2, relevant in non-linear PDE inverse problems and data assimilation. We show that when the score of the model…

Statistics Theory · Mathematics 2026-01-21 Dimitri Konen

We prove a formula for the evaluation of expectations containing a scalar function of a Gaussian random vector multiplied by a product of the random vector components, each one raised to a non-negative integer power. Some of the powers…

Probability · Mathematics 2025-08-21 Konstantinos Mamis

Many functions encountered in applied mathematics and in statistical data analysis can be expressed in terms of perspective functions. One of the earliest examples is the Fisher information, which appeared in statistics in the 1920s. We…

Functional Analysis · Mathematics 2017-02-15 Patrick L. Combettes

This paper is devoted to the mathematical study of some divergences based on the mutual information well-suited to categorical random vectors. These divergences are generalizations of the "entropy distance" and "information distance". Their…

Statistics Theory · Mathematics 2016-08-16 Jean-François Coeurjolly , Rémy Drouilhet , Jean-François Robineau

We generalize the so-called density approach to Stein characterizations of probability distributions. We prove an elementary factorization property of the resulting Stein operator in terms of a generalized (standardized) score function. We…

Probability · Mathematics 2011-11-11 Christophe Ley , Yvik Swan

We prove lower bounds on the error of any estimator for the mean of a real probability distribution under the knowledge that the distribution belongs to a given set. We apply these lower bounds both to parametric and nonparametric…

Statistics Theory · Mathematics 2024-03-05 Rémy Degenne , Timothée Mathieu

In this paper, we investigate the problem of classifying feature vectors with mutually independent but non-identically distributed elements. First, we show the importance of this problem. Next, we propose a classifier and derive an…

Machine Learning · Computer Science 2021-09-01 Farzad Shahrivari , Nikola Zlatanov

Estimators based on influence functions (IFs) have been shown to be effective in many settings, especially when combined with machine learning techniques. By focusing on estimating a specific target of interest (e.g., the average effect of…

Methodology · Statistics 2019-10-29 Aaron Fisher , Edward H. Kennedy

We provide a new perspective on Stein's so-called density approach by introducing a new operator and characterizing class which are valid for a much wider family of probability distributions on the real line. We prove an elementary…

Probability · Mathematics 2013-04-05 Christophe Ley , Yvik Swan

We observe a large number of functions differing from each other only by a translation parameter. While the main pattern is unknown, we propose to estimate the shift parameters using $M$-estimators. Fourier transform enables to transform…

Statistics Theory · Mathematics 2007-12-18 Fabrice Gamboa , Jean-Michel Loubes , Elie Maza

This paper provides general matrix formulas for computing the score function, the (expected and observed) Fisher information and the $\Delta$ matrices (required for the assessment of local influence) for a quite general model which includes…

Methodology · Statistics 2021-09-17 Alexandre G. Patriota

We define an integral, the distributional integral of functions of one real variable, that is more general than the Lebesgue and the Denjoy-Perron-Henstock-Kurzweil integrals, and which allows the integration of functions with…

Functional Analysis · Mathematics 2013-11-12 Ricardo Estrada , Jasson Vindas

The concept of Shannon entropy of random variables was generalized to measurable functions in general, and to simple functions with finite values in particular. It is shown that the information measure of a function is related to the time…

Information Theory · Computer Science 2017-01-25 Guo Zhao

Representations for the generating functionals of static correlators of $z$-components of spins in the XY and $XX$ Heisenberg spin chains are obtained in the form of sums of the fermionic functional integrals. The peculiarity of the…

Mathematical Physics · Physics 2007-05-23 C. Malyshev

In this paper, a new identity for convex functions is derived. A consequence of the identity is that we can derive new estimates for the remainder term of the midpoint, trapezoid, and Simpson formulae for functions whose derivatives in…

Classical Analysis and ODEs · Mathematics 2012-07-31 Imdat Iscan

In this paper, we use a unified framework introduced in [3] to study two classes of nonconforming immersed finite element (IFE) spaces with integral value degrees of freedom. The shape functions on interface elements are piecewise…

Numerical Analysis · Mathematics 2018-10-19 Ruchi Guo , Tao Lin , Xu Zhang