English
Related papers

Related papers: E-Values for Exponential Families: the General Cas…

200 papers

Quality statistical inference requires a sufficient amount of data, which can be missing or hard to obtain. To this end, prediction-powered inference has risen as a promising methodology, but existing approaches are largely limited to…

Machine Learning · Statistics 2025-05-27 Daniel Csillag , Claudio José Struchiner , Guilherme Tegoni Goedert

In this paper, we propose a new class of distributions by exponentiating the random variables associated with the probability density functions of composite distributions. We also derive some mathematical properties of this new class of…

Methodology · Statistics 2022-04-05 Bowen Liu , Malwane M. A. Ananda

The use of objective prior in Bayesian applications has become a common practice to analyze data without subjective information. Formal rules usually obtain these priors distributions, and the data provide the dominant information in the…

Statistics Theory · Mathematics 2020-05-18 Pedro L. Ramos , Francisco A. Rodrigues , Eduardo Ramos , Dipak K. Dey , Francisco Louzada

The versatility of exponential families, along with their attendant convexity properties, make them a popular and effective statistical model. A central issue is learning these models in high-dimensions, such as when there is some sparsity…

Machine Learning · Computer Science 2015-05-19 Sham M. Kakade , Ohad Shamir , Karthik Sridharan , Ambuj Tewari

We develop e-values and e-processes testing the null hypothesis that a distribution over nonnegative integers is monotone, and that a distribution over integers is unimodal given a certain mode. Our e-processes lead to tests of power one…

Statistics Theory · Mathematics 2026-04-23 Hongjian Wang , Aaditya Ramdas

We study the properties of variational Bayes approximations for exponential family models with missing values. It is shown that the iterative algorithm for obtaining the variational Bayesian estimator converges locally to the true value…

Statistics Theory · Mathematics 2012-07-19 Bo Wang , D. Titterington

We study inference with a small labeled sample, a large unlabeled sample, and high-quality predictions from an external model. We link prediction-powered inference with empirical likelihood by stacking supervised estimating equations based…

Methodology · Statistics 2025-12-19 Guanghui Wang , Mengtao Wen , Changliang Zou

The asymptotic expansion of the distribution of the gradient test statistic is derived for a composite hypothesis under a sequence of Pitman alternative hypotheses converging to the null hypothesis at rate $n^{-1/2}$, $n$ being the sample…

Statistics Theory · Mathematics 2015-03-17 Artur Lemonte , Silvia Ferrari

We derive expressions for the predicitive information rate (PIR) for the class of autoregressive Gaussian processes AR(N), both in terms of the prediction coefficients and in terms of the power spectral density. The latter result suggests a…

Machine Learning · Statistics 2012-08-15 Samer A. Abdallah , Mark D. Plumbley

The $\lambda$-exponential family generalizes the standard exponential family via a generalized convex duality motivated by optimal transport. It is the constant-curvature analogue of the exponential family from the information-geometric…

Statistics Theory · Mathematics 2025-05-07 Xiwei Tian , Ting-Kam Leonard Wong , Jiaowen Yang , Jun Zhang

The growing availability of network data and of scientific interest in distributed systems has led to the rapid development of statistical models of network structure. Typically, however, these are models for the entire network, while the…

Statistics Theory · Mathematics 2022-03-18 Cosma Rohilla Shalizi , Alessandro Rinaldo

Given a composite null $ \mathcal P$ and composite alternative $ \mathcal Q$, when and how can we construct a p-value whose distribution is exactly uniform under the null, and stochastically smaller than uniform under the alternative?…

Statistics Theory · Mathematics 2024-12-03 Zhenyuan Zhang , Aaditya Ramdas , Ruodu Wang

We propose an e-value based framework for testing arbitrary composite nulls against composite alternatives, when an $\epsilon$ fraction of the data can be arbitrarily corrupted. Our tests are inherently sequential, being valid at arbitrary…

Methodology · Statistics 2025-12-25 Aytijhya Saha , Aaditya Ramdas

We propose using a discounted version of a convex combination of the log-likelihood with the corresponding expected log-likelihood such that when they are maximized they yield a filter, predictor and smoother for time series. This paper…

Methodology · Statistics 2026-04-29 Simon Donker van Heel , Neil Shephard

Consider a pair of random vectors $(\mathbf{X},\mathbf{Y}) $ and the conditional expectation operator $\mathbb{E}[\mathbf{X}|\mathbf{Y}=\mathbf{y}]$. This work studies analytic properties of the conditional expectation by characterizing…

Probability · Mathematics 2021-08-31 Alex Dytso , Martina Cardone

The Zellner's g-prior and its recent hierarchical extensions are the most popular default prior choices in the Bayesian variable selection context. These prior set-ups can be expressed power-priors with fixed set of imaginary data. In this…

Computation · Statistics 2013-07-10 Dimitris Fouskakis , Ioannis Ntzoufras

This paper studies power indices based on average representations of a weighted game. If restricted to account for the lack of power of dummy voters, average representations become coherent measures of voting power, with power distributions…

Computer Science and Game Theory · Computer Science 2017-10-10 Serguei Kaniovski , Sascha Kurz

Gaussian process training decomposes into inference of the (approximate) posterior and learning of the hyperparameters. For non-Gaussian (non-conjugate) likelihoods, two common choices for approximate inference are Expectation Propagation…

Machine Learning · Computer Science 2022-11-14 Rui Li , ST John , Arno Solin

The reciprocal of $e^{-x}$ has a power series about $0$ in which all coefficients are non-negative. Gessel [Reciprocals of exponential polynomials and permutation enumeration, Australas. J. Combin., 74, 2019] considered truncates of the…

Combinatorics · Mathematics 2023-05-25 David Galvin , John Engbers , Clifford Smyth

We tighten the Entropy Power Inequality (EPI) when one of the random summands is Gaussian. Our strengthening is closely connected to the concept of strong data processing for Gaussian channels and generalizes the (vector extension of)…

Information Theory · Computer Science 2016-02-10 Thomas A. Courtade