English
Related papers

Related papers: Closed-Form Gaussian Estimators for Multi-Source P…

200 papers

We present two classes of improved estimators for mutual information $M(X,Y)$, from samples of random points distributed according to some joint probability density $\mu(x,y)$. In contrast to conventional estimators based on binnings, they…

Statistical Mechanics · Physics 2009-11-10 Alexander Kraskov , Harald Stoegbauer , Peter Grassberger

In this work, we extend the sparse iterative covariance-based estimator (SPICE), by generalizing the formulation to allow for different norm constraints on the signal and noise parameters in the covariance model. For a given norm, the…

Methodology · Statistics 2017-04-21 Johan Swärd , Stefan Ingi Adalbjörnsson , Andreas Jakobsson

Efficient information processing is crucial for both living organisms and engineered systems. The mutual information rate, a core concept of information theory, quantifies the amount of information shared between the trajectories of input…

Molecular Networks · Quantitative Biology 2025-09-01 Manuel Reinhardt , Age J. Tjalma , Anne-Lena Moor , Christoph Zechner , Pieter Rein ten Wolde

Generalized additive index models (GAIMs) offer a flexible semiparametric framework for capturing complex data relationships, balancing the interpretability of parametric models with the flexibility of nonparametric approaches. However,…

Methodology · Statistics 2026-05-29 Ziyu Peng , Linglingzhi Zhu , Yao Xie

Optimal experimental design (OED) is a framework that leverages a mathematical model of the experiment to identify optimal conditions for conducting the experiment. Under a Bayesian approach, the design objective function is typically…

Computation · Statistics 2026-01-27 Thomas E. Coons , Xun Huan

This paper proposes a flexible Bayesian approach to multiple imputation using conditional Gaussian mixtures. We introduce novel shrinkage priors for covariate-dependent mixing proportions in the mixture models to automatically select the…

Methodology · Statistics 2022-08-17 Shonosuke Sugasawa , Jae Kwang Kim , Kosuke Morikawa

For many applications with multivariate data, random field models capturing departures from Gaussianity within realisations are appropriate. For this reason, we formulate a new class of multivariate non-Gaussian models based on systems of…

Methodology · Statistics 2020-01-01 David Bolin , Jonas Wallin

In this paper we propose and study a general class of Gaussian Semiparametric Estimators (GSE) of the fractional differencing parameter in the context of long-range dependent multivariate time series. We establish large sample properties of…

Statistics Theory · Mathematics 2022-11-16 Guilherme Pumi , Sílvia R. C. Lopes

The large-scale multiple testing inherent to high throughput biological data necessitates very high statistical stringency and thus true effects in data are difficult to detect unless they have high effect sizes. One solution to this…

Methodology · Statistics 2017-12-21 Mohamad S. Hasan

Fusing measurements from multiple, heterogeneous, partial sources, observing a common object or process, poses challenges due to the increasing availability of numbers and types of sensors. In this work we propose, implement and validate an…

In this paper, we propose and investigate closed-form point estimators for a weighted exponential family. We also develop a bias-reduced version of these proposed closed-form estimators through bootstrap methods. Estimators are assessed…

Methodology · Statistics 2024-05-28 Roberto Vila , Eduardo Nakano , Helton Saulo

In the era of big data, integrating multi-source functional data to extract a subspace that captures the shared subspace across sources has attracted considerable attention. In practice, data collection procedures often follow…

Methodology · Statistics 2025-10-16 Chi Zhang , Peijun Sang , Yingli Qin

Most simulation schemes for partial differential equations (PDEs) focus on minimizing a simple error norm of a discretized version of a field. This paper takes a fundamentally different approach; the discretized field is interpreted as data…

Methodology · Statistics 2018-04-18 Reimar H. Leike , Torsten A. Enßlin

Recent years have experienced increasing utilization of complex machine learning models across multiple sources of data to inform more generalizable decision-making. However, distribution shifts across data sources and privacy concerns…

Methodology · Statistics 2024-05-16 Yi Liu , Alexander W. Levis , Sharon-Lise Normand , Larry Han

The estimation of information measures of continuous distributions based on samples is a fundamental problem in statistics and machine learning. In this paper, we analyze estimates of differential entropy in $K$-dimensional Euclidean space,…

Information Theory · Computer Science 2021-11-29 Georg Pichler , Pablo Piantanida , Günther Koliander

We propose PACE-GGM, a data-adaptive differentially private method for covariance estimation that concentrates its privacy budget on the most informative entries of the empirical covariance matrix, rather than perturbing all entries. This…

Machine Learning · Computer Science 2026-05-26 Cecilia Ferrando , Miguel Fuentes , Brett Mullins , Cameron Musco , Daniel Sheldon

The era of big data has witnessed an increasing availability of multiple data sources for statistical analyses. We consider estimation of causal effects combining big main data with unmeasured confounders and smaller validation data with…

Methodology · Statistics 2021-08-24 Shu Yang , Peng Ding

Weighted conformal prediction (WCP) has been commonly used to quantify prediction uncertainty under covariate shift. However, the effectiveness of WCP relies heavily on the degree of overlap between the training and test covariate…

Methodology · Statistics 2026-04-02 Mufang Ying , Wenge Guo , Koulik Khamaru , Ying Hung

With the advent of artificial intelligence and machine learning, various domains of science and engineering communities have leveraged data-driven surrogates to model complex systems through fusing numerous sources of information (data)…

Statistical estimates from survey samples have traditionally been obtained via design-based estimators. In many cases, these estimators tend to work well for quantities such as population totals or means, but can fall short as sample sizes…

Methodology · Statistics 2020-09-15 Paul A. Parker , Scott H. Holan , Ryan Janicki