中文
相关论文

相关论文: Some relations between mutual information and esti…

200 篇论文

For a continuous-input-continuous-output arbitrarily distributed quantum channel carrying classical information, the channel capacity can be computed in terms of the distribution of the channel envelope, received signal strength over a…

信息论 · 计算机科学 2022-06-09 Mouli Chakraborty , Harun Siljak , Indrakshi Dey , Nicola Marchetti

For continuous-time linear stochastic dynamical systems driven by Wiener processes, we consider the problem of designing ensemble filters when the observation process is randomly time-sampled. We propose a continuous-discrete McKean--Vlasov…

最优化与控制 · 数学 2024-06-21 Aneel Tanwani , Olga Yufereva

In recent years, a number of results have been developed which connect information measures and estimation measures under various models, including, predominently, Gaussian and Poisson models. More recent results due to Taborda and…

信息论 · 计算机科学 2012-08-01 Dongning Guo

This paper provides a unified framework for analyzing tensor estimation problems that allow for nonlinear observations, heteroskedastic noise, and covariate information. We study a general class of high-dimensional models where each…

信息论 · 计算机科学 2025-06-10 Riccardo Rossetti , Galen Reeves

Causal inference from observational data requires assumptions. These assumptions range from measuring confounders to identifying instruments. Traditionally, causal inference assumptions have focused on estimation of effects for a single…

机器学习 · 统计学 2019-03-04 Rajesh Ranganath , Adler Perotte

Several problems in statistics involve the combination of high-variance unbiased estimators with low-variance estimators that are only unbiased under strong assumptions. A notable example is the estimation of causal effects while combining…

统计方法学 · 统计学 2023-05-25 Michael Oberst , Alexander D'Amour , Minmin Chen , Yuyan Wang , David Sontag , Steve Yadlowsky

We propose an approach to estimate the effect of multiple simultaneous interventions in the presence of hidden confounders. To overcome the problem of hidden confounding, we consider the setting where we have access to not only the…

统计方法学 · 统计学 2020-06-17 Sorawit Saengkyongam , Ricardo Silva

The particle filter is a popular Bayesian filtering algorithm for use in cases where the state-space model is nonlinear and/or the random terms (initial state or noises) are non-Gaussian distributed. We study the behavior of the error in…

统计计算 · 统计学 2019-03-29 Ziyu Liu , Shihong Wei , James C. Spall

The era of big data has witnessed an increasing availability of multiple data sources for statistical analyses. We consider estimation of causal effects combining big main data with unmeasured confounders and smaller validation data with…

统计方法学 · 统计学 2021-08-24 Shu Yang , Peng Ding

The concept of causality is fundamental to numerous scientific explanations; however, its extension to the quantum regime has yet to be rigorously explored. This letter introduces the development of a quantum causal index, a novel extension…

量子物理 · 物理学 2025-11-03 Anupam Ghosh

We describe a method for inferring linear causal relations among multi-dimensional variables. The idea is to use an asymmetry between the distributions of cause and effect that occurs if both the covariance matrix of the cause and the…

机器学习 · 统计学 2009-09-25 Dominik Janzing , Patrik O. Hoyer , Bernhard Schoelkopf

Estimating mutual information (MI) is a fundamental task in data science and machine learning. Existing estimators mainly rely on either highly flexible models (e.g., neural networks), which require large amounts of data, or overly…

机器学习 · 计算机科学 2025-10-27 Yanzhi Chen , Zijing Ou , Adrian Weller , Michael U. Gutmann

Establishing causal relations between random variables from observational data is perhaps the most important challenge in today's \blue{science}. In remote sensing and geosciences this is of special relevance to better understand the…

统计方法学 · 统计学 2020-12-10 Adrián Pérez-Suay , Gustau Camps-Valls

There has been definite progress recently in proving the variational single-letter formula given by the heuristic replica method for various estimation problems. In particular, the replica formula for the mutual information in the case of…

信息论 · 计算机科学 2018-11-16 Jean Barbier , Nicolas Macris , Antoine Maillard , Florent Krzakala

A waveform channel is considered where the transmitted signal is corrupted by Wiener phase noise and additive white Gaussian noise. A discrete-time channel model that takes into account the effect of filtering on the phase noise is…

信息论 · 计算机科学 2017-08-15 Hassan Ghozlan , Gerhard Kramer

Causal inference from observational data following the restricted structural causal models (SCM) framework hinges largely on the asymmetry between cause and effect from the data generating mechanisms, such as non-Gaussianity or…

机器学习 · 计算机科学 2024-05-30 Kang Du , Yu Xiang

The I-MMSE formula connects two important quantities in information theory and estimation theory: the mutual information and the minimum mean-squared error (MMSE). It states that in a scalar Gaussian channel, the derivative of the mutual…

信息论 · 计算机科学 2024-08-27 Minh-Toan Nguyen

{We consider the problem of estimating causal influences between observed processes from time series possibly corrupted by errors in the time variable (dating errors) which are typical in palaeoclimatology, planetary science and…

数据分析、统计与概率 · 物理学 2020-04-20 D. A. Smirnov , N. Marwan , S. F. M. Breitenbach , F. Lechleitner , J. Kurths

Causal inference is to estimate the causal effect in a causal relationship when intervention is applied. Precisely, in a causal model with binary interventions, i.e., control and treatment, the causal effect is simply the difference between…

机器学习 · 计算机科学 2022-07-19 Zhenyu Lu , Yurong Cheng , Mingjun Zhong , George Stoian , Ye Yuan , Guoren Wang

In this paper, we study Sibson's $\alpha$-mutual information in the context of the additive Gaussian noise channel. While the classical case $\alpha = 1$ is well understood and admits deep connections to estimation-theoretic quantities,…

信息论 · 计算机科学 2026-04-14 Mohammad Milanian , Alex Dytso , Martina Cardone