English
Related papers

Related papers: A note on numerical evaluation of conditional Akai…

200 papers

Estimating conditional mutual information (CMI) is an essential yet challenging step in many machine learning and data mining tasks. Estimating CMI from data that contains both discrete and continuous variables, or even discrete-continuous…

Information Theory · Computer Science 2021-01-14 Alexander Marx , Lincen Yang , Matthijs van Leeuwen

The statistical analysis of measurement data has become a key component of many quantum engineering experiments. As standard full state tomography becomes unfeasible for large dimensional quantum systems, one needs to exploit prior…

Quantum Physics · Physics 2012-11-27 Madalin Guta , Theodore Kypraios , Ian Dryden

Graphical models have long been studied in statistics as a tool for inferring conditional independence relationships among a large set of random variables. The most existing works in graphical modeling focus on the cases that the data are…

Methodology · Statistics 2022-12-12 Siqi Liang , Faming Liang

Regression models fitted to data can be assessed on their goodness of fit, though models with many parameters should be disfavored to prevent over-fitting. Statisticians' tools for this are little known to physical scientists. These include…

Methodology · Statistics 2013-05-28 Robert S. Maier

In statistical modeling area, the Akaike information criterion AIC, is a widely known and extensively used tool for model choice. The {\phi}-divergence test statistic is a recently developed tool for statistical model selection. The…

Methodology · Statistics 2011-10-28 Papa Ngom , Bertrand Ntep

Mixed-effect models are very popular for analyzing data with a hierarchical structure, e.g. repeated observations within subjects in a longitudinal design, patients nested within centers in a multicenter design. However, recently, due to…

Methodology · Statistics 2019-05-09 Abhik Ghosh , Magne Thoresen

We present a Bayesian mixture model for estimating the joint distribution of mixed ordinal, nominal, and continuous data conditional on a set of fixed variables. The model uses multivariate normal and categorical mixture kernels for the…

Methodology · Statistics 2016-07-14 Maria DeYoreo , Jerome P. Reiter

Fixed effect estimators of nonlinear panel data models suffer from the incidental parameter problem. This leads to two undesirable consequences in applied research: (1) point estimates are subject to large biases, and (2) confidence…

Econometrics · Economics 2022-04-18 Shuowen Chen

Offline data are both valuable and practical resources for teaching robots complex behaviors. Ideally, learning agents should not be constrained by the scarcity of available demonstrations, but rather generalize beyond the training…

Machine Learning · Computer Science 2024-12-13 Núria Armengol Urpí , Marco Bagatella , Marin Vlastelica , Georg Martius

Model selection is of fundamental importance to high dimensional modeling featured in many contemporary applications. Classical principles of model selection include the Kullback-Leibler divergence principle and the Bayesian principle,…

Statistics Theory · Mathematics 2016-05-12 Jinchi Lv , Jun S. Liu

We propose a fully Bayesian approach for causal inference with multivariate categorical data based on staged tree models, a class of probabilistic graphical models capable of representing asymmetric and context-specific dependencies. To…

Methodology · Statistics 2025-11-06 Andrea Cremaschi , Manuele Leonelli , Gherardo Varando

We consider a problem of clustering a sequence of multinomial observations by way of a model selection criterion. We propose a form of a penalty term for the model selection procedure. Our approach subsumes both the conventional AIC and BIC…

Machine Learning · Statistics 2015-08-17 Nam H. Lee , Runze Tang , Carey E. Priebe , Michael Rosen

The semiparametric estimation approach, which includes inverse-probability-weighted and doubly robust estimation using propensity scores, is a standard tool in causal inference, and it is rapidly being extended in various directions. On the…

Methodology · Statistics 2022-12-29 Takamichi Baba , Yoshiyuki Ninomiya

Clustered data is ubiquitous in a variety of scientific fields. In this paper, we propose a flexible and interpretable modeling approach, called grouped heterogenous mixture modeling, for clustered data, which models cluster-wise…

Methodology · Statistics 2020-02-10 Shonosuke Sugasawa

The era of big data has witnessed an increasing availability of observational data from mobile and social networking, online advertising, web mining, healthcare, education, public policy, marketing campaigns, and so on, which facilitates…

Machine Learning · Computer Science 2023-03-06 Zhixuan Chu , Ruopeng Li , Stephen Rathbun , Sheng Li

Most causal inference methods focus on estimating marginal average treatment effects, but many important causal estimands depend on the joint distribution of potential outcomes, including the probability of causation and proportions…

Methodology · Statistics 2025-10-16 Zach Shahn , David Madigan

In repeated measures factorial designs involving clustered units, parametric methods such as linear mixed effects models are used to handle within subject correlations. However, assumptions of these parametric models such as continuity and…

Methodology · Statistics 2021-04-13 Solomon W. Harrar , Yue Cui

We address the computational efficiency in solving the A-optimal Bayesian design of experiments problems for which the observational map is based on partial differential equations and, consequently, is computationally expensive to evaluate.…

Numerical Analysis · Mathematics 2023-08-14 Vinh Hoang , Luis Espath , Sebastian Krumscheid , Raúl Tempone

We go through the process of crafting a robust and numerically stable online algorithm for the computation of the Watanabe-Akaike information criteria (WAIC). We implement this algorithm in the NIMBLE software. The implementation is…

Computation · Statistics 2021-06-28 Joshua E. Hug , Christopher J. Paciorek

Despite the popularity of feature importance (FI) measures in interpretable machine learning, the statistical adequacy of these methods is rarely discussed. From a statistical perspective, a major distinction is between analyzing a…

Machine Learning · Statistics 2023-05-03 Kristin Blesch , David S. Watson , Marvin N. Wright