English
Related papers

Related papers: Bayesian Estimation and Comparison of Moment Condi…

200 papers

As Basu (1977) writes, "Eliminating nuisance parameters from a model is universally recognized as a major problem of statistics," but after more than 50 years since Basu wrote these words, the two mainstream schools of thought in statistics…

Methodology · Statistics 2023-09-26 Ryan Martin

Some statistical models are specified via a data generating process for which the likelihood function cannot be computed in closed form. Standard likelihood-based inference is then not feasible but the model parameters can be inferred by…

Computation · Statistics 2015-02-20 Michael U. Gutmann , Jukka Corander , Ritabrata Dutta , Samuel Kaski

In Econometrics, imposing restrictions without assuming underlying distributions to modelize complex realities is a valuable methodological tool. However, if a subset of restrictions were not correctly specified, the usual test-statistics…

Methodology · Statistics 2015-10-29 Angel Felipe , Nirian Martín , Pedro Miranda , Leandro Pardo

Targeted maximum likelihood estimation (TMLE) is a general method for estimating parameters in semiparametric and nonparametric models. Each iteration of TMLE involves fitting a parametric submodel that targets the parameter of interest. We…

Methodology · Statistics 2014-06-03 Iván Díaz , Michael Rosenblum

Machine learning models in high-stakes applications, such as recidivism prediction and automated personnel selection, often exhibit systematic performance disparities across sensitive subpopulations, raising critical concerns regarding…

Machine Learning · Statistics 2026-02-13 Jie Tang , Chuanlong Xie , Xianli Zeng , Lixing Zhu

We propose a semiparametric framework for causal inference with right-censored survival outcomes and many weak invalid instruments, motivated by Mendelian randomization in biobank studies where classical methods may fail. We adopt an…

Methodology · Statistics 2025-10-06 Qiushi Bu , Wen Su , Xingqiu Zhao , Zhonghua Liu

Marginal likelihood, also known as model evidence, is a fundamental quantity in Bayesian statistics. It is used for model selection using Bayes factors or for empirical Bayes tuning of prior hyper-parameters. Yet, the calculation of…

Methodology · Statistics 2024-09-04 Anindya Bhadra , Ksheera Sagar , David Rowe , Sayantan Banerjee , Jyotishka Datta

In statistical practice, a realistic Bayesian model for a given data set can be defined by a likelihood function that is analytically or computationally intractable, due to large data sample size, high parameter dimensionality, or complex…

Methodology · Statistics 2019-03-19 George Karabatsos , Fabrizio Leisen

We develop an empirical likelihood (EL) framework for random forests and related ensemble methods, providing a likelihood-based approach to quantify their statistical uncertainty. Exploiting the incomplete $U$-statistic structure inherent…

Machine Learning · Statistics 2025-11-19 Harold D. Chiang , Yukitoshi Matsushita , Taisuke Otsu

Given a set of possible models (e.g., Bayesian network structures) and a data sample, in the unsupervised model selection problem the task is to choose the most accurate model with respect to the domain joint probability distribution. In…

Machine Learning · Computer Science 2013-01-18 Sanjoy Dasgupta , Leonard Schulman

In statistics, there are a variety of methods for performing model selection that all stem from slightly different paradigms of statistical inference. The reasons for choosing one particular method over another seem to be based entirely on…

Statistics Theory · Mathematics 2019-01-29 Danica M. Ommen , Christopher P. Saunders

Empirical risk minimization (ERM) is typically designed to perform well on the average loss, which can result in estimators that are sensitive to outliers, generalize poorly, or treat subgroups unfairly. While many methods aim to address…

Machine Learning · Computer Science 2021-03-18 Tian Li , Ahmad Beirami , Maziar Sanjabi , Virginia Smith

How do we compare between hypotheses that are entirely consistent with observations? The marginal likelihood (aka Bayesian evidence), which represents the probability of generating our observations from a prior, provides a distinctive…

Machine Learning · Computer Science 2023-05-03 Sanae Lotfi , Pavel Izmailov , Gregory Benton , Micah Goldblum , Andrew Gordon Wilson

In computational mechanics, multiple models are often present to describe a physical system. While Bayesian model selection is a helpful tool to compare these models using measurement data, it requires the computationally expensive…

Computation · Statistics 2025-04-14 Subhayan De , Reza Farzad , Patrick T. Brewick , Erik A. Johnson , Steven F. Wojtkiewicz

Exponential random graph models are an important tool in the statistical analysis of data. However, Bayesian parameter estimation for these models is extremely challenging, since evaluation of the posterior distribution typically involves…

Computation · Statistics 2017-05-05 Lampros Bouranis , Nial Friel , Florian Maire

This paper presents a study of the large-sample behavior of the posterior distribution of a structural parameter which is partially identified by moment inequalities. The posterior density is derived based on the limited information…

Statistics Theory · Mathematics 2010-01-13 Yuan Liao , Wenxin Jiang

This paper aims at developing a quasi-Bayesian analysis of the nonparametric instrumental variables model, with a focus on the asymptotic properties of quasi-posterior distributions. In this paper, instead of assuming a distributional…

Statistics Theory · Mathematics 2013-11-21 Kengo Kato

Nested error regression models are useful tools for analysis of grouped data, especially in the case of small area estimation. This paper suggests a nested error regression model using uncertain random effects in which the random effect in…

Methodology · Statistics 2017-02-28 Shonosuke Sugasawa , Tatsuya Kubokawa

Good large sample performance is typically a minimum requirement of any model selection criterion. This article focuses on the consistency property of the Bayes factor, a commonly used model comparison tool, which has experienced a recent…

Statistics Theory · Mathematics 2016-07-04 Siddhartha Chib , Todd A. Kuffner

The practice of employing empirical likelihood (EL) components in place of parametric likelihood functions in the construction of Bayesian-type procedures has been well-addressed in the modern statistical literature. We rigorously derive…

Methodology · Statistics 2018-08-21 Albert Vexler , Li Zou , Alan D. Hutson