English
Related papers

Related papers: Information criteria for multistep ahead predictio…

200 papers

We propose a robust variable selection procedure using a divergence based M-estimator combined with a penalty function. It produces robust estimates of the regression parameters and simultaneously selects the important explanatory…

Methodology · Statistics 2020-01-01 Abhijit Mandal , Samiran Ghosh

The Information bottleneck method is an unsupervised non-parametric data organization technique. Given a joint distribution P(A,B), this method constructs a new variable T that extracts partitions, or clusters, over the values of A that are…

Machine Learning · Computer Science 2013-01-14 Nir Friedman , Ori Mosenzon , Noam Slonim , Naftali Tishby

Bayesian predictive densities when the observed data $x$ and the target variable $y$ to be predicted have different distributions are investigated by using the framework of information geometry. The performance of predictive densities is…

Statistics Theory · Mathematics 2015-03-27 Fumiyasu Komaki

We propose a Bayesian elastic net that uses empirical likelihood and develop an efficient tuning of Hamiltonian Monte Carlo for posterior sampling. The proposed model relaxes the assumptions on the identity of the error distribution,…

Methodology · Statistics 2022-07-20 Chul Moon , Adel Bedoui

We propose a general method to carry out a valid Bayesian analysis of a finite-dimensional `targeted' parameter in the presence of a finite-dimensional nuisance parameter. We apply our methods to causal inference based on estimating…

Methodology · Statistics 2026-02-03 Magid Sabbagh , David A. Stephens

Clinical prediction models provide a prediction (e.g., estimated risk) for each individual, typically expressed as a point estimate derived from a deterministic function such as a logistic regression equation. Such 'plug-in' predictions…

Methodology · Statistics 2026-05-20 Mohsen Sadatsafavi , Richard D. Riley

There is a growing interest in the so-called Bayesian Predictive Inference approach, which allows to perform Bayesian inference without specifying the likelihood and prior of the model, or the need of any MCMC. Instead, only a sequence of…

Statistics Theory · Mathematics 2025-09-30 Marco Battiston , Lorenzo Cappello

We consider finite-dimensional linear Gaussian Bayesian inverse problems with uncorrelated sensor measurements. In this setting, it is known that the expected information gain, quantified by the expected Kullback-Leibler divergence from the…

Optimization and Control · Mathematics 2025-05-12 Steven Maio , Alen Alexanderian

There is growing interest in Bayesian clinical trial designs with informative prior distributions, e.g. for extrapolation of adult data to pediatrics, or use of external controls. While the classical type I error is commonly used to…

Methodology · Statistics 2023-09-06 Nicky Best , Maxine Ajimi , Beat Neuenschwander , Gaelle Saint-Hilary , Simon Wandel

Inferring and comparing complex, multivariable probability density functions is fundamental to problems in several fields, including probabilistic learning, network theory, and data analysis. Classification and prediction are the two faces…

Information Theory · Computer Science 2017-03-30 David J. Galas , T. Gregory Dewey , James Kunert-Graf , Nikita A. Sakhanenko

Bayesian inference provides a flexible way of combining data with prior information. However, quantile regression is not equipped with a parametric likelihood, and therefore, Bayesian inference for quantile regression demands careful…

Statistics Theory · Mathematics 2012-07-24 Yunwen Yang , Xuming He

Feature selection and reducing the dimensionality of data is an essential step in data analysis. In this work, we propose a new criterion for feature selection that is formulated as conditional information between features given the labeled…

Machine Learning · Statistics 2019-05-20 Salimeh Yasaei Sekeh , Alfred O. Hero

Three different inferential problems related to a two dimensional categorical data from a Bayesian perspective have been discussed in this article. Conjugate prior distribution with symmetric and asymmetric hyper parameters are considered.…

Statistics Theory · Mathematics 2024-09-05 Samyajoy Pal , Christian Heumann , M. Subbiah

In this work, we develop an objective Bayesian framework for the Dhillon probability distribution. We explicitly derive three objective priors: the Jeffreys prior, the overall reference prior, and the maximal data information prior. We show…

We propose a new method for conducting Bayesian prediction that delivers accurate predictions without correctly specifying the unknown true data generating process. A prior is defined over a class of plausible predictive models. After…

Methodology · Statistics 2020-08-24 Ruben Loaiza-Maya , Gael M. Martin , David T. Frazier

We propose a two-component mixture of a noninformative (diffuse) and an informative prior distribution, weighted through the data in such a way to prefer the first component if a prior-data conflict arises. The data-driven approach for…

Methodology · Statistics 2017-08-02 Leonardo Egidi , Francesco Pauli , Nicola Torelli

Motivated by the analysis of the distribution of university grades, which is usually asymmetric, we discuss two informative priors for the shape parameter of the skew-normal distribution, showing that they lead to closed-form…

Methodology · Statistics 2013-05-15 Antonio Canale , Bruno Scarpa

We discuss optimal prediction for families of probability distributions with a locally compact topological group structure. Right-invariant priors were previously shown to yield a posterior predictive distribution minimizing the worst-case…

Statistics Theory · Mathematics 2025-08-26 Jannis Bolik , Thomas Hofmann

A Bayesian approach to variable selection which is based on the expected Kullback-Leibler divergence between the full model and its projection onto a submodel has recently been suggested in the literature. Here we extend this idea by…

Methodology · Statistics 2009-01-30 David Nott , Chenlei Leng

Given a random sample from a distribution with density function that depends on an unknown parameter $\theta$, we are interested in accurately estimating the true parametric density function at a future observation from the same…

Statistics Theory · Mathematics 2009-09-29 Mihaela Aslan