English
Related papers

Related papers: Posterior inference via Hill's prediction model

200 papers

Especially when facing reliability data with limited information (e.g., a small number of failures), there are strong motivations for using Bayesian inference methods. These include the option to use information from physics-of-failure or…

Methodology · Statistics 2022-10-27 Qinglong Tian , Colin Lewis-Beck , Jarad Niemi , William Meeker

Variational inference methods often focus on the problem of efficient model optimization, with little emphasis on the choice of the approximating posterior. In this paper, we review and implement the various methods that enable us to…

Machine Learning · Statistics 2017-07-11 Siddhartha Saxena , Shibhansh Dohare , Jaivardhan Kapoor

There is a growing interest in the so-called Bayesian Predictive Inference approach, which allows to perform Bayesian inference without specifying the likelihood and prior of the model, or the need of any MCMC. Instead, only a sequence of…

Statistics Theory · Mathematics 2025-09-30 Marco Battiston , Lorenzo Cappello

We extend conformal prediction methodology beyond the case of exchangeable data. In particular, we show that a weighted version of conformal prediction can be used to compute distribution-free prediction intervals for problems in which the…

Methodology · Statistics 2020-07-08 Ryan J. Tibshirani , Rina Foygel Barber , Emmanuel J. Candes , Aaditya Ramdas

The majority of the statisticians concluded many decades ago that fiducial inference was nonsensical to them. Hannig et al. (2016) and others have, however, contributed to a renewed interest and focus. Fiducial inference is similar to…

Methodology · Statistics 2021-12-15 G. Taraldsen , B. H. Lindquist

Preferential attachment is widely used to model power-law behavior of degree distributions in both directed and undirected networks. Practical analyses on the tail exponent of the power-law degree distribution use the Hill estimator as one…

Probability · Mathematics 2017-11-17 Tiandong Wang , Sidney Resnick

Bayesian inference offers benefits over maximum likelihood, but it also comes with computational costs. Computing the posterior is typically intractable, as is marginalizing that posterior to form the posterior predictive distribution. In…

Machine Learning · Computer Science 2023-07-18 Alexander A. Alemi , Ben Poole

We consider a general class of empirical-type likelihoods and develop higher order asymptotics with a view to characterizing members thereof that allow the existence of possibly data-dependent probability matching priors ensuring…

Statistics Theory · Mathematics 2008-12-18 Rahul Mukerjee

Likelihood-free inference refers to inference when a likelihood function cannot be explicitly evaluated, which is often the case for models based on simulators. Most of the literature is based on sample-based `Approximate Bayesian…

Machine Learning · Statistics 2018-11-22 Conor Durkan , George Papamakarios , Iain Murray

Many models in natural language processing define probabilistic distributions over linguistic structures. We argue that (1) the quality of a model' s posterior distribution can and should be directly evaluated, as to whether probabilities…

Computation and Language · Computer Science 2015-09-03 Khanh Nguyen , Brendan O'Connor

Credal sets are sets of probability distributions that are considered as candidates for an imprecisely known ground-truth distribution. In machine learning, they have recently attracted attention as an appealing formalism for uncertainty…

Machine Learning · Statistics 2024-02-19 Alireza Javanmardi , David Stutz , Eyke Hüllermeier

Consider binary observations whose response probability is an unknown smooth function of a set of covariates. Suppose that a prior on the response probability function is induced by a Gaussian process mapped to the unit interval through a…

Statistics Theory · Mathematics 2007-06-13 Subhashis Ghosal , Anindya Roy

Bayesian inference allows machine learning models to express uncertainty. Current machine learning models use only a single learnable parameter combination when making predictions, and as a result are highly overconfident when their…

Machine Learning · Computer Science 2022-02-23 Andrew Wood , Moshik Hershcovitch , Daniel Waddington , Sarel Cohen , Peter Chin

The field of distribution-free predictive inference provides tools for provably valid prediction without any assumptions on the distribution of the data, which can be paired with any regression algorithm to provide accurate and reliable…

Statistics Theory · Mathematics 2023-01-19 Michael Bian , Rina Foygel Barber

We consider the asymptotic behavior of posterior distributions and Bayes estimators based on observations which are required to be neither independent nor identically distributed. We give general results on the rate of convergence of the…

Statistics Theory · Mathematics 2009-09-29 Subhashis Ghosal , Aad van der Vaart

Bayesian models quantify uncertainty and facilitate optimal decision-making in downstream applications. For most models, however, practitioners are forced to use approximate inference techniques that lead to sub-optimal decisions due to…

Machine Learning · Statistics 2019-09-12 Tomasz Kuśmierczyk , Joseph Sakaya , Arto Klami

In the current insurance literature, prediction of insurance claims in the regression problem is often performed with a statistical model. This model-based approach may potentially suffer from several drawbacks: (i) model misspecification,…

Machine Learning · Statistics 2025-09-30 Liang Hong

Parameter inference is a fundamental problem in data-driven modeling. Given observed data that is believed to be a realization of some parameterized model, the aim is to find parameter values that are able to explain the observed data. In…

Data Structures and Algorithms · Computer Science 2016-04-20 Carlo Albert , Simone Ulzega , Ruedi Stoop

We consider a prior for nonparametric Bayesian estimation which uses finite random series with a random number of terms. The prior is constructed through distributions on the number of basis functions and the associated coefficients. We…

Statistics Theory · Mathematics 2015-02-10 Weining Shen , Subhashis Ghosal

This work presents a new methodology to obtain probabilistic interval predictions of a dynamical system. The proposed strategy uses stored past system measurements to estimate the future evolution of the system. The method relies on the use…

Systems and Control · Electrical Eng. & Systems 2021-12-21 A. Daniel Carnerero , Daniel R. Ramirez , Teodoro Alamo