English
Related papers

Related papers: Variable Second-Order Inclusion Probabilities as a…

200 papers

In this paper, the worst-case probability measure over the data is introduced as a tool for characterizing the generalization capabilities of machine learning algorithms. More specifically, the worst-case probability measure is a Gibbs…

Machine Learning · Computer Science 2023-12-20 Xinying Zou , Samir M. Perlaza , Iñaki Esnaola , Eitan Altman

Variational inference is a popular method for estimating model parameters and conditional distributions in hierarchical and mixed models, which arise frequently in many settings in the health, social, and biological sciences. Variational…

Methodology · Statistics 2019-01-10 Ted Westling , Tyler H. McCormick

In this paper, we propose a general model for plane-based clustering. The general model contains many existing plane-based clustering methods, e.g., k-plane clustering (kPC), proximal plane clustering (PPC), twin support vector clustering…

Machine Learning · Computer Science 2020-09-24 Zhen Wang , Yuan-Hai Shao , Lan Bai , Chun-Na Li , Li-Ming Liu

We propose a deep and interpretable probabilistic generative model to analyze glyph shapes in printed Early Modern documents. We focus on clustering extracted glyph images into underlying templates in the presence of multiple confounding…

Machine Learning · Computer Science 2020-05-05 Kartik Goyal , Chris Dyer , Christopher Warren , Max G'Sell , Taylor Berg-Kirkpatrick

One of the fundamental problems in Bayesian statistics is the approximation of the posterior distribution. Gibbs sampler and coordinate ascent variational inference are renownedly utilized approximation techniques that rely on stochastic…

Statistics Theory · Mathematics 2021-06-18 Se Yoon Lee

Let $ k >0 $ be an integer and $ Y $ a standard Gamma$(k)$ distributed random variable. Let $ X $ be an independent positive random variable with a density that is hyperbolically monotone (HM) of order $ k.$ Then $Y\cdot X$ and $Y/X $ both…

Probability · Mathematics 2015-08-28 Anita Behme , Lennart Bondesson

Generative flow networks (GFlowNets) are amortized variational inference algorithms that are trained to sample from unnormalized target distributions over compositional objects. A key limitation of GFlowNets until this time has been that…

The focus of modern biomedical studies has gradually shifted to explanation and estimation of joint effects of high dimensional predictors on disease risks. Quantifying uncertainty in these estimates may provide valuable insight into…

Methodology · Statistics 2021-03-09 Zhe Fei , Yi Li

Two popular approaches for relating correlated measurements of a non-Gaussian response variable to a set of predictors are to fit a marginal model using generalized estimating equations and to fit a generalized linear mixed model by…

Methodology · Statistics 2017-02-23 Jeffrey J. Gory , Peter F. Craigmile , Steven N. MacEachern

Generalization and invariance are two essential properties of any machine learning model. Generalization captures a model's ability to classify unseen data while invariance measures consistency of model predictions on transformations of the…

Machine Learning · Computer Science 2022-07-15 Weijian Deng , Stephen Gould , Liang Zheng

For general thinning procedures, its inverse operation, the condensing, is studied and a link to integration-by-parts formulas is established. This extends the recent results on that link for independent thinnings of point processes to…

Probability · Mathematics 2017-04-26 Mathias Rafler

Many problems in the geophysical sciences demand the ability to calibrate the parameters and predict the time evolution of complex dynamical models using sequentially-collected data. Here we introduce a general methodology for the joint…

Computation · Statistics 2018-12-12 Sara Pérez-Vieites , Inés P. Mariño , Joaquín Míguez

In this paper, a scale mixture of Normal distributions model is developed for classification and clustering of data having outliers and missing values. The classification method, based on a mixture model, focuses on the introduction of…

Machine Learning · Statistics 2017-11-23 G. Revillon , A. Djafari , C. Enderli

Diffusion probabilistic models excel at sampling new images from learned distributions. Originally motivated by drift-diffusion concepts from physics, they apply image perturbations such as noise and blur in a forward process that results…

Image and Video Processing · Electrical Eng. & Systems 2024-06-07 Pascal Peter

Bayesian statistical inference for Generalized Linear Models (GLMs) with parameters lying on a constrained space is of general interest (e.g., in monotonic or convex regression), but often constructing valid prior distributions supported on…

Methodology · Statistics 2021-09-02 Rahul Ghosal , Sujit K. Ghosh

Classical learning theory suggests that the optimal generalization performance of a machine learning model should occur at an intermediate model complexity, with simpler models exhibiting high bias and more complex models exhibiting high…

Machine Learning · Statistics 2020-11-09 Ben Adlam , Jeffrey Pennington

We propose a method to efficiently integrate truncated probability densities. The method uses Markov chain Monte Carlo method to sample from a probability density matching the function being integrated. The required normalisation or…

Computation · Statistics 2013-12-10 A. John Arul , Kannan Iyer

The main principle of stacked generalization (or Stacking) is using a second-level generalizer to combine the outputs of base classifiers in an ensemble. In this paper, we investigate different combination types under the stacking…

Machine Learning · Computer Science 2011-06-10 Mehmet Umut Sen , Hakan Erdogan

The variance of the concentration in a sample can be estimated using knowledge of the particle masses, concentrations and the parameter for the dependent selection of particles. A number of variance estimators are constructed including a…

Applications · Statistics 2010-05-18 B. Geelhoed

Dynamic factor models are often estimated by point-estimation methods, disregarding parameter uncertainty. We propose a method accounting for parameter uncertainty by means of posterior approximation, using variational inference. Our…

Methodology · Statistics 2022-10-14 Erik Spånberg