English
Related papers

Related papers: Fast Maximum Likelihood Estimation and Supervised …

200 papers

A new method for multinomial inference is proposed by representing the cell probabilities as unordered segments on the unit interval and following Dempster-Shafer (DS) theory. The resulting DS posterior is then strengthened to improve…

Methodology · Statistics 2024-10-10 Earl C. Lawrence , Alexander C. Murph , Scott A. Vander Wiel , Chaunhai Liu

Training machine learning and statistical models often involves optimizing a data-driven risk criterion. The risk is usually computed with respect to the empirical data distribution, but this may result in poor and unstable out-of-sample…

Machine Learning · Statistics 2024-11-11 Nicola Bariletto , Nhat Ho

We consider optimal designs for general multinomial logistic models, which cover baseline-category, cumulative, adjacent-categories, and continuation-ratio logit models, with proportional odds, non-proportional odds, or partial proportional…

Statistics Theory · Mathematics 2019-02-19 Xianwei Bu , Dibyen Majumdar , Jie Yang

We consider the estimation of Dirichlet Process Mixture Models (DPMMs) in distributed environments, where data are distributed across multiple computing nodes. A key advantage of Bayesian nonparametric models such as DPMMs is that they…

Machine Learning · Statistics 2017-09-20 Ruohui Wang , Dahua Lin

Many popular Bayesian nonparametric priors can be characterized in terms of exchangeable species sampling sequences. However, in some applications, exchangeability may not be appropriate. We introduce a {novel and probabilistically coherent…

Statistics Theory · Mathematics 2015-03-17 Edoardo M. Airoldi , Thiago Costa , Federico Bassetti , Fabrizio Leisen , Michele Guindani

Linear mixed effects models are widely used in statistical modelling. We consider a mixed effects model with Bayesian variable selection in the random effects using spike-and-slab priors and developed a variational Bayes inference scheme…

Methodology · Statistics 2024-08-15 M-Z. Spyropoulou , J. Hopker , J. E. Griffin

We present a novel Bayesian inference tool that uses a neural network to parameterise efficient Markov Chain Monte-Carlo (MCMC) proposals. The target distribution is first transformed into a diagonal, unit variance Gaussian by a series of…

Cosmology and Nongalactic Astrophysics · Physics 2020-06-03 Adam Moss

Deep learning methodologies have been employed in several different fields, with an outstanding success in image recognition applications, such as material quality control, medical imaging, autonomous driving, etc. Deep learning models rely…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Saul Calderon-Ramirez , Shengxiang Yang , David Elizondo

Multivariate extreme value statistical analysis is concerned with observations on several variables which are thought to possess some degree of tail-dependence. In areas such as the modeling of financial and insurance risks, or as the…

Applications · Statistics 2014-12-31 Alexis Bienvenüe , Christian Y. Robert

Maximum entropy (MAXENT) method has a large number of applications in theoretical and applied machine learning, since it provides a convenient non-parametric tool for estimating unknown probabilities. The method is a major contribution of…

Data Analysis, Statistics and Probability · Physics 2020-12-18 A. E. Allahverdyan , N. H. Martirosyan

This paper considers statistical inference for the explained variance $\beta^{\intercal}\Sigma \beta$ under the high-dimensional linear model $Y=X\beta+\epsilon$ in the semi-supervised setting, where $\beta$ is the regression vector and…

Methodology · Statistics 2020-12-01 T. Tony Cai , Zijian Guo

Bayesian supervised predictive classifiers, hypothesis testing, and parametric estimation under Partition Exchangeability are implemented. The two classifiers presented are the marginal classifier (that assumes test data is i.i.d.) next to…

Computation · Statistics 2021-12-06 Ville Kinnula , Jing Tang , Ali Amiryousefi

Dirichlet distributions are commonly used for modeling vectors in a probability simplex. When used as a prior or a proposal distribution, it is natural to set the mean of a Dirichlet to be equal to the location where one wants the…

Methodology · Statistics 2024-10-18 Catherine Xue , Alessandro Zito , Jeffrey W. Miller

Stochastic variational inference (SVI) is emerging as the most promising candidate for scaling inference in Bayesian probabilistic models to large datasets. However, the performance of these methods has been assessed primarily in the…

Machine Learning · Statistics 2015-06-29 Amar Shah , David A. Knowles , Zoubin Ghahramani

Full likelihood-based inference for high-dimensional multivariate extreme value distributions, or max-stable processes, is feasible when incorporating occurrence times of the maxima; without this information, $d$-dimensional likelihood…

Methodology · Statistics 2015-04-01 J. L. Wadsworth

In many modern applications, a carefully designed primary study provides individual-level data for interpretable modeling, while summary-level external information is available through black-box, efficient, and nonparametric…

Methodology · Statistics 2026-04-07 Chi-Shian Dai , Jun Shao

Three different inferential problems related to a two dimensional categorical data from a Bayesian perspective have been discussed in this article. Conjugate prior distribution with symmetric and asymmetric hyper parameters are considered.…

Statistics Theory · Mathematics 2024-09-05 Samyajoy Pal , Christian Heumann , M. Subbiah

A new class of nonparametric prior distributions, termed Beta-Binomial stick-breaking process, is proposed. By allowing the underlying length random variables to be dependent through a Beta marginals Markov chain, an appealing discrete…

Statistics Theory · Mathematics 2020-08-12 María F. Gil-Leyva , Ramsés H. Mena , Theodoros Nicoleris

We use the delta method and Stein's method to derive, under regularity conditions, explicit upper bounds for the distributional distance between the distribution of the maximum likelihood estimator (MLE) of a $d$-dimensional parameter and…

Statistics Theory · Mathematics 2020-02-04 Andreas Anastasiou , Robert E. Gaunt

Many statistical analyses involve the comparison of multiple data sets collected under different conditions in order to identify the difference in the underlying distributions. A common challenge in multi-sample comparison is the presence…

Methodology · Statistics 2016-04-07 Li Ma , Jacopo Soriano