English
Related papers

Related papers: Scalable Estimation of Multinomial Response Models…

200 papers

A core problem in statistics and probabilistic machine learning is to compute probability distributions and expectations. This is the fundamental problem of Bayesian statistics and machine learning, which frames all inference as…

Machine Learning · Statistics 2024-12-06 Christian A. Naesseth , Fredrik Lindsten , Thomas B. Schön

Probabilistic databases play a crucial role in the management and understanding of uncertain data. However, incorporating probabilities into the semantics of incomplete databases has posed many challenges, forcing systems to sacrifice…

Databases · Computer Science 2015-03-17 Michael Wick , Andrew McCallum , Gerome Miklau

Practitioners of Bayesian statistics have long depended on Markov chain Monte Carlo (MCMC) to obtain samples from intractable posterior distributions. Unfortunately, MCMC algorithms are typically serial, and do not scale to the large…

Machine Learning · Statistics 2015-06-11 Maxim Rabinovich , Elaine Angelino , Michael I. Jordan

Bayesian multinomial logistic regression provides a principled, interpretable approach to multiclass classification, but posterior sampling becomes increasingly expensive as the model dimension grows. Prior work has studied scalability in…

Computation · Statistics 2026-02-27 Jared D. Fisher , Kyle R. McEvoy

We consider the problem of estimating the conditional distribution of a post-model-selection estimator where the conditioning is on the selected model. The notion of a post-model-selection estimator here refers to the combined procedure…

Statistics Theory · Mathematics 2007-11-06 Hannes Leeb , Benedikt M. Pötscher

A strong tool for the selection of items that share a common trait from a set of given items is proposed. The selection method is based on marginal estimates and exploits that the estimates of the standard deviation of the mixing…

Methodology · Statistics 2023-09-04 Gerhard Tutz

This paper generalises the exponential family GLM to allow arbitrary distributions for the response variable. This is achieved by combining the model-assisted regression approach from survey sampling with the GLM scoring algorithm, weighted…

Methodology · Statistics 2019-01-10 Murray Aitkin

Cross-classified data frequently arise in scientific fields such as education, healthcare, and social sciences. A common modeling strategy is to introduce crossed random effects within a regression framework. However, this approach often…

Methodology · Statistics 2025-07-22 Shota Takeishi , Shonosuke Sugasawa

The multinomial probit (MNP) model is widely used to analyze categorical outcomes due to its ability to capture flexible substitution patterns among alternatives. Conventional likelihood based and Markov chain Monte Carlo (MCMC) estimators…

Methodology · Statistics 2026-01-08 Gyeongjun Kim , Yeseul Kang , Lucas Kock , Prateek Bansal , Keemin Sohn

With the emergence of diverse data collection techniques, objects in real applications can be represented as multi-modal features. What's more, objects may have multiple semantic meanings. Multi-modal and Multi-label (MMML) problem becomes…

Machine Learning · Computer Science 2019-07-30 Yi Zhang , Cheng Zeng , Hao Cheng , Chongjun Wang , Lei Zhang

Modeling the dependence between outputs is a fundamental challenge in multilabel classification. In this work we show that a generic regularized nonlinearity mapping independent predictions to joint predictions is sufficient to achieve…

Machine Learning · Computer Science 2015-04-22 Nikos Karampatziakis , Paul Mineiro

Measuring public opinion at subnational geographies is critical to many theories in political science. Multilevel regression and post-stratification (MRP) is a popular tool for doing so, although existing work is limited to measuring…

Methodology · Statistics 2025-07-08 Max Goplerud , Michael Auslen

Categorical responses arise naturally within various scientific disciplines. In many circumstances, there is no predetermined order for the response categories, and the response has to be modeled as nominal. In this study, we regard the…

Statistics Theory · Mathematics 2024-03-20 Tianmeng Wang , Jie Yang

Motivated by real-world machine learning applications, we consider a statistical classification task in a sequential setting where test samples arrive sequentially. In addition, the generating distributions are unknown and only a set of…

Machine Learning · Statistics 2021-02-11 Mahdi Haghifam , Vincent Y. F. Tan , Ashish Khisti

We present a nonparametric Bayesian joint model for multivariate continuous and categorical variables, with the intention of developing a flexible engine for multiple imputation of missing values. The model fuses Dirichlet process mixtures…

Applications · Statistics 2015-10-14 Jared S. Murray , Jerome P. Reiter

Bayesian analyses combine information represented by different terms in a joint Bayesian model. When one or more of the terms is misspecified, it can be helpful to restrict the use of information from suspect model components to modify…

Methodology · Statistics 2022-06-27 Xuejun Yu , David J. Nott , Michael Stanley Smith

In this article, we investigate the use of a probabilistic model for unsupervised clustering in text collections. Unsupervised clustering has become a basic module for many intelligent text processing applications, such as information…

Information Retrieval · Computer Science 2016-08-16 Loïs Rigouste , Olivier Cappé , François Yvon

Recent advances in stochastic gradient techniques have made it possible to estimate posterior distributions from large datasets via Markov Chain Monte Carlo (MCMC). However, when the target posterior is multimodal, mixing performance is…

Machine Learning · Statistics 2018-01-12 Yizhe Zhang , Changyou Chen , Zhe Gan , Ricardo Henao , Lawrence Carin

Predicting the winner of an election is of importance to multiple stakeholders. To formulate the problem, we consider an independent sequence of categorical data with a finite number of possible outcomes in each. The data is assumed to be…

Applications · Statistics 2024-10-17 Soudeep Deb , Rishideep Roy , Shubhabrata Das

A new method for multinomial inference is proposed by representing the cell probabilities as unordered segments on the unit interval and following Dempster-Shafer (DS) theory. The resulting DS posterior is then strengthened to improve…

Methodology · Statistics 2024-10-10 Earl C. Lawrence , Alexander C. Murph , Scott A. Vander Wiel , Chaunhai Liu