English
Related papers

Related papers: Composite Marginal Likelihood Methods for Random U…

200 papers

As a critical task for large-scale commercial recommender systems, reranking has shown the potential of improving recommendation results by uncovering mutual influence among items. Reranking rearranges items in the initial ranking lists…

Information Retrieval · Computer Science 2022-02-15 Yunjia Xi , Weiwen Liu , Xinyi Dai , Ruiming Tang , Weinan Zhang , Qing Liu , Xiuqiang He , Yong Yu

Standard variational lower bounds used to train latent variable models produce biased estimates of most quantities of interest. We introduce an unbiased estimator of the log marginal likelihood and its gradients for latent variable models…

Machine Learning · Computer Science 2020-07-14 Yucen Luo , Alex Beatson , Mohammad Norouzi , Jun Zhu , David Duvenaud , Ryan P. Adams , Ricky T. Q. Chen

Variable clustering is important for explanatory analysis. However, only few dedicated methods for variable clustering with the Gaussian graphical model have been proposed. Even more severe, small insignificant partial correlations due to…

Applications · Statistics 2018-06-18 Daniel Andrade , Akiko Takeda , Kenji Fukumizu

Robust matrix completion (RMC) is a widely used machine learning tool that simultaneously tackles two critical issues in low-rank data analysis: missing data entries and extreme outliers. This paper proposes a novel scalable and learnable…

Machine Learning · Computer Science 2026-05-22 HanQin Cai , Chandra Kundu , Jialin Liu , Wotao Yin

We establish epigraphical and uniform laws of large numbers for sample-based approximations of law invariant risk functionals. These sample-based approximation schemes include Monte Carlo (MC) and certain randomized quasi-Monte Carlo…

Optimization and Control · Mathematics 2025-07-01 Olena Melnikov , Johannes Milz

List-wise based learning to rank methods are generally supposed to have better performance than point- and pair-wise based. However, in real-world applications, state-of-the-art systems are not from list-wise based camp. In this paper, we…

Information Retrieval · Computer Science 2019-09-17 Tian Xia , Shaodan Zhai , Shaojun Wang

We consider the problem of controlling an unknown stochastic linear system with quadratic costs - called the adaptive LQ control problem. We re-examine an approach called ''Reward Biased Maximum Likelihood Estimate'' (RBMLE) that was…

Optimization and Control · Mathematics 2023-03-27 Akshay Mete , Rahul Singh , P. R. Kumar

Motivated by the successes of deep learning, we propose a class of neural network-based discrete choice models, called RUMnets, inspired by the random utility maximization (RUM) framework. This model formulates the agents' random utility…

Machine Learning · Computer Science 2023-07-21 Ali Aouad , Antoine Désir

Prior work on input-token importance in auto-regressive transformers has relied on Softmax-normalized attention weights, which obscure the richer structure of pre-Softmax query-key logits. We introduce RCStat, a statistical framework that…

Computation and Language · Computer Science 2025-06-25 Debabrata Mahapatra , Shubham Agarwal , Apoorv Saxena , Subrata Mitra

Recently, based on the idea of randomizing space theory, random convex analysis has been being developed in order to deal with the corresponding problems in random environments such as analysis of conditional convex risk measures and the…

Functional Analysis · Mathematics 2017-09-11 Tiexin Guo , Erxin Zhang , Mingzhi Wu , Bixuan Yang , George Yuan , Xiaolin Zeng

We investigate the class of $\sigma$-stable Poisson-Kingman random probability measures (RPMs) in the context of Bayesian nonparametric mixture modeling. This is a large class of discrete RPMs which encompasses most of the the popular…

Computation · Statistics 2018-02-22 María Lomelí , Stefano Favaro , Yee Whye Teh

Generalized linear mixed models (GLMMs) are often used for analyzing correlated non-Gaussian data. The likelihood function in a GLMM is available only as a high dimensional integral, and thus closed-form inference and prediction are not…

Methodology · Statistics 2022-06-27 Vivekananda Roy

Plackett-Luce gradient estimation enables the optimization of stochastic ranking models within feasible time constraints through sampling techniques. Unfortunately, the computational complexity of existing methods does not scale well with…

Machine Learning · Computer Science 2022-04-29 Harrie Oosterhuis

In this paper, we focus on the problem of robustifying reinforcement learning (RL) algorithms with respect to model uncertainties. Indeed, in the framework of model-based RL, we propose to merge the theory of constrained Markov decision…

Machine Learning · Computer Science 2020-10-13 Reazul Hasan Russel , Mouhacine Benosman , Jeroen Van Baar

Conditional Restricted Boltzmann Machines (CRBMs) are rich probabilistic models that have recently been applied to a wide range of problems, including collaborative filtering, classification, and modeling motion capture data. While much…

Machine Learning · Computer Science 2012-02-20 Volodymyr Mnih , Hugo Larochelle , Geoffrey E. Hinton

In Bayesian inference for the Cox proportional hazards model, modeling the baseline hazard function is challenging. Recently, direct Bayesian inference using the partial likelihood is considered in the framework of general Bayesian…

Methodology · Statistics 2026-04-29 Tomohiro Ohigashi , Shunichiro Orihara , Shonosuke Sugasawa

The rebmix package provides R functions for random univariate and multivariate finite mixture model generation, estimation, clustering and classification. The paper is focused on multivariate normal mixture models with unrestricted…

Machine Learning · Statistics 2018-01-29 Marko Nagode

Energy-based models (EBMs) offer a flexible framework for parameterizing probability distributions using neural networks. However, learning EBMs by exact maximum likelihood estimation (MLE) is generally intractable, due to the need to…

Machine Learning · Computer Science 2025-08-20 Michael E. Sander , Vincent Roulet , Tianlin Liu , Mathieu Blondel

Inspired by the Reward-Biased Maximum Likelihood Estimate method of adaptive control, we propose RBMLE -- a novel family of learning algorithms for stochastic multi-armed bandits (SMABs). For a broad range of SMABs including both the…

Machine Learning · Computer Science 2020-10-26 Xi Liu , Ping-Chun Hsieh , Anirban Bhattacharya , P. R. Kumar

We establish a collection of closed-loop guarantees and propose a scalable optimization algorithm for distributionally robust model predictive control (DRMPC) applied to linear systems, convex constraints, and quadratic costs. Via standard…

Optimization and Control · Mathematics 2024-11-13 Robert D. McAllister , Peyman Mohajerin Esfahani