English
Related papers

Related papers: Information criteria for non-normalized models

200 papers

We develop a general method for estimating a finite mixture of non-normalized models. Here, a non-normalized model is defined to be a parametric distribution with an intractable normalization constant. Existing methods for estimating…

Machine Learning · Statistics 2021-09-01 Takeru Matsuda , Aapo Hyvarinen

There are many models, often called unnormalized models, whose normalizing constants are not calculated in closed form. Maximum likelihood estimation is not directly applicable to unnormalized models. Score matching, contrastive divergence…

Machine Learning · Statistics 2018-08-27 Masatoshi Uehara , Takeru Matsuda , Fumiyasu Komaki

Many parametric statistical models are not properly normalised and only specified up to an intractable partition function, which renders parameter estimation difficult. Examples of unnormalised models are Gibbs distributions, Markov random…

Machine Learning · Statistics 2018-06-12 Ciwan Ceylan , Michael U. Gutmann

Several statistical models are given in the form of unnormalized densities, and calculation of the normalization constant is intractable. We propose estimation methods for such unnormalized models with missing data. The key concept is to…

Machine Learning · Statistics 2020-06-11 Masatoshi Uehara , Takeru Matsuda , Jae Kwang Kim

Noise-contrastive estimation (NCE) is a popular method for estimating unnormalised probabilistic models, such as energy-based models, which are effective for modelling complex data distributions. Unlike classical maximum likelihood (ML)…

Machine Learning · Statistics 2024-02-27 Amanda Olmin , Jakob Lindqvist , Lennart Svensson , Fredrik Lindsten

Unnormalized (or energy-based) models provide a flexible framework for capturing the characteristics of data with complex dependency structures. However, the application of standard Bayesian inference methods has been severely limited…

Methodology · Statistics 2026-03-11 Naruki Sonobe , Shonosuke Sugasawa , Daichi Mochihashi , Takeru Matsuda

A statistical model is said to be un-normalised when its likelihood function involves an intractable normalising constant. Two popular methods for parameter inference for these models are MC-MLE (Monte Carlo maximum likelihood estimation),…

Statistics Theory · Mathematics 2018-02-01 Lionel Riou-Durand , Nicolas Chopin

Models with unnormalized probability density functions are ubiquitous in statistics, artificial intelligence and many other fields. However, they face significant challenges in model selection if the normalizing constants are intractable.…

Methodology · Statistics 2025-11-11 Rong Bian , Kung-Sik Chan , Bing Cheng , Howell Tong

Noise Contrastive Estimation (NCE) is a powerful parameter estimation method for log-linear models, which avoids calculation of the partition function or its derivatives at each training step, a computationally demanding step in many cases.…

Computation and Language · Computer Science 2018-09-07 Zhuang Ma , Michael Collins

Unnormalised latent variable models are a broad and flexible class of statistical models. However, learning their parameters from data is intractable, and few estimation techniques are currently available for such models. To increase the…

Machine Learning · Statistics 2019-02-26 Benjamin Rhodes , Michael Gutmann

For propensity score analysis and sparse estimation, we develop an information criterion for determining the regularization parameters needed in variable selection. First, for Gaussian distribution-based causal inference models, we extend…

Methodology · Statistics 2022-04-22 Yoshiyuki Ninomiya

Estimating the score, i.e., the gradient of log density function, from a set of samples generated by an unknown distribution is a fundamental task in inference and learning of probabilistic models that involve flexible yet intractable…

Machine Learning · Statistics 2020-07-01 Yuhao Zhou , Jiaxin Shi , Jun Zhu

We consider constructing model selection criteria for evaluating nonlinear mixed effects models via basis expansions. Mean functions and random functions in the mixed effects model are expressed by basis expansions, then they are estimated…

Methodology · Statistics 2014-02-25 Hidetoshi Matsui

Conventional likelihood-based information criteria for model selection rely on the distribution assumption of data. However, for complex data that are increasingly available in many scientific fields, the specification of their underlying…

Methodology · Statistics 2020-06-25 Chixiang Chen , Ming Wang , Rongling Wu , Runze Li

Many probabilistic models that have an intractable normalizing constant may be extended to contain covariates. Since the evaluation of the exact likelihood is difficult or even impossible for these models, score matching was proposed to…

Statistics Theory · Mathematics 2022-03-21 Jiazhen Xu , Janice L. Scealy , Andrew T. A. Wood , Tao Zou

The theoretical foundation for a number of model selection criteria is established in the context of inhomogeneous point processes and under various asymptotic settings: infill, increasing domain, and combinations of these. For…

Statistics Theory · Mathematics 2021-06-11 Achmad Choiruddin , Jean-François Coeurjolly , Rasmus Waagepetersen

Noise contrastive estimation (NCE) is a popular method for training energy-based models (EBM) with intractable normalisation terms. The key idea of NCE is to learn by comparing unnormalised log-likelihoods of the reference and noisy…

Sound · Computer Science 2025-05-21 Wanli Sun , Anton Ragni

A common challenge in estimating parameters of probability density functions is the intractability of the normalizing constant. While in such cases maximum likelihood estimation may be implemented using numerical integration, the approach…

Methodology · Statistics 2018-02-20 Shiqing Yu , Mathias Drton , Ali Shojaie

Learning unnormalized statistical models (e.g., energy-based models) is computationally challenging due to the complexity of handling the partition function. To eschew this complexity, noise-contrastive estimation~(NCE) has been proposed by…

Machine Learning · Computer Science 2023-06-14 Wei Jiang , Jiayu Qin , Lingyu Wu , Changyou Chen , Tianbao Yang , Lijun Zhang

Proposed in Hyv\"arinen (2005), score matching is a parameter estimation procedure that does not require computation of distributional normalizing constants. In this work we utilize the geometric median of means to develop a robust score…

Machine Learning · Statistics 2025-06-23 Richard Schwank , Andrew McCormack , Mathias Drton
‹ Prev 1 2 3 10 Next ›