English
Related papers

Related papers: Discrete approximation of a mixture distribution v…

200 papers

Computing and storing probabilities is a hard problem as soon as one has to deal with complex distributions over multiple random variables. The problem of efficient representation of probability distributions is central in term of…

Artificial Intelligence · Computer Science 2016-08-16 David Bellot , Pierre Bessiere

Seemingly unrelated linear regression models are introduced in which the distribution of the errors is a finite mixture of Gaussian components. Identifiability conditions are provided. The score vector and the Hessian matrix are derived.…

Methodology · Statistics 2014-03-18 Giuliano Galimberti , Elena Scardovi , Gabriele Soffritti

Estimators derived from an EM algorithm are not robust since they are based on the maximization of the likelihood function. We propose a proximal-point algorithm based on the EM algorithm which aim to minimize a divergence criterion.…

Computation · Statistics 2016-07-11 Diaa Al Mohamad , Michel Broniatowski

In this paper, we propose a distributed algorithm for the minimum dominating set problem. For some especial networks, we prove theoretically that the achieved answer by our proposed algorithm is a constant approximation factor of the exact…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-05 Sharareh Alipour , Ehsan Futuhi , Shayan Karimi

Uniform distribution of the points has been of interest to researchers for a long time and has applications in different areas of Mathematics and Computer Science. One of the well-known measures to evaluate the uniformity of a given…

Computational Geometry · Computer Science 2020-10-21 Milad Bakhshizadeh , Ali Kamalinejad , Mina Latifi

Defect transport is a key process in materials science and catalysis, but as migration mechanisms are often too complex to enumerate a priori, calculation of transport tensors typically have no measure of convergence and require significant…

Computational Physics · Physics 2020-09-04 Thomas D Swinburne , Danny Perez

We focus here on a class of fourth-order parabolic equations that can be written as a system of second-order equations by introducing an auxiliary variable. We design a novel second-order fully discrete mixed finite element method to…

Numerical Analysis · Mathematics 2020-08-28 Sana Keita , Abdelaziz Beljadid , Yves Bourgault

We study the problem of separating a mixture of distributions, all of which come from interventions on a known causal bayesian network. Given oracle access to marginals of all distributions resulting from interventions on the network, and…

Machine Learning · Computer Science 2020-01-16 Gaurav Sinha , Ayush Chauhan , Aurghya Maiti , Naman Poddar , Pulkit Goel

In this paper we introduce the intuitive notion of trivergence of probability distributions (TPD). This notion allow us to calculate the similarity among triplets of objects. For this computation, we can use the well known measures of…

Information Theory · Computer Science 2015-06-23 Juan-Manuel Torres-Moreno

We propose a method to fuse posterior distributions learned from heterogeneous datasets. Our algorithm relies on a mean field assumption for both the fused model and the individual dataset posteriors and proceeds using a simple…

Machine Learning · Computer Science 2020-07-14 Sebastian Claici , Mikhail Yurochkin , Soumya Ghosh , Justin Solomon

In quantitative finance, it is often necessary to analyze the distribution of the sum of specific functions of observed values at discrete points of an underlying process. Examples include the probability density function, the hedging…

Statistical Finance · Quantitative Finance 2019-08-15 Jong Jun Park , Kyungsub Lee

We propose a novel probabilistic approach to multilevel clustering problems based on composite transportation distance, which is a variant of transportation distance where the underlying metric is Kullback-Leibler divergence. Our method…

Machine Learning · Computer Science 2018-10-30 Nhat Ho , Viet Huynh , Dinh Phung , Michael I. Jordan

We consider the numerical approximation of acoustic wave propagation problems by mixed BDM(k+1)-P(k) finite elements on unstructured meshes. Optimal convergence of the discrete velocity and super-convergence of the pressure by one order are…

Numerical Analysis · Mathematics 2019-05-27 Herbert Egger , Bogdan Radu

In this study, we consider unsupervised clustering of categorical vectors that can be of different size using mixture. We use likelihood maximization to estimate the parameters of the underlying mixture model and a penalization technique to…

Statistics Theory · Mathematics 2017-09-08 Esther Derman , Erwan Le Pennec

With the widespread success of deep neural networks in science and technology, it is becoming increasingly important to quantify the uncertainty of the predictions produced by deep learning. In this paper, we introduce a new method that…

Machine Learning · Computer Science 2019-08-15 Qingyang Wu , He Li , Lexin Li , Zhou Yu

Multi-dimensional distributions of discrete data that resemble ellipsoids arise in numerous areas of science, statistics, and computational geometry. We describe a complete algebraic algorithm to determine the quadratic form specifying the…

Data Analysis, Statistics and Probability · Physics 2020-04-20 Rafey Anwar , Madeline Hamilton , Pavel Nadolsky

Mixture distributions are extensively used as a modeling tool in diverse areas from machine learning to communications engineering to physics, and obtaining bounds on the entropy of probability distributions is of fundamental importance in…

Information Theory · Computer Science 2022-12-05 James Melbourne , Saurav Talukdar , Shreyas Bhaban , Mokshay Madiman , Murti V. Salapaka

The Kullback-Leibler (KL) divergence is a fundamental equation of information theory that quantifies the proximity of two probability distributions. Although difficult to understand by examining the equation, an intuition and understanding…

Information Theory · Computer Science 2014-04-09 Jonathon Shlens

The gradient discretisation method (GDM) is a generic framework for designing and analysing numerical schemes for diffusion models. In this paper, we study the GDM for the porous medium equation, including fast diffusion and slow diffusion…

Numerical Analysis · Mathematics 2020-04-02 Jerome Droniou , Kim-Ngan Le

Accurate probabilistic predictions can be characterized by two properties -- calibration and sharpness. However, standard maximum likelihood training yields models that are poorly calibrated and thus inaccurate -- a 90% confidence interval…

Machine Learning · Computer Science 2025-05-14 Volodymyr Kuleshov , Shachi Deshpande