English
Related papers

Related papers: Integrating Probabilistic Rules into Neural Networ…

200 papers

Stochastic differential equations (SDEs) are one of the most important representations of dynamical systems. They are notable for the ability to include a deterministic component of the system and a stochastic one to represent random…

Machine Learning · Computer Science 2021-05-19 Noura Dridi , Lucas Drumetz , Ronan Fablet

We present a Bayesian approach to machine learning with probabilistic programs. In our approach, training on available data is implemented as inference on a hierarchical model. The posterior distribution of model parameters is then used to…

Machine Learning · Computer Science 2022-01-19 David Tolpin

Although stochastic approximation learning methods have been widely used in the machine learning literature for over 50 years, formal theoretical analyses of specific machine learning algorithms are less common because stochastic…

Machine Learning · Statistics 2017-04-21 Richard M. Golden

Expectation Maximization (EM) is among the most popular algorithms for maximum likelihood estimation, but it is generally only guaranteed to find its stationary points of the log-likelihood objective. The goal of this article is to present…

Machine Learning · Computer Science 2018-10-29 Ji Xu , Daniel Hsu , Arian Maleki

Latent Euclidean embedding models a given network by representing each node in a Euclidean space, where the probability of two nodes sharing an edge is a function of the distances between the nodes. This implies that for two nodes to share…

Social and Information Networks · Computer Science 2019-09-19 Clifford Anderson-Bergman , Phan Nguyen , Jose Cadena Pico

Sum-Product Networks with complex probability distribution at the leaves have been shown to be powerful tractable-inference probabilistic models. However, while learning the internal parameters has been amply studied, learning complex leaf…

Machine Learning · Computer Science 2017-06-15 Mattia Desana , Christoph Schnörr

Dynamic Bayesian networks provide a compact and natural representation for complex dynamic systems. However, in many cases, there is no expert available from whom a model can be elicited. Learning provides an alternative approach for…

Artificial Intelligence · Computer Science 2013-01-30 Xavier Boyen , Nir Friedman , Daphne Koller

Software systems are complex, and behavioral comprehension with the increasing amount of AI components challenges traditional testing and maintenance strategies.The lack of tools and methodologies for behavioral software comprehension…

Software Engineering · Computer Science 2019-12-19 Hannes Thaller , Lukas Linsbauer , Rudolf Ramler , Alexander Egyed

Schedules can be built in a similar way to a human scheduler by using a set of rules that involve domain knowledge. This paper presents an Estimation of Distribution Algorithm (eda) for the nurse scheduling problem, which involves choosing…

Neural and Evolutionary Computing · Computer Science 2010-07-05 Uwe Aickelin , Jingpeng Li

Deep neural networks has been increasingly applied in fault diagnostics, where it uses historical data to capture systems behavior, bypassing the need for high-fidelity physical models. However, despite their competence in prediction tasks,…

Machine Learning · Computer Science 2025-09-24 Arman Mohammadi , Mattias Krysander , Daniel Jung , Erik Frisk

In this paper, different strands of literature are combined in order to obtain algorithms for semi-parametric estimation of discrete choice models that include the modelling of unobserved heterogeneity by using mixing distributions for the…

Methodology · Statistics 2022-12-12 Dietmar Bauer , Sebastian Büscher , Manuel Batram

This paper presents an entirely unsupervised interest point training framework by jointly learning detector and descriptor, which takes an image as input and outputs a probability and a description for every image point. The objective of…

Computer Vision and Pattern Recognition · Computer Science 2019-07-29 Pei Yan , Yihua Tan , Yuan Xiao , Yuan Tai , Cai Wen

Expectation propagation (EP) is a deterministic approximation algorithm that is often used to perform approximate Bayesian parameter learning. EP approximates the full intractable posterior distribution through a set of local approximations…

Machine Learning · Statistics 2015-11-19 Yingzhen Li , Jose Miguel Hernandez-Lobato , Richard E. Turner

We consider a stochastic blockmodel equipped with node covariate information, that is helpful in analyzing social network data. The key objective is to obtain maximum likelihood estimates of the model parameters. For this task, we devise a…

Computation · Statistics 2018-08-08 Sandipan Roy , Yves Atchadé , George Michailidis

Algorithms for learning the conditional probabilities of Bayesian networks with hidden variables typically operate within a high-dimensional search space and yield only locally optimal solutions. One way of limiting the search space and…

Artificial Intelligence · Computer Science 2013-01-18 Frank Wittig , Anthony Jameson

Mixed linear regression (MLR) model is among the most exemplary statistical tools for modeling non-linear distributions using a mixture of linear models. When the additive noise in MLR model is Gaussian, Expectation-Maximization (EM)…

Machine Learning · Statistics 2021-05-14 Babak Barazandeh , Ali Ghafelebashi , Meisam Razaviyayn , Ram Sriharsha

Reliable probability estimation is of crucial importance in many real-world applications where there is inherent (aleatoric) uncertainty. Probability-estimation models are trained on observed outcomes (e.g. whether it has rained or not, or…

Finite mixture models are powerful tools for modelling and analyzing heterogeneous data. Parameter estimation is typically carried out using maximum likelihood estimation via the Expectation-Maximization (EM) algorithm. Recently, the…

Computation · Statistics 2020-05-15 Sharon X. Lee , Geoffrey J. McLachlan , Kaleb L. Leemaqz

Mixture models are probabilistic models aimed at uncovering and representing latent subgroups within a population. In the realm of network data analysis, the latent subgroups of nodes are typically identified by their connectivity…

Methodology · Statistics 2020-05-27 Giacomo De Nicola , Benjamin Sischka , Göran Kauermann

Probabilistic logic programs are logic programs in which some of the facts are annotated with probabilities. This paper investigates how classical inference and learning tasks known from the graphical model community can be tackled for…

Artificial Intelligence · Computer Science 2020-02-19 Daan Fierens , Guy Van den Broeck , Joris Renkens , Dimitar Shterionov , Bernd Gutmann , Ingo Thon , Gerda Janssens , Luc De Raedt