English
Related papers

Related papers: Decision Theoretic Foundations of Graphical Model …

200 papers

A test is adaptive when its sequence and number of questions is dynamically tuned on the basis of the estimated skills of the taker. Graphical models, such as Bayesian networks, are used for adaptive tests as they allow to model the…

Artificial Intelligence · Computer Science 2021-09-29 Alessandro Antonucci , Francesca Mangili , Claudio Bonesana , Giorgia Adorni

Neural Networks and Decision Trees: two popular techniques for supervised learning that are seemingly disconnected in their formulation and optimization method, have recently been combined in a single construct. The connection pivots on…

Machine Learning · Statistics 2020-02-27 Giuseppe Nuti , Lluís Antoni Jiménez Rugama , Kaspar Thommen

This work initiates a systematic investigation of testing high-dimensional structured distributions by focusing on testing Bayesian networks -- the prototypical family of directed graphical models. A Bayesian network is defined by a…

Data Structures and Algorithms · Computer Science 2020-01-28 Clement Canonne , Ilias Diakonikolas , Daniel Kane , Alistair Stewart

We introduce a class of neural networks derived from probabilistic models in the form of Bayesian belief networks. By imposing additional assumptions about the nature of the probabilistic models represented in the belief networks, we derive…

Disordered Systems and Neural Networks · Physics 2007-05-23 M. J. Barber , J. W. Clark , C. H. Anderson

Contemporary machine learning methods will try to approach the Bayes error, as it is the lowest possible error any model can achieve. This paper postulates that any decision is composed of not one but two Bayesian decisions and that…

Machine Learning · Computer Science 2024-10-18 Stefan Jaeger

This paper gives a generative model of the interpretation of formal logic for data-driven logical reasoning. The key idea is to represent the interpretation as likelihood of a formula being true given a model of formal logic. Using the…

Artificial Intelligence · Computer Science 2022-03-01 Hiroyuki Kido

This paper develops methods of distributed Bayesian hypothesis tests for fault detection and diagnosis that are based on belief propagation and optimization in graphical models. The main challenges in developing distributed statistical…

Systems and Control · Computer Science 2015-01-20 Kwang-Ki K. Kim

Bayesian graphical models are powerful tools to infer complex relationships in high dimension, yet are often fraught with computational and statistical challenges. If exploited in a principled way, the increasing information collected…

Methodology · Statistics 2024-03-15 Xiaoyue Xi , Hélène Ruffieux

A novel approach to perform unsupervised sequential learning for functional data is proposed. Our goal is to extract reference shapes (referred to as templates) from noisy, deformed and censored realizations of curves and images. Our model…

Methodology · Statistics 2016-04-05 Florian Maire , Eric Moulines , Sidonie Lefebvre

Promising results have driven a recent surge of interest in continuous optimization methods for Bayesian network structure learning from observational data. However, there are theoretical limitations on the identifiability of underlying…

We consider the problem of learning the functions computing children from parents in a Structural Causal Model once the underlying causal graph has been identified. This is in some sense the second step after causal discovery. Taking a…

Machine Learning · Statistics 2017-07-03 Paul K. Rubenstein , Ilya Tolstikhin , Philipp Hennig , Bernhard Schoelkopf

This paper looks at the task of network topology inference, where the goal is to learn an unknown graph from nodal observations. One of the novelties of the approach put forth is the consideration of prior information about the density of…

Signal Processing · Electrical Eng. & Systems 2022-07-12 Samuel Rey , T. Mitchell Roddenberry , Santiago Segarra , Antonio G. Marques

We study the problem of learning the best Bayesian network structure with respect to a decomposable score such as BDe, BIC or AIC. This problem is known to be NP-hard, which means that solving it becomes quickly infeasible as the number of…

Artificial Intelligence · Computer Science 2012-07-02 Tomi Silander , Petri Myllymaki

This paper studies the problem of learning Bayesian networks from continuous observational data, generated according to a linear Gaussian structural equation model. We consider an $\ell_0$-penalized maximum likelihood estimator for this…

Machine Learning · Statistics 2025-10-14 Tong Xu , Simge Küçükyavuz , Ali Shojaie , Armeen Taeb

Decision Trees are some of the most popular machine learning models today due to their out-of-the-box performance and interpretability. Often, Decision Trees models are constructed greedily in a top-down fashion via heuristic search…

Machine Learning · Computer Science 2023-02-16 Colin Sullivan , Mo Tiwari , Sebastian Thrun , Chris Piech

We present a new family of exchangeable stochastic processes, the Functional Neural Processes (FNPs). FNPs model distributions over functions by learning a graph of dependencies on top of latent representations of the points in the given…

Machine Learning · Computer Science 2019-11-05 Christos Louizos , Xiahan Shi , Klamer Schutte , Max Welling

While deep learning has led to huge progress in complex image classification tasks like ImageNet, unexpected failure modes, e.g. via spurious features, call into question how reliably these classifiers work in the wild. Furthermore, for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Maximilian Augustin , Yannic Neuhaus , Matthias Hein

This study proposes the first Bayesian approach for learning high-dimensional linear Bayesian networks. The proposed approach iteratively estimates each element of the topological ordering from backward and its parent using the inverse of a…

Machine Learning · Statistics 2023-11-28 Seyong Hwang , Kyoungjae Lee , Sunmin Oh , Gunwoong Park

Theory refinement is the task of updating a domain theory in the light of new cases, to be done automatically or with some expert assistance. The problem of theory refinement under uncertainty is reviewed here in the context of Bayesian…

Artificial Intelligence · Computer Science 2013-03-26 Wray L. Buntine

The use of sophisticated machine learning models for critical decision making is faced with a challenge that these models are often applied as a "black-box". This has led to an increased interest in interpretable machine learning, where…

Artificial Intelligence · Computer Science 2020-07-22 Catarina Moreira , Yu-Liang Chou , Mythreyi Velmurugan , Chun Ouyang , Renuka Sindhgatta , Peter Bruza