English
Related papers

Related papers: Renormalized Normalized Maximum Likelihood and Thr…

200 papers

A Bayesian network is a widely used probabilistic graphical model with applications in knowledge discovery and prediction. Learning a Bayesian network (BN) from data can be cast as an optimization problem using the well-known…

Artificial Intelligence · Computer Science 2018-11-14 Zhenyu A. Liao , Charupriya Sharma , James Cussens , Peter van Beek

The graph structure of a Bayesian network (BN) can be learned from data using the well-known score-and-search approach. Previous work has shown that incorporating structured representations of the conditional probability distributions…

Machine Learning · Computer Science 2022-06-22 Charupriya Sharma , Peter van Beek

Sparse Bayesian learning (SBL) has been extensively utilized in data-driven modeling to combat the issue of overfitting. While SBL excels in linear-in-parameter models, its direct applicability is limited in models where observations…

Computational Engineering, Finance, and Science · Computer Science 2023-10-24 Nastaran Dabiran , Brandon Robinson , Rimple Sandhu , Mohammad Khalil , Chris L. Pettit , Dominique Poirel , Abhijit Sarkar

We give a new consistent scoring function for structure learning of Bayesian networks. In contrast to traditional approaches to score-based structure learning, such as BDeu or MDL, the complexity penalty that we propose is data-dependent…

Machine Learning · Computer Science 2015-05-13 Eliot Brenner , David Sontag

Bayesian networks are probabilistic graphical models with a wide range of application areas including gene regulatory networks inference, risk analysis and image processing. Learning the structure of a Bayesian network (BNSL) from discrete…

Artificial Intelligence · Computer Science 2021-06-24 Fulya Trösser , Simon de Givry , George Katsirelos

Sparse Bayesian Learning (SBL) models are extensively used in signal processing and machine learning for promoting sparsity through hierarchical priors. The hyperparameters in SBL models are crucial for the model's performance, but they are…

Machine Learning · Computer Science 2024-01-08 Feng Yu , Lixin Shen , Guohui Song

This paper extends the work in [Suzuki, 1996] and presents an efficient depth-first branch-and-bound algorithm for learning Bayesian network structures, based on the minimum description length (MDL) principle, for a given (consistent)…

Artificial Intelligence · Computer Science 2013-01-18 Jin Tian

A maximum likelihood based model selection of discrete Bayesian networks is considered. The model selection is performed through scoring function $S$, which, for a given network $G$ and $n$-sample $D_n$, is defined to be the maximum…

Statistics Theory · Mathematics 2013-04-18 Nikolay H. Balov

We give a new consistent scoring function for structure learning of Bayesian networks. In contrast to traditional approaches to scorebased structure learning, such as BDeu or MDL, the complexity penalty that we propose is data-dependent and…

Machine Learning · Computer Science 2013-09-27 Eliot Brenner , David Sontag

The performance of sparse signal recovery from noise corrupted, underdetermined measurements can be improved if both sparsity and correlation structure of signals are exploited. One typical correlation structure is the intra-block…

Information Theory · Computer Science 2013-10-01 Benyuan Liu , Zhilin Zhang , Hongqi Fan , Qiang Fu

This paper introduces a new sparse Bayesian learning (SBL) algorithm that jointly recovers a temporal sequence of edge maps from noisy and under-sampled Fourier data. The new method is cast in a Bayesian framework and uses a prior that…

Applications · Statistics 2023-03-01 Yao Xiao , Anne Gelb , Guohui Song

The recovery of a low rank matrix from a subset of noisy low-precision quantized samples arises in several applications such as collaborative filtering, intelligent recommendation and millimeter wave channel estimation with few bit ADCs. In…

Information Theory · Computer Science 2019-11-25 Jiang Zhu , Zhennan Liu , Qi Zhang , Chunyi Song , Zhiwei Xu

Accurate channel estimation is a key requirement in extremely large-scale multiple-input multiple-output (XL-MIMO) systems. Sparse Bayesian learning (SBL) is a well-established framework for exploiting channel sparsity, but its performance…

Signal Processing · Electrical Eng. & Systems 2026-05-28 Arttu Arjas , Italo Atzeni

We consider the parametric data model employed in applications such as line spectral estimation and direction-of-arrival estimation. We focus on the stochastic maximum likelihood estimation (MLE) framework and offer approaches to estimate…

Signal Processing · Electrical Eng. & Systems 2023-04-12 Rohan R. Pote , Bhaskar D. Rao

Successful machine learning methods require a trade-off between memorization and generalization. Too much memorization and the model cannot generalize to unobserved examples. Too much over-generalization and we risk under-fitting the data.…

Artificial Intelligence · Computer Science 2023-03-09 Chase Yakaboski , Eugene Santos

Dynamic Bayesian networks have been well explored in the literature as discrete-time models: however, their continuous-time extensions have seen comparatively little attention. In this paper, we propose the first constraint-based algorithm…

Artificial Intelligence · Computer Science 2021-06-04 Alessandro Bregoli , Marco Scutari , Fabio Stella

Bayesian belief network learning algorithms have three basic components: a measure of a network structure and a database, a search heuristic that chooses network structures to be considered, and a method of estimating the probability tables…

Artificial Intelligence · Computer Science 2013-02-28 Remco R. Bouckaert

We explore the issue of refining an existent Bayesian network structure using new data which might mention only a subset of the variables. Most previous works have only considered the refinement of the network's conditional probability…

Artificial Intelligence · Computer Science 2013-02-28 Wai Lam , Fahiem Bacchus

This study proposes the first Bayesian approach for learning high-dimensional linear Bayesian networks. The proposed approach iteratively estimates each element of the topological ordering from backward and its parent using the inverse of a…

Machine Learning · Statistics 2023-11-28 Seyong Hwang , Kyoungjae Lee , Sunmin Oh , Gunwoong Park

Learning Bayesian networks from raw data can help provide insights into the relationships between variables. While real data often contains a mixture of discrete and continuous-valued variables, many Bayesian network structure learning…

Artificial Intelligence · Computer Science 2018-09-19 Yi-Chun Chen , Tim Allan Wheeler , Mykel John Kochenderfer