English
Related papers

Related papers: Learning noisy-OR Bayesian Networks with Max-Produ…

200 papers

Bayesian neural networks (BNNs) have recently regained a significant amount of attention in the deep learning community due to the development of scalable approximate Bayesian inference techniques. There are several advantages of using a…

Machine Learning · Statistics 2023-05-02 Aliaksandr Hubin , Geir Storvik

Bayesian neural networks with latent variables are scalable and flexible probabilistic models: They account for uncertainty in the estimation of the network weights and, by making use of latent variables, can capture complex noise patterns…

Machine Learning · Statistics 2018-06-19 Stefan Depeweg , José Miguel Hernández-Lobato , Finale Doshi-Velez , Steffen Udluft

Constrained optimization problems arise in various engineering systems such as inventory management and power grids. Standard deep neural network (DNN) based machine learning proxies are ineffective in practical settings where labeled data…

Machine Learning · Computer Science 2025-06-09 Parikshit Pareek , Abhijith Jayakumar , Kaarthik Sundar , Deepjyoti Deka , Sidhant Misra

We present a new algorithm to learn a deep neural network model robust against adversarial attacks. Previous algorithms demonstrate an adversarially trained Bayesian Neural Network (BNN) provides improved robustness. We recognize the…

Machine Learning · Computer Science 2023-12-04 Bao Gia Doan , Ehsan Abbasnejad , Javen Qinfeng Shi , Damith C. Ranasinghe

Neural Networks (NNs) have been widely {used in supervised learning} due to their ability to model complex nonlinear patterns, often presented in high-dimensional data such as images and text. However, traditional NNs often lack the ability…

Artificial Intelligence · Computer Science 2022-10-18 Jiayu Huang , Yutian Pang , Yongming Liu , Hao Yan

Deep neural networks have been successful in diverse discriminative classification tasks, although, they are poorly calibrated often assigning high probability to misclassified predictions. Potential consequences could lead to…

Machine Learning · Statistics 2020-10-06 John Mitros , Arjun Pakrashi , Brian Mac Namee

Batch normalization (BN) has become a critical component across diverse deep neural networks. The network with BN is invariant to positively linear re-scale transformation, which makes there exist infinite functionally equivalent networks…

Machine Learning · Computer Science 2022-06-07 Mingyang Yi

In this article a novel approach for training deep neural networks using Bayesian techniques is presented. The Bayesian methodology allows for an easy evaluation of model uncertainty and additionally is robust to overfitting. These are…

Machine Learning · Computer Science 2019-04-03 Konstantin Posch , Jürgen Pilz

Blind image deblurring is an important yet very challenging problem in low-level vision. Traditional optimization based methods generally formulate this task as a maximum-a-posteriori estimation or variational inference problem, whose…

Image and Video Processing · Electrical Eng. & Systems 2021-06-08 Hui Wang , Zongsheng Yue , Qian Zhao , Deyu Meng

Bayesian Neural Networks (BNNs) that possess a property of uncertainty estimation have been increasingly adopted in a wide range of safety-critical AI applications which demand reliable and robust decision making, e.g., self-driving, rescue…

Hardware Architecture · Computer Science 2021-10-08 Qiyu Wan , Haojun Xia , Xingyao Zhang , Lening Wang , Shuaiwen Leon Song , Xin Fu

In cognitive radio (CR) technology, the trend of sensing is no longer to only detect the presence of active primary users. A large number of applications demand for more comprehensive knowledge on primary user behaviors in spatial,…

Machine Learning · Computer Science 2015-02-10 Weijia Han , Huiyan Sang , Min Sheng , Jiandong Li , Shuguang Cui

Complex network reconstruction is a hot topic in many fields. Currently, the most popular data-driven reconstruction framework is based on lasso. However, it is found that, in the presence of noise, lasso loses efficiency for weighted…

Machine Learning · Statistics 2020-03-03 Shuang Xu , Chun-Xia Zhang , Pei Wang , Jiangshe Zhang

Machine learning models perform well across domains such as diagnostics, weather forecasting, NLP, and autonomous driving, but their limited uncertainty handling restricts use in safety-critical settings. Traditional neural networks often…

Machine Learning · Computer Science 2025-12-01 Bernhard Klein , Falk Selker , Hendrik Borras , Sophie Steger , Franz Pernkopf , Holger Fröning

Near-term noisy intermediate-scale quantum circuits can efficiently implement implicit probabilistic models in discrete spaces, supporting distributions that are practically infeasible to sample from using classical means. One of the…

Quantum Physics · Physics 2022-04-07 Ivana Nikoloska , Osvaldo Simeone

Variational Bayesian neural networks (BNNs) perform variational inference over weights, but it is difficult to specify meaningful priors and approximate posteriors in a high-dimensional weight space. We introduce functional variational…

Machine Learning · Computer Science 2019-03-15 Shengyang Sun , Guodong Zhang , Jiaxin Shi , Roger Grosse

Traditional neural networks are simple to train but they typically produce overconfident predictions. In contrast, Bayesian neural networks provide good uncertainty quantification but optimizing them is time consuming due to the large…

Machine Learning · Computer Science 2024-11-07 Yadi Wei , Roni Khardon

Link prediction is a fundamental task in statistical network analysis. Recent advances have been made on learning flexible nonparametric Bayesian latent feature models for link prediction. In this paper, we present a max-margin learning…

Machine Learning · Computer Science 2016-02-25 Jun Zhu , Jiaming Song , Bei Chen

Variational inference provides approximations to the computationally intractable posterior distribution in Bayesian networks. A prominent medical application of noisy-or Bayesian network is to infer potential diseases given observed…

Machine Learning · Computer Science 2016-05-23 Yusheng Xie , Nan Du , Wei Fan , Jing Zhai , Weicheng Zhu

Bayesian Neural Networks (BNNs) provide principled uncertainty quantification but suffer from substantial computational and memory overhead compared to deterministic networks. While quantization techniques have successfully reduced resource…

Machine Learning · Computer Science 2025-12-12 Hendrik Borras , Yong Wu , Bernhard Klein , Holger Fröning

Modern neural network architectures have achieved remarkable accuracies but remain highly dependent on their training data, often lacking interpretability in their learned mappings. While effective on large datasets, they tend to overfit on…

Machine Learning · Computer Science 2025-03-19 Pavia Bera , Sanjukta Bhanja