English
Related papers

Related papers: BayesDLL: Bayesian Deep Learning Library

200 papers

Deep learning is computationally intensive, with significant efforts focused on reducing arithmetic complexity, particularly regarding energy consumption dominated by data movement. While existing literature emphasizes inference, training…

Machine Learning · Statistics 2025-06-09 Van Minh Nguyen , Cristian Ocampo , Aymen Askri , Louis Leconte , Ba-Hien Tran

Uncertainty quantification is an important task in machine learning - a task in which standardneural networks (NNs) have traditionally not excelled. This can be a limitation for safety-critical applications, where uncertainty-aware methods…

Machine Learning · Computer Science 2024-01-05 Felix Fiedler , Sergio Lucia

Bayesian models are a powerful tool for studying complex data, allowing the analyst to encode rich hierarchical dependencies and leverage prior information. Most importantly, they facilitate a complete characterization of uncertainty…

Machine Learning · Statistics 2023-04-25 Steven Winter , Trevor Campbell , Lizhen Lin , Sanvesh Srivastava , David B. Dunson

Evaluation of Bayesian deep learning (BDL) methods is challenging. We often seek to evaluate the methods' robustness and scalability, assessing whether new tools give `better' uncertainty estimates than old ones. These evaluations are…

We propose Radial Bayesian Neural Networks (BNNs): a variational approximate posterior for BNNs which scales well to large models while maintaining a distribution over weight-space with full support. Other scalable Bayesian deep learning…

Machine Learning · Statistics 2021-06-01 Sebastian Farquhar , Michael Osborne , Yarin Gal

Understanding and interpreting how machine learning (ML) models make decisions have been a big challenge. While recent research has proposed various technical approaches to provide some clues as to how an ML model makes individual…

Machine Learning · Computer Science 2018-11-09 Wenbo Guo , Sui Huang , Yunzhe Tao , Xinyu Xing , Lin Lin

The willingness to trust predictions formulated by automatic algorithms is key in a vast number of domains. However, a vast number of deep architectures are only able to formulate predictions without an associated uncertainty. In this…

Image and Video Processing · Electrical Eng. & Systems 2022-09-28 Matteo Ferrante , Tommaso Boccato , Nicola Toschi

We show that a neural network with arbitrary depth and non-linearities, with dropout applied before every weight layer, is mathematically equivalent to an approximation to a well known Bayesian model. This interpretation might offer an…

Machine Learning · Statistics 2016-05-26 Yarin Gal , Zoubin Ghahramani

In variational inference, the benefits of Bayesian models rely on accurately capturing the true posterior distribution. We propose using neural samplers that specify implicit distributions, which are well-suited for approximating complex…

Machine Learning · Computer Science 2023-11-10 Anshuk Uppal , Kristoffer Stensbo-Smidt , Wouter Boomsma , Jes Frellsen

Bayesian Neural Networks (BNNs) provide a probabilistic interpretation for deep learning models by imposing a prior distribution over model parameters and inferring a posterior distribution based on observed data. The model sampled from the…

Machine Learning · Computer Science 2023-11-15 Van-Anh Nguyen , Tung-Long Vuong , Hoang Phan , Thanh-Toan Do , Dinh Phung , Trung Le

In this paper, we present XuanCe, a comprehensive and unified deep reinforcement learning (DRL) library designed to be compatible with PyTorch, TensorFlow, and MindSpore. XuanCe offers a wide range of functionalities, including over 40…

Machine Learning · Computer Science 2023-12-29 Wenzhang Liu , Wenzhe Cai , Kun Jiang , Guangran Cheng , Yuanda Wang , Jiawei Wang , Jingyu Cao , Lele Xu , Chaoxu Mu , Changyin Sun

We study Bayesian hypernetworks: a framework for approximate Bayesian inference in neural networks. A Bayesian hypernetwork $\h$ is a neural network which learns to transform a simple noise distribution, $p(\vec\epsilon) = \N(\vec 0,\mat…

Machine Learning · Statistics 2018-04-26 David Krueger , Chin-Wei Huang , Riashat Islam , Ryan Turner , Alexandre Lacoste , Aaron Courville

With the increasing variety of services that e-commerce platforms provide, criteria for evaluating their success become also increasingly multi-targeting. This work introduces a multi-target optimization framework with Bayesian modeling of…

Machine Learning · Computer Science 2019-02-26 Qi Wang , Zhihui Ji , Huasheng Liu , Binqiang Zhao

Deep Learning (DL) algorithms have become the {\em de facto} choice for data analysis. Several DL implementations -- primarily limited to a single compute node -- such as Caffe, TensorFlow, Theano and Torch have become readily available.…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-04-18 Abhinav Vishnu , Joseph Manzano , Charles Siegel , Jeff Daily

BayesOpt is a library with state-of-the-art Bayesian optimization methods to solve nonlinear optimization, stochastic bandits or sequential experimental design problems. Bayesian optimization is sample efficient by building a posterior…

Machine Learning · Computer Science 2014-05-30 Ruben Martinez-Cantin

Many networking tasks now employ deep learning (DL) to solve complex prediction and optimization problems. However, current design philosophy of DL-based algorithms entails intensive engineering overhead due to the manual design of deep…

Networking and Internet Architecture · Computer Science 2024-08-07 Duo Wu , Xianda Wang , Yaqi Qiao , Zhi Wang , Junchen Jiang , Shuguang Cui , Fangxin Wang

Neural network frameworks such as PyTorch and TensorFlow are the workhorses of numerous machine learning applications ranging from object recognition to machine translation. While these frameworks are versatile and straightforward to use,…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-04-24 Nicolas Weber , Florian Schmidt , Mathias Niepert , Felipe Huici

Deep Neural Networks (DNNs) are powerful tools for various computer vision tasks, yet they often struggle with reliable uncertainty quantification - a critical requirement for real-world applications. Bayesian Neural Networks (BNN) are…

Machine Learning · Computer Science 2023-12-27 Gianni Franchi , Olivier Laurent , Maxence Leguéry , Andrei Bursuc , Andrea Pilzer , Angela Yao

Modern neural network architectures have achieved remarkable accuracies but remain highly dependent on their training data, often lacking interpretability in their learned mappings. While effective on large datasets, they tend to overfit on…

Machine Learning · Computer Science 2025-03-19 Pavia Bera , Sanjukta Bhanja

This paper addresses the problem of learning dictionaries for multimodal datasets, i.e. datasets collected from multiple data sources. We present an algorithm called multimodal sparse Bayesian dictionary learning (MSBDL). MSBDL leverages…

Machine Learning · Statistics 2019-05-30 Igor Fedorov , Bhaskar D. Rao