中文
相关论文

相关论文: VIBNN: Hardware Acceleration of Bayesian Neural Ne…

200 篇论文

Neural networks (NNs) have demonstrated their potential in a wide range of applications such as image recognition, decision making or recommendation systems. However, standard NNs are unable to capture their model uncertainty which is…

硬件体系结构 · 计算机科学 2021-12-02 Hongxiang Fan , Martin Ferianc , Miguel Rodrigues , Hongyu Zhou , Xinyu Niu , Wayne Luk

Neural networks have demonstrated their outstanding performance in a wide range of tasks. Specifically recurrent architectures based on long-short term memory (LSTM) cells have manifested excellent capability to model time dependencies in…

机器学习 · 计算机科学 2021-11-09 Martin Ferianc , Zhiqiang Que , Hongxiang Fan , Wayne Luk , Miguel Rodrigues

Complex-Valued Neural Networks (CVNNs) have significant advantages in handling tasks that involve complex numbers. However, existing CVNNs are unable to quantify predictive uncertainty. We propose, for the first time, dropout-based Bayesian…

硬件体系结构 · 计算机科学 2026-04-23 Zehuan Zhang , Mark Chen , He Li , Wayne Luk

Bayesian Neural Networks (BNNs) that possess a property of uncertainty estimation have been increasingly adopted in a wide range of safety-critical AI applications which demand reliable and robust decision making, e.g., self-driving, rescue…

硬件体系结构 · 计算机科学 2021-10-08 Qiyu Wan , Haojun Xia , Xingyao Zhang , Lening Wang , Shuaiwen Leon Song , Xin Fu

Bayesian Neural Networks (BNNs) can overcome the problem of overconfidence that plagues traditional frequentist deep neural networks, and are hence considered to be a key enabler for reliable AI systems. However, conventional hardware…

神经与进化计算 · 计算机科学 2024-01-30 Prabodh Katti , Nicolas Skatchkovsky , Osvaldo Simeone , Bipin Rajendran , Bashir M. Al-Hashimi

Binary neural networks (BNNs) have 1-bit weights and activations. Such networks are well suited for FPGAs, as their dominant computations are bitwise arithmetic and the memory requirement is also significantly reduced. However, compared to…

机器学习 · 计算机科学 2020-12-23 Yichi Zhang , Junhao Pan , Xinheng Liu , Hongzheng Chen , Deming Chen , Zhiru Zhang

Bayesian neural Networks (BNNs) are a promising method of obtaining statistical uncertainties for neural network predictions but with a higher computational overhead which can limit their practical usage. This work explores the use of high…

机器学习 · 计算机科学 2020-09-09 Himanshu Sharma , Elise Jennings

Artificial Neural Networks are connectionist systems that perform a given task by learning on examples without having prior knowledge about the task. This is done by finding an optimal point estimate for the weights in every node.…

机器学习 · 计算机科学 2019-01-10 Kumar Shridhar , Felix Laumann , Marcus Liwicki

Reliable uncertainty estimation plays a crucial role in various safety-critical applications such as medical diagnosis and autonomous driving. In recent years, Bayesian neural networks (BayesNNs) have gained substantial research and…

机器学习 · 计算机科学 2024-06-25 Hao Mark Chen , Liam Castelli , Martin Ferianc , Hongyu Zhou , Shuanglong Liu , Wayne Luk , Hongxiang Fan

Recent work has demonstrated that Bayesian neural networks (BNN's) trained with mean field variational inference (MFVI) can be implemented in analog hardware, promising orders of magnitude energy savings compared to the standard digital…

机器学习 · 计算机科学 2025-01-13 Ravi G. Patel , T. Patrick Xiao , Sapan Agarwal , Christopher Bennett

It is always well believed that Binary Neural Networks (BNNs) could drastically accelerate the inference efficiency by replacing the arithmetic operations in float-valued Deep Neural Networks (DNNs) with bit-wise operations. Nevertheless,…

计算机视觉与模式识别 · 计算机科学 2019-08-19 Jianhao Zhang , Yingwei Pan , Ting Yao , He Zhao , Tao Mei

Bayesian neural networks (BNNs) hold great promise as a flexible and principled solution to deal with uncertainty when learning from finite data. Among approaches to realize probabilistic inference in deep neural networks, variational Bayes…

Variational Bayesian neural networks (BNNs) perform variational inference over weights, but it is difficult to specify meaningful priors and approximate posteriors in a high-dimensional weight space. We introduce functional variational…

机器学习 · 计算机科学 2019-03-15 Shengyang Sun , Guodong Zhang , Jiaxin Shi , Roger Grosse

Bayesian Neural Networks (BNNs) provide a tool to estimate the uncertainty of a neural network by considering a distribution over weights and sampling different models for each input. In this paper, we propose a method for uncertainty…

机器学习 · 计算机科学 2024-10-28 Illia Oleksiienko , Dat Thanh Tran , Alexandros Iosifidis

Bayesian neural networks offer better estimates of model uncertainty compared to frequentist networks. However, inference involving Bayesian models requires multiple instantiations or sampling of the network parameters, requiring…

神经与进化计算 · 计算机科学 2024-01-30 Prabodh Katti , Anagha Nimbekar , Chen Li , Amit Acharyya , Bashir M. Al-Hashimi , Bipin Rajendran

Deep feedforward neural networks (DFNNs) are a powerful tool for functional approximation. We describe flexible versions of generalized linear and generalized linear mixed models incorporating basis functions formed by a DFNN. The…

统计计算 · 统计学 2018-05-28 Minh-Ngoc Tran , Nghia Nguyen , David Nott , Robert Kohn

To adopt neural networks in safety critical domains, knowing whether we can trust their predictions is crucial. Bayesian neural networks (BNNs) provide uncertainty estimates by averaging predictions with respect to the posterior weight…

机器学习 · 计算机科学 2021-03-17 Jannik Schmitt , Stefan Roth

Bayesian Neural Networks (BNNs) provide principled estimates of model and data uncertainty by encoding parameters as distributions. This makes them key enablers for reliable AI that can be deployed on safety critical edge systems. These…

新兴技术 · 计算机科学 2024-11-13 Prabodh Katti , Bashir M. Al-Hashimi , Bipin Rajendran

Uncertainty estimation is an indispensable capability for AI-enabled, safety-critical applications, e.g. autonomous vehicles or medical diagnosis. Bayesian neural networks (BNNs) use Bayesian statistics to provide both classification…

硬件体系结构 · 计算机科学 2025-01-24 Zephan M. Enciso , Boyang Cheng , Likai Pei , Jianbo Liu , Steven Davis , Michael Niemier , Ningyuan Cao

Active learning methods for neural networks are usually based on greedy criteria which ultimately give a single new design point for the evaluation. Such an approach requires either some heuristics to sample a batch of design points at one…

机器学习 · 计算机科学 2020-01-28 Evgenii Tsymbalov , Sergei Makarychev , Alexander Shapeev , Maxim Panov
‹ 上一页 1 2 3 10 下一页 ›