English
Related papers

Related papers: Risk-Averse Certification of Bayesian Neural Netwo…

200 papers

This paper proposes a safety analysis method that facilitates a tunable balance between the worst-case and risk-neutral perspectives. First, we define a risk-sensitive safe set to specify the degree of safety attained by a stochastic…

Systems and Control · Electrical Eng. & Systems 2020-07-28 Margaret P. Chapman , Jonathan P. Lacotte , Kevin M. Smith , Insoon Yang , Yuxi Han , Marco Pavone , Claire J. Tomlin

Bayesian neural networks (BNNs) promise improved generalization under covariate shift by providing principled probabilistic representations of epistemic uncertainty. However, weight-based BNNs often struggle with high computational…

Machine Learning · Statistics 2022-06-13 Trung Trinh , Markus Heinonen , Luigi Acerbi , Samuel Kaski

Modern neural networks have found to be miscalibrated in terms of confidence calibration, i.e., their predicted confidence scores do not reflect the observed accuracy or precision. Recent work has introduced methods for post-hoc confidence…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Fabian Küppers , Jan Kronenberger , Jonas Schneider , Anselm Haselhoff

A long memory and non-linear realized volatility model class is proposed for direct Value at Risk (VaR) forecasting. This model, referred to as RNN-HAR, extends the heterogeneous autoregressive (HAR) model, a framework known for efficiently…

Risk Management · Quantitative Finance 2024-08-27 Rangika Peiris , Minh-Ngoc Tran , Chao Wang , Richard Gerlach

This paper works on Binary Neural Networks (BNNs), a promising avenue for efficient deep learning, offering significant reductions in computational overhead and memory footprint to full precision networks. However, the challenge of…

Machine Learning · Computer Science 2024-10-02 Federico Fontana , Romeo Lanzino , Anxhelo Diko , Gian Luca Foresti , Luigi Cinque

For the goal of automated design of high-performance deep convolutional neural networks (CNNs), Neural Architecture Search (NAS) methodology is becoming increasingly important for both academia and industries.Due to the costly stochastic…

Machine Learning · Computer Science 2021-10-12 Shengran Hu , Ran Cheng , Cheng He , Zhichao Lu , Jing Wang , Miao Zhang

Compared to point estimates calculated by standard neural networks, Bayesian neural networks (BNN) provide probability distributions over the output predictions and model parameters, i.e., the weights. Training the weight distribution of a…

Machine Learning · Computer Science 2022-12-01 Philipp Wagner , Xinyang Wu , Marco F. Huber

As deep neural networks(DNN) become increasingly prevalent, particularly in high-stakes areas such as autonomous driving and healthcare, the ability to detect incorrect predictions of models and intervene accordingly becomes crucial for…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Ge Yan , Tsui-Wei Weng

Modern neural networks tend to be overconfident on unseen, noisy or incorrectly labelled data and do not produce meaningful uncertainty measures. Bayesian deep learning aims to address this shortcoming with variational approximations (such…

Machine Learning · Statistics 2018-05-28 Nick Pawlowski , Andrew Brock , Matthew C. H. Lee , Martin Rajchl , Ben Glocker

Convolutional neural network (CNN) has achieved unprecedented success in image super-resolution tasks in recent years. However, the network's performance depends on the distribution of the training sets and degrades on out-of-distribution…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Aupendu Kar , Prabir Kumar Biswas

Many of the successes of machine learning are based on minimizing an averaged loss function. However, it is well-known that this paradigm suffers from robustness issues that hinder its applicability in safety-critical domains. These issues…

Machine Learning · Computer Science 2022-06-09 Alexander Robey , Luiz F. O. Chamon , George J. Pappas , Hamed Hassani

Performance of trained neural network (NN) models, in terms of testing accuracy, has improved remarkably over the past several years, especially with the advent of deep learning. However, even the most accurate NNs can be biased toward a…

Machine Learning · Computer Science 2023-03-14 Mahum Naseer , Bharath Srinivas Prabakaran , Osman Hasan , Muhammad Shafique

We propose a new class of Bayesian neural networks (BNNs) that can be trained using noisy data of variable fidelity, and we apply them to learn function approximations as well as to solve inverse problems based on partial differential…

Machine Learning · Computer Science 2021-06-02 Xuhui Meng , Hessam Babaee , George Em Karniadakis

Recently, adversarial deception becomes one of the most considerable threats to deep neural networks. However, compared to extensive research in new designs of various adversarial attacks and defenses, the neural networks' intrinsic…

Machine Learning · Computer Science 2019-05-13 Fuxun Yu , Zhuwei Qin , Chenchen Liu , Liang Zhao , Yanzhi Wang , Xiang Chen

We introduce NeuralSurv, the first deep survival model to incorporate Bayesian uncertainty quantification. Our non-parametric, architecture-agnostic framework captures time-varying covariate-risk relationships in continuous time via a novel…

Machine Learning · Computer Science 2025-12-17 Mélodie Monod , Alessandro Micheli , Samir Bhatt

As spiking neural networks (SNNs) are deployed increasingly in real-world efficiency critical applications, the security concerns in SNNs attract more attention. Currently, researchers have already demonstrated an SNN can be attacked with…

Neural and Evolutionary Computing · Computer Science 2022-05-04 Ling Liang , Kaidi Xu , Xing Hu , Lei Deng , Yuan Xie

Randomized artificial neural networks such as extreme learning machines provide an attractive and efficient method for supervised learning under limited computing ressources and green machine learning. This especially applies when equipping…

Machine Learning · Statistics 2022-01-02 Ansgar Steland , Bart E. Pieters

This paper addresses the need for deep learning models to integrate well-defined constraints into their outputs, driven by their application in surrogate models, learning with limited data and partial information, and scenarios requiring…

Machine Learning · Statistics 2024-07-02 Rahul Rathnakumar , Jiayu Huang , Hao Yan , Yongming Liu

Heteroscedastic regression is the task of supervised learning where each label is subject to noise from a different distribution. This noise can be caused by the labelling process, and impacts negatively the performance of the learning…

Machine Learning · Computer Science 2021-07-12 Vincent Mai , Waleed Khamies , Liam Paull

The performance of automatic speaker verification (ASV) and anti-spoofing drops seriously under real-world domain mismatch conditions. The relaxed instance frequency-wise normalization (RFN), which normalizes the frequency components based…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-10 Jin Li , Man-Wai Mak , Johan Rohdin , Kong Aik Lee , Hynek Hermansky