English
Related papers

Related papers: When Monte-Carlo Dropout Meets Multi-Exit: Optimiz…

200 papers

Pilot contamination (PC) arises when the pilot sequences assigned to user equipments (UEs) are not mutually orthogonal, eventually due to their reuse. In this work, we propose a novel expectation propagation (EP)-based joint channel…

Information Theory · Computer Science 2025-11-21 Christian Forsch , Zilu Zhao , Dirk Slock , Laura Cottatellucci

Existing multilevel quasi-Monte Carlo (MLQMC) methods often rely on multiple independent randomizations of a low-discrepancy (LD) sequence to estimate statistical errors on each level. While this approach is standard, it can be less…

Deep Neural Networks (DNNs) are powerful tools for various computer vision tasks, yet they often struggle with reliable uncertainty quantification - a critical requirement for real-world applications. Bayesian Neural Networks (BNN) are…

Machine Learning · Computer Science 2023-12-27 Gianni Franchi , Olivier Laurent , Maxence Leguéry , Andrei Bursuc , Andrea Pilzer , Angela Yao

Fully convolutional U-shaped neural networks have largely been the dominant approach for pixel-wise image segmentation. In this work, we tackle two defects that hinder their deployment in real-world applications: 1) Predictions lack…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Martin Ferianc , Divyansh Manocha , Hongxiang Fan , Miguel Rodrigues

We propose a new class of Bayesian neural networks (BNNs) that can be trained using noisy data of variable fidelity, and we apply them to learn function approximations as well as to solve inverse problems based on partial differential…

Machine Learning · Computer Science 2021-06-02 Xuhui Meng , Hessam Babaee , George Em Karniadakis

In recent years, the Hamiltonian Monte Carlo (HMC) algorithm has been found to work more efficiently compared to other popular Markov Chain Monte Carlo (MCMC) methods (such as random walk Metropolis-Hastings) in generating samples from a…

Computation · Statistics 2014-02-18 Andrew L. Beam , Sujit K. Ghosh , Jon Doyle

Among Bayesian methods, Monte-Carlo dropout provides principled tools for evaluating the epistemic uncertainty of neural networks. Its popularity recently led to seminal works that proposed activating the dropout layers only during…

Machine Learning · Computer Science 2023-02-07 Emanuele Ledda , Giorgio Fumera , Fabio Roli

Accurately detecting crack boundaries is crucial for reliability assessment and risk management of structures and materials, such as structural health monitoring, diagnostics, prognostics, and maintenance scheduling. Uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Rahul Rathnakumar , Yutian Pang , Yongming Liu

In this paper, we propose a new stochastic optimization algorithm for Bayesian inference based on multilevel Monte Carlo (MLMC) methods. In Bayesian statistics, biased estimators of the model evidence have been often used as stochastic…

Machine Learning · Statistics 2021-02-26 Kei Ishikawa , Takashi Goda

Convolutional neural network (CNN) has achieved unprecedented success in image super-resolution tasks in recent years. However, the network's performance depends on the distribution of the training sets and degrades on out-of-distribution…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Aupendu Kar , Prabir Kumar Biswas

As a powerful technique in medical imaging, image synthesis is widely used in applications such as denoising, super resolution and modality transformation etc. Recently, the revival of deep neural networks made immense progress in the field…

Image and Video Processing · Electrical Eng. & Systems 2021-04-23 Gengyan Zhao , Mary E. Meyerand , Rasmus M. Birn

Bayesian Neural Networks (BNNs) can overcome the problem of overconfidence that plagues traditional frequentist deep neural networks, and are hence considered to be a key enabler for reliable AI systems. However, conventional hardware…

Neural and Evolutionary Computing · Computer Science 2024-01-30 Prabodh Katti , Nicolas Skatchkovsky , Osvaldo Simeone , Bipin Rajendran , Bashir M. Al-Hashimi

This paper presents an implementation of multilayer feed forward neural networks (NN) to optimize CMOS analog circuits. For modeling and design recently neural network computational modules have got acceptance as an unorthodox and useful…

Neural and Evolutionary Computing · Computer Science 2012-12-13 Mriganka Chakraborty

Credit risk modelling is an integral part of the global financial system. While there has been great attention paid to neural network models for credit default prediction, such models often lack the required interpretation mechanisms and…

Machine Learning · Statistics 2019-06-18 Rendani Mbuvha , Illyes Boulkaibet , Tshilidzi Marwala

In classification applications, we often want probabilistic predictions to reflect confidence or uncertainty. Dropout, a commonly used training technique, has recently been linked to Bayesian inference, yielding an efficient way to quantify…

Machine Learning · Computer Science 2019-06-25 Zhilu Zhang , Adrian V. Dalca , Mert R. Sabuncu

Recently, there has been a significant amount of interest in satellite telemetry anomaly detection (AD) using neural networks (NN). For AD purposes, the current approaches focus on either forecasting or reconstruction of the time series,…

Machine Learning · Computer Science 2022-11-29 Mohammad Amin Maleki Sadr , Yeying Zhu , Peng Hu

Finding the best setup for experiments is the primary concern for Optimal Experimental Design (OED). Here, we focus on the Bayesian experimental design problem of finding the setup that maximizes the Shannon expected information gain. We…

Numerical Analysis · Mathematics 2020-02-28 Andre Gustavo Carlon , Ben Mansour Dia , Luis FR Espath , Rafael Holdorf Lopez , Raul Tempone

Physics simulations like computational fluid dynamics (CFD) are a computational bottleneck in computer-aided design (CAD) optimization processes. To overcome this bottleneck, one requires either an optimization framework that is highly…

Machine Learning · Computer Science 2024-08-29 Harsh Vardhan , David Hyde , Umesh Timalsina , Peter Volgyesi , Janos Sztipanovits

Bayesian Neural Networks (BNNs) that possess a property of uncertainty estimation have been increasingly adopted in a wide range of safety-critical AI applications which demand reliable and robust decision making, e.g., self-driving, rescue…

Hardware Architecture · Computer Science 2021-10-08 Qiyu Wan , Haojun Xia , Xingyao Zhang , Lening Wang , Shuaiwen Leon Song , Xin Fu

Stress and material deformation field predictions are among the most important tasks in computational mechanics. These predictions are typically made by solving the governing equations of continuum mechanics using finite element analysis,…

Machine Learning · Statistics 2024-06-24 George D. Pasparakis , Lori Graham-Brady , Michael D. Shields