中文
相关论文

相关论文: Deep Sub-Ensembles for Fast Uncertainty Estimation…

200 篇论文

Deep ensemble is a simple yet powerful way to improve the performance of deep neural networks. Under this motivation, recent works on mode connectivity have shown that parameters of ensembles are connected by low-loss subspaces, and one can…

机器学习 · 计算机科学 2023-06-21 EungGu Yun , Hyungi Lee , Giung Nam , Juho Lee

Whereas the ability of deep networks to produce useful predictions has been amply demonstrated, estimating the reliability of these predictions remains challenging. Sampling approaches such as MC-Dropout and Deep Ensembles have emerged as…

机器学习 · 计算机科学 2024-05-28 Nikita Durasov , Nik Dorndorf , Hieu Le , Pascal Fua

This work introduces a novel probabilistic deep learning technique called deep Gaussian mixture ensembles (DGMEs), which enables accurate quantification of both epistemic and aleatoric uncertainty. By assuming the data generating process…

机器学习 · 统计学 2023-06-13 Yousef El-Laham , Niccolò Dalmasso , Elizabeth Fons , Svitlana Vyetrenko

Deep neural networks (DNNs) have achieved great success in the area of computer vision. The disparity estimation problem tends to be addressed by DNNs which achieve much better prediction accuracy in stereo matching than traditional…

计算机视觉与模式识别 · 计算机科学 2020-03-25 Qiang Wang , Shaohuai Shi , Shizhen Zheng , Kaiyong Zhao , Xiaowen Chu

Image classification requires the generation of features capable of detecting image patterns informative of group identity. The objective of this study was to classify images from the public CIFAR-10 image dataset by leveraging combinations…

计算机视觉与模式识别 · 计算机科学 2020-03-02 Felipe O. Giuste , Juan C. Vizcarra

Deep neural networks (DNNs) have achieved great success in the area of computer vision. The disparity estimation problem tends to be addressed by DNNs which achieve much better prediction accuracy than traditional hand-crafted feature-based…

计算机视觉与模式识别 · 计算机科学 2021-10-07 Qiang Wang , Shaohuai Shi , Shizhen Zheng , Kaiyong Zhao , Xiaowen Chu

Quantifying uncertainty in weather forecasts is critical, especially for predicting extreme weather events. This is typically accomplished with ensemble prediction systems, which consist of many perturbed numerical weather simulations, or…

机器学习 · 计算机科学 2021-03-17 Peter Grönquist , Chengyuan Yao , Tal Ben-Nun , Nikoli Dryden , Peter Dueben , Shigang Li , Torsten Hoefler

In this paper, we introduce a new technique that combines two popular methods to estimate uncertainty in object detection. Quantifying uncertainty is critical in real-world robotic applications. Traditional detection models can be ambiguous…

计算机视觉与模式识别 · 计算机科学 2021-06-30 Zongyao Lyu , Nolan B. Gutierrez , William J. Beksi

Neural networks have proven effective at solving difficult problems but designing their architectures can be challenging, even for image classification problems alone. Our goal is to minimize human participation, so we employ evolutionary…

神经与进化计算 · 计算机科学 2017-06-13 Esteban Real , Sherry Moore , Andrew Selle , Saurabh Saxena , Yutaka Leon Suematsu , Jie Tan , Quoc Le , Alex Kurakin

Accurate and reliable Magnetic Resonance Imaging (MRI) analysis is particularly important for adaptive radiotherapy, a recent medical advance capable of improving cancer diagnosis and treatment. Recent studies have shown that IVIM-NET, a…

硬件体系结构 · 计算机科学 2024-07-09 Zehuan Zhang , Matej Genci , Hongxiang Fan , Andreas Wetscherek , Wayne Luk

Uncertainty quantification (UQ) is essential for deploying deep neural networks in safety-critical settings. Although methods like Deep Ensembles achieve strong UQ performance, their high computational and memory costs hinder scalability to…

机器学习 · 计算机科学 2026-04-22 Firas Gabetni , Giuseppe Curci , Andrea Pilzer , Subhankar Roy , Elisa Ricci , Gianni Franchi

Deep neural network ensembles hold the potential of improving generalization performance for complex learning tasks. This paper presents formal analysis and empirical evaluation to show that heterogeneous deep ensembles with high ensemble…

计算机视觉与模式识别 · 计算机科学 2023-10-04 Yanzhao Wu , Ka-Ho Chow , Wenqi Wei , Ling Liu

Uncertainty Quantification aims to determine when the prediction from a Machine Learning model is likely to be wrong. Computer Vision research has explored methods for determining epistemic uncertainty (also known as model uncertainty),…

Ensemble learning combines several individual models to obtain better generalization performance. Currently, deep learning architectures are showing better performance compared to the shallow or traditional models. Deep ensemble learning…

机器学习 · 计算机科学 2022-08-09 M. A. Ganaie , Minghui Hu , A. K. Malik , M. Tanveer , P. N. Suganthan

Deep neural networks have achieved increasingly accurate results on a wide variety of complex tasks. However, much of this improvement is due to the growing use and availability of computational resources (e.g use of GPUs, more layers, more…

机器学习 · 计算机科学 2018-08-03 Ini Oguntola , Subby Olubeko , Christopher Sweeney

Committee-based models (ensembles or cascades) construct models by combining existing pre-trained ones. While ensembles and cascades are well-known techniques that were proposed before deep learning, they are not considered a core building…

计算机视觉与模式识别 · 计算机科学 2022-02-18 Xiaofang Wang , Dan Kondratyuk , Eric Christiansen , Kris M. Kitani , Yair Alon , Elad Eban

In this paper, we present an Adaptive Ensemble Learning framework that aims to boost the performance of deep neural networks by intelligently fusing features through ensemble learning techniques. The proposed framework integrates ensemble…

人工智能 · 计算机科学 2023-04-07 Neelesh Mungoli

Ensemble learning has proven effective in improving predictive performance and estimating uncertainty in neural networks. However, conventional ensemble methods often suffer from redundant parameter usage and computational inefficiencies…

机器学习 · 计算机科学 2024-12-23 Arnav Kharbanda , Advait Chandorkar

Understanding and quantifying uncertainty in black box Neural Networks (NNs) is critical when deployed in real-world settings such as healthcare. Recent works using Bayesian and non-Bayesian methods have shown how a unified predictive…

机器学习 · 计算机科学 2020-09-29 Utkarsh Sarawgi , Wazeer Zulfikar , Rishab Khincha , Pattie Maes

We propose an algorithm to enhance certified robustness of a deep model ensemble by optimally weighting each base model. Unlike previous works on using ensembles to empirically improve robustness, our algorithm is based on optimizing a…

机器学习 · 统计学 2019-11-01 Huan Zhang , Minhao Cheng , Cho-Jui Hsieh