中文
相关论文

相关论文: On Local Posterior Structure in Deep Ensembles

200 篇论文

Bayesian neural networks (BNNs) have become a principal approach to alleviate overconfident predictions in deep learning, but they often suffer from scaling issues due to a large number of distribution parameters. In this paper, we discover…

机器学习 · 计算机科学 2021-12-14 Shiye Lei , Zhuozhuo Tu , Leszek Rutkowski , Feng Zhou , Li Shen , Fengxiang He , Dacheng Tao

In deep learning, transfer learning and ensemble models have shown promise in improving computer-aided disease diagnosis. However, applying the transfer learning and ensemble model is still relatively limited. Moreover, the ensemble model's…

图像与视频处理 · 电气工程与系统科学 2024-09-11 Md Taimur Ahad , Sumaya Mustofa , Faruk Ahmed , Yousuf Rayhan Emon , Aunirudra Dey Anu

Deep neural networks are behind many of the recent successes in machine learning applications. However, these models can produce overconfident decisions while encountering out-of-distribution (OOD) examples or making a wrong prediction.…

机器学习 · 计算机科学 2021-06-24 Navid Kardan , Ankit Sharma , Kenneth O. Stanley

Recently recurrent neural networks (RNNs) have demonstrated the ability to improve scene labeling through capturing long-range dependencies among image units. In this paper, we propose dense RNNs for scene labeling by exploring various…

计算机视觉与模式识别 · 计算机科学 2018-01-23 Heng Fan , Haibin Ling

This work presents a novel ensemble of Bayesian Neural Networks (BNNs) for control of safety-critical systems. Decision making for safety-critical systems is challenging due to performance requirements with significant consequences in the…

机器人学 · 计算机科学 2020-01-10 Keuntaek Lee , Ziyi Wang , Bogdan I. Vlahov , Harleen K. Brar , Evangelos A. Theodorou

This paper integrates deep neural networks (DNNs) into structural economic models to increase flexibility and capture rich heterogeneity while preserving interpretability. Economic structure and machine learning are complements in empirical…

计量经济学 · 经济学 2025-04-28 Max H. Farrell , Tengyuan Liang , Sanjog Misra

Ensembles of CNN models trained with different seeds (also known as Deep Ensembles) are known to achieve superior performance over a single copy of the CNN. Neural Ensemble Search (NES) can further boost performance by adding architectural…

机器学习 · 计算机科学 2021-07-12 Ashwin Raaghav Narayanan , Arber Zela , Tonmoy Saikia , Thomas Brox , Frank Hutter

The development of neural networks has greatly improved the performance in various computer vision tasks. In the filed of image denoising, convolutional neural network based methods such as DnCNN break through the limits of classical…

图像与视频处理 · 电气工程与系统科学 2021-01-26 Xiaoqi Ma

Deep neural networks (DNNs) are powerful black-box predictors that have achieved impressive performance on a wide variety of tasks. However, their accuracy comes at the cost of intelligibility: it is usually unclear how they make their…

Deep neural networks have been successful in diverse discriminative classification tasks, although, they are poorly calibrated often assigning high probability to misclassified predictions. Potential consequences could lead to…

机器学习 · 统计学 2020-10-06 John Mitros , Arjun Pakrashi , Brian Mac Namee

Current end-to-end (E2E) and plug-and-play (PnP) image reconstruction algorithms approximate the maximum a posteriori (MAP) estimate but cannot offer sampling from the posterior distribution, like diffusion models. By contrast, it is…

图像与视频处理 · 电气工程与系统科学 2025-03-24 Jyothi Rikhab Chand , Mathews Jacob

Deep Evolutionary Network Structured Representation (DENSER) is a novel approach to automatically design Artificial Neural Networks (ANNs) using Evolutionary Computation. The algorithm not only searches for the best network topology (e.g.,…

神经与进化计算 · 计算机科学 2018-11-28 Filipe Assunção , Nuno Lourenço , Penousal Machado , Bernardete Ribeiro

Approximate Bayesian inference for neural networks is considered a robust alternative to standard training, often providing good performance on out-of-distribution data. However, Bayesian neural networks (BNNs) with high-fidelity…

机器学习 · 计算机科学 2021-12-07 Pavel Izmailov , Patrick Nicholson , Sanae Lotfi , Andrew Gordon Wilson

The task of quantifying the inherent uncertainty associated with neural network predictions is a key challenge in artificial intelligence. Bayesian neural networks (BNNs) and deep ensembles are among the most prominent approaches to tackle…

机器学习 · 计算机科学 2025-05-23 Valentin Villecroze , Yixin Wang , Gabriel Loaiza-Ganem

This study aims to comprehensively investigate the deep ensemble approach, an approximate Bayesian inference, in the multi-output regression task for predicting the aerodynamic performance of a missile configuration. To this end, the effect…

机器学习 · 计算机科学 2023-11-27 Sunwoong Yang , Kwanjung Yee

Comparing Bayesian neural networks (BNNs) with different widths is challenging because, as the width increases, multiple model properties change simultaneously, and, inference in the finite-width case is intractable. In this work, we…

机器学习 · 统计学 2022-11-29 Jiayu Yao , Yaniv Yacoby , Beau Coker , Weiwei Pan , Finale Doshi-Velez

Deep Neural Networks have shown promising classification performance when predicting certain biomarkers from Whole Slide Images in digital pathology. However, the calibration of the networks' output probabilities is often not evaluated.…

图像与视频处理 · 电气工程与系统科学 2023-12-18 Alexander Kurz , Hendrik A. Mehrtens , Tabea-Clara Bucher , Titus J. Brinker

Deep Neural Nets (DNNs) learn latent representations induced by their downstream task, objective function, and other parameters. The quality of the learned representations impacts the DNN's generalization ability and the coherence of the…

机器学习 · 计算机科学 2024-02-13 Nir Weingarten , Zohar Yakhini , Moshe Butman , Ran Gilad-Bachrach

Binary neural networks (BNNs), where both weights and activations are binarized into 1 bit, have been widely studied in recent years due to its great benefit of highly accelerated computation and substantially reduced memory footprint that…

计算机视觉与模式识别 · 计算机科学 2021-01-01 Zhuo Su , Linpu Fang , Deke Guo , Dewen Hu , Matti Pietikäinen , Li Liu

Learning the structure of Bayesian networks (BNs) from data is challenging, especially for datasets involving a large number of variables. The recently proposed divide-and-conquer (D\&D) strategies present a promising approach for learning…

机器学习 · 计算机科学 2025-07-01 Shengcai Liu , Hui Ou-yang , Zhiyuan Wang , Cheng Chen , Qijun Cai , Yew-Soon Ong , Ke Tang