中文
相关论文

相关论文: Sparse Penalty in Deep Belief Networks: Using the …

200 篇论文

Pruning neural networks has proven to be a successful approach to increase the efficiency and reduce the memory storage of deep learning models without compromising performance. Previous literature has shown that it is possible to achieve a…

机器学习 · 计算机科学 2024-08-12 Joaquin Alvarez

Machine learning techniques have received growing attention as an alternative strategy for developing general-purpose density functional approximations, augmenting the historically successful approach of human designed functionals derived…

Deep learning has been wildly successful in practice and most state-of-the-art machine learning methods are based on neural networks. Lacking, however, is a rigorous mathematical theory that adequately explains the amazing performance of…

机器学习 · 统计学 2023-10-03 Rahul Parhi , Robert D. Nowak

Deep neural networks (DNNs) frequently contain far more weights, represented at a higher precision, than are required for the specific task which they are trained to perform. Consequently, they can often be compressed using techniques such…

机器学习 · 计算机科学 2020-12-03 Vinu Joseph , Saurav Muralidharan , Animesh Garg , Michael Garland , Ganesh Gopalakrishnan

Bayesian neural networks (BNNs) offer uncertainty quantification but come with the downside of substantially increased training and inference costs. Sparse BNNs have been investigated for efficient inference, typically by either slowly…

机器学习 · 计算机科学 2024-02-20 Junbo Li , Zichen Miao , Qiang Qiu , Ruqi Zhang

Building robust online content recommendation systems requires learning complex interactions between user preferences and content features. The field has evolved rapidly in recent years from traditional multi-arm bandit and collaborative…

信息检索 · 计算机科学 2018-05-08 Yoel Zeldes , Stavros Theodorakis , Efrat Solodnik , Aviv Rotman , Gil Chamiel , Dan Friedman

Deep Belief Network (DBN) has a deep architecture that represents multiple features of input patterns hierarchically with the pre-trained Restricted Boltzmann Machines (RBM). A traditional RBM or DBN model cannot change its network…

神经与进化计算 · 计算机科学 2018-07-12 Shin Kamada , Takumi Ichimura

Deep Neural Networks (DNNs) are powerful tools for various computer vision tasks, yet they often struggle with reliable uncertainty quantification - a critical requirement for real-world applications. Bayesian Neural Networks (BNN) are…

机器学习 · 计算机科学 2023-12-27 Gianni Franchi , Olivier Laurent , Maxence Leguéry , Andrei Bursuc , Andrea Pilzer , Angela Yao

Cognition in midlife is an important predictor of age-related mental decline and statistical models that predict cognitive performance can be useful for predicting decline. However, existing models struggle to capture complex relationships…

机器学习 · 计算机科学 2021-12-30 Sharath Koorathota , Arunesh Mittal , Richard P. Sloan , Paul Sajda

Deep Learning has a hierarchical network architecture to represent the complicated feature of input patterns. The adaptive structural learning method of Deep Belief Network (DBN) has been developed. The method can discover an optimal number…

神经与进化计算 · 计算机科学 2018-08-28 Shin Kamada , Takumi Ichimura , Toshihide Harada

This work develops rigorous theoretical basis for the fact that deep Bayesian neural network (BNN) is an effective tool for high-dimensional variable selection with rigorous uncertainty quantification. We develop new Bayesian non-parametric…

机器学习 · 统计学 2019-12-04 Jeremiah Zhe Liu

In this work, we propose a new training method for finding minimum weight norm solutions in over-parameterized neural networks (NNs). This method seeks to improve training speed and generalization performance by framing NN training as a…

机器学习 · 统计学 2018-06-22 Yamini Bansal , Madhu Advani , David D Cox , Andrew M Saxe

Deep Neural Networks (DNNs) have emerged as a core tool for machine learning. The computations performed during DNN training and inference are dominated by operations on the weight matrices describing the DNN. As DNNs incorporate more…

分布式、并行与集群计算 · 计算机科学 2018-03-06 Jeremy Kepner , Manoj Kumar , José Moreira , Pratap Pattnaik , Mauricio Serrano , Henry Tufo

Efficiently quantifying predictive uncertainty in medical images remains a challenge. While Bayesian neural networks (BNN) offer predictive uncertainty, they require substantial computational resources to train. Although Bayesian…

计算机视觉与模式识别 · 计算机科学 2024-11-21 Zeinab Abboud , Herve Lombaert , Samuel Kadoury

In an ever expanding set of research and application areas, deep neural networks (DNNs) set the bar for algorithm performance. However, depending upon additional constraints such as processing power and execution time limits, or…

机器学习 · 计算机科学 2021-06-22 Nathan Dahlin , Krishna Chaitanya Kalagarla , Nikhil Naik , Rahul Jain , Pierluigi Nuzzo

Deep belief networks are used extensively for unsupervised stochastic learning on large datasets. Compared to other deep learning approaches their layer-by-layer learning makes them highly scalable. Unfortunately, the principles by which…

无序系统与神经网络 · 物理学 2019-07-15 Swapnil Nitin Shah

Translating machine learning algorithms into clinical applications requires addressing challenges related to interpretability, such as accounting for the effect of confounding variables (or metadata). Confounding variables affect the…

机器学习 · 计算机科学 2022-07-12 Anthony Vento , Qingyu Zhao , Robert Paul , Kilian M. Pohl , Ehsan Adeli

Deep Neural Networks (DNNs) have achieved state-of-the-art accuracy performance in many tasks. However, recent works have pointed out that the outputs provided by these models are not well-calibrated, seriously limiting their use in…

机器学习 · 计算机科学 2020-07-16 Juan Maroñas , Roberto Paredes , Daniel Ramos

Recently, there has been a significant focus on exploring the theoretical aspects of deep learning, especially regarding its performance in classification tasks. Bayesian deep learning has emerged as a unified probabilistic framework,…

统计理论 · 数学 2025-01-24 The Tien Mai

While deep learning has demonstrated impressive progress, it remains a daunting challenge to learn from hard samples as these samples are usually noisy and intricate. These hard samples play a crucial role in the optimal performance of deep…

计算机视觉与模式识别 · 计算机科学 2024-12-30 Qiao Xiao , Boqian Wu , Lu Yin , Christopher Neil Gadzinski , Tianjin Huang , Mykola Pechenizkiy , Decebal Constantin Mocanu