English
Related papers

Related papers: Deep Belief Network Training Improvement Using Eli…

200 papers

Imbalanced data with a skewed class distribution are common in many real-world applications. Deep Belief Network (DBN) is a machine learning technique that is effective in classification tasks. However, conventional DBN does not work well…

Machine Learning · Computer Science 2018-05-08 Chong Zhang , Kay Chen Tan , Haizhou Li , Geok Soon Hong

We show how deep learning methods can be applied in the context of crowdsourcing and unsupervised ensemble learning. First, we prove that the popular model of Dawid and Skene, which assumes that all classifiers are conditionally…

Machine Learning · Statistics 2017-04-24 Uri Shaham , Xiuyuan Cheng , Omer Dror , Ariel Jaffe , Boaz Nadler , Joseph Chang , Yuval Kluger

An adaptive structural learning method of Restricted Boltzmann Machine (RBM) and Deep Belief Network (DBN) has been developed as one of prominent deep learning models. The neuron generation-annihilation algorithm in RBM and layer generation…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Shin Kamada , Takumi Ichimura

Deep neural networks (DNNs) depend on the storage of a large number of parameters, which consumes an important portion of the energy used during inference. This paper considers the case where the energy usage of memory elements can be…

Machine Learning · Computer Science 2019-12-24 Sébastien Henwood , François Leduc-Primeau , Yvon Savaria

Deep neural networks ( DNNs ) are becoming a key enabling technology for many application domains. However, on-device inference on battery-powered, resource-constrained embedding systems is often infeasible due to prohibitively long…

Machine Learning · Computer Science 2019-11-13 Vicent Sanz Marco , Ben Taylor , Zheng Wang , Yehia Elkhatib

The power budget for embedded hardware implementations of Deep Learning algorithms can be extremely tight. To address implementation challenges in such domains, new design paradigms, like Approximate Computing, have drawn significant…

Image and Video Processing · Electrical Eng. & Systems 2019-03-27 Ian Colbert , Ken Kreutz-Delgado , Srinjoy Das

Deep Boltzmann machines (DBMs), one of the first ``deep'' learning methods ever studied, are multi-layered probabilistic models governed by a pairwise energy function that describes the likelihood of all variables/nodes in the network. In…

Machine Learning · Computer Science 2023-07-12 Zhili Feng , Ezra Winston , J. Zico Kolter

Deep learning (DL) has achieved remarkable successes in many disciplines such as computer vision and natural language processing due to the availability of ``big data''. However, such success cannot be easily replicated in many nuclear…

Machine Learning · Computer Science 2023-12-22 Farah Alsafadi , Xu Wu

Deep belief networks (DBNs) are stochastic neural networks that can extract rich internal representations of the environment from the sensory data. DBNs had a catalytic effect in triggering the deep learning revolution, demonstrating for…

Machine Learning · Computer Science 2024-02-08 Matteo Zambra , Alberto Testolin , Marco Zorzi

Deep learning methods relying on multi-layered networks have been actively studied in a wide range of fields in recent years, and deep Boltzmann machines(DBMs) is one of them. In this study, a model of DBMs with some properites of weight…

Disordered Systems and Neural Networks · Physics 2022-10-06 Yuma Ichikawa , Koji Hukushima

We develop a probabilistic framework for deep learning based on the Deep Rendering Mixture Model (DRMM), a new generative probabilistic model that explicitly capture variations in data due to latent task nuisance variables. We demonstrate…

Machine Learning · Statistics 2016-12-07 Ankit B. Patel , Tan Nguyen , Richard G. Baraniuk

Estimation of Distribution Algorithms (EDAs) require flexible probability models that can be efficiently learned and sampled. Deep Boltzmann Machines (DBMs) are generative neural networks with these desired properties. We integrate a DBM…

Neural and Evolutionary Computing · Computer Science 2016-08-09 Malte Probst , Franz Rothlauf

Deep kernel learning aims at designing nonlinear combinations of multiple standard elementary kernels by training deep networks. This scheme has proven to be effective, but intractable when handling large-scale datasets especially when the…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Mingyuan Jiu , Hichem Sahbi

We propose a novel deep neural network (DNN) based approximation architecture to learn estimates of measurements. We detail an algorithm that enables training of the DNN. The DNN estimator only uses measurements, if and when they are…

Machine Learning · Computer Science 2022-09-13 Shivangi Agarwal , Sanjit K. Kaul , Saket Anand , P. B. Sujit

Deep generative models (DGM) are neural networks with many hidden layers trained to approximate complicated, high-dimensional probability distributions using a large number of samples. When trained successfully, we can use the DGMs to…

Machine Learning · Computer Science 2021-04-13 Lars Ruthotto , Eldad Haber

The Deep Material Network (DMN) has emerged as a powerful framework for multiscale materials modeling, enabling efficient and accurate prediction of material behavior across different length scales. Unlike conventional data-driven…

Computational Engineering, Finance, and Science · Computer Science 2026-03-23 Ting-Ju Wei , Wen-Ning Wan , Chuin-Shan Chen

Deep learning approaches require collection of data on many different input features or variables for accurate model training and prediction. Since data collection on input features could be costly, it is crucial to reduce the cost by…

Machine Learning · Computer Science 2023-02-24 Rui Ming , Haiping Xu , Shannon E. Gibbs , Donghui Yan , Ming Shao

Deep Material Networks (DMNs) are structure-preserving, mechanistic machine learning models that embed micromechanical principles into their architectures, enabling strong extrapolation capabilities and significant potential to accelerate…

Machine Learning · Computer Science 2026-02-10 Xiaolong He , Haoyan Wei , Wei Hu , Henan Mao , C. T. Wu

Location-based services (LBS) are witnessing a rise in popularity owing to their key features of delivering powerful and personalized digital experiences. The recent developments in wireless sensing techniques make the realization of…

Signal Processing · Electrical Eng. & Systems 2023-05-30 Osamah A. Abdullah , Hayder Al-Hraishawi , Symeon Chatzinotas

Since the advent of deep learning, it has been used to solve various problems using many different architectures. The application of such deep architectures to auditory data is also not uncommon. However, these architectures do not always…

Machine Learning · Computer Science 2014-12-25 Kratarth Goel , Raunaq Vohra