English
Related papers

Related papers: Deep Belief Network Training Improvement Using Eli…

200 papers

For the past couple of decades, numerical optimization has played a central role in addressing wireless resource management problems such as power control and beamformer design. However, optimization algorithms often entail considerable…

Information Theory · Computer Science 2018-09-18 Haoran Sun , Xiangyi Chen , Qingjiang Shi , Mingyi Hong , Xiao Fu , Nicholas D. Sidiropoulos

Modern neural network architectures for large-scale learning tasks have substantially higher model complexities, which makes understanding, visualizing and training these architectures difficult. Recent contributions to deep learning…

Machine Learning · Computer Science 2024-10-30 Jayadeva , Himanshu Pant , Mayank Sharma , Abhimanyu Dubey , Sumit Soman , Suraj Tripathi , Sai Guruju , Nihal Goalla

Deep Neural Networks (DNN) are core components for classification and regression tasks of many software systems. Companies incur in high costs for testing DNN with datasets representative of the inputs expected in operation, as these need…

Software Engineering · Computer Science 2024-03-29 Antonio Guerriero , Roberto Pietrantuono , Stefano Russo

Recent approaches based on metric learning have achieved great progress in few-shot learning. However, most of them are limited to image-level representation manners, which fail to properly deal with the intra-class variations and spatial…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Chao Dong , Qi Ye , Wenchao Meng , Kaixiang Yang

Testing of deep learning models is challenging due to the excessive number and complexity of computations involved. As a result, test data selection is performed manually and in an ad hoc way. This raises the question of how we can…

Machine Learning · Computer Science 2019-05-01 Wei Ma , Mike Papadakis , Anestis Tsakmalis , Maxime Cordy , Yves Le Traon

In this paper, we investigate deep learning (DL)-enabled signal demodulation methods and establish the first open dataset of real modulated signals for wireless communication systems. Specifically, we propose a flexible communication…

Signal Processing · Electrical Eng. & Systems 2019-03-12 Hongmei Wang , Zhenzhen Wu , Shuai Ma , Songtao Lu , Han Zhang , Guoru Ding , Shiyin Li

Image reconstruction using deep learning algorithms offers improved reconstruction quality and lower reconstruction time than classical compressed sensing and model-based algorithms. Unfortunately, clean and fully sampled ground-truth data…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Hemant Kumar Aggarwal , Aniket Pramanik , Maneesh John , Mathews Jacob

Recent advances in training deep (multi-layer) architectures have inspired a renaissance in neural network use. For example, deep convolutional networks are becoming the default option for difficult tasks on large datasets, such as image…

Neural and Evolutionary Computing · Computer Science 2016-02-17 Mark D. McDonnell , Migel D. Tissera , Tony Vladusich , André van Schaik , Jonathan Tapson

In recent years multilayer perceptrons (MLPs) with many hid- den layers Deep Neural Network (DNN) has performed sur- prisingly well in many speech tasks, i.e. speech recognition, speaker verification, speech synthesis etc. Although in the…

Machine Learning · Computer Science 2015-02-19 Sankar Mukherjee , Shyamal Kumar Das Mandal

Large-scale deep neural networks (DNN) have been successfully used in a number of tasks from image recognition to natural language processing. They are trained using large training sets on large models, making them computationally and…

Machine Learning · Computer Science 2017-03-28 Sek Chai , Aswin Raghavan , David Zhang , Mohamed Amer , Tim Shields

This paper presents a novel deep learning based method for automatic malware signature generation and classification. The method uses a deep belief network (DBN), implemented with a deep stack of denoising autoencoders, generating an…

Cryptography and Security · Computer Science 2017-11-27 Eli David , Nathan S. Netanyahu

Deep learning techniques have recently emerged to efficiently manage mmWave beam transmissions without requiring time consuming beam sweeping strategies. A fundamental challenge in these methods is their dependency on hardware-specific…

Signal Processing · Electrical Eng. & Systems 2025-01-08 Omar Mashaal , Elsayed Mohammed , Alec Digby , Lorne Swersky , Ashkan Eshaghbeigi , Hatem Abou-Zeid

Recent advancements in multi-modal artificial intelligence (AI) have revolutionized the fields of stock market forecasting and heart rate monitoring. Utilizing diverse data sources can substantially improve prediction accuracy. Nonetheless,…

Machine Learning · Computer Science 2024-03-21 Zihong Luo , Zheng Tao , Yuxuan Huang , Kexin He , Chengzhi Liu

We present energy-based generative flow networks (EB-GFN), a novel probabilistic modeling algorithm for high-dimensional discrete data. Building upon the theory of generative flow networks (GFlowNets), we model the generation process by a…

Machine Learning · Computer Science 2022-06-10 Dinghuai Zhang , Nikolay Malkin , Zhen Liu , Alexandra Volokhova , Aaron Courville , Yoshua Bengio

In this paper, deep neural network (DNN) is utilized to improve the belief propagation (BP) detection for massive multiple-input multiple-output (MIMO) systems. A neural network architecture suitable for detection task is firstly introduced…

Signal Processing · Electrical Eng. & Systems 2018-04-06 Xiaosi Tan , Weihong Xu , Yair Be'ery , Zaichen Zhang , Xiaohu You , Chuan Zhang

While energy-based models (EBMs) exhibit a number of desirable properties, training and sampling on high-dimensional datasets remains challenging. Inspired by recent progress on diffusion probabilistic models, we present a diffusion…

Machine Learning · Computer Science 2021-03-30 Ruiqi Gao , Yang Song , Ben Poole , Ying Nian Wu , Diederik P. Kingma

Training energy-based models (EBMs) on high-dimensional data can be both challenging and time-consuming, and there exists a noticeable gap in sample quality between EBMs and other generative frameworks like GANs and diffusion models. To…

Machine Learning · Statistics 2024-11-12 Yaxuan Zhu , Jianwen Xie , Yingnian Wu , Ruiqi Gao

Bayesian neural networks (BNN) and deep ensembles are principled approaches to estimate the predictive uncertainty of a deep learning model. However their practicality in real-time, industrial-scale applications are limited due to their…

Machine Learning · Computer Science 2020-10-27 Jeremiah Zhe Liu , Zi Lin , Shreyas Padhy , Dustin Tran , Tania Bedrax-Weiss , Balaji Lakshminarayanan

In this paper we present an approach for training deep generative models solely based on solving determined systems of linear equations. A network that uses this approach, called a StarNet, has the following desirable properties: 1)…

Machine Learning · Computer Science 2021-01-08 Amir Zadeh , Santiago Benoit , Louis-Philippe Morency

The free energy of a system is central to many material models. Although free energy data is not generally found directly, its derivatives can be observed or calculated. In this work, we present an Integrable Deep Neural Network (IDNN) that…

Materials Science · Physics 2019-06-26 G. H. Teichert , A. R. Natarajan , A. Van der Ven , K. Garikipati