English
Related papers

Related papers: Feature Learning in Deep Neural Networks - Studies…

200 papers

Deep neural networks (DNNs) exhibit high performance in image recognition; however, the reasons for their strong generalization abilities remain unclear. A plausible hypothesis is that DNNs achieve robust and accurate predictions by…

Machine Learning · Computer Science 2025-05-30 Keisuke Kawano , Takuro Kutsuna , Keisuke Sano

Deep Neural Networks (DNNs) are generated by sequentially performing linear and non-linear processes. Using a combination of linear and non-linear procedures is critical for generating a sufficiently deep feature space. The majority of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Yufei Hu , Nacim Belkhir , Jesus Angulo , Angela Yao , Gianni Franchi

Although deep neural networks (DNNs) have demonstrated impressive results during the last decade, they remain highly specialized tools, which are trained -- often from scratch -- to solve each particular task. The human brain, in contrast,…

Neural and Evolutionary Computing · Computer Science 2019-08-22 Alexander V. Terekhov , Guglielmo Montone , J. Kevin O'Regan

In the field of pattern recognition research, the method of using deep neural networks based on improved computing hardware recently attracted attention because of their superior accuracy compared to conventional methods. Deep neural…

Computer Vision and Pattern Recognition · Computer Science 2018-09-27 Kyongsik Yun , Alexander Huyen , Thomas Lu

Deep Neural Networks (DNNs) have demonstrated exceptional performance on most recognition tasks such as image classification and segmentation. However, they have also been shown to be vulnerable to adversarial examples. This phenomenon has…

Computer Vision and Pattern Recognition · Computer Science 2018-07-10 Anurag Arnab , Ondrej Miksik , Philip H. S. Torr

Biological data including gene expression data are generally high-dimensional and require efficient, generalizable, and scalable machine-learning methods to discover their complex nonlinear patterns. The recent advances in machine learning…

Machine Learning · Computer Science 2020-12-21 Dinesh Singh , Héctor Climente-González , Mathis Petrovich , Eiryo Kawakami , Makoto Yamada

As deep neural networks (DNNs) achieve tremendous success across many application domains, researchers tried to explore in many aspects on why they generalize well. In this paper, we provide a novel perspective on these issues using the…

Machine Learning · Computer Science 2020-02-25 Jinlong Liu , Guoqing Jiang , Yunzhi Bai , Ting Chen , Huayan Wang

Currently there is great interest in the utility of deep neural networks (DNNs) for the physical layer of radio frequency (RF) communications. In this manuscript, we describe a custom DNN specially designed to solve problems in the RF…

Signal Processing · Electrical Eng. & Systems 2021-09-23 Brian Shevitski , Yijing Watkins , Nicole Man , Michael Girard

Nowadays, we mainly use various convolution neural network (CNN) structures to extract features from radio data or spectrogram in AMR. Based on expert experience and spectrograms, they not only increase the difficulty of preprocessing, but…

Signal Processing · Electrical Eng. & Systems 2019-12-10 Miao Du , Qin Yu , Shaomin Fei , Chen Wang , Xiaofeng Gong , Ruisen Luo

Model-based methods and deep neural networks have both been tremendously successful paradigms in machine learning. In model-based methods, problem domain knowledge can be built into the constraints of the model, typically at the expense of…

Machine Learning · Computer Science 2014-11-21 John R. Hershey , Jonathan Le Roux , Felix Weninger

Recently deep neural networks (DNNs) have been used to learn speaker features. However, the quality of the learned features is not sufficiently good, so a complex back-end model, either neural or probabilistic, has to be used to address the…

Sound · Computer Science 2017-05-11 Lantian Li , Yixiang Chen , Ying Shi , Zhiyuan Tang , Dong Wang

Deep neural networks (DNNs) have set benchmarks on a wide array of supervised learning tasks. Trained DNNs, however, often lack robustness to minor adversarial perturbations to the input, which undermines their true practicality. Recent…

Machine Learning · Computer Science 2018-11-20 Farzan Farnia , Jesse M. Zhang , David Tse

Given the rapid changes in telecommunication systems and their higher dependence on artificial intelligence, it is increasingly important to have models that can perform well under different, possibly adverse, conditions. Deep Neural…

Signal Processing · Electrical Eng. & Systems 2021-03-30 Javier Maroto , Gérôme Bovet , Pascal Frossard

Deep Neural Networks (DNNs) have emerged as a core tool for machine learning. The computations performed during DNN training and inference are dominated by operations on the weight matrices describing the DNN. As DNNs incorporate more…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-06 Jeremy Kepner , Manoj Kumar , José Moreira , Pratap Pattnaik , Mauricio Serrano , Henry Tufo

Deep learning models have been shown to outperform methods that rely on summary statistics, like the power spectrum, in extracting information from complex cosmological data sets. However, due to differences in the subgrid physics…

Cosmology and Nongalactic Astrophysics · Physics 2024-04-16 Andrea Roncoli , Aleksandra Ćiprijanović , Maggie Voetberg , Francisco Villaescusa-Navarro , Brian Nord

Deep neural networks (DNNs) are powerful tools for compressing and distilling information. Their scale and complexity, often involving billions of inter-dependent parameters, render direct microscopic analysis difficult. Under such…

Machine Learning · Statistics 2022-09-26 Inbar Seroussi , Gadi Naveh , Zohar Ringel

Deep Neural Networks (DNNs) are powerful algorithms that have been proven capable of extracting non-Gaussian information from weak lensing (WL) data sets. Understanding which features in the data determine the output of these nested,…

Cosmology and Nongalactic Astrophysics · Physics 2021-04-14 José Manuel Zorrilla Matilla , Manasi Sharma , Daniel Hsu , Zoltán Haiman

In deep learning, dense layer connectivity has become a key design principle in deep neural networks (DNNs), enabling efficient information flow and strong performance across a range of applications. In this work, we model densely connected…

Machine Learning · Computer Science 2025-10-03 Jinshu Huang , Haibin Su , Xue-Cheng Tai , Chunlin Wu

Deep neural networks (DNNs) are powerful black-box predictors that have achieved impressive performance on a wide variety of tasks. However, their accuracy comes at the cost of intelligibility: it is usually unclear how they make their…

Machine Learning · Computer Science 2021-10-26 Rishabh Agarwal , Levi Melnick , Nicholas Frosst , Xuezhou Zhang , Ben Lengerich , Rich Caruana , Geoffrey Hinton

An important characteristic of neural networks is their ability to learn representations of the input data with effective features for prediction, which is believed to be a key factor to their superior empirical performance. To better…

Machine Learning · Computer Science 2022-06-06 Zhenmei Shi , Junyi Wei , Yingyu Liang