English
Related papers

Related papers: Understanding Deep Neural Networks Using Topologic…

200 papers

Topological data analysis (TDA) is a branch of computational mathematics, bridging algebraic topology and data science, that provides compact, noise-robust representations of complex structures. Deep neural networks (DNNs) learn millions of…

Deep Neural Networks are, from a physical perspective, graphs whose `links` and `vertices` iteratively process data and solve tasks sub-optimally. We use Complex Network Theory (CNT) to represents Deep Neural Networks (DNNs) as directed…

Machine Learning · Computer Science 2022-09-14 Emanuele La Malfa , Gabriele La Malfa , Claudio Caprioli , Giuseppe Nicosia , Vito Latora

We use topological data analysis (TDA) to study how data transforms as it passes through successive layers of a deep neural network (DNN). We compute the persistent homology of the activation data for each layer of the network and summarize…

Machine Learning · Computer Science 2022-05-09 Matthew Wheeler , Jose Bouza , Peter Bubenik

Despite significant advances in the field of deep learning in ap-plications to various areas, an explanation of the learning pro-cess of neural network models remains an important open ques-tion. The purpose of this paper is a comprehensive…

Machine Learning · Computer Science 2023-06-07 German Magai

Deep Neural Networks (DNNs) are universal function approximators providing state-of- the-art solutions on wide range of applications. Common perceptual tasks such as speech recognition, image classification, and object tracking are now…

Machine Learning · Statistics 2017-11-08 Randall Balestriero , Richard Baraniuk

Deep Neural Networks (DNNs) are generated by sequentially performing linear and non-linear processes. Using a combination of linear and non-linear procedures is critical for generating a sufficiently deep feature space. The majority of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Yufei Hu , Nacim Belkhir , Jesus Angulo , Angela Yao , Gianni Franchi

It is commonly believed that the hidden layers of deep neural networks (DNNs) attempt to extract informative features for learning tasks. In this paper, we formalize this intuition by showing that the features extracted by DNN coincide with…

Information Theory · Computer Science 2019-05-17 Shao-Lun Huang , Xiangxiang Xu , Lizhong Zheng , Gregory W. Wornell

Nonlinear methods such as Deep Neural Networks (DNNs) are the gold standard for various challenging machine learning problems, e.g., image classification, natural language processing or human action recognition. Although these methods…

Machine Learning · Computer Science 2017-11-15 Grégoire Montavon , Sebastian Bach , Alexander Binder , Wojciech Samek , Klaus-Robert Müller

Despite the remarkable performance, Deep Neural Networks (DNNs) behave as black-boxes hindering user trust in Artificial Intelligence (AI) systems. Research on opening black-box DNN can be broadly categorized into post-hoc methods and…

Machine Learning · Computer Science 2021-06-25 Sandareka Wickramanayake , Wynne Hsu , Mong Li Lee

Artificial Neural Networks (ANNs) require significant amounts of data and computational resources to achieve high effectiveness in performing the tasks for which they are trained. To reduce resource demands, various techniques, such as…

Neural and Evolutionary Computing · Computer Science 2024-12-04 A. Stolarek , W. Jaworek

Recently, deep neural network (DNN)-based physical layer communication techniques have attracted considerable interest. Although their potential to enhance communication systems and superb performance have been validated by simulation…

Signal Processing · Electrical Eng. & Systems 2022-08-30 Jun Liu , Haitao Zhao , Dongtang Ma , Kai Mei , Jibo Wei

The theoretical explanation for deep neural network (DNN) is still an open problem. In this paper DNN is considered as a discrete-time dynamical system due to its layered structure. The complexity provided by the nonlinearity in the…

Machine Learning · Computer Science 2019-01-09 Husheng Li

Deep neural networks (DNNs) are powerful types of artificial neural networks (ANNs) that use several hidden layers. They have recently gained considerable attention in the speech transcription and image recognition community (Krizhevsky et…

Machine Learning · Computer Science 2017-06-15 Matthew Dixon , Diego Klabjan , Jin Hoon Bang

Not only are Deep Neural Networks (DNNs) black box models, but also we frequently conceptualize them as such. We lack good interpretations of the mechanisms linking inputs to outputs. Therefore, we find it difficult to analyze in…

Machine Learning · Computer Science 2020-06-29 Christopher Snyder , Sriram Vishwanath

Deep Neural Networks (DNNs) can be represented as graphs whose links and vertices iteratively process data and solve tasks sub-optimally. Complex Network Theory (CNT), merging statistical physics with graph theory, provides a method for…

Machine Learning · Computer Science 2024-04-19 Emanuele La Malfa , Gabriele La Malfa , Giuseppe Nicosia , Vito Latora

This survey provides a comprehensive exploration of applications of Topological Data Analysis (TDA) within neural network analysis. Using TDA tools such as persistent homology and Mapper, we delve into the intricate structures and behaviors…

Machine Learning · Computer Science 2024-01-04 Rubén Ballester , Carles Casacuberta , Sergio Escalera

Deep neural networks (DNNs) have been shown to outperform traditional machine learning algorithms in a broad variety of application domains due to their effectiveness in modeling complex problems and handling high-dimensional datasets. Many…

Convolutional neural networks (CNN's) are powerful and widely used tools. However, their interpretability is far from ideal. One such shortcoming is the difficulty of deducing a network's ability to generalize to unseen data. We use…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Rickard Brüel Gabrielsson , Gunnar Carlsson

Deep Neural Network (DNN)-based physical layer techniques are attracting considerable interest due to their potential to enhance communication systems. However, most studies in the physical layer have tended to focus on the application of…

Signal Processing · Electrical Eng. & Systems 2022-02-22 Jun Liu , Haitao Zhao , Dongtang Ma , Kai Mei , Jibo Wei

Developing Intelligent Systems involves artificial intelligence approaches including artificial neural networks. Here, we present a tutorial of Deep Neural Networks (DNNs), and some insights about the origin of the term "deep"; references…

Neural and Evolutionary Computing · Computer Science 2016-03-24 Juan C. Cuevas-Tello , Manuel Valenzuela-Rendon , Juan A. Nolazco-Flores
‹ Prev 1 2 3 10 Next ›