English
Related papers

Related papers: On the Evolution of Neuron Communities in a Deep L…

200 papers

Recent artificial neural networks that process natural language achieve unprecedented performance in tasks requiring sentence-level understanding. As such, they could be interesting models of the integration of linguistic information in the…

Computation and Language · Computer Science 2023-02-17 Sophie Arana , Jacques Pesnot Lerousseau , Peter Hagoort

To be effective, efficient, and diverse, deep learning models need to dynamically choose its architecture based on signals from a population of neurons. We hypothesize dynamic routing models can be improved with neural inhibition in those…

Machine Learning · Computer Science 2025-07-08 Will Y. Zou , Jennifer Y. Zhang

The scientific community has been increasingly interested in harnessing the power of deep learning to solve various domain challenges. However, despite the effectiveness in building predictive models, fundamental challenges exist in…

Machine Learning · Computer Science 2020-07-20 Shusen Liu , Bhavya Kailkhura , Jize Zhang , Anna M. Hiszpanski , Emily Robertson , Donald Loveland , T. Yong-Jin Han

Understanding the behavior of Artificial Neural Networks is one of the main topics in the field recently, as black-box approaches have become usual since the widespread of deep learning. Such high-dimensional models may manifest…

Machine Learning · Computer Science 2021-07-30 Leonardo F. S. Scabini , Odemir M. Bruno

Modern neural network architectures for large-scale learning tasks have substantially higher model complexities, which makes understanding, visualizing and training these architectures difficult. Recent contributions to deep learning…

Machine Learning · Computer Science 2024-10-30 Jayadeva , Himanshu Pant , Mayank Sharma , Abhimanyu Dubey , Sumit Soman , Suraj Tripathi , Sai Guruju , Nihal Goalla

As the discipline has evolved, research in machine learning has been focused more and more on creating more powerful neural networks, without regard for the interpretability of these networks. Such "black-box models" yield state-of-the-art…

Machine Learning · Computer Science 2021-09-02 Lachlan O'Neill , Simon Angus , Satya Borgohain , Nader Chmait , David L. Dowe

Deep learning based on artificial neural networks is a powerful machine learning method that, in the last few years, has been successfully used to realize tasks, e.g., image classification, speech recognition, translation of languages,…

Information Theory · Computer Science 2019-06-18 Alessio Zappone , Marco Di Renzo , Mérouane Debbah , Thanh Tu Lam , Xuewen Qian

In recent years, there has been increasing interest in developing models and tools to address the complex patterns of connectivity found in brain tissue. Specifically, this is due to a need to understand how emergent properties emerge from…

Neurons and Cognition · Quantitative Biology 2022-04-15 Sean Knight , Navjot Gadda

Deep neural networks (DNs) provide superhuman performance in numerous computer vision tasks, yet it remains unclear exactly which of a DN's units contribute to a particular decision. NeuroView is a new family of DN architectures that are…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 CJ Barberan , Randall Balestriero , Richard G. Baraniuk

Despite deep-learning being state-of-the-art for data-driven model predictions, it has not yet found frequent application in ecology. Given the low sample size typical in many environmental research fields, the default choice for the…

Applications · Statistics 2022-09-29 Marieke Wesselkamp , Niklas Moser , Maria Kalweit , Joschka Boedecker , Carsten F. Dormann

Neural networks are powerful functions with widespread use, but the theoretical behaviour of these functions is not fully understood. Creating deep neural networks by stacking many layers has achieved exceptional performance in many…

Machine Learning · Computer Science 2024-08-16 Cameron Jakub , Mihai Nica

Recent efforts to understand intermediate representations in deep neural networks have commonly attempted to label individual neurons and combinations of neurons that make up linear directions in the latent space by examining extremal…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Laura O'Mahony , Nikola S. Nikolov , David JP O'Sullivan

Identification of different neuronal cell types is critical for understanding their contribution to brain functions. Yet, automated and reliable classification of neurons remains a challenge, primarily because of their biological…

Neural and Evolutionary Computing · Computer Science 2020-09-29 Eirini Troullinou , Grigorios Tsagkatakis , Spyridon Chavlis , Gergely Turi , Wen-Ke Li , Attila Losonczy , Panagiotis Tsakalides , Panayiota Poirazi

Deep learning algorithms demonstrate a surprising ability to learn high-dimensional tasks from limited examples. This is commonly attributed to the depth of neural networks, enabling them to build a hierarchy of abstract, low-dimensional…

Machine Learning · Computer Science 2024-07-04 Francesco Cagnetta , Leonardo Petrini , Umberto M. Tomasini , Alessandro Favero , Matthieu Wyart

We propose two new criteria to understand the advantage of deepening neural networks. It is important to know the expressivity of functions computable by deep neural networks in order to understand the advantage of deepening neural…

Machine Learning · Computer Science 2024-03-06 Yasushi Esaki , Yuta Nakahara , Toshiyasu Matsushima

Recently deep neural networks demonstrate competitive performances in classification and regression tasks for many temporal or sequential data. However, it is still hard to understand the classification mechanisms of temporal deep neural…

Machine Learning · Computer Science 2020-07-13 Sohee Cho , Ginkyeng Lee , Wonjoon Chang , Jaesik Choi

Deep Neural networks are efficient and flexible models that perform well for a variety of tasks such as image, speech recognition and natural language understanding. In particular, convolutional neural networks (CNN) generate a keen…

Machine Learning · Computer Science 2018-12-20 Yesmina Jaafra , Jean Luc Laurent , Aline Deruyver , Mohamed Saber Naceur

Deep neural networks, despite their success in numerous applications, often function without established theoretical foundations. In this paper, we bridge this gap by drawing parallels between deep learning and classical numerical analysis.…

Machine Learning · Computer Science 2023-10-04 Emanuele Zappala , Daniel Levine , Sizhuang He , Syed Rizvi , Sacha Levy , David van Dijk

Neural activity forecasting is central to understanding neural systems and enabling closed-loop control. While deep learning has recently advanced the state-of-the-art in the time series forecasting literature, its application to neural…

Deep learning models suffer from opaqueness. For Convolutional Neural Networks (CNNs), current research strategies for explaining models focus on the target classes within the associated training dataset. As a result, the understanding of…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Xuehao Liu , Sarah Jane Delany , Susan McKeever