English
Related papers

Related papers: Detecting Information Relays in Deep Neural Networ…

200 papers

Relational reasoning is a central component of generally intelligent behavior, but has proven difficult for neural networks to learn. In this paper we describe how to use Relation Networks (RNs) as a simple plug-and-play module to solve…

Computation and Language · Computer Science 2017-06-06 Adam Santoro , David Raposo , David G. T. Barrett , Mateusz Malinowski , Razvan Pascanu , Peter Battaglia , Timothy Lillicrap

Reflection on one's thought process and making corrections to it if there exists dissatisfaction in its performance is, perhaps, one of the essential traits of intelligence. However, such high-level abstract concepts mandatory for…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Stanislav Selitskiy

The artificial neural network shows powerful ability of inference, but it is still criticized for lack of interpretability and prerequisite needs of big dataset. This paper proposes the Rule-embedded Neural Network (ReNN) to overcome the…

Machine Learning · Computer Science 2018-09-03 Hu Wang

Understanding how high-level concepts are represented within artificial neural networks is a fundamental challenge in the field of artificial intelligence. While existing literature in explainable AI emphasizes the importance of labeling…

Machine Learning · Computer Science 2024-05-17 Abhilekha Dalal , Rushrukh Rayan , Pascal Hitzler

Recurrent Neural Networks (RNNs) have been proven to be effective in modeling sequential data and they have been applied to boost a variety of tasks such as document classification, speech recognition and machine translation. Most of…

Computation and Language · Computer Science 2018-08-21 Zhiwei Wang , Yao Ma , Dawei Yin , Jiliang Tang

Network analysis is rapidly becoming a standard tool for studying functional magnetic resonance imaging (fMRI) data. In this framework, different brain areas are mapped to the nodes of a network, whose links depict functional dependencies…

Neurons and Cognition · Quantitative Biology 2017-05-30 Rainer Kujala , Enrico Glerean , Raj Kumar Pan , Iiro P. Jääskeläinen , Mikko Sams , Jari Saramäki

Data missingness and quality are common problems in machine learning, especially for high-stakes applications such as healthcare. Developers often train machine learning models on carefully curated datasets using only high quality data;…

Artificial neural network (ANN) is a supervised learning algorithm, where parameters are learned by several back-and-forth iterations of passing the inputs through the network, comparing the output with the expected labels, and correcting…

Cryptography and Security · Computer Science 2021-10-13 Mohammad Sadeq Dousti

The paper considers the problem of deep-learning-based classification of digitally modulated signals using I/Q data and studies the generalization ability of a trained neural network (NN) to correctly classify digitally modulated signals it…

Signal Processing · Electrical Eng. & Systems 2023-07-06 John A. Snoap , Dimitrie C. Popescu , Chad M. Spooner

Deep learning based on artificial neural networks is a powerful machine learning method that, in the last few years, has been successfully used to realize tasks, e.g., image classification, speech recognition, translation of languages,…

Information Theory · Computer Science 2019-06-18 Alessio Zappone , Marco Di Renzo , Mérouane Debbah , Thanh Tu Lam , Xuewen Qian

What has an Artificial Neural Network (ANN) learned after being successfully trained to solve a task - the set of training items or the relations between them? This question is difficult to answer for modern applied ANNs because of their…

Machine Learning · Computer Science 2024-04-22 Renate Krause , Stefan Reimann

In biological evolution complex neural structures grow from a handful of cellular ingredients. As genomes in nature are bounded in size, this complexity is achieved by a growth process where cells communicate locally to decide whether to…

Neural and Evolutionary Computing · Computer Science 2024-05-15 Eleni Nisioti , Erwan Plantec , Milton Montero , Joachim Winther Pedersen , Sebastian Risi

Understanding the inner workings of neural networks is essential for enhancing model performance and interpretability. Current research predominantly focuses on examining the connection between individual neurons and the model's final…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Tue M. Cao , Nhat X. Hoang , Hieu H. Pham , Phi Le Nguyen , My T. Thai

This workshop explores the interface between cognitive neuroscience and recent advances in AI fields that aim to reproduce human performance such as natural language processing and computer vision, and specifically deep learning approaches…

Knowledge tracing---where a machine models the knowledge of a student as they interact with coursework---is a well established problem in computer supported education. Though effectively modeling student knowledge would have high…

Artificial Intelligence · Computer Science 2015-06-22 Chris Piech , Jonathan Spencer , Jonathan Huang , Surya Ganguli , Mehran Sahami , Leonidas Guibas , Jascha Sohl-Dickstein

Neural networks are known to exploit spurious artifacts (or shortcuts) that co-occur with a target label, exhibiting heuristic memorization. On the other hand, networks have been shown to memorize training examples, resulting in…

Machine Learning · Computer Science 2024-02-05 Rachit Bansal , Danish Pruthi , Yonatan Belinkov

Dendrites are crucial structures for computation of an individual neuron. It has been shown that the dynamics of a biological neuron with dendrites can be approximated by artificial neural networks (ANN) with deep structure. However, it…

Neurons and Cognition · Quantitative Biology 2023-05-23 Jingyang Ma , Songting Li , Douglas Zhou

Though modern neural networks have achieved impressive performance in both vision and language tasks, we know little about the functions that they implement. One possibility is that neural networks implicitly break down complex tasks into…

Computation and Language · Computer Science 2023-11-08 Michael A. Lepori , Thomas Serre , Ellie Pavlick

With the increasing acquisition of large-scale neural recordings comes the challenge of inferring the computations they perform and understanding how these give rise to behavior. Here, we review emerging conceptual and technological…

Neurons and Cognition · Quantitative Biology 2019-06-25 Simon Musall , Anne Urai , David Sussillo , Anne Churchland

Artificial Neural Networks are powerful function approximators capable of modelling solutions to a wide variety of problems, both supervised and unsupervised. As their size and expressivity increases, so too does the variance of the model,…

Neural and Evolutionary Computing · Computer Science 2018-01-26 Richard Evans , Edward Grefenstette