English
Related papers

Related papers: Finding Concept Representations in Neural Networks…

200 papers

Neural network models are widely used in a variety of domains, often as black-box solutions, since they are not directly interpretable for humans. The field of explainable artificial intelligence aims at developing explanation methods to…

Machine Learning · Computer Science 2023-07-25 Patrik Hammersborg , Inga Strümke

Humans represent scenes and objects in rich feature spaces, carrying information that allows us to generalise about category memberships and abstract functions with few examples. What determines whether a neural network model generalises…

Cognitive neuroscience is enjoying rapid increase in extensive public brain-imaging datasets. It opens the door to large-scale statistical models. Finding a unified perspective for all available data calls for scalable and automated…

Machine Learning · Statistics 2019-05-16 Arthur Mensch , Julien Mairal , Danilo Bzdok , Bertrand Thirion , Gaël Varoquaux

In an effort to understand the meaning of the intermediate representations captured by deep networks, recent papers have tried to associate specific semantic concepts to individual neural network filter responses, where interesting…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Ruth Fong , Andrea Vedaldi

The question how neural systems (of humans) can perform reasoning is still far from being solved. We posit that the process of forming Concepts is a fundamental step required for this. We argue that, first, Concepts are formed as closed…

Artificial Intelligence · Computer Science 2023-03-15 Minija Tamosiunaite , Tomas Kulvicius , Florentin Wörgötter

Understanding the inner working mechanism of deep neural networks (DNNs) is essential and important for researchers to design and improve the performance of DNNs. In this work, the entropy analysis is leveraged to study the neurons…

Computer Vision and Pattern Recognition · Computer Science 2019-11-06 Longwei Wang , Peijie Chen

We study the problem of large scale, multi-label visual recognition with a large number of possible classes. We propose a method for augmenting a trained neural network classifier with auxiliary capacity in a manner designed to…

Machine Learning · Statistics 2015-04-15 David Warde-Farley , Andrew Rabinovich , Dragomir Anguelov

While neural networks have been successfully applied to many natural language processing tasks, they come at the cost of interpretability. In this paper, we propose a general methodology to analyze and interpret decisions from a neural…

Computation and Language · Computer Science 2017-01-11 Jiwei Li , Will Monroe , Dan Jurafsky

Structured internal representations (cognitive maps) shape cognition, from imagining the future and counterfactual past, to transferring knowledge to new settings. Our understanding of how such representations are formed and maintained in…

Neurons and Cognition · Quantitative Biology 2024-10-07 Matthew M Nour , Yunzhe Liu , Mohamady El-Gaby , Robert A McCutcheon , Raymond J Dolan

Recent advances in computer vision facilitate fully automatic extraction of object-centric relational representations from visual-inertial data. These state representations, dubbed 3D scene graphs, are a hierarchical decomposition of…

Robotics · Computer Science 2026-03-31 Christopher Agia

An increasing abstraction has marked some recent investigations in network science. Examples include the development of algorithms that map time series data into networks whose vertices and edges can have different interpretations, beyond…

Physics and Society · Physics 2020-11-24 Arthur A. B. Pessa , Haroldo V. Ribeiro

Every day, humans perceive objects and communicate these perceptions through various channels. In this paper, we present a computational model designed to track and simulate the perception of objects, as well as their representations as…

Artificial Intelligence · Computer Science 2024-12-19 David Kupeev , Eyal Nitzany

Neural models learn data representations that lie on low-dimensional manifolds, yet modeling the relation between these representational spaces is an ongoing challenge. By integrating spectral geometry principles into neural modeling, we…

Machine Learning · Computer Science 2025-07-15 Marco Fumero , Marco Pegoraro , Valentino Maiorca , Francesco Locatello , Emanuele Rodolà

The ongoing exponential rise in recording capacity calls for new approaches for analysing and interpreting neural data. Effective dimensionality has emerged as an important property of neural activity across populations of neurons, yet…

Neurons and Cognition · Quantitative Biology 2021-08-30 Mehrdad Jazayeri , Srdjan Ostojic

Graph is a universe data structure that is widely used to organize data in real-world. Various real-word networks like the transportation network, social and academic network can be represented by graphs. Recent years have witnessed the…

Machine Learning · Computer Science 2021-11-23 Xueyi Liu , Jie Tang

It is essential for understanding neural network decisions to interpret the functionality (also known as concepts) of neurons. Existing approaches describe neuron concepts by generating natural language descriptions, thereby advancing the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 ZeBin Ji , Yang Hu , Xiuli Bi , Bo Liu , Bin Xiao

The study of neural computation aims to understand the function of a neural system as an information processing machine. Neural systems are undoubtedly complex, necessitating principled and automated tools to abstract away details to…

Dynamical Systems · Mathematics 2025-07-09 Abel Sagodi , Il Memming Park

Mining graph data has become a popular research topic in computer science and has been widely studied in both academia and industry given the increasing amount of network data in the recent years. However, the huge amount of network data…

Machine Learning · Computer Science 2020-01-03 Wenwu Zhu , Xin Wang , Peng Cui

Understanding intermediate representations of the concepts learned by deep learning classifiers is indispensable for interpreting general model behaviors. Existing approaches to reveal learned concepts often rely on human supervision, such…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Wonjoon Chang , Dahee Kwon , Jaesik Choi

Deep neural networks have become increasingly successful at solving classic perception problems such as object recognition, semantic segmentation, and scene understanding, often reaching or surpassing human-level accuracy. This success is…

Computer Vision and Pattern Recognition · Computer Science 2016-08-09 Joshua C. Peterson , Joshua T. Abbott , Thomas L. Griffiths