English
Related papers

Related papers: Human alignment of neural network representations

200 papers

Vision Transformers (ViTs) achieve remarkable performance in image recognition tasks, yet their alignment with human perception remains largely unexplored. This study systematically analyzes how model size, dataset size, data augmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Pablo Hernández-Cámara , Jose Manuel Jaén-Lorites , Jorge Vila-Tomás , Valero Laparra , Jesus Malo

Algorithmic case-based decision support provides examples to help human make sense of predicted labels and aid human in decision-making tasks. Despite the promising performance of supervised learning, representations learned by supervised…

Machine Learning · Computer Science 2023-03-10 Han Liu , Yizhou Tian , Chacha Chen , Shi Feng , Yuxin Chen , Chenhao Tan

Linearly transforming stimulus representations of deep neural networks yields high-performing models of behavioral and neural responses to complex stimuli. But does the test accuracy of such predictions identify genuine representational…

Neurons and Cognition · Quantitative Biology 2026-01-05 Itamar Avitan , Tal Golan

It is now a standard for neural network representations to be trained on large, publicly available datasets, and used for new problems. The reasons for why neural network representations have been so successful for transfer, however, are…

Machine Learning · Computer Science 2022-09-20 Ehsan Imani , Wei Hu , Martha White

When trained on large-scale object classification datasets, certain artificial neural network models begin to approximate core object recognition behaviors and neural response patterns in the primate brain. While recent machine learning…

Machine Learning · Computer Science 2025-11-07 Abdulkadir Gokce , Martin Schrimpf

Despite advancements in artificial intelligence, object recognition models still lag behind in emulating visual information processing in human brains. Recent studies have highlighted the potential of using neural data to mimic brain…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Zitong Lu , Yile Wang , Julie D. Golomb

Complex machine learning models are deployed in several critical domains including healthcare and autonomous vehicles nowadays, albeit as functional black boxes. Consequently, there has been a recent surge in interpreting decisions of such…

Artificial Intelligence · Computer Science 2021-01-20 Zijian Zhang , Jaspreet Singh , Ujwal Gadiraju , Avishek Anand

Deep neural networks trained with different architectures, objectives, and datasets have been reported to converge on similar visual representations. However, what remains unknown is which visual properties models actually converge on and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Florian P. Mahner , Johannes Roth , Ka Chun Lam , Michael F. Bonner , Francisco Pereira , Martin N. Hebart

How can we build AI systems that can learn any set of individual human values both quickly and safely, avoiding causing harm or violating societal standards for acceptable behavior during the learning process? We explore the effects of…

Artificial Intelligence · Computer Science 2024-11-11 Andrea Wynn , Ilia Sucholutsky , Thomas L. Griffiths

In recent years, various methods and benchmarks have been proposed to empirically evaluate the alignment of artificial neural networks to human neural and behavioral data. But how aligned are different alignment metrics? To answer this…

Neurons and Cognition · Quantitative Biology 2024-07-11 Jannis Ahlert , Thomas Klein , Felix Wichmann , Robert Geirhos

Biological and artificial information processing systems form representations of the world that they can use to categorize, reason, plan, navigate, and make decisions. How can we measure the similarity between the representations formed by…

The ability to translate diverse patterns of inputs into structured patterns of behavior has been thought to rest on both humans' and machines' ability to learn robust representations of relevant concepts. The rapid advancement of…

Artificial Intelligence · Computer Science 2025-10-02 Zach Studdiford , Timothy T. Rogers , Kushin Mukherjee , Siddharth Suresh

In cognitive science and AI, a longstanding question is whether machines learn representations that align with those of the human mind. While current models show promise, it remains an open question whether this alignment is superficial or…

Neurons and Cognition · Quantitative Biology 2025-10-27 Craig Sanders , Billy Dickson , Sahaj Singh Maini , Robert Nosofsky , Zoran Tiganj

The widespread use of deep neural networks has achieved substantial success in many tasks. However, there still exists a huge gap between the operating mechanism of deep learning models and human-understandable decision making, so that…

Artificial Intelligence · Computer Science 2021-03-08 Xiaowei Zhou , Jie Yin , Ivor Tsang , Chen Wang

Modern machine learning models for computer vision exceed humans in accuracy on specific visual recognition tasks, notably on datasets like ImageNet. However, high accuracy can be achieved in many ways. The particular decision function…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Shikhar Tuli , Ishita Dasgupta , Erin Grant , Thomas L. Griffiths

Computer vision has made remarkable progress in recent years. Deep neural network (DNN) models optimized to identify objects in images exhibit unprecedented task-trained accuracy and, remarkably, some generalization ability: new visual…

Computer Vision and Pattern Recognition · Computer Science 2017-01-18 Ron Dekel

Recent research has seen many behavioral comparisons between humans and deep neural networks (DNNs) in the domain of image classification. Often, comparison studies focus on the end-result of the learning process by measuring and comparing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Lukas S. Huber , Fred W. Mast , Felix A. Wichmann

How do humans learn to acquire a powerful, flexible and robust representation of objects? While much of this process remains unknown, it is clear that humans do not require millions of object labels. Excitingly, recent algorithmic…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Robert Geirhos , Kantharaju Narayanappa , Benjamin Mitzkus , Matthias Bethge , Felix A. Wichmann , Wieland Brendel

Some recent artificial neural networks (ANNs) claim to model aspects of primate neural and human performance data. Their success in object recognition is, however, dependent on exploiting low-level features for solving visual tasks in a way…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Girik Malik , Dakarai Crowder , Ennio Mingolla

In the present study, we investigate and compare reasoning in large language models (LLM) and humans using a selection of cognitive psychology tools traditionally dedicated to the study of (bounded) rationality. To do so, we presented to…

Computation and Language · Computer Science 2023-09-25 Nicolas Yax , Hernan Anlló , Stefano Palminteri