English
Related papers

Related papers: fMRI predictors based on language models of increa…

200 papers

Progress in natural language processing (NLP) models that estimate representations of word sequences has recently been leveraged to improve the understanding of language processing in the brain. However, these models have not been…

Neurons and Cognition · Quantitative Biology 2019-11-11 Dan Schwartz , Mariya Toneva , Leila Wehbe

In this paper, we investigated how to build a high-performance vision encoding model to predict brain activity as part of our participation in the Algonauts Project 2023 Challenge. The challenge provided brain activity recorded by…

Neurons and Cognition · Quantitative Biology 2023-08-02 Takuya Matsuyama , Kota S Sasaki , Shinji Nishimoto

Language models have been shown to be rich enough to encode fMRI activations of certain Regions of Interest in our Brains. Previous works have explored transfer learning from representations learned for popular natural language processing…

Computation and Language · Computer Science 2023-11-10 Arvindh Arun , Jerrin John , Sanjai Kumaran

fMRI semantic category understanding using linguistic encoding models attempt to learn a forward mapping that relates stimuli to the corresponding brain activation. Classical encoding models use linear multi-variate methods to predict the…

Machine Learning · Computer Science 2018-12-04 Subba Reddy Oota , Adithya Avvaru , Naresh Manwani , Raju S. Bapi

Understanding how the brain represents the multifaceted properties of words in context is essential for explaining the neural architecture of human language. Here, we combine large-scale psycholinguistic modeling with naturalistic fMRI to…

Neurons and Cognition · Quantitative Biology 2026-01-21 Xuan Yang , Chuanji Gao , Cheng Xiao , Nicholas Riccardi , Rutvik H. Desai

Deep learning has recently made remarkable progress in natural language processing. Yet, the resulting algorithms remain far from competing with the language abilities of the human brain. Predictive coding theory offers a potential…

Neurons and Cognition · Quantitative Biology 2021-11-30 Charlotte Caucheteux , Alexandre Gramfort , Jean-Remi King

Large Language Models (LLMs) have been shown to be effective models of the human language system, with some models predicting most explainable variance of brain activity in current datasets. Even in untrained models, the representations…

Computation and Language · Computer Science 2024-06-24 Badr AlKhamissi , Greta Tuckute , Antoine Bosselut , Martin Schrimpf

Several popular Transformer based language models have been found to be successful for text-driven brain encoding. However, existing literature leverages only pretrained text Transformer models and has not explored the efficacy of…

Computation and Language · Computer Science 2022-11-17 Subba Reddy Oota , Jashn Arora , Veeral Agarwal , Mounika Marreddy , Manish Gupta , Bapi Raju Surampudi

The human brain has long inspired the pursuit of artificial intelligence (AI). Recently, neuroimaging studies provide compelling evidence of alignment between the computational representation of artificial neural networks (ANNs) and the…

Neurons and Cognition · Quantitative Biology 2024-11-01 Haiyang Sun , Lin Zhao , Zihao Wu , Xiaohui Gao , Yutao Hu , Mengfei Zuo , Wei Zhang , Junwei Han , Tianming Liu , Xintao Hu

This study investigates whether large language models (LLMs) mirror human neurocognition during abstract reasoning. We compared the performance and neural representations of human participants with those of eight open-source LLMs on an…

Neurons and Cognition · Quantitative Biology 2025-08-15 Christopher Pinier , Sonia Acuña Vargas , Mariia Steeghs-Turchina , Dora Matzke , Claire E. Stevenson , Michael D. Nunez

Neural language models, particularly large-scale ones, have been consistently proven to be most effective in predicting brain neural activity across a range of studies. However, previous research overlooked the comparison of these models…

Computation and Language · Computer Science 2024-05-01 Yunhao Zhang , Shaonan Wang , Xinyi Dong , Jiajun Yu , Chengqing Zong

Human languages differ widely in their forms, each having distinct sounds, scripts, and syntax. Yet, they can all convey similar meaning. Do different languages converge on a shared neural substrate for conceptual meaning? We used language…

Neurons and Cognition · Quantitative Biology 2025-06-26 Zaid Zada , Samuel A Nastase , Jixing Li , Uri Hasson

Recent breakthroughs in language models (LMs) using neural networks have raised the question: how similar are these models' processing to human language processing? Results using a framework called Brain Score (BS) -- predicting fMRI…

Computation and Language · Computer Science 2026-04-20 Jingnong Qu , Ashvin Ranjan , Shane Steinert-Threlkeld

Understanding how humans and artificial intelligence systems predict and plan by interacting with their environment is a fundamental challenge at the intersection of neuroscience and machine learning. Most brain-encoding studies focus on…

Neurons and Cognition · Quantitative Biology 2026-05-20 Subba Reddy Oota , Anant Khandelwal , Khushbu Pahwa , Satya Sai Srinath Namburi , Tanmoy Chakraborty , Bapi S. Raju , Manish Gupta

Large language models (LLMs) exhibit remarkable similarity to neural activity in the human language network. However, the key properties of language shaping brain-like representations, and their evolution during training as a function of…

Computation and Language · Computer Science 2025-09-23 Badr AlKhamissi , Greta Tuckute , Yingtian Tang , Taha Binhuraib , Antoine Bosselut , Martin Schrimpf

Research has repeatedly demonstrated that intermediate hidden states extracted from large language models are able to predict measured brain response to natural language stimuli. Yet, very little is known about the representation properties…

Computation and Language · Computer Science 2026-03-16 Emily Cheng , Richard J. Antonello

A recent study (Kuribayashi et al., 2025) has shown that human sentence processing behavior, typically measured on syntactically unchallenging constructions, can be effectively modeled using surprisal from early layers of large language…

Computation and Language · Computer Science 2026-04-21 Tatsuki Kuribayashi , Alex Warstadt , Yohei Oseki , Ethan Gotlieb Wilcox

Language models have been shown to be very effective in predicting brain recordings of subjects experiencing complex language stimuli. For a deeper understanding of this alignment, it is important to understand the correspondence between…

Computation and Language · Computer Science 2023-11-09 Subba Reddy Oota , Manish Gupta , Mariya Toneva

Large language models (LLMs) have complicated internal dynamics, but induce representations of words and phrases whose geometry we can study. Human language processing is also opaque, but neural response measurements can provide (noisy)…

Computation and Language · Computer Science 2023-11-01 Jiaang Li , Antonia Karamolegkou , Yova Kementchedjhieva , Mostafa Abdou , Sune Lehmann , Anders Søgaard

A popular approach to decompose the neural bases of language consists in correlating, across individuals, the brain responses to different stimuli (e.g. regular speech versus scrambled words, sentences, or paragraphs). Although successful,…

Neurons and Cognition · Quantitative Biology 2023-03-21 Charlotte Caucheteux , Alexandre Gramfort , Jean-Rémi King