English
Related papers

Related papers: fMRI predictors based on language models of increa…

200 papers

Large language models (LLMs) exhibit remarkable capabilities on not just language tasks, but also various tasks that are not linguistic in nature, such as logical reasoning and social inference. In the human brain, neuroscience has…

Computation and Language · Computer Science 2025-02-14 Badr AlKhamissi , Greta Tuckute , Antoine Bosselut , Martin Schrimpf

Do machines and humans process language in similar ways? Recent research has hinted at the affirmative, showing that human neural activity can be effectively predicted using the internal representations of language models (LMs). Although…

Computation and Language · Computer Science 2025-01-15 Yuchen Zhou , Emmy Liu , Graham Neubig , Michael J. Tarr , Leila Wehbe

Recent advances in multimodal large language models (LLMs) have enabled unified reasoning across images, audio, and video, but extending such capability to brain imaging remains largely unexplored. Bridging this gap is essential to link…

Computation and Language · Computer Science 2026-05-15 Yuxiang Wei , Yanteng Zhang , Xi Xiao , Chengxuan Qian , Tianyang Wang , Vince D. Calhoun

Large language models (LLMs) reliably predict neural activity during language comprehension and transformer depth has been interpreted as mirroring hierarchical cortical organization. However, it remains unclear whether such alignment…

Computation and Language · Computer Science 2026-05-21 Ni Yang , Rui He , Philipp Homan , Iris Sommer , Davide Staub , Wolfram Hinzen

Understanding the similarity between large language models (LLMs) and human brain activity is crucial for advancing both AI and cognitive neuroscience. In this study, we provide a multilinguistic, large-scale assessment of this similarity…

Human-Computer Interaction · Computer Science 2026-01-09 Xin Xiao , Kaiwen Wei , Jiang Zhong , Xuekai Wei , Mingliang Zhou

Large Language Models (LLMs) do not differentially represent numbers, which are pervasive in text. In contrast, neuroscience research has identified distinct neural representations for numbers and words. In this work, we investigate how…

Artificial Intelligence · Computer Science 2024-01-10 Raj Sanjay Shah , Vijay Marupudi , Reba Koenen , Khushi Bhardwaj , Sashank Varma

Encoding models have been used to assess how the human brain represents concepts in language and vision. While language and vision rely on similar concept representations, current encoding models are typically trained and tested on brain…

Computation and Language · Computer Science 2023-05-23 Jerry Tang , Meng Du , Vy A. Vo , Vasudev Lal , Alexander G. Huth

While brain-aligned large language models (LLMs) have garnered attention for their potential as cognitive models and for potential for enhanced safety and trustworthiness in AI, the role of this brain alignment for linguistic competence…

Computation and Language · Computer Science 2026-03-25 Gabriele Merlin , Mariya Toneva

Functional MRI (fMRI) has become the most common method for investigating the human brain. However, fMRI data present some complications for statistical analysis and modeling. One recently developed approach to these data focuses on…

Applications · Statistics 2015-03-19 Vincent Q. Vu , Pradeep Ravikumar , Thomas Naselaris , Kendrick N. Kay , Jack L. Gallant , Bin Yu

Language-brain encoding experiments evaluate the ability of language models to predict brain responses elicited by language stimuli. The evaluation scenarios for this task have not yet been standardized which makes it difficult to compare…

Computation and Language · Computer Science 2019-04-05 Lisa Beinborn , Samira Abnar , Rochelle Choenni

Traditional psychological experiments utilizing naturalistic stimuli face challenges in manual annotation and ecological validity. To address this, we introduce a novel paradigm leveraging multimodal large language models (LLMs) as proxies…

Artificial Intelligence · Computer Science 2025-02-27 Xin Liu , Ziyue Zhang , Jingxin Nie

Understanding how humans process natural language has long been a vital research direction. The field of natural language processing (NLP) has recently experienced a surge in the development of powerful language models. These models have…

Computation and Language · Computer Science 2023-11-20 Zhengqi He , Taro Toyoizumi

Pretrained language models are remarkably effective in aligning with human brain responses elicited by natural language stimuli, positioning them as promising model organisms for studying language processing in the brain. However, existing…

Computation and Language · Computer Science 2025-10-27 Omer Moussa , Mariya Toneva

Speech language models align with human brain responses to natural language to an impressive degree. However, current models rely heavily on low-level speech features, indicating they lack brain-relevant semantics which limits their utility…

Computation and Language · Computer Science 2025-03-05 Omer Moussa , Dietrich Klakow , Mariya Toneva

Large language models (LLMs) have demonstrated remarkable performance, particularly in multilingual contexts. While recent studies suggest that LLMs can transfer skills learned in one language to others, the internal mechanisms behind this…

Computation and Language · Computer Science 2025-03-04 Hongchuan Zeng , Senyu Han , Lu Chen , Kai Yu

Brain metabolism is controlled by complex regulation mechanisms. As part of their nature many complex systems show scaling behavior in their timeseries data. Corresponding scaling exponents can sometimes be used to characterize these…

Condensed Matter · Physics 2007-05-23 Stefan Thurner , Christian Windischberger , Ewald Moser , Markus Barth

Early detection is crucial for timely intervention aimed at preventing and slowing the progression of neurocognitive disorder (NCD), a common and significant health problem among the aging population. Recent evidence has suggested that…

Computation and Language · Computer Science 2025-06-11 Yuejiao Wang , Xianmin Gong , Xixin Wu , Patrick Wong , Hoi-lam Helene Fung , Man Wai Mak , Helen Meng

Associative learning--forming links between co-occurring items--is fundamental to human cognition, reshaping internal representations in complex ways. Testing hypotheses on how representational changes occur in biological systems is…

Machine Learning · Computer Science 2025-10-27 Camila Kolling , Vy Ai Vo , Mariya Toneva

Recent advancements in artificial intelligence have sparked interest in the parallels between large language models (LLMs) and human neural processing, particularly in language comprehension. While prior research has established…

Computation and Language · Computer Science 2024-12-10 Gavin Mischler , Yinghao Aaron Li , Stephan Bickel , Ashesh D. Mehta , Nima Mesgarani

Research has repeatedly demonstrated that intermediate hidden states extracted from large language models and speech audio models predict measured brain response to natural language stimuli. Yet, very little is known about the…

Computation and Language · Computer Science 2026-05-05 Emily Cheng , Aditya R. Vaidya , Richard Antonello