中文
相关论文

相关论文: Brain2Word: Decoding Brain Activity for Language G…

200 篇论文

Speech language models align with human brain responses to natural language to an impressive degree. However, current models rely heavily on low-level speech features, indicating they lack brain-relevant semantics which limits their utility…

计算与语言 · 计算机科学 2025-03-05 Omer Moussa , Dietrich Klakow , Mariya Toneva

Brain decoding has emerged as a rapidly advancing and extensively utilized technique within neuroscience. This paper centers on the application of raw electroencephalogram (EEG) signals for decoding human brain activity, offering a more…

机器学习 · 计算机科学 2025-02-04 Zenon Lamprou , Yashar Moshfeghi

Decoding brain functional states underlying different cognitive processes using multivariate pattern recognition techniques has attracted increasing interests in brain imaging studies. Promising performance has been achieved using brain…

计算机视觉与模式识别 · 计算机科学 2018-09-18 Hongming Li , Yong Fan

Decoding of seen visual contents with non-invasive brain recordings has important scientific and practical values. Efforts have been made to recover the seen images from brain signals. However, most existing approaches cannot faithfully…

计算机视觉与模式识别 · 计算机科学 2023-09-28 Jiaxuan Chen , Yu Qi , Yueming Wang , Gang Pan

Reconstructing seeing images from fMRI recordings is an absorbing research area in neuroscience and provides a potential brain-reading technology. The challenge lies in that visual encoding in brain is highly complex and not fully revealed.…

神经与进化计算 · 计算机科学 2021-01-29 Tao Fang , Yu Qi , Gang Pan

AI-based neural decoding reconstructs visual perception by leveraging generative models to map brain activity, measured through functional MRI (fMRI), into latent hierarchical representations. Traditionally, ridge linear models transform…

图像与视频处理 · 电气工程与系统科学 2025-09-04 Lorenzo Veronese , Andrea Moglia , Luca Mainardi , Pietro Cerveri

The release of large datasets and developments in AI have led to dramatic improvements in decoding methods that reconstruct seen images from human brain activity. We evaluate the prospect of further improving recent decoding methods by…

神经元与认知 · 定量生物学 2023-12-14 Reese Kneeland , Jordyn Ojeda , Ghislain St-Yves , Thomas Naselaris

Brain decoding aims to reconstruct original stimuli from fMRI signals, providing insights into interpreting mental content. Current approaches rely heavily on subject-specific models due to the complex brain processing mechanisms and the…

计算机视觉与模式识别 · 计算机科学 2024-12-30 Zicheng Wang , Zhen Zhao , Luping Zhou , Parashkev Nachev

Understanding the neural mechanisms behind auditory and linguistic processing is key to advancing cognitive neuroscience. In this study, we use Magnetoencephalography (MEG) data to analyze brain responses to spoken language stimuli. We…

神经元与认知 · 定量生物学 2025-01-08 Matteo Ciferri , Matteo Ferrante , Nicola Toschi

Motor imagery (MI) is a well-documented technique used by subjects in BCI (Brain Computer Interface) experiments to modulate brain activity within the motor cortex and surrounding areas of the brain. In our term project, we conducted an…

人机交互 · 计算机科学 2023-06-14 Giovanni Jana , Corey Karnei , Shuvam Keshari

Understanding the hidden mechanisms behind human's visual perception is a fundamental question in neuroscience. To that end, investigating into the neural responses of human mind activities, such as functional Magnetic Resonance Imaging…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Yuankun Yang , Li Zhang , Ziyang Xie , Zhiyuan Yuan , Jianfeng Feng , Xiatian Zhu , Yu-Gang Jiang

Previous brain decoding research primarily involves single-subject studies, reconstructing stimuli via fMRI activity from the same subject. Our study aims to introduce a generalization technique for cross-subject brain decoding, facilitated…

神经元与认知 · 定量生物学 2023-09-06 Matteo Ferrante , Tommaso Boccato , Nicola Toschi

Word embeddings trained on large corpora have shown to encode high levels of unfair discriminatory gender, racial, religious and ethnic biases. In contrast, human-written dictionaries describe the meanings of words in a concise, objective…

计算与语言 · 计算机科学 2021-01-26 Masahiro Kaneko , Danushka Bollegala

Deciphering visual content from functional Magnetic Resonance Imaging (fMRI) helps illuminate the human vision system. However, the scarcity of fMRI data and noise hamper brain decoding model performance. Previous approaches primarily…

计算机视觉与模式识别 · 计算机科学 2024-06-14 Yulong Liu , Yongqiang Ma , Guibo Zhu , Haodong Jing , Nanning Zheng

Brain-to-Image reconstruction aims to recover visual stimuli perceived by humans from brain activity. However, the reconstructed visual stimuli often missing details and semantic inconsistencies, which may be attributed to insufficient…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Runze Xia , Shuo Feng , Renzhi Wang , Congchi Yin , Xuyun Wen , Piji Li

Humans learn language by interaction with their environment and listening to other humans. It should also be possible for computational models to learn language directly from speech but so far most approaches require text. We improve on…

计算与语言 · 计算机科学 2019-09-25 Danny Merkx , Stefan L. Frank , Mirjam Ernestus

Reading comprehension, a fundamental cognitive ability essential for knowledge acquisition, is a complex skill, with a notable number of learners lacking proficiency in this domain. This study introduces innovative tasks for Brain-Computer…

人机交互 · 计算机科学 2024-01-30 Yuhong Zhang , Shilai Yang , Gert Cauwenberghs , Tzyy-Ping Jung

Neural decoding is still a challenge and hot topic in neurocomputing science. Recently, many studies have shown that brain network patterns containing rich spatial and temporal structure information, which represents the activation…

神经元与认知 · 定量生物学 2022-11-24 Chunyu Liu , Jiacai Zhang

Decoding visual experience from brain activity has advanced substantially, but cur- rent brain-to-text systems largely recover semantic content while discarding affect. Additionally, language models can generate emotional text when prompted…

机器学习 · 计算机科学 2026-05-19 Bilal A. Mohammed , Lin Gu , Ruogo Fang

Neuroscientists evaluate deep neural networks for natural language processing as possible candidate models for how language is processed in the brain. These models are often trained without explicit linguistic supervision, but have been…

计算与语言 · 计算机科学 2021-02-01 Mostafa Abdou , Ana Valeria Gonzalez , Mariya Toneva , Daniel Hershcovich , Anders Søgaard