中文
相关论文

相关论文: Decoding the Multimodal Mind: Generalizable Brain-…

200 篇论文

Brain-computer interfaces (BCIs) with speech decoding from brain recordings have broad application potential in fields such as clinical rehabilitation and cognitive neuroscience. However, current decoding methods remain limited to…

神经元与认知 · 定量生物学 2025-06-05 Yi Guo , Yihang Dong , Michael Kwok-Po Ng , Shuqiang Wang

Brain-computer interfaces (BCIs) enable direct communication between the brain and external devices. This review highlights the core decoding algorithms that enable multimodal BCIs, including a dissection of the elements, a unified view of…

人机交互 · 计算机科学 2025-02-06 Siyang Li , Hongbin Wang , Xiaoqing Chen , Dongrui Wu

Decoding visual-semantic information from brain signals, such as functional MRI (fMRI), across different subjects poses significant challenges, including low signal-to-noise ratio, limited data availability, and cross-subject variability.…

计算机视觉与模式识别 · 计算机科学 2024-09-27 Ruizhe Zheng , Lichao Sun

Brain-related research topics in artificial intelligence have recently gained popularity, particularly due to the expansion of what multimodal architectures can do from computer vision to natural language processing. Our main goal in this…

神经元与认知 · 定量生物学 2024-10-01 Youssef Hmamouche , Ismail Chihab , Lahoucine Kdouri , Amal El Fallah Seghrouchni

Multimodal brain decoding aims to reconstruct semantic information that is consistent with visual stimuli from brain activity signals such as fMRI, and then generate readable natural language descriptions. However, multimodal brain decoding…

机器学习 · 计算机科学 2026-04-21 Xuanyu Hu

Brain-Computer Interfaces (BCI) help patients with faltering communication abilities due to neurodegenerative diseases produce text or speech output by direct neural processing. However, practical implementation of such a system has proven…

人机交互 · 计算机科学 2019-07-10 Janaki Sheth , Ariel Tankus , Michelle Tran , Nader Pouratian , Itzhak Fried , William Speier

In daily life, we encounter diverse external stimuli, such as images, sounds, and videos. As research in multimodal stimuli and neuroscience advances, fMRI-based brain decoding has become a key tool for understanding brain perception and…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Pengyu Liu , Guohua Dong , Dan Guo , Kun Li , Fengling Li , Xun Yang , Meng Wang , Xiaomin Ying

Generating human language through non-invasive brain-computer interfaces (BCIs) has the potential to unlock many applications, such as serving disabled patients and improving communication. Currently, however, generating language via BCIs…

计算与语言 · 计算机科学 2025-11-04 Ziyi Ye , Qingyao Ai , Yiqun Liu , Maarten de Rijke , Min Zhang , Christina Lioma , Tuukka Ruotsalo

Brain decoding techniques are essential for understanding the neurocognitive system. Although numerous methods have been introduced in this field, accurately aligning complex external stimuli with brain activities remains a formidable…

神经元与认知 · 定量生物学 2024-07-16 Heng Huang , Lin Zhao , Zihao Wu , Xiaowei Yu , Jing Zhang , Xintao Hu , Dajiang Zhu , Tianming Liu

We address prevailing challenges of the brain-powered research, departing from the observation that the literature hardly recover accurate spatial information and require subject-specific models. To address these challenges, we propose…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Weihao Xia , Raoul de Charette , Cengiz Öztireli , Jing-Hao Xue

Decoding non-invasive brain recordings is pivotal for advancing our understanding of human cognition but faces challenges due to individual differences and complex neural signal representations. Traditional methods often require customized…

神经与进化计算 · 计算机科学 2024-10-15 Guobin Shen , Dongcheng Zhao , Xiang He , Linghao Feng , Yiting Dong , Jihang Wang , Qian Zhang , Yi Zeng

Intracranial language brain-computer interfaces (BCIs) are a promising route for restoring communication in people with severe motor and speech impairments, but clinical translation remains limited by fragmented evidence and unresolved…

神经元与认知 · 定量生物学 2026-03-17 Dongyi He , Wai Ting Siok , Nizhuan Wang

Multimodal functional neuroimaging enables systematic analysis of brain mechanisms and provides discriminative representations for brain-computer interface (BCI) decoding. However, its acquisition is constrained by high costs and…

计算机视觉与模式识别 · 计算机科学 2025-06-04 Weiheng Yao , Xuhang Chen , Shuqiang Wang

Language, as an information medium created by advanced organisms, has always been a concern of neuroscience regarding how it is represented in the brain. Decoding linguistic representations in the evoked brain has shown groundbreaking…

计算与语言 · 计算机科学 2024-07-31 Yu Wang , Heyang Liu , Yuhao Wang , Chuan Xuan , Yixuan Hou , Sheng Feng , Hongcheng Liu , Yusheng Liao , Yanfeng Wang

Encoding models have been used to assess how the human brain represents concepts in language and vision. While language and vision rely on similar concept representations, current encoding models are typically trained and tested on brain…

计算与语言 · 计算机科学 2023-05-23 Jerry Tang , Meng Du , Vy A. Vo , Vasudev Lal , Alexander G. Huth

Deciphering language from brain activity is a crucial task in brain-computer interface (BCI) research. Non-invasive cerebral signaling techniques including electroencephalography (EEG) and magnetoencephalography (MEG) are becoming…

计算与语言 · 计算机科学 2025-12-29 Yiqian Yang , Hyejeong Jo , Yiqun Duan , Qiang Zhang , Jinni Zhou , Xuming Hu , Won Hee Lee , Renjing Xu , Hui Xiong

Brain activity translation into human language delivers the capability to revolutionize machine-human interaction while providing communication support to people with speech disability. Electronic decoding reaches a certain level of…

信号处理 · 电气工程与系统科学 2025-02-26 Mostafa El Gedawy , Omnia Nabil , Omar Mamdouh , Mahmoud Nady , Nour Alhuda Adel , Ahmed Fares

Decoding human visual neural representations is a challenging task with great scientific significance in revealing vision-processing mechanisms and developing brain-like intelligent machines. Most existing methods are difficult to…

计算机视觉与模式识别 · 计算机科学 2023-03-31 Changde Du , Kaicheng Fu , Jinpeng Li , Huiguang He

Decoding text stimuli from cognitive signals (e.g. fMRI) enhances our understanding of the human language system, paving the way for building versatile Brain-Computer Interface. However, existing studies largely focus on decoding individual…

信号处理 · 电气工程与系统科学 2023-07-12 Nuwa Xi , Sendong Zhao , Haochun Wang , Chi Liu , Bing Qin , Ting Liu

Decoding human brain activity from electroencephalography (EEG) signals is a central challenge at the intersection of neuroscience and artificial intelligence, enabling diverse applications in mental state assessment, clinical monitoring,…

人机交互 · 计算机科学 2026-05-12 Weiheng Lu , Zhouheng Yao , Jiamin Wu , Pengyu Zhu , Yuchen Zhou , Weijian Mai , Qihao Zheng , Wanli Ouyang , Chunfeng Song
‹ 上一页 1 2 3 10 下一页 ›