中文
相关论文

相关论文: UniBrain: A Unified Model for Cross-Subject Brain …

200 篇论文

Reconstructing perceived images from human brain activity forms a crucial link between human and machine learning through Brain-Computer Interfaces. Early methods primarily focused on training separate models for each individual to account…

计算机视觉与模式识别 · 计算机科学 2025-01-27 Zhibo Tian , Ruijie Quan , Fan Ma , Kun Zhan , Yi Yang

We introduce UniToken, an auto-regressive generation model that encodes visual inputs through a combination of discrete and continuous representations, enabling seamless integration of unified visual understanding and image generation…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Yang Jiao , Haibo Qiu , Zequn Jie , Shaoxiang Chen , Jingjing Chen , Lin Ma , Yu-Gang Jiang

Decoding visual signals holds the tantalizing potential to unravel the complexities of cognition and perception. While recent studies have focused on reconstructing visual stimuli from neural recordings to bridge brain activity with visual…

计算工程、金融与科学 · 计算机科学 2025-09-23 Zixiang Yin , Jiarui Li , Zhengming Ding

Brain-computer interface (BCI) technology enables direct communication between the brain and external devices through electroencephalography (EEG) signals. However, existing decoding models often mix common and personalized components,…

神经元与认知 · 定量生物学 2025-11-21 Xiaoyuan Li , Xinru Xue , Bohan Zhang , Ye Sun , Shoushuo Xi , Gang Liu

Multimodal MRI provides complementary and clinically relevant information to probe tissue condition and to characterize various diseases. However, it is often difficult to acquire sufficiently many modalities from the same subject due to…

图像与视频处理 · 电气工程与系统科学 2021-06-08 Xiaofeng Liu , Fangxu Xing , Georges El Fakhri , Jonghye Woo

Decoding visual information from human brain activity has seen remarkable advancements in recent research. However, the diversity in cortical parcellation and fMRI patterns across individuals has prompted the development of deep learning…

计算机视觉与模式识别 · 计算机科学 2024-12-17 Guangyin Bao , Qi Zhang , Zixuan Gong , Jialei Zhou , Wei Fan , Kun Yi , Usman Naseem , Liang Hu , Duoqian Miao

In this work, we study the problem of cross-subject motor imagery (MI) decoding from electroencephalography (EEG) data. Multi-subject EEG datasets present several kinds of domain shifts due to various inter-individual differences (e.g.…

信号处理 · 电气工程与系统科学 2024-02-22 Georgios Zoumpourlis , Ioannis Patras

Cross-subject visual decoding aims to reconstruct visual experiences from brain activity across individuals, enabling more scalable and practical brain-computer interfaces. However, existing methods often suffer from degraded performance…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Shumeng Li , Jintao Guo , Jian Zhang , Yulin Zhou , Luyang Cao , Yinghuan Shi

Addressing the question of visualising human mind could help us to find regions that are associated with observed cognition and responsible for expressing the elusive mental image, leading to a better understanding of cognitive function.…

神经元与认知 · 定量生物学 2021-02-11 Pan Wang , Rui Zhou , Shuo Wang , Ling Li , Wenjia Bai , Jialu Fan , Chunlin Li , Peter Childs , Yike Guo

Decoding natural visual scenes from brain activity has flourished, with extensive research in single-subject tasks and, however, less in cross-subject tasks. Reconstructing high-quality images in cross-subject tasks is a challenging problem…

计算机视觉与模式识别 · 计算机科学 2024-12-17 Zixuan Gong , Qi Zhang , Guangyin Bao , Lei Zhu , Ke Liu , Liang Hu , Duoqian Miao

Existing cross-subject fMRI decoding methods typically train a model on multiple scanned subjects and then adapt it to a new subject using substantial paired fMRI-image data. However, in realistic scenarios, new-subject fMRI data are often…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Jintao Guo , Lin Wang , Shumeng Li , Jian Zhang , Yulin Zhou , Luyang Cao , Hairong Zheng , Yinghuan Shi

Neurophysiological decoding, fundamental to advancing brain-computer interface (BCI) technologies, has significantly benefited from recent advances in deep learning. However, existing decoding approaches largely remain constrained to…

信号处理 · 电气工程与系统科学 2025-08-07 Di Wu , Yifei Jia , Siyuan Li , Shiqi Zhao , Jie Yang , Mohamad Sawan

Cross-subject brain-to-visual decoding remains a core challenge in brain-computer interfaces due to severe inter-individual variability that induces systematic subject-specific functional misalignment. To address this issue, we propose…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Jiaxiang Liu , Jiawei Du , Xupeng Chen , Guoqi Li , Jiang Cai , Simon Fong , Mingkun Xu

Visual encoding and decoding models act as gateways to understanding the neural mechanisms underlying human visual perception. Typically, visual encoding models that predict brain activity from stimuli and decoding models that reproduce…

机器学习 · 计算机科学 2026-04-14 Weijian Mai , Mu Nan , Yu Zhu , Jiahang Cao , Rui Zhang , Yuqin Dai , Chunfeng Song , Andrew F. Luo , Jiamin Wu

Image-to-fMRI encoding is important for both neuroscience research and practical applications. However, such "Brain-Encoders" have been typically trained per-subject and per fMRI-dataset, thus restricted to very limited training data. In…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Roman Beliy , Navve Wasserman , Amit Zalcher , Michal Irani

Current AI frameworks for brain decoding and encoding, typically train and test models within the same datasets. This limits their utility for brain computer interfaces (BCI) or neurofeedback, for which it would be useful to pool…

Brain decoding, understood as the process of mapping brain activities to the stimuli that generated them, has been an active research area in the last years. In the case of language stimuli, recent studies have shown that it is possible to…

计算与语言 · 计算机科学 2020-11-12 Nicolas Affolter , Beni Egressy , Damian Pascual , Roger Wattenhofer

Improving the interpretability of brain decoding approaches is of primary interest in many neuroimaging studies. Despite extensive studies of this type, at present, there is no formal definition for interpretability of brain decoding…

机器学习 · 统计学 2016-06-21 Seyed Mostafa Kia , Andrea Passerini

Due to the lack of paired samples and the low signal-to-noise ratio of functional MRI (fMRI) signals, reconstructing perceived natural images or decoding their semantic contents from fMRI data are challenging tasks. In this work, we…

计算机视觉与模式识别 · 计算机科学 2023-05-16 Yulong Liu , Yongqiang Ma , Wei Zhou , Guibo Zhu , Nanning Zheng

Combining Functional MRI (fMRI) data across different subjects and datasets is crucial for many neuroscience tasks. Relying solely on shared anatomy for brain-to-brain mapping is inadequate. Existing functional transformation methods thus…

神经元与认知 · 定量生物学 2025-03-18 Navve Wasserman , Roman Beliy , Roy Urbach , Michal Irani