English
Related papers

Related papers: UMind: A Unified Multitask Network for Zero-Shot M…

200 papers

Understanding and decoding brain activity into visual representations is a fundamental challenge at the intersection of neuroscience and artificial intelligence. While EEG visual decoding has shown promise due to its non-invasive, and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Minxu Liu , Donghai Guan , Chuhang Zheng , Chunwei Tian , Jie Wen , Qi Zhu

Visual decoding from brain signals is a key challenge at the intersection of computer vision and neuroscience, requiring methods that bridge neural representations and computational models of vision. A field-wide goal is to achieve…

The intrication of brain signals drives research that leverages multimodal AI to align brain modalities with visual and textual data for explainable descriptions. However, most existing studies are limited to coarse interpretations, lacking…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Weihao Xia , Cengiz Oztireli

Models based on U-like structures have improved the performance of medical image segmentation. However, the single-layer decoder structure of U-Net is too "thin" to exploit enough information, resulting in large semantic differences between…

Image and Video Processing · Electrical Eng. & Systems 2023-09-08 Haoyuan Chen , Yufei Han , Pin Xu , Yanyi Li , Kuan Li , Jianping Yin

In this study, we introduce MGA-Net, a novel mask-guided attention neural network, which extends the U-net model for precision neonatal brain imaging. MGA-Net is designed to extract the brain from other structures and reconstruct…

Portable and wearable consumer-grade electroencephalography (EEG) devices, like Muse headbands, offer unprecedented mobility for daily brain-computer interface (BCI) applications, including cognitive load detection. However, the exacerbated…

Human-Computer Interaction · Computer Science 2025-07-02 Xiaoxiao Yang , Chao Feng , Jiancheng Chen

Reconstruction dynamic visual scenes from electroencephalography (EEG) signals remains a primary challenge in brain decoding, limited by the low spatial resolution of EEG, a temporal mismatch between neural recordings and video dynamics,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Junxiang Liu , Junming Lin , Jiangtong Li , Jie Li

Brain imaging analysis is fundamental in neuroscience, providing valuable insights into brain structure and function. Traditional workflows follow a sequential pipeline-brain extraction, registration, segmentation, parcellation, network…

Image and Video Processing · Electrical Eng. & Systems 2025-02-27 Yao Su , Keqi Han , Mingjie Zeng , Lichao Sun , Liang Zhan , Carl Yang , Lifang He , Xiangnan Kong

Human's perception of the visual world is shaped by the stereo processing of 3D information. Understanding how the brain perceives and processes 3D visual stimuli in the real world has been a longstanding endeavor in neuroscience. Towards…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Zhanqiang Guo , Jiamin Wu , Yonghao Song , Jiahui Bu , Weijian Mai , Qihao Zheng , Wanli Ouyang , Chunfeng Song

Understanding neural activity and information representation is crucial for advancing knowledge of brain function and cognition. Neural activity, measured through techniques like electrophysiology and neuroimaging, reflects various aspects…

Neurons and Cognition · Quantitative Biology 2024-07-22 Fengyu Yang , Chao Feng , Daniel Wang , Tianye Wang , Ziyao Zeng , Zhiyang Xu , Hyoungseob Park , Pengliang Ji , Hanbin Zhao , Yuanning Li , Alex Wong

Neuroimaging techniques have shown to be useful when studying the brain's activity. This paper uses Magnetoencephalography (MEG) data, provided by the Human Connectome Project (HCP), in combination with various deep artificial neural…

Machine Learning · Computer Science 2020-07-07 Ismail Alaoui Abdellaoui , Jesus Garcia Fernandez , Caner Sahinli , Siamak Mehrkanoon

Visual decoding from electroencephalography (EEG) has emerged as a highly promising avenue for non-invasive brain-computer interfaces (BCIs). Existing EEG-based decoding methods predominantly align brain signals with the final-layer…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Jingyi Tang , Shuai Jiang , Fei Su , Zhicheng Zhao

Brain decoding aims to reconstruct visual perception of human subject from fMRI signals, which is crucial for understanding brain's perception mechanisms. Existing methods are confined to the single-subject paradigm due to substantial brain…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Yuqin Dai , Zhouheng Yao , Chunfeng Song , Qihao Zheng , Weijian Mai , Kunyu Peng , Shuai Lu , Wanli Ouyang , Jian Yang , Jiamin Wu

We introduce a two-stage multitask learning framework for analyzing Electroencephalography (EEG) signals that integrates denoising, dynamical modeling, and representation learning. In the first stage, a denoising autoencoder is trained to…

Machine Learning · Computer Science 2026-02-24 Sucheta Ghosh , Felix Dietrich , Zahra Monfared

Decoding neural representations of visual stimuli from electroencephalography (EEG) offers valuable insights into brain activity and cognition. Recent advancements in deep learning have significantly enhanced the field of visual decoding of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Minsuk Choi , Hiroshi Ishikawa

Decoding visual semantic representations from human brain activity is a significant challenge. While recent zero-shot decoding approaches have improved performance by leveraging aligned image-text datasets, they overlook a fundamental…

Neurons and Cognition · Quantitative Biology 2026-01-21 Zhengdi Zhang , Hao Zhang , Wenjun Xia

Brain activity translation into human language delivers the capability to revolutionize machine-human interaction while providing communication support to people with speech disability. Electronic decoding reaches a certain level of…

Signal Processing · Electrical Eng. & Systems 2025-02-26 Mostafa El Gedawy , Omnia Nabil , Omar Mamdouh , Mahmoud Nady , Nour Alhuda Adel , Ahmed Fares

Seeing is believing, however, the underlying mechanism of how human visual perceptions are intertwined with our cognitions is still a mystery. Thanks to the recent advances in both neuroscience and artificial intelligence, we have been able…

Image and Video Processing · Electrical Eng. & Systems 2023-08-17 Yu-Ting Lan , Kan Ren , Yansen Wang , Wei-Long Zheng , Dongsheng Li , Bao-Liang Lu , Lili Qiu

Neural decoding from electroencephalography (EEG) remains fundamentally limited by poor generalization to unseen subjects, driven by high inter-subject variability and the lack of large-scale datasets to model it effectively. Existing…

Machine Learning · Computer Science 2025-11-25 Mengchun Zhang , Kateryna Shapovalenko , Yucheng Shao , Eddie Guo , Parusha Pradhan

Decoding visual representations from human brain activity has emerged as a thriving research domain, particularly in the context of brain-computer interfaces. Our study presents an innovative method that employs to classify and reconstruct…

Signal Processing · Electrical Eng. & Systems 2023-09-15 Matteo Ferrante , Tommaso Boccato , Stefano Bargione , Nicola Toschi