English
Related papers

Related papers: Perception Activator: An intuitive and portable fr…

200 papers

Semantic image parsing, which refers to the process of decomposing images into semantic regions and constructing the structure representation of the input, has recently aroused widespread interest in the field of computer vision. The recent…

Computer Vision and Pattern Recognition · Computer Science 2018-10-11 Lili Huang , Jiefeng Peng , Ruimao Zhang , Guanbin Li , Liang Lin

Reconstructing dynamic videos from fMRI is important for understanding visual cognition and enabling vivid brain-computer interfaces. However, current methods are critically limited to single-shot clips, failing to address the multi-shot…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Wenwen Zeng , Yonghuang Wu , Yifan Chen , Xuan Xie , Chengqian Zhao , Feiyu Yin , Guoqing Wu , Jinhua Yu

Decoding visual experiences from fMRI offers a powerful avenue to understand human perception and develop advanced brain-computer interfaces. However, current progress often prioritizes maximizing reconstruction fidelity while overlooking…

Machine Learning · Computer Science 2025-10-09 Yuxiang Wei , Yanteng Zhang , Xi Xiao , Tianyang Wang , Xiao Wang , Vince D. Calhoun

The exploration of brain activity and its decoding from fMRI data has been a longstanding pursuit, driven by its potential applications in brain-computer interfaces, medical diagnostics, and virtual reality. Previous approaches have…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Xuelin Qian , Yun Wang , Jingyang Huo , Jianfeng Feng , Yanwei Fu

Decoding visual stimuli from brain recordings aims to deepen our understanding of the human visual system and build a solid foundation for bridging human and computer vision through the Brain-Computer Interface. However, reconstructing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Zijiao Chen , Jiaxin Qing , Tiange Xiang , Wan Lin Yue , Juan Helen Zhou

While significant advancements in artificial intelligence (AI) have catalyzed progress across various domains, its full potential in understanding visual perception remains underexplored. We propose an artificial neural network dubbed…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Ruixing Liang , Xiangyu Zhang , Qiong Li , Lai Wei , Hexin Liu , Avisha Kumar , Kelley M. Kempski Leadingham , Joshua Punnoose , Leibny Paola Garcia , Amir Manbachi

This work introduces a novel approach to fMRI-based visual image reconstruction using a subject-agnostic common representation space. We show that the brain signals of the subjects can be aligned in this common space during training to form…

Image and Video Processing · Electrical Eng. & Systems 2025-10-10 Christos Zangos , Danish Ebadulla , Thomas Christopher Sprague , Ambuj Singh

Advances in neuroimaging techniques have provided us novel insights into understanding how the human mind works. Functional magnetic resonance imaging (fMRI) is the most popular and widely used neuroimaging technique, and there is growing…

Neurons and Cognition · Quantitative Biology 2022-06-15 Jihyun Hur , Jaeyeong Yang , Hoyoung Doh , Woo-Young Ahn

Clarifying the neural basis of speech intelligibility is critical for computational neuroscience and digital speech processing. Recent neuroimaging studies have shown that intelligibility modulates cortical activity beyond simple acoustics,…

Neurons and Cognition · Quantitative Biology 2025-11-05 Ching-Chih Sung , Shuntaro Suzuki , Francis Pingfan Chien , Komei Sugiura , Yu Tsao

Combining Functional MRI (fMRI) data across different subjects and datasets is crucial for many neuroscience tasks. Relying solely on shared anatomy for brain-to-brain mapping is inadequate. Existing functional transformation methods thus…

Neurons and Cognition · Quantitative Biology 2025-03-18 Navve Wasserman , Roman Beliy , Roy Urbach , Michal Irani

Encoding models have been used to assess how the human brain represents concepts in language and vision. While language and vision rely on similar concept representations, current encoding models are typically trained and tested on brain…

Computation and Language · Computer Science 2023-05-23 Jerry Tang , Meng Du , Vy A. Vo , Vasudev Lal , Alexander G. Huth

Improving the interpretability of brain decoding approaches is of primary interest in many neuroimaging studies. Despite extensive studies of this type, at present, there is no formal definition for interpretability of brain decoding…

Machine Learning · Statistics 2016-06-21 Seyed Mostafa Kia , Andrea Passerini

Brain-to-Image reconstruction aims to recover visual stimuli perceived by humans from brain activity. However, the reconstructed visual stimuli often missing details and semantic inconsistencies, which may be attributed to insufficient…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Runze Xia , Shuo Feng , Renzhi Wang , Congchi Yin , Xuyun Wen , Piji Li

Understanding how the brain represents visual information is a fundamental challenge in neuroscience and artificial intelligence. While AI-driven decoding of neural data has provided insights into the human visual system, integrating…

Neural and Evolutionary Computing · Computer Science 2025-10-07 Dongyang Li , Haoyang Qin , Mingyang Wu , Chen Wei , Quanying Liu

Modern imaging techniques for probing brain function, including functional Magnetic Resonance Imaging, intrinsic and extrinsic contrast optical imaging, and magnetoencephalography, generate large data sets with complex content. In this…

Neurons and Cognition · Quantitative Biology 2009-11-10 P. P. Mitra , B. Pesaran

Seeing is believing, however, the underlying mechanism of how human visual perceptions are intertwined with our cognitions is still a mystery. Thanks to the recent advances in both neuroscience and artificial intelligence, we have been able…

Image and Video Processing · Electrical Eng. & Systems 2023-08-17 Yu-Ting Lan , Kan Ren , Yansen Wang , Wei-Long Zheng , Dongsheng Li , Bao-Liang Lu , Lili Qiu

Functional brain imaging allows measuring dynamic functionality in all brain regions. It is broadly used in clinical cognitive neuroscience as, well as in research. It will allow the observation of neural activities in the brain…

Medical Physics · Physics 2016-04-01 Saman Sarraf , Jian Sun

Reconstructing visual stimuli from functional Magnetic Resonance Imaging fMRI enables fine-grained retrieval of brain activity. However, the accurate reconstruction of diverse details, including structure, background, texture, color, and…

Neural and Evolutionary Computing · Computer Science 2025-01-09 Haoyu Li , Hao Wu , Badong Chen

Functional magnetic resonance imaging (fMRI) is a neuroimaging modality that captures the blood oxygen level in a subject's brain while the subject either rests or performs a variety of functional tasks under different conditions. Given…

Computer Vision and Pattern Recognition · Computer Science 2021-01-20 Sam Nguyen , Brenda Ng , Alan D. Kaplan , Priyadip Ray

Quantitative modeling of human brain activity based on language representations has been actively studied in systems neuroscience. However, previous studies examined word-level representation, and little is known about whether we could…

Computer Vision and Pattern Recognition · Computer Science 2018-02-08 Eri Matsuo , Ichiro Kobayashi , Shinji Nishimoto , Satoshi Nishida , Hideki Asoh