English
Related papers

Related papers: Brain-optimized inference improves reconstructions…

200 papers

Can artificial intelligence unlock the secrets of the human brain? How do the inner mechanisms of deep learning models relate to our neural circuits? Is it possible to enhance AI by tapping into the power of brain recordings? These…

Neurons and Cognition · Quantitative Biology 2024-12-31 Subba Reddy Oota , Zijiao Chen , Manish Gupta , Raju S. Bapi , Gael Jobard , Frederic Alexandre , Xavier Hinaut

A fundamental challenge in neuroscience is to decode mental states from brain activity. While functional magnetic resonance imaging (fMRI) offers a non-invasive approach to capture brain-wide neural dynamics with high spatial precision,…

Image and Video Processing · Electrical Eng. & Systems 2025-07-31 Yueh-Po Peng , Vincent K. M. Cheung , Li Su

Decoding visual stimuli from brain recordings aims to deepen our understanding of the human visual system and build a solid foundation for bridging human and computer vision through the Brain-Computer Interface. However, reconstructing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Zijiao Chen , Jiaxin Qing , Tiange Xiang , Wan Lin Yue , Juan Helen Zhou

Understanding how the brain encodes visual information is a central challenge in neuroscience and machine learning. A promising approach is to reconstruct visual stimuli, essentially images, from functional Magnetic Resonance Imaging (fMRI)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zheng Huang , Enpei Zhang , Weikang Qiu , Yinghao Cai , Carl Yang , Elynn Chen , Xiang Zhang , Rex Ying , Dawei Zhou , Yujun Yan

Magnetic Resonance Imaging (MRI) plays a crucial role in brain disease diagnosis, but it is not always feasible for certain patients due to physical or clinical constraints. Recent studies attempt to synthesize MRI from Computed Tomography…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Junming Liu , Yifei Sun , Weihua Cheng , Yujin Kang , Yirong Chen , Ding Wang , Guosun Zeng

The main goal of this study is to extract a set of brain networks in multiple time-resolutions to analyze the connectivity patterns among the anatomic regions for a given cognitive task. We suggest a deep architecture which learns the…

Machine Learning · Statistics 2017-08-16 Arash Rahnama , Abdullah Alchihabi , Vijay Gupta , Panos Antsaklis , Fatos T. Yarman Vural

Deep learning (DL) reconstruction particularly of MRI has led to improvements in image fidelity and reduction of acquisition time. In neuroimaging, DL methods can reconstruct high-quality images from undersampled data. However, it is…

Image and Video Processing · Electrical Eng. & Systems 2023-09-27 Yuning Du , Yuyang Xue , Rohan Dharmakumar , Sotirios A. Tsaftaris

Functional brain network properties are heavily influenced by how the the network nodes are defined. A common approach uses Regions of Interest (ROIs), i.e., predetermined collections of functional magnetic resonance imaging (fMRI)…

Neurons and Cognition · Quantitative Biology 2025-03-07 Tarmo Nurmi , Pietro De Luca , Maria Hakonen , Mikko Kivelä , Onerva Korhonen

Reconstructing visual stimuli from functional Magnetic Resonance Imaging fMRI enables fine-grained retrieval of brain activity. However, the accurate reconstruction of diverse details, including structure, background, texture, color, and…

Neural and Evolutionary Computing · Computer Science 2025-01-09 Haoyu Li , Hao Wu , Badong Chen

Recent work has demonstrated that complex visual stimuli can be decoded from human brain activity using deep generative models, offering new ways to probe how the brain represents real-world scenes. However, many existing approaches first…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Pinyuan Feng , Hossein Adeli , Wenxuan Guo , Fan Cheng , Ethan Hwang , Nikolaus Kriegeskorte

Reconstructing human vision from brain activities has been an appealing task that helps to understand our cognitive process. Even though recent research has seen great success in reconstructing static images from non-invasive brain…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Zijiao Chen , Jiaxin Qing , Juan Helen Zhou

Brain-computer interface (BCI) decodes brain signals to understand user intention and status. Because of its simple and safe data acquisition process, electroencephalogram (EEG) is commonly used in non-invasive BCI. One of EEG paradigms,…

Human-Computer Interaction · Computer Science 2020-02-05 Byeong-Hoo Lee , Ji-Hoon Jeong , Kyung-Hwan Shim , Dong-Joo Kim

Deep learning has led to significant advances in artificial intelligence, in part, by adopting strategies motivated by neurophysiology. However, it is unclear whether deep learning could occur in the real brain. Here, we show that a deep…

Neurons and Cognition · Quantitative Biology 2017-04-11 Jordan Guergiuev , Timothy P. Lillicrap , Blake A. Richards

Recently, leveraging big data in deep learning has led to significant performance improvements, as confirmed in applications like mental state decoding using fMRI data. However, fMRI datasets remain relatively small in scale, and the…

Neurons and Cognition · Quantitative Biology 2024-10-08 Yuto Nishimura , Masataka Sawayama , Ayumu Yamashita , Hideki Nakayama , Kaoru Amano

Monitoring diseases that affect the brain's structural integrity requires automated analysis of magnetic resonance (MR) images, e.g., for the evaluation of volumetric changes. However, many of the evaluation tools are optimized for…

Decoding images from brain activity has been a challenge. Owing to the development of deep learning, there are available tools to solve this problem. The decoded image, which aims to map neural spike trains to low-level visual features and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Wenyi Li , Shengjie Zheng , Yufan Liao , Rongqi Hong , Weiliang Chen , Chenggnag He , Xiaojian Li

Sensor-based human activity recognition is a key technology for many human-centered intelligent applications. However, this research is still in its infancy and faces many unresolved challenges. To address these, we propose a comprehensive…

Signal Processing · Electrical Eng. & Systems 2025-04-08 Hanyu Liu , Ying Yu , Hang Xiao , Siyao Li , Xuze Li , Jiarui Li , Haotian Tang

The growing interest in brain-inspired computational models arises from the remarkable problem-solving efficiency of the human brain. Action recognition, a complex task in computational neuroscience, has received significant attention due…

Neural and Evolutionary Computing · Computer Science 2024-06-18 Alireza Nadafian , Milad Mozafari , Timothée Masquelier , Mohammad Ganjtabesh

Conventional methods for scalable image coding for humans and machines require the transmission of additional information to achieve scalability. A recent diffusion-based approach avoids this by generating human-oriented images from…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Yui Tatsumi , Ziyue Zeng , Hiroshi Watanabe

Neural decoding, a critical component of Brain-Computer Interface (BCI), has recently attracted increasing research interest. Previous research has focused on leveraging signal processing and deep learning methods to enhance neural decoding…

Neurons and Cognition · Quantitative Biology 2025-12-11 Gaorui Zhang , Zhizhang Yuan , Jialan Yang , Junru Chen , Li Meng , Yang Yang