English
Related papers

Related papers: Optimized two-stage AI-based Neural Decoding for E…

200 papers

Decoding stimulus images from fMRI signals has advanced with pre-trained generative models. However, existing methods struggle with cross-subject mappings due to cognitive variability and subject-specific differences. This challenge arises…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Yangyang Xu , Bangzhen Liu , Wenqi Shao , Yong Du , Shengfeng He , Tingting Zhu

While latent diffusion models (LDMs), such as Stable Diffusion, are designed for high-resolution (HR) image generation, they often struggle with significant structural distortions when generating images at resolutions higher than their…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Boyuan Cao , Jiaxin Ye , Yujie Wei , Hongming Shan

We investigate optimal strategies for decoding perceived natural speech from fMRI data acquired from a limited number of participants. Leveraging Lebel et al. (2023)'s dataset of 8 participants, we first demonstrate the effectiveness of…

Neurons and Cognition · Quantitative Biology 2025-05-28 Louis Jalouzot , Alexis Thual , Yair Lakretz , Christophe Pallier , Bertrand Thirion

The successful reconstruction of perceptual experiences from human brain activity has provided insights into the neural representations of sensory experiences. However, reconstructing arbitrary sounds has been avoided due to the complexity…

Sound · Computer Science 2023-06-21 Jong-Yun Park , Mitsuaki Tsukamoto , Misato Tanaka , Yukiyasu Kamitani

Many recent studies have shown that the perception of speech can be decoded from brain signals and subsequently reconstructed as continuous language. However, there is a lack of neurological basis for how the semantic information embedded…

Computation and Language · Computer Science 2026-04-14 Congchi Yin , Ziyi Ye , Piji Li

Deep learning approaches have shown promising performance for compressed sensing-based Magnetic Resonance Imaging. While deep neural networks trained with mean squared error (MSE) loss functions can achieve high peak signal to noise ratio,…

Computer Vision and Pattern Recognition · Computer Science 2018-07-02 Maximilian Seitzer , Guang Yang , Jo Schlemper , Ozan Oktay , Tobias Würfl , Vincent Christlein , Tom Wong , Raad Mohiaddin , David Firmin , Jennifer Keegan , Daniel Rueckert , Andreas Maier

Diffusion magnetic resonance imaging (dMRI) is a crucial non-invasive technique for exploring the microstructure of the living human brain. Traditional hand-crafted and model-based tissue microstructure reconstruction methods often require…

Image and Video Processing · Electrical Eng. & Systems 2025-02-26 Xinrui Ma , Jian Cheng , Wenxin Fan , Ruoyou Wu , Yongquan Ye , Shanshan Wang

Generative models based on deep learning have shown significant potential in medical imaging, particularly for modality transformation and multimodal fusion in MRI-based brain imaging. This study introduces GM-LDM, a novel framework that…

Image and Video Processing · Electrical Eng. & Systems 2025-06-17 Hu Xu , Yang Jingling , Jia Sihan , Bi Yuda , Calhoun Vince

Decoding continuous language from neural signals remains a significant challenge in the intersection of neuroscience and artificial intelligence. We introduce Neuro2Semantic, a novel framework that reconstructs the semantic content of…

Computation and Language · Computer Science 2025-06-03 Siavash Shams , Richard Antonello , Gavin Mischler , Stephan Bickel , Ashesh Mehta , Nima Mesgarani

How to decode human vision through neural signals has attracted a long-standing interest in neuroscience and machine learning. Modern contrastive learning and generative models improved the performance of visual decoding and reconstruction…

Human-Computer Interaction · Computer Science 2024-10-07 Dongyang Li , Chen Wei , Shiying Li , Jiachen Zou , Haoyang Qin , Quanying Liu

Artificial intelligence (AI) systems power the world we live in. Deep neural networks (DNNs) are able to solve tasks in an ever-expanding landscape of scenarios, but our eagerness to apply these powerful models leads us to focus on their…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Loris Giulivi , Mark James Carman , Giacomo Boracchi

Limited view tomographic reconstruction aims to reconstruct a tomographic image from a limited number of sinogram or projection views arising from sparse view or limited angle acquisitions that reduce radiation dose or shorten scanning…

Image and Video Processing · Electrical Eng. & Systems 2020-09-04 Bo Zhou , S. Kevin Zhou , James S. Duncan , Chi Liu

We introduce a new class of iterative image reconstruction algorithms for radio interferometry, at the interface of convex optimization and deep learning, inspired by plug-and-play methods. The approach consists in learning a prior image…

Image and Video Processing · Electrical Eng. & Systems 2022-09-28 Matthieu Terris , Arwa Dabbech , Chao Tang , Yves Wiaux

Generative AI models hold great potential in creating synthetic brain MRIs that advance neuroimaging studies by, for example, enriching data diversity. However, the mainstay of AI research only focuses on optimizing the visual quality (such…

Image and Video Processing · Electrical Eng. & Systems 2023-10-10 Wei Peng , Tomas Bosschieter , Jiahong Ouyang , Robert Paul , Ehsan Adeli , Qingyu Zhao , Kilian M. Pohl

Decoding brain functional states underlying different cognitive processes using multivariate pattern recognition techniques has attracted increasing interests in brain imaging studies. Promising performance has been achieved using brain…

Computer Vision and Pattern Recognition · Computer Science 2018-09-18 Hongming Li , Yong Fan

Capturing dynamic spatiotemporal neural activity is essential for understanding large-scale brain mechanisms. Functional magnetic resonance imaging (fMRI) provides high-resolution cortical representations that form a strong basis for…

Image and Video Processing · Electrical Eng. & Systems 2026-04-01 Wanying Qu , Jianxiong Gao , Wei Wang , Yanwei Fu

Reconstructing visual information from brain activity via computer vision technology provides an intuitive understanding of visual neural mechanisms. Despite progress in decoding fMRI data with generative models, achieving accurate…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Shiyi Zhang , Dong Liang , Yihang Zhou

Following the success of deep learning in a wide range of applications, neural network-based machine learning techniques have received interest as a means of accelerating magnetic resonance imaging (MRI). A number of ideas inspired by deep…

Signal Processing · Electrical Eng. & Systems 2019-04-03 Florian Knoll , Kerstin Hammernik , Chi Zhang , Steen Moeller , Thomas Pock , Daniel K. Sodickson , Mehmet Akcakaya

Reconstructing human vision from brain activities has been an appealing task that helps to understand our cognitive process. Even though recent research has seen great success in reconstructing static images from non-invasive brain…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Zijiao Chen , Jiaxin Qing , Juan Helen Zhou

The differential diagnosis of neurodegenerative dementias is a challenging clinical task, mainly because of the overlap in symptom presentation and the similarity of patterns observed in structural neuroimaging. To improve diagnostic…

Machine Learning · Computer Science 2025-05-27 Andrew Zamai , Nathanael Fijalkow , Boris Mansencal , Laurent Simon , Eloi Navet , Pierrick Coupe