English
Related papers

Related papers: BrainCodec: Neural fMRI codec for the decoding of …

200 papers

Brain decoding has emerged as a rapidly advancing and extensively utilized technique within neuroscience. This paper centers on the application of raw electroencephalogram (EEG) signals for decoding human brain activity, offering a more…

Machine Learning · Computer Science 2025-02-04 Zenon Lamprou , Yashar Moshfeghi

How to efficiently utilize the temporal features is crucial, yet challenging, for video restoration. The temporal features usually contain various noisy and uncorrelated information, and they may interfere with the restoration of the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Cong Huang , Jiahao Li , Bin Li , Dong Liu , Yan Lu

Decoding visual stimuli from neural activity is essential for understanding the human brain. While fMRI methods have successfully reconstructed static images, fMRI-to-video reconstruction faces challenges due to the need for capturing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Haonan Wang , Qixiang Zhang , Lehan Wang , Xuanqi Huang , Xiaomeng Li

Exploring the mysteries of the human brain is a long-term research topic in neuroscience. With the help of deep learning, decoding visual information from human brain activity fMRI has achieved promising performance. However, these decoding…

Neurons and Cognition · Quantitative Biology 2024-09-04 Guangyin Bao , Duoqian Miao

Incorporating semantic information into the codecs during image compression can significantly reduce the repetitive computation of fundamental semantic analysis (such as object recognition) in client-side applications. The same practice…

Computer Vision and Pattern Recognition · Computer Science 2018-01-30 Sihui Luo , Yezhou Yang , Mingli Song

Magnetic Resonance Imaging (MRI) is a non-invasive diagnostic and radiotherapy (RT) planning tool, offering detailed insights into the anatomy of the human body. The extensive scan time is stressful for patients, who must remain motionless…

Image and Video Processing · Electrical Eng. & Systems 2023-11-23 Shahinur Alam , Jinsoo Uh , Alexander Dresner , Chia-ho Hua , Khaled Khairy

Recently, deep learning-based image compression has made signifcant progresses, and has achieved better ratedistortion (R-D) performance than the latest traditional method, H.266/VVC, in both subjective metric and the more challenging…

Image and Video Processing · Electrical Eng. & Systems 2022-06-23 Haisheng Fu , Feng Liang , Jie Liang , Binglin Li , Guohe Zhang , Jingning Han

We address prevailing challenges of the brain-powered research, departing from the observation that the literature hardly recover accurate spatial information and require subject-specific models. To address these challenges, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Weihao Xia , Raoul de Charette , Cengiz Öztireli , Jing-Hao Xue

We explore encoding brain symmetry into a neural network for a brain tumor segmentation task. A healthy human brain is symmetric at a high level of abstraction, and the high-level asymmetric parts are more likely to be tumor regions. Paying…

Computer Vision and Pattern Recognition · Computer Science 2017-11-20 Hejia Zhang , Xia Zhu , Theodore L. Willke

Purpose To develop and evaluate a deep learning-based method (MC-Net) to suppress motion artifacts in brain magnetic resonance imaging (MRI). Methods MC-Net was derived from a UNet combined with a two-stage multi-loss function. T1-weighted…

Image and Video Processing · Electrical Eng. & Systems 2022-10-26 Lei Zhang , Xiaoke Wang , Michael Rawson , Radu Balan , Edward H. Herskovits , Elias Melhem , Linda Chang , Ze Wang , Thomas Ernst

Neural audio codecs have revolutionized audio processing by enabling speech tasks to be performed on highly compressed representations. Recent work has shown that speech separation can be achieved within these compressed domains, offering…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-28 Jia Qi Yip , Chin Yuen Kwok , Bin Ma , Eng Siong Chng

In modern neuroscience, functional magnetic resonance imaging (fMRI) has been a crucial and irreplaceable tool that provides a non-invasive window into the dynamics of whole-brain activity. Nevertheless, fMRI is limited by hemodynamic…

Signal Processing · Electrical Eng. & Systems 2024-01-26 Yamin Li , Ange Lou , Ziyuan Xu , Shiyu Wang , Catie Chang

Recently, DNN models for lossless image coding have surpassed their traditional counterparts in compression performance, reducing the previous lossless bit rate by about ten percent for natural color images. But even with these advances,…

Image and Video Processing · Electrical Eng. & Systems 2025-07-23 Xi Zhang , Xiaolin Wu

Brain decoding algorithms form an important part of the arsenal of analysis tools available to neuroscientists, allowing for a more detailed study of the kind of information represented in patterns of cortical activity. While most current…

Quantitative Methods · Quantitative Biology 2017-08-17 R. S. van Bergen , J. F. M. Jehee

The development of foundation models for functional magnetic resonance imaging (fMRI) time series holds significant promise for predicting phenotypes related to disease and cognition. Current models, however, are often trained using a…

Machine Learning · Computer Science 2026-03-03 Sam Gijsen , Marc-Andre Schulz , Kerstin Ritter

The advent of neuralmorphic spike cameras has garnered significant attention for their ability to capture continuous motion with unparalleled temporal resolution.However, this imaging attribute necessitates considerable resources for binary…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Kexiang Feng , Chuanmin Jia , Siwei Ma , Wen Gao

Decoding visual content from fMRI signals recorded while a person views images, and specifically answering questions about the seen images, is a long-standing challenge. While significant progress has been made in recent years in visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Roman Beliy , Matias Cosarinsky , Oliver Heinimann , Navve Wasserman , Michal Irani

Decoding brain signals accurately and efficiently is crucial for intra-cortical brain-computer interfaces. Traditional decoding approaches based on neural activity vector features suffer from low accuracy, whereas deep learning based…

Human-Computer Interaction · Computer Science 2025-04-15 Song Yang , Haotian Fu , Herui Zhang , Peng Zhang , Wei Li , Dongrui Wu

Neural image compression methods have seen increasingly strong performance in recent years. However, they suffer orders of magnitude higher computational complexity compared to traditional codecs, which hinders their real-world deployment.…

Image and Video Processing · Electrical Eng. & Systems 2023-11-13 Yibo Yang , Stephan Mandt

The rapid pace of innovation in biological microscopy imaging has led to large images, putting pressure on data storage and impeding efficient sharing, management, and visualization. This necessitates the development of efficient…