English
Related papers

Related papers: NeuroCine: Decoding Vivid Video Sequences from Hum…

200 papers

Motor Imagery (MI) is an emerging Brain-Computer Interface (BCI) paradigm where a person imagines body movements without physical action. By decoding scalp-recorded electroencephalography (EEG) signals, BCIs establish direct communication…

Human-Computer Interaction · Computer Science 2026-04-14 Jiani Cao , Kun Wang , Yang Liu , Zhenjiang Li

Mental disorders are among the most widespread diseases globally. Analyzing functional brain networks through functional magnetic resonance imaging (fMRI) is crucial for understanding mental disorder behaviors. Although existing fMRI-based…

Neural and Evolutionary Computing · Computer Science 2025-05-26 Jun-En Ding , Dongsheng Luo , Anna Zilverstand , Kaustubh Kulkarni , Feng Liu

Brain decoding aims to reconstruct original stimuli from fMRI signals, providing insights into interpreting mental content. Current approaches rely heavily on subject-specific models due to the complex brain processing mechanisms and the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Zicheng Wang , Zhen Zhao , Luping Zhou , Parashkev Nachev

Recent fMRI-to-image approaches mainly focused on associating fMRI signals with specific conditions of pre-trained diffusion models. These approaches, while producing high-quality images, capture only a limited aspect of the complex…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Jingyang Huo , Yikai Wang , Xuelin Qian , Yun Wang , Chong Li , Jianfeng Feng , Yanwei Fu

Two recent developments have accelerated progress in image reconstruction from human brain activity: large datasets that offer samples of brain activity in response to many thousands of natural scenes, and the open-sourcing of powerful…

Neurons and Cognition · Quantitative Biology 2023-06-02 Reese Kneeland , Jordyn Ojeda , Ghislain St-Yves , Thomas Naselaris

Human perception plays a vital role in forming beliefs and understanding reality. A deeper understanding of brain functionality will lead to the development of novel deep neural networks. In this work, we introduce a novel framework named…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Xuan-Bac Nguyen , Xin Li , Pawan Sinha , Samee U. Khan , Khoa Luu

In this work, we explore the decoding of mental imagery from subjects using their fMRI measurements. In order to achieve this decoding, we first created a mapping between a subject's fMRI signals elicited by the videos the subjects watched.…

Image and Video Processing · Electrical Eng. & Systems 2024-10-02 Arman Afrasiyabi , Erica Busch , Rahul Singh , Dhananjay Bhaskar , Laurent Caplette , Nicholas Turk-Browne , Smita Krishnaswamy

Decoding continuous language from brain activity is a formidable yet promising field of research. It is particularly significant for aiding people with speech disabilities to communicate through brain signals. This field addresses the…

Computation and Language · Computer Science 2024-04-03 Xinpei Zhao , Jingyuan Sun , Shaonan Wang , Jing Ye , Xiaohan Zhang , Chengqing Zong

Decoding visual stimuli from neural population activity is crucial for understanding the brain and for applications in brain-machine interfaces. However, such biological data is often scarce, particularly in primates or humans, where…

Machine Learning · Computer Science 2025-10-24 Jan Sobotka , Luca Baroni , Ján Antolík

Magnetic resonance imaging (MRI) relies on radiofrequency (RF) excitation of proton spin. Clinical diagnosis requires a comprehensive collation of biophysical data via multiple MRI contrasts, acquired using a series of RF sequences that…

Medical Physics · Physics 2025-12-24 Dinor Nagar , Moritz Zaiss , Or Perlman

Decoding behavior, perception, or cognitive state directly from neural signals has applications in brain-computer interface research as well as implications for systems neuroscience. In the last decade, deep learning has become the…

Neurons and Cognition · Quantitative Biology 2020-05-21 Jesse A. Livezey , Joshua I. Glaser

The application of deep learning (DL) models to neuroimaging data poses several challenges, due to the high dimensionality, low sample size and complex temporo-spatial dependency structure of these datasets. Even further, DL models act as…

Machine Learning · Computer Science 2019-04-08 Armin W. Thomas , Hauke R. Heekeren , Klaus-Robert Müller , Wojciech Samek

Neuromorphic imaging is an emerging technique that imitates the human retina to sense variations in dynamic scenes. It responds to pixel-level brightness changes by asynchronous streaming events and boasts microsecond temporal precision…

Image and Video Processing · Electrical Eng. & Systems 2024-10-23 Pei Zhang , Shuo Zhu , Chutian Wang , Yaping Zhao , Edmund Y. Lam

Clarifying the neural basis of speech intelligibility is critical for computational neuroscience and digital speech processing. Recent neuroimaging studies have shown that intelligibility modulates cortical activity beyond simple acoustics,…

Neurons and Cognition · Quantitative Biology 2025-11-05 Ching-Chih Sung , Shuntaro Suzuki , Francis Pingfan Chien , Komei Sugiura , Yu Tsao

Cognitive neuroscience is enjoying rapid increase in extensive public brain-imaging datasets. It opens the door to large-scale statistical models. Finding a unified perspective for all available data calls for scalable and automated…

Machine Learning · Statistics 2019-05-16 Arthur Mensch , Julien Mairal , Danilo Bzdok , Bertrand Thirion , Gaël Varoquaux

Accurate decoding of lower-limb motion from EEG signals is essential for advancing brain-computer interface (BCI) applications in movement intent recognition and control. This study presents NeuroDyGait, a two-stage, phase-aware EEG-to-gait…

Signal Processing · Electrical Eng. & Systems 2026-02-13 Xi Fu , Weibang Jiang , Rui Liu , Gernot R. Müller-Putz , Cuntai Guan

The dispute of how the human brain represents conceptual knowledge has been argued in many scientific fields. Brain imaging studies have shown that the spatial patterns of neural activation in the brain are correlated with thinking about…

Neurons and Cognition · Quantitative Biology 2018-06-15 Subba Reddy Oota , Naresh Manwani , Bapi Raju S

Fluorescence microscopy is widely employed for the analysis of living biological samples; however, the utility of the resulting recordings is frequently constrained by noise, temporal variability, and inconsistent visualisation of signals…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Hassan Eshkiki , Sarah Costa , Mostafa Mohammadpour , Farinaz Tanhaei , Christopher H. George , Fabio Caraffini

Functional magnetic resonance imaging (fMRI) is a powerful tool for investigating human brain function. However, the high cost of data acquisition and the inherent subjectivity of psychiatric rating scales often lead to datasets with small…

Machine Learning · Computer Science 2026-05-29 Jiyao Wang , Peiyu Duan , Nicha C. Dvornek , Lawrence H. Staib , Denis Sukhodolsky , Pamela Ventola , James S. Duncan

Finding an appropriate representation of dynamic activities in the brain is crucial for many downstream applications. Due to its highly dynamic nature, temporally averaged fMRI (functional magnetic resonance imaging) can only provide a…

Machine Learning · Computer Science 2022-08-18 Sikun Lin , Shuyun Tang , Scott Grafton , Ambuj Singh