English
Related papers

Related papers: NECOMIMI: Neural-Cognitive Multimodal EEG-informed…

200 papers

Zero-shot EEG-to-image retrieval aims to decode perceived visual content from electroencephalography (EEG) by aligning neural responses with pretrained visual representations, providing a promising route toward scalable visual neural…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Lin Jiang , Qingshan She , Jiale Xu , Haiqi Xu , Duanpo Wu , Zhenzhong Kuang

EEG is a non-invasive, safe, and low-risk method to record electrophysiological signals inside the brain. Especially with recent technology developments like dry electrodes, consumer-grade EEG devices, and rapid advances in machine…

Machine Learning · Computer Science 2025-06-23 Tri Duc Ly , Gia H. Ngo

Decoding visual neural representations from Electroencephalography (EEG) signals remains a formidable challenge due to their high-dimensional, noisy, and non-Euclidean nature. In this work, we propose a Spatial-Functional Awareness…

Artificial Intelligence · Computer Science 2025-10-10 Yueming Sun , Long Yang

Unified multimodal generative models aim to integrate image understanding and generation abilities, offering significant advantages in harnessing multimodal corpora, particularly interleaved text-image data. However, existing unified models…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Hong Zhang , Zhongjie Duan , Xingjun Wang , Yuze Zhao , Weiyi Lu , Zhipeng Di , Yixuan Xu , Yingda Chen , Yu Zhang

This paper proposes a data-driven model for solving the inverse problem of electrocardiography, the mathematical problem that forms the basis of electrocardiographic imaging (ECGI). We present a conditional diffusion framework that learns a…

Machine Learning · Computer Science 2026-01-27 Ramiro Valdes Jara , Adam Meyers

To be practical for real-life applications, models for brain-computer interfaces must be easily and quickly deployable on new subjects, effective on affordable scanning hardware, and small enough to run locally on accessible computing…

Neurons and Cognition · Quantitative Biology 2026-02-12 Reese Kneeland , Wangshu Jiang , Ugo Bruzadin Nunes , Paul Steven Scotti , Arnaud Delorme , Jonathan Xu

Brain-computer interface (BCI) facilitates direct communication between the human brain and external systems by utilizing brain signals, eliminating the need for conventional communication methods such as speaking, writing, or typing.…

Multimedia · Computer Science 2024-07-23 Linfeng Zheng , Peilin Chen , Shiqi Wang

Multi-subject image generation aims to synthesize images that faithfully preserve the identities of multiple reference subjects while following textual instructions. However, existing methods often suffer from identity inconsistency and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Yijia Xu , Zihao Wang , Jinshi Cui

Processing temporal sequences is central to a variety of applications in health care, and in particular multi-channel Electrocardiogram (ECG) is a highly prevalent diagnostic modality that relies on robust sequence modeling. While Recurrent…

Machine Learning · Statistics 2018-07-17 Deepta Rajan , Jayaraman J. Thiagarajan

Recent progress in diffusion models has revolutionized the popular technology of text-to-image generation. While existing approaches could produce photorealistic high-resolution images with text conditions, there are still several open…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Zhida Feng , Zhenyu Zhang , Xintong Yu , Yewei Fang , Lanxin Li , Xuyi Chen , Yuxiang Lu , Jiaxiang Liu , Weichong Yin , Shikun Feng , Yu Sun , Li Chen , Hao Tian , Hua Wu , Haifeng Wang

In this work, we propose a denoising diffusion generative model (DDGM) trained with healthy electrocardiogram (ECG) data that focuses on ECG morphology and inter-lead dependence. Our results show that this innovative generative model can…

Signal Processing · Electrical Eng. & Systems 2024-01-12 Gabriel V. Cardoso , Lisa Bedin , Josselin Duchateau , Rémi Dubois , Eric Moulines

Decoding visual information from electroencephalography (EEG) has recently achieved promising results, primarily focusing on reconstructing two-dimensional (2D) images from brain activity. However, the reconstruction of three-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Emanuele Balloni , Emanuele Frontoni , Chiara Matti , Marina Paolanti , Roberto Pierdicca , Emiliano Santarnecchi

Background and objective: Brain activity in premature newborns has traditionally been studied using electroencephalography (EEG), leading to substantial advances in our understanding of early neural development. However, since brain…

Signal Processing · Electrical Eng. & Systems 2025-07-22 Benoît Brebion , Alban Gallard , Katrin Sippel , Amer Zaylaa , Hubert Preissl , Sahar Moghimi , Fabrice Wallois , Yaël Frégier

Visual stimuli reconstruction from EEG remains challenging due to fidelity loss and representation shift. We propose CognitionCapturerPro, an enhanced framework that integrates EEG with multi-modal priors (images, text, depth, and edges)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Kaifan Zhang , Lihuo He , Junjie Ke , Yuqi Ji , Lukun Wu , Lizi Wang , Xinbo Gao

EEG based brain state decoding has numerous applications. State of the art decoding is based on processing of the multivariate sensor space signal, however evidence is mounting that EEG source reconstruction can assist decoding. EEG source…

Neurons and Cognition · Quantitative Biology 2017-04-20 Rasmus S. Andersen , Anders U. Eliasen , Nicolai Pedersen , Michael Riis Andersen , Sofie Therese Hansen , Lars Kai Hansen

We introduce a two-stage multitask learning framework for analyzing Electroencephalography (EEG) signals that integrates denoising, dynamical modeling, and representation learning. In the first stage, a denoising autoencoder is trained to…

Machine Learning · Computer Science 2026-02-24 Sucheta Ghosh , Felix Dietrich , Zahra Monfared

Text-guided diffusion models have become a popular tool in image synthesis, known for producing high-quality and diverse images. However, their application to editing real images often encounters hurdles primarily due to the text condition…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Hansam Cho , Jonghyun Lee , Seoung Bum Kim , Tae-Hyun Oh , Yonghyun Jeong

Multimodal neuroimaging provides complementary insights for Alzheimer's disease diagnosis, yet clinical datasets frequently suffer from missing modalities. We propose ACADiff, a framework that synthesizes missing brain imaging modalities…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Rong Zhou , Houliang Zhou , Yao Su , Brian Y. Chen , Yu Zhang , Lifang He , Alzheimer's Disease Neuroimaging Initiative

Recent advances in multimodal large language models enable new possibilities for image-based decision support. However, their reliability and operational trade-offs in neuroimaging remain insufficiently understood. We present a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Katarina Trojachanec Dineva , Stefan Andonov , Ilinka Ivanoska , Ivan Kitanovski , Sasho Gramatikov , Tamara Kostova , Monika Simjanoska Misheva , Kostadin Mishev

In medical imaging, generative models are increasingly relied upon for two distinct but equally critical tasks: reconstruction, where the goal is to restore medical imaging (usually inverse problems like inpainting or superresolution), and…

Image and Video Processing · Electrical Eng. & Systems 2025-07-28 Niklas Bubeck , Yundi Zhang , Suprosanna Shit , Daniel Rueckert , Jiazhen Pan