English
Related papers

Related papers: Structure-Guided Diffusion Model for EEG-Based Vis…

200 papers

Reconstructing visual stimuli from measured functional magnetic resonance imaging (fMRI) has been a meaningful and challenging task. Previous studies have successfully achieved reconstructions with structures similar to the original images,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Yizhuo Lu , Changde Du , Dianpeng Wang , Huiguang He

Can we directly visualize what we imagine in our brain together with what we describe? The inherent nature of human perception reveals that, when we think, our body can combine language description and build a vivid picture in our brain.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Ling Wang , Chen Wu , Lin Wang

Decoding natural language from non-invasive electroencephalography (EEG) remains fundamentally limited by low signal-to-noise ratio and restricted information bandwidth. This raises a fundamental question regarding whether sentence-level…

Computation and Language · Computer Science 2026-04-21 Xiaoli Yang , Huiyuan Tian , Yurui Li , Jianyu Zhang , Shijian Li , Gang Pan

Masked Image Modeling (MIM) techniques have redefined the landscape of computer vision, enabling pre-trained models to achieve exceptional performance across a broad spectrum of tasks. Despite their success, the full potential of MIM-based…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Sumin Son , Hyesong Choi , Dongbo Min

Reconstructing visual stimuli from brain recordings has been a meaningful and challenging task. Especially, the achievement of precise and controllable image reconstruction bears great significance in propelling the progress and utilization…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Yizhuo Lu , Changde Du , Qiongyi zhou , Dianpeng Wang , Huiguang He

This paper presents PolyDiffuse, a novel structured reconstruction algorithm that transforms visual sensor data into polygonal shapes with Diffusion Models (DM), an emerging machinery amid exploding generative AI, while formulating…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Jiacheng Chen , Ruizhi Deng , Yasutaka Furukawa

Human visual reconstruction aims to reconstruct fine-grained visual stimuli based on subject-provided descriptions and corresponding neural signals. As a widely adopted modality, Electroencephalography (EEG) captures rich visual cognition…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Zhijian Gong , Tianren Yao , Wenjia Dong , Xueyuan Xu

The present study introduces an innovative approach to the synthesis of Electroencephalogram (EEG) signals by integrating diffusion models with reinforcement learning. This integration addresses key challenges associated with traditional…

Signal Processing · Electrical Eng. & Systems 2024-10-02 Yang An , Yuhao Tong , Weikai Wang , Steven W. Su

Significant disparities between the features of natural images and those inherent to histopathological images make it challenging to directly apply and transfer pre-trained models from natural images to histopathology tasks. Moreover, the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Zhenfeng Zhuang , Min Cen , Yanfeng Li , Fangyu Zhou , Lequan Yu , Baptiste Magnier , Liansheng Wang

Data scarcity in the brain-computer interface field can be alleviated through the use of generative models, specifically diffusion models. While diffusion models have previously been successfully applied to electroencephalogram (EEG) data,…

Machine Learning · Computer Science 2024-11-05 Guido Klein , Pierre Guetschel , Gianluigi Silvestri , Michael Tangermann

Decoding the human brain has been a hallmark of neuroscientists and Artificial Intelligence researchers alike. Reconstruction of visual images from brain Electroencephalography (EEG) signals has garnered a lot of interest due to its…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Prajwal Singh , Dwip Dalal , Gautam Vashishtha , Krishna Miyapuram , Shanmuganathan Raman

Interpreting EEG signals linked to spoken language presents a complex challenge, given the data's intricate temporal and spatial attributes, as well as the various noise factors. Denoising diffusion probabilistic models (DDPMs), which have…

Computation and Language · Computer Science 2023-11-15 Soowon Kim , Seo-Hyun Lee , Young-Eun Lee , Ji-Won Lee , Ji-Ha Park , Seong-Whan Lee

Electroencephalography (EEG) foundation models hold significant promise for universal Brain-Computer Interfaces (BCIs). However, existing approaches often rely on end-to-end fine-tuning and exhibit limited efficacy under frozen-probing…

Machine Learning · Computer Science 2026-03-20 Jiquan Wang , Sha Zhao , Yangxuan Zhou , Yiming Kang , Shijian Li , Gang Pan

Diffusion model shows remarkable potential on sparse-view computed tomography (SVCT) reconstruction. However, when a network is trained on a limited sample space, its generalization capability may be constrained, which degrades performance…

Image and Video Processing · Electrical Eng. & Systems 2025-11-11 Zekun Zhou , Tan Liu , Bing Yu , Yanru Gong , Liu Shi , Qiegen Liu

Neuron segmentation in electron microscopy (EM) aims to reconstruct the complete neuronal connectome; however, current deep learning-based methods are limited by their reliance on large-scale training data and extensive, time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Liuyun Jiang , Yanchao Zhang , Jinyue Guo , Yizhuo Lu , Ruining Zhou , Hua Han

Decoding visual information from electroencephalography (EEG) signals remains a fundamental challenge in brain-computer interfaces and medical rehabilitation. Existing EEG visual decoding methods mainly focus on learning a single global EEG…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Xiang Gao , Hui Tian , Yanming Zhu , Xuefei Yin , Alan Wee-Chung Liew

Diffusion models have enabled remarkably high-quality medical image generation, yet it is challenging to enforce anatomical constraints in generated images. To this end, we propose a diffusion model-based method that supports…

Image and Video Processing · Electrical Eng. & Systems 2024-06-21 Nicholas Konz , Yuwen Chen , Haoyu Dong , Maciej A. Mazurowski

Reliable image transmission over wireless channels is particularly challenging at extremely low transmission rates, where conventional compression and channel coding schemes fail to preserve adequate visual quality. To address this issue,…

Information Theory · Computer Science 2025-10-27 Shengkang Chen , Tong Wu , Zhiyong Chen , Feng Yang , Meixia Tao , Wenjun Zhang

The application of iodinated contrast media (ICM) improves the sensitivity and specificity of computed tomography (CT) for a wide range of clinical indications. However, overdose of ICM can cause problems such as kidney damage and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Genyuan Zhang , Zihao Wang , Zhifan Gao , Lei Xu , Zhen Zhou , Haijun Yu , Jianjia Zhang , Xiujian Liu , Weiwei Zhang , Shaoyu Wang , Huazhu Fu , Fenglin Liu , Weiwen Wu

Exemplar-guided image translation, synthesizing photo-realistic images that conform to both structural control and style exemplars, is attracting attention due to its ability to enhance user control over style manipulation. Previous…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Eungbean Lee , Somi Jeong , Kwanghoon Sohn