English
Related papers

Related papers: FreqSelect: Frequency-Aware fMRI-to-Image Reconstr…

200 papers

Learning a robust Variational Autoencoder (VAE) is a fundamental step for many deep learning applications in medical image analysis, such as MRI synthesizes. Existing brain VAEs predominantly focus on single-modality data (i.e., T1-weighted…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Mingjie Li , Edward Kim , Yue Zhao , Ehsan Adeli , Kilian M. Pohl

Inverse inference, or "brain reading", is a recent paradigm for analyzing functional magnetic resonance imaging (fMRI) data, based on pattern recognition and statistical learning. By predicting some cognitive variables related to brain…

The reconstruction of clipped speech signals is an important task in audio signal processing to achieve an enhanced audio quality for further processing. In this paper, Frequency Selective Extrapolation (FSE), which is commonly used for…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-11 Markus Jonscher , Jürgen Seiler , André Kaup

The infrared and visible images fusion (IVIF) is receiving increasing attention from both the research community and industry due to its excellent results in downstream applications. Existing deep learning approaches often utilize…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Tianpei Zhang , Jufeng Zhao , Yiming Zhu , Guangmang Cui , Yuhan Lyu

Analyzing and reconstructing visual stimuli from brain signals effectively advances the understanding of human visual system. However, the EEG signals are complex and contain significant noise. This leads to substantial limitations in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Honghao Fu , Zhiqi Shen , Jing Jih Chin , Hao Wang

Simultaneous EEG-fMRI is a multi-modal neuroimaging technique that provides complementary spatial and temporal resolution. Challenging has been developing principled and interpretable approaches for fusing the modalities, specifically…

Neurons and Cognition · Quantitative Biology 2022-12-06 Xueqing Liu , Tao Tu , Paul Sajda

Ultrasound is a widely accessible and cost-effective medical imaging tool commonly used for prenatal evaluation of the fetal brain. However, it has limitations, particularly in the third trimester, where the complexity of the fetal brain…

Image and Video Processing · Electrical Eng. & Systems 2025-04-04 Naomi Silverstein , Efrat Leibowitz , Ron Beloosesky , Haim Azhari

Recent self-supervised video representation learning methods focus on maximizing the similarity between multiple augmented views from the same video and largely rely on the quality of generated views. However, most existing methods lack a…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Jinhyung Kim , Taeoh Kim , Minho Shim , Dongyoon Han , Dongyoon Wee , Junmo Kim

Recent advances in fMRI-based image reconstruction have achieved remarkable photo-realistic fidelity. Yet, a persistent limitation remains: while reconstructed images often appear naturalistic and holistically similar to the target stimuli,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Lan Yang , Minghan Yang , Ke Li , Honggang Zhang , Kaiyue Pang , Yi-Zhe Song

Image fusion is a fundamental and important task in computer vision, aiming to combine complementary information from different modalities to fuse images. In recent years, diffusion models have made significant developments in the field of…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Zirui Wang , Jiayi Zhang , Tianwei Guan , Yuhan Zhou , Xingyuan Li , Minjing Dong , Jinyuan Liu

Implicit Neural Representations (INRs) leverage neural networks to map coordinates to corresponding signals, enabling continuous and compact representations. This paradigm has driven significant advances in various vision tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Sukhun Ko , Seokhyun Youn , Dahyeon Kye , Kyle Min , Chanho Eom , Jihyong Oh

Purpose: A novel subspace-based reconstruction method for frequency-modulated balanced steady-state free precession (fmSSFP) MRI is presented. In this work, suitable data acquisition schemes, subspace sizes, and efficiencies for banding…

Sparse-view tomographic reconstruction is a pivotal direction for reducing radiation dose and augmenting clinical applicability. While many research works have proposed the reconstruction of tomographic images from sparse 2D projections,…

Image and Video Processing · Electrical Eng. & Systems 2024-09-24 Jingmou Xian , Jian Zhu , Haolin Liao , Si Li

We present a novel method to provide efficient and highly detailed reconstructions. Inspired by wavelets, we learn a neural field that decompose the signal both spatially and frequency-wise. We follow the recent grid-based paradigm for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Zhijie Wu , Yuhe Jin , Kwang Moo Yi

Psychovisual models suggest human vision decouples low-level feature extraction from higher cognition by first forming intermediate abstractions. In contrast, deep learning-based vision models routinely extract and aggregate features using…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Wendi Ma , Aryaman Sharma , Wei Dai , Shekhar S. Chandra

Recent advances in All-in-One (AiO) RGB image restoration have demonstrated the effectiveness of prompt learning in handling multiple degradations within a single model. However, extending these approaches to hyperspectral image (HSI)…

Image and Video Processing · Electrical Eng. & Systems 2025-03-12 Chia-Ming Lee , Ching-Heng Cheng , Yu-Fan Lin , Yi-Ching Cheng , Wo-Ting Liao , Fu-En Yang , Yu-Chiang Frank Wang , Chih-Chung Hsu

In this paper, we consider voxel selection for functional Magnetic Resonance Imaging (fMRI) brain data with the aim of finding a more complete set of probably correlated discriminative voxels, thus improving interpretation of the discovered…

Computer Vision and Pattern Recognition · Computer Science 2015-06-09 Yilun Wang , Junjie Zheng , Sheng Zhang , Xujun Duan , Huafu Chen

Recent learning-based lossless image compression methods encode an image in the unit of subimages and achieve comparable performances to conventional non-learning algorithms. However, these methods do not consider the performance drop in…

Image and Video Processing · Electrical Eng. & Systems 2021-12-14 Hochang Rhee , Yeong Il Jang , Seyun Kim , Nam Ik Cho

Decoding stimulus images from fMRI signals has advanced with pre-trained generative models. However, existing methods struggle with cross-subject mappings due to cognitive variability and subject-specific differences. This challenge arises…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Yangyang Xu , Bangzhen Liu , Wenqi Shao , Yong Du , Shengfeng He , Tingting Zhu

In fluorescence microscopy, spectral unmixing aims to recover individual fluorophore concentrations from spectral images that capture mixed fluorophore emissions. Since classical methods operate pixel-wise and rely on least-squares fitting,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Federico Carrara , Talley Lambert , Mehdi Seifi , Florian Jug