English
Related papers

Related papers: Sharing deep generative representation for perceiv…

200 papers

Deciphering visual content from functional Magnetic Resonance Imaging (fMRI) helps illuminate the human vision system. However, the scarcity of fMRI data and noise hamper brain decoding model performance. Previous approaches primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Yulong Liu , Yongqiang Ma , Guibo Zhu , Haodong Jing , Nanning Zheng

Here, we present a novel approach to solve the problem of reconstructing perceived stimuli from brain responses by combining probabilistic inference with deep learning. Our approach first inverts the linear transformation from latent…

Neurons and Cognition · Quantitative Biology 2017-06-16 Yağmur Güçlütürk , Umut Güçlü , Katja Seeliger , Sander Bosch , Rob van Lier , Marcel van Gerven

The ability to record activities from hundreds of neurons simultaneously in the brain has placed an increasing demand for developing appropriate statistical techniques to analyze such data. Recently, deep generative models have been…

Machine Learning · Statistics 2020-11-11 Ding Zhou , Xue-Xin Wei

Resting-state functional magnetic resonance imaging (rs-fMRI) can reflect spontaneous neural activities in brain and is widely used for brain disorder analysis.Previous studies propose to extract fMRI representations through diverse…

Quantitative Methods · Quantitative Biology 2023-06-27 Qianqian Wang , Wei Wang , Yuqi Fang , P. -T. Yap , Hongtu Zhu , Hong-Jun Li , Lishan Qiao , Mingxia Liu

Face plays an important role in humans visual perception, and reconstructing perceived faces from brain activities is challenging because of its difficulty in extracting high-level features and maintaining consistency of multiple face…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Zihao Wang , Jing Zhao , Xuetong Ding , Hui Zhang

Reconstructing natural images from functional magnetic resonance imaging (fMRI) data remains a core challenge in natural decoding due to the mismatch between the richness of visual stimuli and the noisy, low resolution nature of fMRI…

Image and Video Processing · Electrical Eng. & Systems 2025-09-03 Junliang Ye , Lei Wang , Md Zakir Hossain

Decoding the human brain has been a hallmark of neuroscientists and Artificial Intelligence researchers alike. Reconstruction of visual images from brain Electroencephalography (EEG) signals has garnered a lot of interest due to its…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Prajwal Singh , Dwip Dalal , Gautam Vashishtha , Krishna Miyapuram , Shanmuganathan Raman

An important task in image processing and neuroimaging is to extract quantitative information from the acquired images in order to make observations about the presence of disease or markers of development in populations. Having a…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Camilo Bermudez , Andrew J. Plassard , Larry T. Davis , Allen T. Newton , Susan M Resnick , Bennett A. Landman

Delineating the associations between images and a vector of covariates is of central interest in medical imaging studies. To tackle this problem of image response regression, we propose a novel nonparametric approach in the framework of…

Machine Learning · Statistics 2022-03-04 Daiwei Zhang , Lexin Li , Chandra Sripada , Jian Kang

A foveated image can be entirely reconstructed from a sparse set of samples distributed according to the retinal sensitivity of the human visual system, which rapidly decreases with increasing eccentricity. The use of Generative Adversarial…

Graphics · Computer Science 2023-04-18 Luca Surace , Marek Wernikowski , Cara Tursun , Karol Myszkowski , Radosław Mantiuk , Piotr Didyk

Deep generative models like VAEs and diffusion models have advanced various generation tasks by leveraging latent variables to learn data distributions and generate high-quality samples. Despite the field of explainable AI making strides in…

Machine Learning · Computer Science 2025-12-22 Mengdan Zhu , Raasikh Kanjiani , Jiahui Lu , Andrew Choi , Qirui Ye , Liang Zhao

A long standing goal in neuroscience has been to elucidate the functional organization of the brain. Within higher visual cortex, functional accounts have remained relatively coarse, focusing on regions of interest (ROIs) and taking the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Andrew F. Luo , Margaret M. Henderson , Leila Wehbe , Michael J. Tarr

3D object reconstruction is important for semantic scene understanding. It is challenging to reconstruct detailed 3D shapes from monocular images directly due to a lack of depth information, occlusion and noise. Most current methods…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Ziwei Liao , Steven L. Waslander

We present an empirical evaluation of fMRI data augmentation via synthesis. For synthesis we use generative mod-els trained on real neuroimaging data to produce novel task-dependent functional brain images. Analyzed generative mod-els…

Computer Vision and Pattern Recognition · Computer Science 2019-07-16 Peiye Zhuang , Alexander G. Schwing , Sanmi Koyejo

Generalizable neural surface reconstruction has become a compelling technique to reconstruct from few images without per-scene optimization, where dense 3D feature volume has proven effective as a global representation of scenes. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Aoxiang Fan , Corentin Dumery , Nicolas Talabot , Hieu Le , Pascal Fua

With the advent of brain imaging techniques and machine learning tools, much effort has been devoted to building computational models to capture the encoding of visual information in the human brain. One of the most challenging brain…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Zarina Rakhimberdina , Quentin Jodelet , Xin Liu , Tsuyoshi Murata

Clustering multi-view data has been a fundamental research topic in the computer vision community. It has been shown that a better accuracy can be achieved by integrating information of all the views than just using one view individually.…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Ming Yin , Weitian Huang , Junbin Gao

Magnetic resonance imaging (MRI) exam protocols consist of multiple contrast-weighted images of the same anatomy to emphasize different tissue properties. Due to the long acquisition times required to collect fully sampled k-space…

Image and Video Processing · Electrical Eng. & Systems 2023-06-08 Brett Levac , Ajil Jalal , Kannan Ramchandran , Jonathan I. Tamir

Causal mapping of the functional organisation of the human brain requires evidence of \textit{necessity} available at adequate scale only from pathological lesions of natural origin. This demands inferential models with sufficient…

Machine Learning · Computer Science 2023-05-30 Guilherme Pombo , Robert Gray , Amy P. K. Nelson , Chris Foulon , John Ashburner , Parashkev Nachev

High-level visual brain regions contain subareas in which neurons appear to respond more strongly to examples of a particular semantic category, like faces or bodies, rather than objects. However, recent work has shown that while this…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Alexander Lappe , Anna Bognár , Ghazaleh Ghamkhari Nejad , Albert Mukovskiy , Lucas Martini , Martin A. Giese , Rufin Vogels