English
Related papers

Related papers: A Penny for Your (visual) Thoughts: Self-Supervise…

200 papers

Reconstructing dynamic visual experiences as videos from functional magnetic resonance imaging (fMRI) is pivotal for advancing the understanding of neural processes. However, current fMRI-to-video reconstruction methods are hindered by a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Yujie Wei , Chenglong Ma , Jianxiong Gao , Chenhui Wang , Shiwei Zhang , Biao Gong , Shuai Tan , Hangjie Yuan , Hongming Shan

Current AI frameworks for brain decoding and encoding, typically train and test models within the same datasets. This limits their utility for brain computer interfaces (BCI) or neurofeedback, for which it would be useful to pool…

Self-supervised approaches for video have shown impressive results in video understanding tasks. However, unlike early works that leverage temporal self-supervision, current state-of-the-art methods primarily rely on tasks from the image…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Ishan Rajendrakumar Dave , Simon Jenni , Mubarak Shah

Reconstructing visual stimulus (image) only from human brain activity measured with functional Magnetic Resonance Imaging (fMRI) is a significant and meaningful task in Human-AI collaboration. However, the inconsistent distribution and…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Ziqi Ren , Jie Li , Xuetong Xue , Xin Li , Fan Yang , Zhicheng Jiao , Xinbo Gao

Real-time magnetic resonance imaging (MRI) methods generally shorten the measuring time by acquiring less data than needed according to the sampling theorem. In order to obtain a proper image from such undersampled data, the reconstruction…

Numerical Analysis · Mathematics 2013-12-05 Housen Li , Markus Haltmeier , Shuo Zhang , Jens Frahm , Axel Munk

Reconstruction of static visual stimuli from non-invasion brain activity fMRI achieves great success, owning to advanced deep learning models such as CLIP and Stable Diffusion. However, the research on fMRI-to-video reconstruction remains…

Image and Video Processing · Electrical Eng. & Systems 2024-12-17 Zixuan Gong , Guangyin Bao , Qi Zhang , Zhongwei Wan , Duoqian Miao , Shoujin Wang , Lei Zhu , Changwei Wang , Rongtao Xu , Liang Hu , Ke Liu , Yu Zhang

This literature review will discuss the use of deep learning methods for image reconstruction using fMRI data. More specifically, the quality of image reconstruction will be determined by the choice in decoding and reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Madison Van Horn

Cardiac cine MRI is the gold standard for cardiac functional assessment, but the inherently slow acquisition process creates the necessity of reconstruction approaches for accelerated undersampled acquisitions. Several regularization…

Image and Video Processing · Electrical Eng. & Systems 2023-07-28 Tabita Catalán , Matías Courdurier , Axel Osses , René Botnar , Francisco Sahli Costabal , Claudia Prieto

We propose a self-supervised feature learning assisted reconstruction (SSFL-Recon) framework for MRI reconstruction to address the limitation of existing supervised learning methods. Although recent deep learning-based methods have shown…

Image and Video Processing · Electrical Eng. & Systems 2025-05-30 Siying Xu , Marcel Früh , Kerstin Hammernik , Andreas Lingg , Jens Kübler , Patrick Krumm , Daniel Rueckert , Sergios Gatidis , Thomas Küstner

Reconstructions of visual perception from brain activity have improved tremendously, but the practical utility of such methods has been limited. This is because such models are trained independently per subject where each subject requires…

The remastering of vintage film comprises of a diversity of sub-tasks including super-resolution, noise removal, and contrast enhancement which aim to restore the deteriorated film medium to its original state. Additionally, due to the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-21 Satoshi Iizuka , Edgar Simo-Serra

The reconstruction of human visual inputs from brain activity, particularly through functional Magnetic Resonance Imaging (fMRI), holds promising avenues for unraveling the mechanisms of the human visual system. Despite the significant…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Yujian Xiong , Wenhui Zhu , Zhong-Lin Lu , Yalin Wang

Long scan duration remains a challenge for high-resolution MRI. Deep learning has emerged as a powerful means for accelerated MRI reconstruction by providing data-driven regularizers that are directly learned from data. These data-driven…

Image and Video Processing · Electrical Eng. & Systems 2020-09-09 Seyed Amir Hossein Hosseini , Burhaneddin Yaman , Steen Moeller , Mehmet Akçakaya

Every day, the human brain processes an immense volume of visual information, relying on intricate neural mechanisms to perceive and interpret these stimuli. Recent breakthroughs in functional magnetic resonance imaging (fMRI) have enabled…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Matteo Ferrante , Furkan Ozcelik , Tommaso Boccato , Rufin VanRullen , Nicola Toschi

Brain decoding is a field of computational neuroscience that uses measurable brain activity to infer mental states or internal representations of perceptual inputs. Therefore, we propose a novel approach to brain decoding that also relies…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Matteo Ferrante , Tommaso Boccato , Nicola Toschi

In this study, we propose a self-supervised video denoising method called "restore-from-restored." This method fine-tunes a pre-trained network by using a pseudo clean video during the test phase. The pseudo clean video is obtained by…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Seunghwan Lee , Donghyeon Cho , Jiwon Kim , Tae Hyun Kim

Fetal brain magnetic resonance imaging (MRI) offers exquisite images of the developing brain but is not suitable for anomaly screening. For this ultrasound (US) is employed. While expert sonographers are adept at reading US images, MR…

Computer Vision and Pattern Recognition · Computer Science 2019-09-19 Jianbo Jiao , Ana I. L. Namburete , Aris T. Papageorghiou , J. Alison Noble

Despite the rapid advances in Brain-computer Interfacing (BCI) and continuous effort to improve the accuracy of brain decoding systems, the urge for the systems to reconstruct the experiences of the users has been widely acknowledged. This…

Signal Processing · Electrical Eng. & Systems 2017-11-20 Pouya Ghaemmaghami

Background: Image reconstruction from highly undersampled 4D flow MRI data can be very time consuming and may result in significant underestimation of velocities depending on regularization, thereby limiting the applicability of the method.…

Medical Physics · Physics 2025-04-01 Luuk Jacobs , Marco Piccirelli , Valery Vishnevskiy , Sebastian Kozerke

Despite significant strides in visual quality assessment, the neural mechanisms underlying visual quality perception remain insufficiently explored. This study employed fMRI to examine brain activity during image quality assessment and…

Multimedia · Computer Science 2024-04-30 Yiming Zhang , Ying Hu , Xiongkuo Min , Yan Zhou , Guangtao Zhai