English
Related papers

Related papers: Bridging the Vision-Brain Gap with an Uncertainty-…

200 papers

Deciphering visual content from functional Magnetic Resonance Imaging (fMRI) helps illuminate the human vision system. However, the scarcity of fMRI data and noise hamper brain decoding model performance. Previous approaches primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Yulong Liu , Yongqiang Ma , Guibo Zhu , Haodong Jing , Nanning Zheng

The pursuit of high perceptual quality in image restoration has driven the development of revolutionary generative models, capable of producing results often visually indistinguishable from real data. However, as their perceptual quality…

Machine Learning · Computer Science 2024-10-29 Regev Cohen , Idan Kligvasser , Ehud Rivlin , Daniel Freedman

Recent work has demonstrated that complex visual stimuli can be decoded from human brain activity using deep generative models, offering new ways to probe how the brain represents real-world scenes. However, many existing approaches first…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Pinyuan Feng , Hossein Adeli , Wenxuan Guo , Fan Cheng , Ethan Hwang , Nikolaus Kriegeskorte

EEG decoding systems based on deep neural networks have been widely used in decision making of brain computer interfaces (BCI). Their predictions, however, can be unreliable given the significant variance and noise in EEG signals. Previous…

Signal Processing · Electrical Eng. & Systems 2022-10-04 Tiehang Duan , Zhenyi Wang , Sheng Liu , Sargur N. Srihari , Hui Yang

Visual perceptual tasks aim to predict human judgment of images (e.g., emotions invoked by images, image quality assessment). Unlike objective tasks such as object/scene recognition, perceptual tasks rely on subjective human assessments,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Amit Zalcher , Navve Wasserman , Roman Beliy , Oliver Heinimann , Michal Irani

Composed Image Retrieval (CIR) enables image search by combining a reference image with modification text. Intrinsic noise in CIR triplets incurs intrinsic uncertainty and threatens the model's robustness. Probabilistic learning approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Haomiao Tang , Jinpeng Wang , Minyi Zhao , Guanghao Meng , Ruisheng Luo , Long Chen , Shu-Tao Xia

Conformal Prediction (CP) provides a statistical framework for uncertainty quantification that constructs prediction sets with coverage guarantees. While CP yields uncontrolled prediction set sizes, Backward Conformal Prediction (BCP)…

Machine Learning · Statistics 2026-05-19 Junxian Liu , Hao Zeng , Hongxin Wei

Incorporating the audio stream enables Video Saliency Prediction (VSP) to imitate the selective attention mechanism of human brain. By focusing on the benefits of joint auditory and visual information, most VSP methods are capable of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Junwen Xiong , Ganglai Wang , Peng Zhang , Wei Huang , Yufei Zha , Guangtao Zhai

Neural networks have become a prominent approach to solve inverse problems in recent years. Amongst the different existing methods, the Deep Image/Inverse Priors (DIPs) technique is an unsupervised approach that optimizes a highly…

Machine Learning · Computer Science 2023-03-21 Nathan Buskulic , Yvain Quéau , Jalal Fadili

LiDAR-camera fusion enhances 3D panoptic segmentation by leveraging camera images to complement sparse LiDAR scans, but it also introduces a critical failure mode. Under adverse conditions, degradation or failure of the camera sensor can…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Rohit Mohan , Florian Drews , Yakov Miron , Daniele Cattaneo , Abhinav Valada

Human decision-making in cognitive tasks and daily life exhibits considerable variability, shaped by factors such as task difficulty, individual preferences, and personal experiences. Understanding this variability across individuals is…

Artificial Intelligence · Computer Science 2025-05-07 Chen Wei , Chi Zhang , Jiachen Zou , Haotian Deng , Dietmar Heinke , Quanying Liu

Image-to-image translation plays a vital role in tackling various medical imaging tasks such as attenuation correction, motion correction, undersampled reconstruction, and denoising. Generative adversarial networks have been shown to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-05 Uddeshya Upadhyay , Yanbei Chen , Tobias Hepp , Sergios Gatidis , Zeynep Akata

Single image inverse problem is a notoriously challenging ill-posed problem that aims to restore the original image from one of its corrupted versions. Recently, this field has been immensely influenced by the emergence of deep-learning…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Qianwei Zhou , Chen Zhou , Haigen Hu , Yuhang Chen , Shengyong Chen , Xiaoxin Li

Neural implicit representation of visual scenes has attracted a lot of attention in recent research of computer vision and graphics. Most prior methods focus on how to reconstruct 3D scene representation from a set of images. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Wenpu Li , Pian Wan , Peng Wang , Jinghang Li , Yi Zhou , Peidong Liu

Obtaining reliable uncertainty estimates of neural network predictions is a long standing challenge. Bayesian neural networks have been proposed as a solution, but it remains open how to specify their prior. In particular, the common…

Machine Learning · Statistics 2019-07-02 Danijar Hafner , Dustin Tran , Timothy Lillicrap , Alex Irpan , James Davidson

Accurate measurement of optical absorption coefficients from photoacoustic imaging (PAI) data would enable direct mapping of molecular concentrations, providing vital clinical insight. The ill-posed nature of the problem of absorption…

Image and Video Processing · Electrical Eng. & Systems 2023-06-13 Janek Gröhl , Thomas R. Else , Lina Hacker , Ellie V. Bunce , Paul W. Sweeney , Sarah E. Bohndiek

The intrication of brain signals drives research that leverages multimodal AI to align brain modalities with visual and textual data for explainable descriptions. However, most existing studies are limited to coarse interpretations, lacking…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Weihao Xia , Cengiz Oztireli

We introduce Primitive-based Representations of Uncertainty (PRIMU), a post-hoc uncertainty estimation (UE) framework for Gaussian Splatting (GS). Reliable UE is essential for deploying GS in safety-critical domains such as robotics and…

Neural Radiance Fields (NeRF) have shown remarkable performance in neural rendering-based novel view synthesis. However, NeRF suffers from severe visual quality degradation when the input images have been captured under imperfect…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Byeonghyeon Lee , Howoong Lee , Usman Ali , Eunbyung Park

Compared to RGB images, raw sensor data provides a richer representation of information, which is crucial for accurate recognition, particularly under challenging conditions such as low-light environments. The traditional Image Signal…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Hanxi Li , Yao Cheng , Bo Zhang , Li Zeng