English
Related papers

Related papers: On hallucinations in tomographic image reconstruct…

200 papers

Large-scale vision-language pre-trained (VLP) models are prone to hallucinate non-existent visual objects when generating text based on visual information. In this paper, we systematically study the object hallucination problem from three…

Computation and Language · Computer Science 2023-02-13 Wenliang Dai , Zihan Liu , Ziwei Ji , Dan Su , Pascale Fung

Single-view 3D object reconstruction has seen much progress, yet methods still struggle generalizing to novel shapes unseen during training. Common approaches predominantly rely on learned global shape priors and, hence, disregard detailed…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Jan Bechtold , Maxim Tatarchenko , Volker Fischer , Thomas Brox

In digital images, the performance of optical aberration is a multivariate degradation, where the spectral of the scene, the lens imperfections, and the field of view together contribute to the results. Besides eliminating it at the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Shiqi Chen , Jinwen Zhou , Menghao Li , Yueting Chen , Tingting Jiang

We study a new family of inverse problems for recovering representations of corrupted data. We assume access to a pre-trained representation learning network R(x) that operates on clean images, like CLIP. The problem is to recover the…

Machine Learning · Computer Science 2021-10-28 Sriram Ravula , Georgios Smyrnis , Matt Jordan , Alexandros G. Dimakis

A novel framework for designing image reconstruction algorithms for linear forward problems is proposed. The framework is based on the novel concept of conserving the information in the data during image reconstruction rather than…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Keith S Cover

Assume you encounter an inverse problem that shall be solved for a large number of data, but no ground-truth data is available. To emulate this encounter, in this study, we assume it is unknown how to solve the imaging problem of Computed…

Reconstructing an object's geometry and appearance from multiple images, also known as inverse rendering, is a fundamental problem in computer graphics and vision. Inverse rendering is inherently ill-posed because the captured image is an…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Akshat Dave , Yongyi Zhao , Ashok Veeraraghavan

Medical image reconstruction is typically an ill-posed inverse problem. In order to address such ill-posed problems, the prior distribution of the sought after object property is usually incorporated by means of some sparsity-promoting…

Image and Video Processing · Electrical Eng. & Systems 2020-01-30 Sayantan Bhadra , Weimin Zhou , Mark A. Anastasio

No-reference image quality assessment (NR-IQA) is a fundamental yet challenging task in low-level computer vision community. The difficulty is particularly pronounced for the limited information, for which the corresponding reference for…

Computer Vision and Pattern Recognition · Computer Science 2018-04-06 Kwan-Yee Lin , Guanxiang Wang

We propose a regularization scheme for image reconstruction that leverages the power of deep learning while hinging on classic sparsity-promoting models. Many deep-learning-based models are hard to interpret and cumbersome to analyze…

Image and Video Processing · Electrical Eng. & Systems 2024-07-10 Mehrsa Pourya , Sebastian Neumayer , Michael Unser

Non-blind deblurring methods achieve decent performance under the accurate blur kernel assumption. Since the kernel uncertainty (i.e. kernel error) is inevitable in practice, semi-blind deblurring is suggested to handle it by introducing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Xiaole Tang , Xile Zhao , Jun Liu , Jianli Wang , Yuchun Miao , Tieyong Zeng

In this paper, we study the task of hallucinating an authentic high-resolution (HR) face from an occluded thumbnail. We propose a multi-stage Progressive Upsampling and Inpainting Generative Adversarial Network, dubbed Pro-UIGAN, which…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Yang Zhang , Xin Yu , Xiaobo Lu , Ping Liu

Motion blur is a fundamental problem in computer vision as it impacts image quality and hinders inference. Traditional deblurring algorithms leverage the physics of the image formation model and use hand-crafted priors: they usually produce…

Computer Vision and Pattern Recognition · Computer Science 2018-01-17 Huaijin Chen , Jinwei Gu , Orazio Gallo , Ming-Yu Liu , Ashok Veeraraghavan , Jan Kautz

Single image inverse problem is a notoriously challenging ill-posed problem that aims to restore the original image from one of its corrupted versions. Recently, this field has been immensely influenced by the emergence of deep-learning…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Qianwei Zhou , Chen Zhou , Haigen Hu , Yuhang Chen , Shengyong Chen , Xiaoxin Li

Image deblurring is a classic problem in low-level computer vision with the aim to recover a sharp image from a blurred input image. Advances in deep learning have led to significant progress in solving this problem, and a large number of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Kaihao Zhang , Wenqi Ren , Wenhan Luo , Wei-Sheng Lai , Bjorn Stenger , Ming-Hsuan Yang , Hongdong Li

Hallucinations in vision-language models (VLMs) hinder reliability and real-world applicability, usually stemming from distribution shifts between pretraining data and test samples. Existing solutions, such as retraining or fine-tuning on…

Multimedia · Computer Science 2025-06-10 Fei Zhao , Chengcui Zhang , Runlin Zhang , Tianyang Wang , Xi Li

An approach to incorporate deep learning within an iterative image reconstruction framework to reconstruct images from severely incomplete measurement data is presented. Specifically, we utilize a convolutional neural network (CNN) as a…

Computer Vision and Pattern Recognition · Computer Science 2017-09-05 Brendan Kelly , Thomas P. Matthews , Mark A. Anastasio

The accuracy of medical imaging-based diagnostics is directly impacted by the quality of the collected images. A passive approach to improve image quality is one that lags behind improvements in imaging hardware, awaiting better sensor…

Image and Video Processing · Electrical Eng. & Systems 2019-09-23 Saeed Izadi , Zahra Mirikharaji , Mengliu Zhao , Ghassan Hamarneh

Hallucinations in vision-language models pose a significant challenge to their reliability, particularly in the generation of long captions. Current methods fall short of accurately identifying and mitigating these hallucinations. To…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Minchan Kim , Minyeong Kim , Junik Bae , Suhwan Choi , Sungkyung Kim , Buru Chang

Signal reconstruction is a challenging aspect of computational imaging as it often involves solving ill-posed inverse problems. Recently, deep feed-forward neural networks have led to state-of-the-art results in solving various inverse…

Computer Vision and Pattern Recognition · Computer Science 2018-04-25 Akshat Dave , Anil Kumar Vadathya , Ramana Subramanyam , Rahul Baburajan , Kaushik Mitra