English
Related papers

Related papers: Inverse Problems Leveraging Pre-trained Contrastiv…

200 papers

Image Restoration (IR) methods based on a pre-trained diffusion model have demonstrated state-of-the-art performance. However, they have two fundamental limitations: 1) they often assume that the degradation operator is completely known and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Hamadi Chihaoui , Abdelhak Lemkhenter , Paolo Favaro

Rectifying the orientation of images represents a daily task for every photographer. This task may be complicated even for the human eye, especially when the horizon or other horizontal and vertical lines in the image are missing. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Ionut Mironica , Andrei Zugravu

Previous face inverse rendering methods often require synthetic data with ground truth and/or professional equipment like a lighting stage. However, a model trained on synthetic data or using pre-defined lighting priors is typically unable…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Meng Wang , Xiaojie Guo , Wenjing Dai , Jiawan Zhang

Contrastive learning applied to self-supervised representation learning has seen a resurgence in recent years, leading to state of the art performance in the unsupervised training of deep image models. Modern batch contrastive approaches…

Machine Learning · Computer Science 2021-03-12 Prannay Khosla , Piotr Teterwak , Chen Wang , Aaron Sarna , Yonglong Tian , Phillip Isola , Aaron Maschinot , Ce Liu , Dilip Krishnan

Deep convolutional networks have become a popular tool for image generation and restoration. Generally, their excellent performance is imputed to their ability to learn realistic image priors from a large number of example images. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Dmitry Ulyanov , Andrea Vedaldi , Victor Lempitsky

Image reconstruction under multiple light scattering is crucial in a number of applications such as diffraction tomography. The reconstruction problem is often formulated as a nonconvex optimization, where a nonlinear measurement model is…

Computer Vision and Pattern Recognition · Computer Science 2018-07-04 Yu Sun , Zhihao Xia , Ulugbek S. Kamilov

Solving inverse problems requires the knowledge of the forward operator, but accurate models can be computationally expensive and hence cheaper variants that do not compromise the reconstruction quality are desired. This chapter reviews…

Numerical Analysis · Mathematics 2024-03-19 Simon Arridge , Andreas Hauptmann , Yury Korolev

Diffusion models have established new state of the art in a multitude of computer vision tasks, including image restoration. Diffusion-based inverse problem solvers generate reconstructions of exceptional visual quality from heavily…

Image and Video Processing · Electrical Eng. & Systems 2024-08-21 Zalan Fabian , Berk Tinaz , Mahdi Soltanolkotabi

In this article we dwell into the class of so called ill posed Linear Inverse Problems (LIP) in machine learning, which has become almost a classic in recent times. The fundamental task in an LIP is to recover the entire signal / data from…

Machine Learning · Computer Science 2020-01-10 Mohammed Rayyan Sheriff , Debasish Chatterjee

This paper presents a new variational inference framework for image restoration and a convolutional neural network (CNN) structure that can solve the restoration problems described by the proposed framework. Earlier CNN-based image…

Image and Video Processing · Electrical Eng. & Systems 2022-07-20 Jae Woong Soh , Nam Ik Cho

Today, most methods for image understanding tasks rely on feed-forward neural networks. While this approach has allowed for empirical accuracy, efficiency, and task adaptation via fine-tuning, it also comes with fundamental disadvantages.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Julian Ost , Tanushree Banerjee , Mario Bijelic , Felix Heide

In this paper, we consider the highly ill-posed problem of jointly recovering two real-valued signals from the phaseless measurements of their circular convolution. The problem arises in various imaging modalities such as Fourier…

Image and Video Processing · Electrical Eng. & Systems 2020-03-02 Fahad Shamshad , Ali Ahmed

Supervised learning with a convolutional neural network is recognized as a powerful means of image restoration. However, most such methods have been designed for application to grayscale and/or color images; therefore, they have limited…

Image and Video Processing · Electrical Eng. & Systems 2019-07-02 Ryuji Imamura , Tatsuki Itasaka , Masahiro Okuda

The success of deep learning in computer vision is rooted in the ability of deep networks to scale up model complexity as demanded by challenging visual tasks. As complexity is increased, so is the need for large amounts of labeled data to…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 Gustav Larsson

Detecting tampered text in document images is a challenging task due to data scarcity. To address this, previous work has attempted to generate tampered documents using rule-based methods. However, the resulting documents often suffer from…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Mohamed Dhouib , Davide Buscaldi , Sonia Vanier , Aymen Shabou

We propose a new approach to linear ill-posed inverse problems. Our algorithm alternates between enforcing two constraints: the measurements and the statistical correlation structure in some transformed space. We use a non-linear multiscale…

Computational Engineering, Finance, and Science · Computer Science 2018-12-04 Ivan Dokmanić , Joan Bruna , Stéphane Mallat , Maarten de Hoop

Masked image modeling (MIM) has gained significant traction for its remarkable prowess in representation learning. As an alternative to the traditional approach, the reconstruction from corrupted images has recently emerged as a promising…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Wenzhao Xiang , Chang Liu , Hang Su , Hongyang Yu

Deep learning has achieved enormous success in various industrial applications. Companies do not want their valuable data to be stolen by malicious employees to train pirated models. Nor do they wish the data analyzed by the competitors…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Kejiang Chen , Xianhan Zeng , Qichao Ying , Sheng Li , Zhenxing Qian , Xinpeng Zhang

Ill-posed inverse problems appear in many image processing applications, such as deblurring and super-resolution. In recent years, solutions that are based on deep Convolutional Neural Networks (CNNs) have shown great promise. Yet, most of…

Computer Vision and Pattern Recognition · Computer Science 2021-02-05 Shady Abu-Hussein , Tom Tirer , Se Young Chun , Yonina C. Eldar , Raja Giryes

Image recognition is a classic and common task in the computer vision field, which has been widely applied in the past decade. Most existing methods in literature aim to learn discriminative features from labeled images for classification,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Jiayin Sun , Hong Wang , Qiulei Dong