English
Related papers

Related papers: Prompt-In-Prompt Learning for Universal Image Rest…

200 papers

Deep image prior (DIP) has been successfully applied to positron emission tomography (PET) image restoration, enabling represent implicit prior using only convolutional neural network architecture without training dataset, whereas the…

Medical Physics · Physics 2024-04-23 Yuya Onishi , Fumio Hashimoto , Kibo Ote , Keisuke Matsubara , Masanobu Ibaraki

Image pyramids are commonly used in modern computer vision tasks to obtain multi-scale features for precise understanding of images. However, image pyramids process multiple resolutions of images using the same large-scale model, which…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Xizhou Zhu , Xue Yang , Zhaokai Wang , Hao Li , Wenhan Dou , Junqi Ge , Lewei Lu , Yu Qiao , Jifeng Dai

Text-to-image generation has become increasingly popular, but achieving the desired images often requires extensive prompt engineering. In this paper, we explore how to decode textual prompts from reference images, a process we refer to as…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Zhiyao Ren , Yibing Zhan , Baosheng Yu , Dacheng Tao

Image fusion, a fundamental low-level vision task, aims to integrate multiple image sequences into a single output while preserving as much information as possible from the input. However, existing methods face several significant…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Zihan Cao , Yu Zhong , Ziqi Wang , Liang-Jian Deng

Zero-shot image restoration (IR) methods based on pretrained diffusion models have recently achieved significant success. These methods typically require at least a parametric form of the degradation model. However, in real-world scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Hamadi Chihaoui , Paolo Favaro

Compressed Image Super-resolution (CSR) aims to simultaneously super-resolve the compressed images and tackle the challenging hybrid distortions caused by compression. However, existing works on CSR usually focuses on a single compression…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Xin Li , Bingchen Li , Yeying Jin , Cuiling Lan , Hanxin Zhu , Yulin Ren , Zhibo Chen

A significant number of researchers have applied deep learning methods to image fusion. However, most works require a large amount of training data or depend on pre-trained models or frameworks to capture features from source images. This…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Xudong Ma , Paul Hill , Nantheera Anantrasirichai , Alin Achim

Prompt-based all-in-one image restoration (IR) frameworks have achieved remarkable performance by incorporating degradation-specific information into prompt modules. Nevertheless, handling the complex and diverse degradations encountered in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Yuang Ai , Huaibo Huang , Ran He

Recovering natural language prompts for image generation models, solely based on the generated images is a difficult discrete optimization problem. In this work, we present the first head-to-head comparison of recent discrete optimization…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Joshua Nathaniel Williams , Avi Schwarzschild , Yutong He , J. Zico Kolter

Despite recent progress in text-to-image (T2I) generation, existing models often struggle to faithfully capture user intentions from short and under-specified prompts. While prior work has attempted to enhance prompts using large language…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Mingrui Wu , Lu Wang , Pu Zhao , Fangkai Yang , Jianjin Zhang , Jianfeng Liu , Yuefeng Zhan , Weihao Han , Hao Sun , Jiayi Ji , Xiaoshuai Sun , Qingwei Lin , Weiwei Deng , Dongmei Zhang , Feng Sun , Qi Zhang , Rongrong Ji

Pre-trained vision-language models like CLIP have remarkably adapted to various downstream tasks. Nonetheless, their performance heavily depends on the specificity of the input text prompts, which requires skillful prompt template…

Machine Learning · Computer Science 2024-10-22 Yingjun Du , Wenfang Sun , Cees G. M. Snoek

Ill-posed inverse problems appear in many image processing applications, such as deblurring and super-resolution. In recent years, solutions that are based on deep Convolutional Neural Networks (CNNs) have shown great promise. Yet, most of…

Computer Vision and Pattern Recognition · Computer Science 2021-02-05 Shady Abu-Hussein , Tom Tirer , Se Young Chun , Yonina C. Eldar , Raja Giryes

Generative text-to-image models have gained great popularity among the public for their powerful capability to generate high-quality images based on natural language prompts. However, developing effective prompts for desired images can be…

Artificial Intelligence · Computer Science 2023-11-02 Yingchaojie Feng , Xingbo Wang , Kam Kwai Wong , Sijia Wang , Yuhong Lu , Minfeng Zhu , Baicheng Wang , Wei Chen

Universal image restoration aims to recover clean images from arbitrary real-world degradations using a single inference model. Despite significant progress, existing all-in-one restoration networks do not scale to multiple degradations. As…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Debabrata Mandal , Soumitri Chattopadhyay , Yujie Wang , Marc Niethammer , Praneeth Chakravarthula

Learning a good image prior is a long-term goal for image restoration and manipulation. While existing methods like deep image prior (DIP) capture low-level image statistics, there are still gaps toward an image prior that captures rich…

Image and Video Processing · Electrical Eng. & Systems 2020-07-21 Xingang Pan , Xiaohang Zhan , Bo Dai , Dahua Lin , Chen Change Loy , Ping Luo

Image pyramids are widely adopted in top-performing methods to obtain multi-scale features for precise visual perception and understanding. However, current image pyramids use the same large-scale model to process multiple resolutions of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Zhaokai Wang , Xizhou Zhu , Xue Yang , Gen Luo , Hao Li , Changyao Tian , Wenhan Dou , Junqi Ge , Lewei Lu , Yu Qiao , Jifeng Dai

Prompt tuning, like CoOp, has recently shown promising vision recognizing and transfer learning ability on various downstream tasks with the emergence of large pre-trained vision-language models like CLIP. However, we identify that existing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yongzhu Miao , Shasha Li , Jintao Tang , Ting Wang

Unified hyperspectral image (HSI) restoration aims to recover various degraded HSIs using a single model, offering great practical value. However, existing methods often depend on explicit degradation priors (e.g., degradation labels) as…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Binfeng Wang , Di Wang , Haonan Guo , Ying Fu , Jing Zhang

Recently, prompt learning has demonstrated remarkable success in adapting pre-trained Vision-Language Models (VLMs) to various downstream tasks such as image classification. However, its application to the downstream Image-Text Retrieval…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Yifan Wang , Tao Wang , Chenwei Tang , Caiyang Yu , Zhengqing Zang , Mengmi Zhang , Shudong Huang , Jiancheng Lv

Image deconvolution is the process of recovering convolutional degraded images, which is always a hard inverse problem because of its mathematically ill-posed property. On the success of the recently proposed deep image prior (DIP), we…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Zhunxuan Wang , Zipei Wang , Qiqi Li , Hakan Bilen