English
Related papers

Related papers: The Power of Context: How Multimodality Improves I…

200 papers

Diffusion-based image super-resolution (SR) methods have achieved remarkable success by leveraging large pre-trained text-to-image diffusion models as priors. However, these methods still face two challenges: the requirement for dozens of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Aiping Zhang , Zongsheng Yue , Renjing Pei , Wenqi Ren , Xiaochun Cao

Guided image super-resolution (GISR) aims to obtain a high-resolution (HR) target image by enhancing the spatial resolution of a low-resolution (LR) target image under the guidance of a HR image. However, previous model-based methods mainly…

Image and Video Processing · Electrical Eng. & Systems 2022-03-11 Man Zhou , Keyu Yan , Jinshan Pan , Wenqi Ren , Qi Xie , Xiangyong Cao

Reference-based super-resolution (RefSR) has the potential to build bridges across spatial and temporal resolutions of remote sensing images. However, existing RefSR methods are limited by the faithfulness of content reconstruction and the…

Image and Video Processing · Electrical Eng. & Systems 2024-03-27 Runmin Dong , Shuai Yuan , Bin Luo , Mengxuan Chen , Jinxiao Zhang , Lixian Zhang , Weijia Li , Juepeng Zheng , Haohuan Fu

Advancements in text-to-image generative AI with large multimodal models are spreading into the field of image compression, creating high-quality representation of images at extremely low bit rates. This work introduces novel components to…

Image and Video Processing · Electrical Eng. & Systems 2025-06-02 Cheng-Lin Wu , Hyomin Choi , Ivan V. Bajić

Single image super-resolution (SISR) is an image processing task which obtains high-resolution (HR) image from a low-resolution (LR) image. Recently, due to the capability in feature extraction, a series of deep learning methods have…

Image and Video Processing · Electrical Eng. & Systems 2020-03-19 Bo Fu , Liyan Wang , Yuechu Wu , Yufeng Wu , Shilin Fu , Yonggong Ren

Recent advancements in diffusion models have showcased their impressive capacity to generate visually striking images. Nevertheless, ensuring a close match between the generated image and the given prompt remains a persistent challenge. In…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Yupeng Zhou , Daquan Zhou , Zuo-Liang Zhu , Yaxing Wang , Qibin Hou , Jiashi Feng

In the recent years impressive advances were made for single image super-resolution. Deep learning is behind a big part of this success. Deep(er) architecture design and external priors modeling are the key ingredients. The internal…

Computer Vision and Pattern Recognition · Computer Science 2017-04-03 Yudong Liang , Radu Timofte , Jinjun Wang , Yihong Gong , Nanning Zheng

Text-to-image generation has witnessed great progress, especially with the recent advancements in diffusion models. Since texts cannot provide detailed conditions like object appearance, reference images are usually leveraged for the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Zhiqi Huang , Huixin Xiong , Haoyu Wang , Longguang Wang , Zhiheng Li

Single-Image Super-Resolution (SISR) plays a pivotal role in enhancing the accuracy and reliability of measurement systems, which are integral to various vision-based instrumentation and measurement applications. These systems often require…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Wanshu Fan , Yue Wang , Cong Wang , Yunzhe Zhang , Wei Wang , Dongsheng Zhou

Image-based single-modality compression learning approaches have demonstrated exceptionally powerful encoding and decoding capabilities in the past few years , but suffer from blur and severe semantics loss at extremely low bitrates. To…

Image and Video Processing · Electrical Eng. & Systems 2023-04-27 Xuhao Jiang , Weimin Tan , Tian Tan , Bo Yan , Liquan Shen

Despite substantial progress, all-in-one image restoration (IR) grapples with persistent challenges in handling intricate real-world degradations. This paper introduces MPerceiver: a novel multimodal prompt learning approach that harnesses…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Yuang Ai , Huaibo Huang , Xiaoqiang Zhou , Jiexiang Wang , Ran He

We study generative super-resolution (SR) in real-world scenarios where content and degradations vary across domains, genres, and segments. For example, images and videos may alternate between text overlays, fast motion, smooth cartoons,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Jiaqi Guo , Mingzhen Li , Haohong Wang , Aggelos K. Katsaggelos

Single image super-resolution (SISR) aims to reconstruct high-resolution (HR) images from the given low-resolution (LR) ones, which is an ill-posed problem because one LR image corresponds to multiple HR images. Recently, learning-based…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Haoying Li , Yifan Yang , Meng Chang , Huajun Feng , Zhihai Xu , Qi Li , Yueting Chen

Scene Text Image Super-Resolution (STISR) aims to enhance the resolution and legibility of text within low-resolution (LR) images, consequently elevating recognition accuracy in Scene Text Recognition (STR). Previous methods predominantly…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Yuxuan Zhou , Liangcai Gao , Zhi Tang , Baole Wei

Structures matter in single image super resolution (SISR). Recent studies benefiting from generative adversarial network (GAN) have promoted the development of SISR by recovering photo-realistic images. However, there are always undesired…

Image and Video Processing · Electrical Eng. & Systems 2020-03-31 Cheng Ma , Yongming Rao , Yean Cheng , Ce Chen , Jiwen Lu , Jie Zhou

The objective of image super-resolution is to generate clean and high-resolution images from degraded versions. Recent advancements in diffusion modeling have led to the emergence of various image super-resolution techniques that leverage…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Haolan Chen , Jinhua Hao , Kai Zhao , Kun Yuan , Ming Sun , Chao Zhou , Wei Hu

Diffusion models have demonstrated their capability to synthesize high-quality and diverse images from textual prompts. However, simultaneous control over both global contexts (e.g., object layouts and interactions) and local details (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Moyuru Yamada

Pre-trained diffusion models utilized for image generation encapsulate a substantial reservoir of a priori knowledge pertaining to intricate textures. Harnessing the potential of leveraging this a priori knowledge in the context of image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Junxiong Lin , Yan Wang , Zeng Tao , Boyang Wang , Qing Zhao , Haorang Wang , Xuan Tong , Xinji Mai , Yuxuan Lin , Wei Song , Jiawen Yu , Shaoqi Yan , Wenqiang Zhang

Speech super-resolution (SR) is the task that restores high-resolution speech from low-resolution input. Existing models employ simulated data and constrained experimental settings, which limit generalization to real-world SR. Predictive…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-26 Heming Wang , Eric W. Healy , DeLiang Wang

Multi-modality image fusion aims to synthesize a single, comprehensive image from multiple source inputs. Traditional approaches, such as CNNs and GANs, offer efficiency but struggle to handle low-quality or complex inputs. Recent advances…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Ran Zhang , Xuanhua He , Ke Cao , Liu Liu , Li Zhang , Man Zhou , Jie Zhang