English
Related papers

Related papers: The Power of Context: How Multimodality Improves I…

200 papers

Diffusion-based super-resolution (SR) models have recently garnered significant attention due to their potent restoration capabilities. But conventional diffusion models perform noise sampling from a single distribution, constraining their…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Chengcheng Wang , Zhiwei Hao , Yehui Tang , Jianyuan Guo , Yujie Yang , Kai Han , Yunhe Wang

Existing super-resolution (SR) models primarily focus on restoring local texture details, often neglecting the global semantic information within the scene. This oversight can lead to the omission of crucial semantic details or the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Haoze Sun , Wenbo Li , Jianzhuang Liu , Haoyu Chen , Renjing Pei , Xueyi Zou , Youliang Yan , Yujiu Yang

Single image super resolution is a very important computer vision task, with a wide range of applications. In recent years, the depth of the super-resolution model has been constantly increasing, but with a small increase in performance, it…

Computer Vision and Pattern Recognition · Computer Science 2018-02-01 Xi Cheng , Xiang Li , Ying Tai , Jian Yang

Recent data-driven image colorization methods have enabled automatic or reference-based colorization, while still suffering from unsatisfactory and inaccurate object-level color control. To address these issues, we propose a new method…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Jianxin Lin , Peng Xiao , Yijun Wang , Rongju Zhang , Xiangxiang Zeng

The generative priors of pre-trained latent diffusion models (DMs) have demonstrated great potential to enhance the visual quality of image super-resolution (SR) results. However, the noise sampling process in DMs introduces randomness in…

Image and Video Processing · Electrical Eng. & Systems 2024-09-26 Lingchen Sun , Rongyuan Wu , Jie Liang , Zhengqiang Zhang , Hongwei Yong , Lei Zhang

Non-visual imaging sensors are widely used in the industry for different purposes. Those sensors are more expensive than visual (RGB) sensors, and usually produce images with lower resolution. To this end, Cross-Modality Super-Resolution…

Computer Vision and Pattern Recognition · Computer Science 2021-01-25 Guy Shacht , Sharon Fogel , Dov Danon , Daniel Cohen-Or , Ilya Leizerson

High-resolution imagery is often hindered by limitations in sensor technology, atmospheric conditions, and costs. Such challenges occur in satellite remote sensing, but also with handheld cameras, such as our smartphones. Hence,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Sander Riisøen Jyhne , Christian Igel , Morten Goodwin , Per-Arne Andersen , Serge Belongie , Nico Lang

Despite recent advances, single-image super-resolution (SR) remains challenging, especially in real-world scenarios with complex degradations. Diffusion-based SR methods, particularly those built on Stable Diffusion, leverage strong…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Fabio D'Oronzio , Federico Putamorsi , Leonardo Zini , Marcella Cornia , Lorenzo Baraldi

Single image super-resolution (SISR) is a notoriously challenging ill-posed problem, which aims to obtain a high-resolution (HR) output from one of its low-resolution (LR) versions. To solve the SISR problem, recently powerful deep learning…

Computer Vision and Pattern Recognition · Computer Science 2019-07-15 Wenming Yang , Xuechen Zhang , Yapeng Tian , Wei Wang , Jing-Hao Xue

With the advent of Generative AI, Single Image Super-Resolution (SISR) quality has seen substantial improvement, as the strong priors learned by Text-2-Image Diffusion (T2IDiff) Foundation Models (FM) can bridge the gap between…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Devendra K. Jangid , Ripon K. Saha , Dilshan Godaliyadda , Jing Li , Seok-Jun Lee , Hamid R. Sheikh

Diffusion models are highly regarded for their controllability and the diversity of images they generate. However, class-conditional generation methods based on diffusion models often focus on more common categories. In large-scale…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Kun Wang , Donglin Di , Tonghua Su , Lei Fan

Existing fusion methods are tailored for high-quality images but struggle with degraded images captured under harsh circumstances, thus limiting the practical potential of image fusion. This work presents a \textbf{D}egradation and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Linfeng Tang , Chunyu Li , Guoqing Wang , Yixuan Yuan , Jiayi Ma

Self-supervised cross-modal super-resolution (SR) can overcome the difficulty of acquiring paired training data, but is challenging because only low-resolution (LR) source and high-resolution (HR) guide images from different modalities are…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Xiaoyu Dong , Naoto Yokoya , Longguang Wang , Tatsumi Uezato

Recently, large-scale diffusion models, e.g., Stable diffusion and DallE2, have shown remarkable results on image synthesis. On the other hand, large-scale cross-modal pre-trained models (e.g., CLIP, ALIGN, and FILIP) are competent for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Runhui Huang , Jianhua Han , Guansong Lu , Xiaodan Liang , Yihan Zeng , Wei Zhang , Hang Xu

Large-scale pre-trained diffusion models have been extensively adopted for real-world image Super-Resolution because of their powerful generative priors through textual guidance. However, when super-resolving high-resolution images with…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Qingji Dong , Hang Dong , Mingqin Chen , Rui Zhang , Yitong Wang

Image synthesis approaches, e.g., generative adversarial networks, have been popular as a form of data augmentation in medical image analysis tasks. It is primarily beneficial to overcome the shortage of publicly accessible data and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Shiyi Du , Xiaosong Wang , Yongyi Lu , Yuyin Zhou , Shaoting Zhang , Alan Yuille , Kang Li , Zongwei Zhou

Multi-image super-resolution (MISR) can achieve higher image quality than single-image super-resolution (SISR) by aggregating sub-pixel information from multiple spatially shifted frames. Among MISR tasks, burst super-resolution (BurstSR)…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Tengda Huang , Yu Zhang , Tianren Li , Yufu Qu , Fulin Liu , Zhenzhong Wei

The colorization of grayscale images is a complex and subjective task with significant challenges. Despite recent progress in employing large-scale datasets with deep neural networks, difficulties with controllability and visual quality…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Nir Zabari , Aharon Azulay , Alexey Gorkor , Tavi Halperin , Ohad Fried

Assuming a known degradation model, the performance of a learned image super-resolution (SR) model depends on how well the variety of image characteristics within the training set matches those in the test set. As a result, the performance…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Cansu Korkmaz , A. Murat Tekalp , Zafer Dogan

We propose Context Diffusion, a diffusion-based framework that enables image generation models to learn from visual examples presented in context. Recent work tackles such in-context learning for image generation, where a query image is…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Ivona Najdenkoska , Animesh Sinha , Abhimanyu Dubey , Dhruv Mahajan , Vignesh Ramanathan , Filip Radenovic