English
Related papers

Related papers: Semantic Segmentation Prior for Diffusion-Based Re…

200 papers

Text-driven diffusion models have become increasingly popular for various image editing tasks, including inpainting, stylization, and object replacement. However, it still remains an open research problem to adopt this language-vision…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Chenyang Qi , Zhengzhong Tu , Keren Ye , Mauricio Delbracio , Peyman Milanfar , Qifeng Chen , Hossein Talebi

Reference-based super-resolution (RefSR) has the potential to build bridges across spatial and temporal resolutions of remote sensing images. However, existing RefSR methods are limited by the faithfulness of content reconstruction and the…

Image and Video Processing · Electrical Eng. & Systems 2024-03-27 Runmin Dong , Shuai Yuan , Bin Luo , Mengxuan Chen , Jinxiao Zhang , Lixian Zhang , Weijia Li , Juepeng Zheng , Haohuan Fu

Remote sensing images captured by different platforms exhibit significant disparities in spatial resolution. Large scale factor super-resolution (SR) algorithms are vital for maximizing the utilization of low-resolution (LR) satellite data…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Ce Wang , Wanjie Sun

The goal of interactive image segmentation is to delineate specific regions within an image via visual or language prompts. Low-latency and high-quality interactive segmentation with diverse prompts remain challenging for existing…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Qin Liu , Jaemin Cho , Mohit Bansal , Marc Niethammer

Referring image segmentation (RIS) aims to segment objects in an image conditioning on free-from text descriptions. Despite the overwhelming progress, it still remains challenging for current approaches to perform well on cases with various…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Yajie Liu , Pu Ge , Haoxiang Ma , Shichao Fan , Qingjie Liu , Di Huang , Yunhong Wang

We present ControlSR, a new method that can tame Diffusion Models for consistent real-world image super-resolution (Real-ISR). Previous Real-ISR models mostly focus on how to activate more generative priors of text-to-image diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Yuhao Wan , Peng-Tao Jiang , Qibin Hou , Hao Zhang , Jinwei Chen , Ming-Ming Cheng , Bo Li

Marine Saliency Segmentation (MSS) plays a pivotal role in various vision-based marine exploration tasks. However, existing marine segmentation techniques face the dilemma of object mislocalization and imprecise boundaries due to the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Laibin Chang , Yunke Wang , JiaXing Huang , Longxiang Deng , Bo Du , Chang Xu

Image restoration is a classic low-level problem aimed at recovering high-quality images from low-quality images with various degradations such as blur, noise, rain, haze, etc. However, due to the inherent complexity and non-uniqueness of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yuhong Zhang , Hengsheng Zhang , Xinning Chai , Zhengxue Cheng , Rong Xie , Li Song , Wenjun Zhang

Referring Image Segmentation (RIS) is a fundamental vision-language task that outputs object masks based on text descriptions. Many works have achieved considerable progress for RIS, including different fusion method designs. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Jianzong Wu , Xiangtai Li , Xia Li , Henghui Ding , Yunhai Tong , Dacheng Tao

Text-to-image diffusion models excel at translating language prompts into photorealistic images by implicitly grounding textual concepts through their cross-modal attention mechanisms. Recent multi-modal diffusion transformers extend this…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Chaehyun Kim , Heeseong Shin , Eunbeen Hong , Heeji Yoon , Anurag Arnab , Paul Hongsuck Seo , Sunghwan Hong , Seungryong Kim

Despite recent advances, single-image super-resolution (SR) remains challenging, especially in real-world scenarios with complex degradations. Diffusion-based SR methods, particularly those built on Stable Diffusion, leverage strong…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Fabio D'Oronzio , Federico Putamorsi , Leonardo Zini , Marcella Cornia , Lorenzo Baraldi

Depth information provides valuable insights into the 3D structure especially the outline of objects, which can be utilized to improve the semantic segmentation tasks. However, a naive fusion of depth information can disrupt feature and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Wei Sun , Yuan Li , Qixiang Ye , Jianbin Jiao , Yanzhao Zhou

Semantic segmentation is a challenging task since it requires excessively more low-level spatial information of the image compared to other computer vision problems. The accuracy of pixel-level classification can be affected by many…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Zülfiye Kütük , Görkem Algan

Semantic segmentation aims to robustly predict coherent class labels for entire regions of an image. It is a scene understanding task that powers real-world applications (e.g., autonomous navigation). One important application, the use of…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Yuxiang Zhang , Sachin Mehta , Anat Caspi

Image semantic segmentation aims at the pixel-level classification of images, which has requirements for both accuracy and speed in practical application. Existing semantic segmentation methods mainly rely on the high-resolution input to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-07 Tianjiao Jiang , Yi Jin , Tengfei Liang , Xu Wang , Yidong Li

Delineating farm boundaries through segmentation of satellite images is a fundamental step in many agricultural applications. The task is particularly challenging for smallholder farms, where accurate delineation requires the use of high…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Aditi Agarwal , Anjali Jain , Nikita Saxena , Ishan Deshpande , Michal Kazmierski , Abigail Annkah , Nadav Sherman , Karthikeyan Shanmugam , Alok Talekar , Vaibhav Rajan

Visual-textual correlations in the attention maps derived from text-to-image diffusion models are proven beneficial to dense visual prediction tasks, e.g., semantic segmentation. However, a significant challenge arises due to the input…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Jiayi Lin , Jiabo Huang , Jian Hu , Shaogang Gong

We introduce DiffSteISR, a pioneering framework for reconstructing real-world stereo images. DiffSteISR utilizes the powerful prior knowledge embedded in pre-trained text-to-image model to efficiently recover the lost texture details in…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Yuanbo Zhou , Xinlin Zhang , Wei Deng , Tao Wang , Tao Tan , Qinquan Gao , Tong Tong

High-resolution (HR) remote sensing imagery plays a vital role in a wide range of applications, including urban planning and environmental monitoring. However, due to limitations in sensors and data transmission links, the images acquired…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Bowen Chen , Keyan Chen , Mohan Yang , Zhengxia Zou , Zhenwei Shi

Reasoning segmentation enables open-set object segmentation via implicit text queries, therefore serving as a foundation for embodied agents that should operate autonomously in real-world environments. However, existing methods for…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yiqing Shen , Mathias Unberath