English
Related papers

Related papers: Instance-aware Image Colorization with Controllabl…

200 papers

Language-based colorization produces plausible and visually pleasing colors under the guidance of user-friendly natural language descriptions. Previous methods implicitly assume that users provide comprehensive color descriptions for most…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Zheng Chang , Shuchen Weng , Peixuan Zhang , Yu Li , Si Li , Boxin Shi

Disentangled representation learning strives to extract the intrinsic factors within observed data. Factorizing these representations in an unsupervised manner is notably challenging and usually requires tailored loss functions or specific…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Tao Yang , Cuiling Lan , Yan Lu , Nanning zheng

Image inpainting aims to fill in the missing pixels with visually coherent and semantically plausible content. Despite the great progress brought from deep generative models, this task still suffers from i. the difficulties in large-scale…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Siyuan Yang , Lu Zhang , Liqian Ma , Yu Liu , JingJing Fu , You He

Recently, the progress of learning-by-synthesis has proposed a training model for synthetic images, which can effectively reduce the cost of human and material resources. However, due to the different distribution of synthetic images…

Computer Vision and Pattern Recognition · Computer Science 2019-03-21 Tongtong Zhao , Yuxiao Yan , Jinjia Peng , Huibing Wang , Xianping Fu

Diffusion models have demonstrated their ability to generate diverse and high-quality images, sparking considerable interest in their potential for real image editing applications. However, existing diffusion-based approaches for local…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Wenjing Huang , Shikui Tu , Lei Xu

Video Instance Segmentation is a fundamental computer vision task that deals with segmenting and tracking object instances across a video sequence. Most existing methods typically accomplish this task by employing a multi-stage top-down…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Jyoti Kini , Mubarak Shah

Text-to-image diffusion models exhibit remarkable generative capabilities, yet their internal operations remain opaque, particularly when handling prompts that are not fully descriptive. In such scenarios, models must make implicit…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Katarzyna Zaleska , Łukasz Popek , Monika Wysoczańska , Kamil Deja

Text-guided image inpainting aims to inpaint masked image regions based on a textual prompt while preserving the background. Although diffusion-based methods have become dominant, their property of modeling the entire image in latent space…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Longtao Jiang , Jie Huang , Mingfei Han , Lei Chen , Yongqiang Yu , Feng Zhao , Xiaojun Chang , Zhihui Li

Depth completion plays a vital role in 3D perception systems, especially in scenarios where sparse depth data must be densified for tasks such as autonomous driving, robotics, and augmented reality. While many existing approaches rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Abdul Haseeb Nizamani , Dandi Zhou , Xinhai Sun

As an important subtopic of image enhancement, color transfer aims to enhance the color scheme of a source image according to a reference one while preserving the semantic context. To implement color transfer, the palette-based color…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Chenlei Lv , Dan Zhang

We propose Generative Probabilistic Image Colorization, a diffusion-based generative process that trains a sequence of probabilistic models to reverse each step of noise corruption. Given a line-drawing image as input, our method suggests…

Computer Vision and Pattern Recognition · Computer Science 2021-09-30 Chie Furusawa , Shinya Kitaoka , Michael Li , Yuri Odagiri

High-quality annotation of fine-grained visual categories demands great expert knowledge, which is taxing and time consuming. Alternatively, learning fine-grained visual representation from enormous unlabeled images (e.g., species, brands)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Qi Bi , Wei Ji , Jingjun Yi , Haolan Zhan , Gui-Song Xia

Diffusion frameworks have achieved comparable performance with previous state-of-the-art image generation models. Researchers are curious about its variants in discriminative tasks because of its powerful noise-to-image denoising pipeline.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Zhangxuan Gu , Haoxing Chen , Zhuoer Xu , Jun Lan , Changhua Meng , Weiqiang Wang

We present the first text-based image editing approach for object parts based on pre-trained diffusion models. Diffusion-based image editing approaches capitalized on the deep understanding of diffusion models of image semantics to perform…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Aleksandar Cvejic , Abdelrahman Eldesokey , Peter Wonka

Unsupervised visual object tracking is a challenging task that requires following arbitrary targets in videos without training on ground-truth annotations. Despite considerable progress, existing state-of-the-art unsupervised trackers often…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Zhengbo Zhang , Zhigang Tu , Junsong Yuan , De Wen Soh , Bo Du

Given a style-reference image as the additional image condition, text-to-image diffusion models have demonstrated impressive capabilities in generating images that possess the content of text prompts while adopting the visual style of the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Lin Zhu , Xinbing Wang , Chenghu Zhou , Qinying Gu , Nanyang Ye

The new alternative is to use deep learning to inpaint any image by utilizing image classification and computer vision techniques. In general, image inpainting is a task of recreating or reconstructing any broken image which could be a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Narayana Darapaneni , Vaibhav Kherde , Kameswara Rao , Deepali Nikam , Swanand Katdare , Anima Shukla , Anagha Lomate , Anwesh Reddy Paduri

Deep neural networks for automatic image colorization often suffer from the color-bleeding artifact, a problematic color spreading near the boundaries between adjacent objects. Such color-bleeding artifacts debase the reality of generated…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Eungyeup Kim , Sanghyeon Lee , Jeonghoon Park , Somi Choi , Choonghyun Seo , Jaegul Choo

Recent object detection models for infrared (IR) imagery are based upon deep neural networks (DNNs) and require large amounts of labeled training imagery. However, publicly available datasets that can be used for such training are limited…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Evelyn A. Stump , Francesco Luzi , Leslie M. Collins , Jordan M. Malof

The paper presents a scalable approach for learning spatially distributed visual representations over individual tokens and a holistic instance representation simultaneously. We use self-attention blocks to represent spatially distributed…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Zhirong Wu , Zihang Lai , Xiao Sun , Stephen Lin