English
Related papers

Related papers: Language-based Image Colorization: A Benchmark and…

200 papers

Text-to-image generation has recently seen remarkable success, granting users with the ability to create high-quality images through the use of text. However, contemporary methods face challenges in capturing the precise semantics conveyed…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Shay Shomer-Chai , Wenxuan Peng , Bharath Hariharan , Hadar Averbuch-Elor

Text-to-image (T2I) diffusion models, with their impressive generative capabilities, have been adopted for image editing tasks, demonstrating remarkable efficacy. However, due to attention leakage and collision between the cross-attention…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Xingxi Yin , Zhi Li , Jingfeng Zhang , Chenglin Li , Yin Zhang

Language-driven image editing can significantly save the laborious image editing work and be friendly to the photography novice. However, most similar work can only deal with a specific image domain or can only do global retouching. To…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Jing Shi , Ning Xu , Trung Bui , Franck Dernoncourt , Zheng Wen , Chenliang Xu

Image colorization is a challenging problem due to multi-modal uncertainty and high ill-posedness. Directly training a deep neural network usually leads to incorrect semantic colors and low color richness. While transformer-based methods…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Xiaoyang Kang , Tao Yang , Wenqi Ouyang , Peiran Ren , Lingzhi Li , Xuansong Xie

Video colorization is a challenging task that involves inferring plausible and temporally consistent colors for grayscale frames. In this paper, we present ColorDiffuser, an adaptation of a pre-trained text-to-image latent diffusion model…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Hanyuan Liu , Minshan Xie , Jinbo Xing , Chengze Li , Tien-Tsin Wong

In this paper, we present a color transfer algorithm to colorize a broad range of gray images without any user intervention. The algorithm uses a machine learning-based approach to automatically colorize grayscale images. The algorithm uses…

Graphics · Computer Science 2017-04-18 Raj Kumar Gupta , Alex Yong-Sang Chia , Deepu Rajan , Huang Zhiyong

We propose a framework for automatic colorization that allows for iterative editing and modifications. The core of our framework lies in an imagination module: by understanding the content within a grayscale image, we utilize a pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Xiaoyan Cong , Yue Wu , Qifeng Chen , Chenyang Lei

We present the Colorization Transformer, a novel approach for diverse high fidelity image colorization based on self-attention. Given a grayscale image, the colorization proceeds in three steps. We first use a conditional autoregressive…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Manoj Kumar , Dirk Weissenborn , Nal Kalchbrenner

Image colorization adds color to grayscale images. It not only increases the visual appeal of grayscale images, but also enriches the information contained in scientific images that lack color information. Most existing methods of…

Computer Vision and Pattern Recognition · Computer Science 2012-10-17 Yingzhen Yang , Xinqi Chu , Tian-Tsong Ng , Alex Yong-Sang Chia , Shuicheng Yan , Thomas S. Huang

Image composition in image editing involves merging a foreground image with a background image to create a composite. Inconsistent lighting conditions between the foreground and background often result in unrealistic composites. Image…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Jiajie Li , Jian Wang , Chen Wang , Jinjun Xiong

Image colorization has been attracting the research interests of the community for decades. However, existing methods still struggle to provide satisfactory colorized results given grayscale images due to a lack of human-like global…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Hanyuan Liu , Jinbo Xing , Minshan Xie , Chengze Li , Tien-Tsin Wong

Recently, the application of deep learning in image colorization has received widespread attention. The maturation of diffusion models has further advanced the development of image colorization models. However, current mainstream image…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Yanru An , Ling Gui , Chunlei Cai , Tianxiao Ye , JIangchao Yao , Guangtao Zhai , Qiang Hu , Xiaoyun Zhang

Deep networks have shown impressive performance in the image restoration tasks, such as image colorization. However, we find that previous approaches rely on the digital representation from single color model with a specific mapping…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Xiangcheng Du , Zhao Zhou , Yanlong Wang , Zhuoyao Wang , Yingbin Zheng , Cheng Jin

This paper reviews published research in the field of computer-aided colorization technology. We argue that the colorization task originates from computer graphics, prospers by introducing computer vision, and tends to the fusion of vision…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Yu Cao , Xin Duan , Xiangqiao Meng , P. Y. Mok , Ping Li , Tong-Yee Lee

We present a novel approach to automatic image colorization by imitating the imagination process of human experts. Our imagination module is designed to generate color images that are context-correlated with black-and-white photos. Given a…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Chenyang Lei , Yue Wu , Qifeng Chen

Automatic image colorization is inherently an ill-posed problem with uncertainty, which requires an accurate semantic understanding of scenes to estimate reasonable colors for grayscale images. Although recent interaction-based methods have…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Pengcheng Zhao , Yanxiang Chen , Yang Zhao , Zhao Zhang

Colorization is the method of converting an image in grayscale to a fully color image. There are multiple methods to do the same. Old school methods used machine learning algorithms and optimization techniques to suggest possible colors to…

Computer Vision and Pattern Recognition · Computer Science 2019-06-19 Shreyank Narayana Gowda

Diffusion models have shown great promise in synthesizing visually appealing images. However, it remains challenging to condition the synthesis at a fine-grained level, for instance, synthesizing image pixels following some generic color…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Ka Chun Shum , Binh-Son Hua , Duc Thanh Nguyen , Sai-Kit Yeung

This paper presents a novel approach to human image colorization by fine-tuning the InstructPix2Pix model, which integrates a language model (GPT-3) with a text-to-image model (Stable Diffusion). Despite the original InstructPix2Pix model's…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Zifeng An , Zijing Xu , Eric Fan , Qi Cao

In recent years, text-driven image editing has made significant progress. However, due to the inherent ambiguity and discreteness of natural language, color editing still faces challenges such as insufficient precision and difficulty in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Yuqi Yang , Dongliang Chang , Yuanchen Fang , Yi-Zhe SonG , Zhanyu Ma , Jun Guo