English
Related papers

Related papers: Controllable-Continuous Color Editing in Diffusion…

200 papers

Designing visually diverse and high-quality designs remains a manual, time-consuming process, limiting scalability and personalization in creative workflows. We present a system for generating editable design variations using a decoder-only…

Machine Learning · Computer Science 2026-04-07 Karthik Suresh , Amine Ben Khalifa , Li Zhang , Wei-ting Hsu , Fangzheng Wu , Vinay More , Asim Kadav

Text-to-image diffusion models sometimes depict blended concepts in the generated images. One promising use case of this effect would be the nonword-to-image generation task which attempts to generate images intuitively imaginable from a…

Multimedia · Computer Science 2024-11-07 Chihaya Matsuhira , Marc A. Kastner , Takahiro Komamizu , Takatsugu Hirayama , Ichiro Ide

Adaptive and flexible image editing is a desirable function of modern generative models. In this work, we present a generative model with auto-encoder architecture for per-region style manipulation. We apply a code consistency loss to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Ansheng You , Chenglin Zhou , Qixuan Zhang , Lan Xu

Diffusion-based point editing methods have gained significant traction in image editing tasks due to their ability to manipulate image semantics and fine details by applying localized perturbations on the manifold of noise latent. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Haoyang Hu , Masataka Seo , Yen-Wei Chen

Video colorization is a challenging task that involves inferring plausible and temporally consistent colors for grayscale frames. In this paper, we present ColorDiffuser, an adaptation of a pre-trained text-to-image latent diffusion model…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Hanyuan Liu , Minshan Xie , Jinbo Xing , Chengze Li , Tien-Tsin Wong

Colorization methods using deep neural networks have become a recent trend. However, most of them do not allow user inputs, or only allow limited user inputs (only global inputs or only local inputs), to control the output colorful images.…

Computer Vision and Pattern Recognition · Computer Science 2018-01-30 Yi Xiao , Peiyao Zhou , Yan Zheng

Recent progress in generative models has significantly advanced image editing capabilities, yet precise and intuitive user control remains difficult. Specifically, users often struggle to communicate both exact spatial layouts and specific…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Anya Ji , George Ma , Téa Wright , Yiming Zhang , David M. Chan , Alane Suhr , Somayeh Sojoudi

Diffusion models have exhibited impressive prowess in the text-to-image task. Recent methods add image-level structure controls, e.g., edge and depth maps, to manipulate the generation process together with text prompts to obtain desired…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Yibo Zhao , Liang Peng , Yang Yang , Zekai Luo , Hengjia Li , Yao Chen , Zheng Yang , Xiaofei He , Wei Zhao , qinglin lu , Boxi Wu , Wei Liu

Recently, text-guided image manipulation has received increasing attention in the research field of multimedia processing and computer vision due to its high flexibility and controllability. Its goal is to semantically manipulate parts of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Ryugo Morita , Zhiqiang Zhang , Man M. Ho , Jinjia Zhou

We present IntrinsicWeather, a diffusion-based framework for controllable weather editing in intrinsic space. Our framework includes two components based on diffusion priors: an inverse renderer that estimates material properties, scene…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Yixin Zhu , Zuo-Liang Zhu , Jian Yang , Miloš Hašan , Jin Xie , Beibei Wang

Despite recent advances in inversion-based editing, text-guided image manipulation remains challenging for diffusion models. The primary bottlenecks include 1) the time-consuming nature of the inversion process; 2) the struggle to balance…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Sihan Xu , Yidong Huang , Jiayi Pan , Ziqiao Ma , Joyce Chai

Many real-world applications, such as interactive photo retouching, artistic content creation, and product design, require flexible and iterative image editing. However, existing image editing methods primarily focus on achieving the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Zijun Zhou , Yingying Deng , Xiangyu He , Weiming Dong , Fan Tang

Text-to-Image diffusion models have made tremendous progress over the past two years, enabling the generation of highly realistic images based on open-domain text descriptions. However, despite their success, text descriptions often…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Shihao Zhao , Dongdong Chen , Yen-Chun Chen , Jianmin Bao , Shaozhe Hao , Lu Yuan , Kwan-Yee K. Wong

Text-to-image diffusion models have achieved remarkable success in generating high-quality and diverse images. Building on these advancements, diffusion models have also demonstrated exceptional performance in text-guided image editing. A…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Mingyu Kang , Yong Suk Choi

Precise and flexible image editing remains a fundamental challenge in computer vision. Based on the modified areas, most editing methods can be divided into two main types: global editing and local editing. In this paper, we choose the two…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Ziqi Jiang , Zhen Wang , Long Chen

Near-infrared gray images captured together with corresponding visible color images have recently proven useful for image restoration and classification. This paper introduces a new coloring method to add colors to near-infrared gray images…

Computer Vision and Pattern Recognition · Computer Science 2021-02-10 Chang-Hwan Son , Xiao-Ping Zhang

There is a rapidly growing interest in controlling consistency across multiple generated images using diffusion models. Among various methods, recent works have found that simply manipulating attention modules by concatenating features from…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Jiaojiao Fan , Haotian Xue , Qinsheng Zhang , Yongxin Chen

Recent deep generative models are able to provide photo-realistic images as well as visual or textual content embeddings useful to address various tasks of computer vision and natural language processing. Their usefulness is nevertheless…

Machine Learning · Computer Science 2020-01-29 Antoine Plumerault , Hervé Le Borgne , Céline Hudelot

Editing materials of objects in images based on exemplar images is an active area of research in computer vision and graphics. We propose MARBLE, a method for performing material blending and recomposing fine-grained material properties by…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Ta-Ying Cheng , Prafull Sharma , Mark Boss , Varun Jampani

Diffusion generative models have recently greatly improved the power of text-conditioned image generation. Existing image generation models mainly include text conditional diffusion model and cross-modal guided diffusion model, which are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Wei Li , Xue Xu , Xinyan Xiao , Jiachen Liu , Hu Yang , Guohao Li , Zhanpeng Wang , Zhifan Feng , Qiaoqiao She , Yajuan Lyu , Hua Wu