English
Related papers

Related papers: Learning to Globally Edit Images with Textual Desc…

200 papers

Automatic segmentation has great potential to facilitate morphological measurements while simultaneously increasing efficiency. Nevertheless often users want to edit the segmentation to their own needs and will need different tools for…

Computer Vision and Pattern Recognition · Computer Science 2018-07-24 Gustav Bredell , Christine Tanner , Ender Konukoglu

In this paper, a novel neural network architecture is proposed attempting to rectify text images with mild assumptions. A new dataset of text images is collected to verify our model and open to public. We explored the capability of deep…

Computer Vision and Pattern Recognition · Computer Science 2016-11-15 Chengzhe Yan , Jie Hu , Changshui Zhang

Text-to-image synthesis aims to generate natural images conditioned on text descriptions. The main difficulty of this task lies in effectively fusing text information into the image synthesis process. Existing methods usually adaptively…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Senmao Ye , Fei Liu , Minkui Tan

Instruction-based image editing aims to modify specific content within existing images according to user-provided instructions while preserving non-target regions. Beyond traditional object- and style-centric manipulation, text-centric…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Hui Zhang , Juntao Liu , Zongkai Liu , Liqiang Niu , Fandong Meng , Zuxuan Wu , Yu-Gang Jiang

Previous studies show the necessity of global and local adjustment for image enhancement. However, existing convolutional neural networks (CNNs) and transformer-based models face great challenges in balancing the computational efficiency…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Kun Zhou , KenKun Liu , Wenbo Li , Xiaoguang Han , Jiangbo Lu

Generative models have been widely studied in computer vision. Recently, diffusion models have drawn substantial attention due to the high quality of their generated images. A key desired property of image generative models is the ability…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Qiucheng Wu , Yujian Liu , Handong Zhao , Ajinkya Kale , Trung Bui , Tong Yu , Zhe Lin , Yang Zhang , Shiyu Chang

Text-guided image editing models have shown remarkable results. However, there remain two problems. First, they employ fixed manipulation modules for various editing requirements (e.g., color changing, texture changing, content adding and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Ming Tao , Bing-Kun Bao , Hao Tang , Fei Wu , Longhui Wei , Qi Tian

In this paper, we propose a novel controllable text-to-image generative adversarial network (ControlGAN), which can effectively synthesise high-quality images and also control parts of the image generation according to natural language…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Bowen Li , Xiaojuan Qi , Thomas Lukasiewicz , Philip H. S. Torr

While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Omid Poursaeed , Tianxing Jiang , Harry Yang , Serge Belongie , SerNam Lim

Instruction-based image editing improves the controllability and flexibility of image manipulation via natural commands without elaborate descriptions or regional masks. However, human instructions are sometimes too brief for current…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Tsu-Jui Fu , Wenze Hu , Xianzhi Du , William Yang Wang , Yinfei Yang , Zhe Gan

In recent years, instruction-based image editing methods have garnered significant attention in image editing. However, despite encompassing a wide range of editing priors, these methods are helpless when handling editing tasks that are…

Graphics · Computer Science 2024-03-28 Ruoyu Zhao , Qingnan Fan , Fei Kou , Shuai Qin , Hong Gu , Wei Wu , Pengcheng Xu , Mingrui Zhu , Nannan Wang , Xinbo Gao

Text-guided semantic manipulation refers to semantically editing an image generated from a source prompt to match a target prompt, enabling the desired semantic changes (e.g., addition, removal, and style transfer) while preserving…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Yu Hong , Xiao Cai , Pengpeng Zeng , Shuai Zhang , Jingkuan Song , Lianli Gao , Heng Tao Shen

We describe a new approach that improves the training of generative adversarial nets (GANs) for synthesizing diverse images from a text input. Our approach is based on the conditional version of GANs and expands on previous work leveraging…

Computer Vision and Pattern Recognition · Computer Science 2019-02-07 Miriam Cha , Youngjune L. Gwon , H. T. Kung

Image content is a predominant factor in marketing campaigns, websites and banners. Today, marketers and designers spend considerable time and money in generating such professional quality content. We take a step towards simplifying this…

Computer Vision and Pattern Recognition · Computer Science 2021-05-17 Shradha Agrawal , Shankar Venkitachalam , Dhanya Raghu , Deepak Pai

We propose a novel model named Multi-Channel Attention Selection Generative Adversarial Network (SelectionGAN) for guided image-to-image translation, where we translate an input image into another while respecting an external semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Hao Tang , Philip H. S. Torr , Nicu Sebe

Retouching can significantly elevate the visual appeal of photos, but many casual photographers lack the expertise to operate in a professional manner. One particularly challenging task for old photo retouching remains the removal of dust…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Ionuţ Mironică

This paper presents UltraEdit, a large-scale (approximately 4 million editing samples), automatically generated dataset for instruction-based image editing. Our key idea is to address the drawbacks in existing image editing datasets like…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Haozhe Zhao , Xiaojian Ma , Liang Chen , Shuzheng Si , Rujie Wu , Kaikai An , Peiyu Yu , Minjia Zhang , Qing Li , Baobao Chang

The recent advances in deep learning have made it possible to generate photo-realistic images by using neural networks and even to extrapolate video frames from an input video clip. In this paper, for the sake of both furthering this…

Computer Vision and Pattern Recognition · Computer Science 2018-08-10 Lijie Fan , Wenbing Huang , Chuang Gan , Junzhou Huang , Boqing Gong

We consider the problem of generating free-form mobile manipulation instructions based on a target object image and receptacle image. Conventional image captioning models are not able to generate appropriate instructions because their…

Robotics · Computer Science 2025-01-29 Kei Katsumata , Motonari Kambara , Daichi Yashima , Ryosuke Korekata , Komei Sugiura

In this paper, we propose a way of synthesizing realistic images directly with natural language description, which has many useful applications, e.g. intelligent image manipulation. We attempt to accomplish such synthesis: given a source…

Computer Vision and Pattern Recognition · Computer Science 2017-07-24 Hao Dong , Simiao Yu , Chao Wu , Yike Guo