English
Related papers

Related papers: CLII: Visual-Text Inpainting via Cross-Modal Predi…

200 papers

With the rapid progression of deep learning technologies, multi-modality image fusion has become increasingly prevalent in object detection tasks. Despite its popularity, the inherent disparities in how different sources depict scene…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Xingyuan Li , Yang Zou , Jinyuan Liu , Zhiying Jiang , Long Ma , Xin Fan , Risheng Liu

Conventional image inpainting techniques typically process entire images, which often leads to computational inefficiency and susceptibility to information redundancy, particularly in occluded or cluttered scenes. Inspired by cortical…

Pattern Formation and Solitons · Physics 2025-10-21 Yonghao Wu , Chang Liu , Vladimir Filaretov , Dmitry Yukhimets

Recent advances in image inpainting have shown impressive results for generating plausible visual details on rather simple backgrounds. However, for complex scenes, it is still challenging to restore reasonable contents as the contextual…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Wendong Zhang , Junwei Zhu , Ying Tai , Yunbo Wang , Wenqing Chu , Bingbing Ni , Chengjie Wang , Xiaokang Yang

Image inpainting is a key technique in image processing task to predict the missing regions and generate realistic images. Given the advancement of existing generative inpainting models with feature extraction, propagation and…

Computer Vision and Pattern Recognition · Computer Science 2022-05-18 Jireh Jam , Connah Kendrick , Vincent Drouard , Kevin Walker , Moi Hoon Yap

Scene text spotting aims to detect and recognize text in real-world images, where instances are often short, fragmented, or visually ambiguous. Existing methods primarily rely on visual cues and implicitly capture local character…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Leeje Jang , Yijun Lin , Yao-Yi Chiang , Jerod Weinman

In recent years, the field of image inpainting has developed rapidly, learning based approaches show impressive results in the task of filling missing parts in an image. But most deep methods are strongly tied to the resolution of the…

Image and Video Processing · Electrical Eng. & Systems 2021-04-29 Andrey Moskalenko , Mikhail Erofeev , Dmitriy Vatolin

Text-to-image diffusion models have shown impressive capabilities in generating realistic visuals from natural-language prompts, yet they often struggle with accurately binding attributes to corresponding objects, especially in prompts…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Do Huu Dat , Nam Hyeonu , Po-Yuan Mao , Tae-Hyun Oh

Amodal completion, which is the process of inferring the full appearance of objects despite partial occlusions, is crucial for understanding complex human-object interactions (HOI) in computer vision and robotics. Existing methods, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Seunggeun Chi , Enna Sachdeva , Pin-Hao Huang , Kwonjoon Lee

Recently, text-guided image manipulation has received increasing attention in the research field of multimedia processing and computer vision due to its high flexibility and controllability. Its goal is to semantically manipulate parts of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Ryugo Morita , Zhiqiang Zhang , Man M. Ho , Jinjia Zhou

In this paper, we focus on image inpainting task, aiming at recovering the missing area of an incomplete image given the context information. Recent development in deep generative models enables an efficient end-to-end framework for image…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Yuhang Song , Chao Yang , Yeji Shen , Peng Wang , Qin Huang , C. -C. Jay Kuo

The task of composed image retrieval (CIR) aims to retrieve images based on the query image and the text describing the users' intent. Existing methods have made great progress with the advanced large vision-language (VL) model in CIR task,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Yongchao Du , Min Wang , Wengang Zhou , Shuping Hui , Houqiang Li

The character information in natural scene images contains various personal information, such as telephone numbers, home addresses, etc. It is a high risk of leakage the information if they are published. In this paper, we proposed a scene…

Computer Vision and Pattern Recognition · Computer Science 2017-05-09 Toshiki Nakamura , Anna Zhu , Keiji Yanai , Seiichi Uchida

Structure-guided image completion aims to inpaint a local region of an image according to an input guidance map from users. While such a task enables many practical applications for interactive editing, existing methods often struggle to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Haitian Zheng , Zhe Lin , Jingwan Lu , Scott Cohen , Eli Shechtman , Connelly Barnes , Jianming Zhang , Qing Liu , Yuqian Zhou , Sohrab Amirghodsi , Jiebo Luo

In-context image editing aims to modify images based on a contextual sequence comprising text and previously generated images. Existing methods typically depend on task-specific pipelines and expert models (e.g., segmentation and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Leigang Qu , Feng Cheng , Ziyan Yang , Qi Zhao , Shanchuan Lin , Yichun Shi , Yicong Li , Wenjie Wang , Tat-Seng Chua , Lu Jiang

This study introduces Text-Guided Subject-Driven Image Inpainting, a novel task that combines text and exemplar images for image inpainting. While both text and exemplar images have been used independently in previous efforts, their…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Shaoan Xie , Yang Zhao , Zhisheng Xiao , Kelvin C. K. Chan , Yandong Li , Yanwu Xu , Kun Zhang , Tingbo Hou

Image inpainting is an effective method to enhance distorted digital images. Different inpainting methods use the information of neighboring pixels to predict the value of missing pixels. Recently deep neural networks have been used to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-20 Mohammad H. Givkashi , Mahshid Hadipour , Arezoo PariZanganeh , Zahra Nabizadeh , Nader Karimi , Shadrokh Samavi

Handling various objects with different colors is a significant challenge for image colorization techniques. Thus, for complex real-world scenes, the existing image colorization algorithms often fail to maintain color consistency. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Subhankar Ghosh , Saumik Bhattacharya , Prasun Roy , Umapada Pal , Michael Blumenstein

Recent years have witnessed the success of large text-to-image diffusion models and their remarkable potential to generate high-quality images. The further pursuit of enhancing the editability of images has sparked significant interest in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Yifu Chen , Jingwen Chen , Yingwei Pan , Yehao Li , Ting Yao , Zhineng Chen , Tao Mei

Interacting and understanding with text heavy visual content with multiple images is a major challenge for traditional vision models. This paper is on enhancing vision models' capability to comprehend or understand and learn from images…

Computer Vision and Pattern Recognition · Computer Science 2024-08-31 Adithya TG , Adithya SK , Abhinav R Bharadwaj , Abhiram HA , Surabhi Narayan

In-context learning allows adapting a model to new tasks given a task description at test time. In this paper, we present IMProv - a generative model that is able to in-context learn visual tasks from multimodal prompts. Given a textual…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Jiarui Xu , Yossi Gandelsman , Amir Bar , Jianwei Yang , Jianfeng Gao , Trevor Darrell , Xiaolong Wang