English
Related papers

Related papers: Self-Supervised Text Erasing with Controllable Ima…

200 papers

Guided image synthesis enables everyday users to create and edit photo-realistic images with minimum effort. The key challenge is balancing faithfulness to the user input (e.g., hand-drawn colored strokes) and realism of the synthesized…

Computer Vision and Pattern Recognition · Computer Science 2022-01-06 Chenlin Meng , Yutong He , Yang Song , Jiaming Song , Jiajun Wu , Jun-Yan Zhu , Stefano Ermon

Previous text-to-image synthesis algorithms typically use explicit textual instructions to generate/manipulate images accurately, but they have difficulty adapting to guidance in the form of coarsely matched texts. In this work, we attempt…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Mengyao Cui , Zhe Zhu , Shao-Ping Lu , Yulu Yang

To highlight the challenges of achieving representation disentanglement for text domain in an unsupervised setting, in this paper we select a representative set of successfully applied models from the image domain. We evaluate these models…

Computation and Language · Computer Science 2021-06-08 Lan Zhang , Victor Prokhorov , Ehsan Shareghi

While scene text image super-resolution (STISR) has yielded remarkable improvements in accurately recognizing scene text, prior methodologies have placed excessive emphasis on optimizing performance, rather than paying due attention to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Minghao Fu , Xin Man , Yihan Xu , Jie Shao

Deep learning-based scene text detection can achieve preferable performance, powered with sufficient labeled training data. However, manual labeling is time consuming and laborious. At the extreme, the corresponding annotated data are…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Weijia Wu , Ning Lu , Enze Xie

In recent years, significant progress has been made in scene text recognition by data-driven methods. However, due to the scarcity of annotated real-world data, the training of these methods predominantly relies on synthetic data. The…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Yujin Ren , Jiaxin Zhang , Lianwen Jin

Diffusion models have transformed image generation, yet controlling their outputs to reliably erase undesired concepts remains challenging. Existing approaches usually require task-specific training and struggle to generalize across both…

Scene text editing (STE) has achieved remarkable progress in accurately rendering target text through diffusion-based methods. However, we identify a critical yet overlooked problem: edit spillover -- when editing a target text region,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Guandong Li , Mengxia Ye

Automatic artistic text generation is an emerging topic which receives increasing attention due to its wide applications. The artistic text can be divided into three components, content, font, and texture, respectively. Existing artistic…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Qirui Huang , Bin Fu , Aozhong Zhang , Yu Qiao

While image-text representation learning has become very popular in recent years, existing models tend to lack spatial awareness and have limited direct applicability for dense understanding tasks. For this reason, self-supervised…

A large number of annotated training images is crucial for training successful scene text recognition models. However, collecting sufficient datasets can be a labor-intensive and costly process, particularly for low-resource languages. To…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Yangchen Xie , Xinyuan Chen , Hongjian Zhan , Palaiahankote Shivakum , Bing Yin , Cong Liu , Yue Lu

Learning-based edge detection has hereunto been strongly supervised with pixel-wise annotations which are tedious to obtain manually. We study the problem of self-training edge detection, leveraging the untapped wealth of large-scale…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Yunfan Ye , Renjiao Yi , Zhiping Cai , Kai Xu

The rapid proliferation of large-scale text-to-image diffusion (T2ID) models has raised serious concerns about their potential misuse in generating harmful content. Although numerous methods have been proposed for erasing undesired concepts…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Koushik Srivatsan , Fahad Shamshad , Muzammal Naseer , Vishal M. Patel , Karthik Nandakumar

Scene text recognition (STR) is a challenging task that requires large-scale annotated data for training. However, collecting and labeling real text images is expensive and time-consuming, which limits the availability of real data.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Mingkun Yang , Biao Yang , Minghui Liao , Yingying Zhu , Xiang Bai

While personalized text-to-image generation has enabled the learning of a single concept from multiple images, a more practical yet challenging scenario involves learning multiple concepts within a single image. However, existing works…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Shaozhe Hao , Kai Han , Zhengyao Lv , Shihao Zhao , Kwan-Yee K. Wong

Despite recent advancements in Machine Learning, many tasks still involve working in low-data regimes which can make solving natural language problems difficult. Recently, a number of text augmentation techniques have emerged in the field…

Computation and Language · Computer Science 2023-02-27 Congcong Wang , Gonzalo Fiz Pontiveros , Steven Derby , Tri Kurniawan Wijaya

Single image super-resolution is the task of inferring a high-resolution image from a single low-resolution input. Traditionally, the performance of algorithms for this task is measured using pixel-wise reconstruction measures such as peak…

Computer Vision and Pattern Recognition · Computer Science 2018-01-16 Mehdi S. M. Sajjadi , Bernhard Schölkopf , Michael Hirsch

Text-to-image models encounter safety issues, including concerns related to copyright and Not-Safe-For-Work (NSFW) content. Despite several methods have been proposed for erasing inappropriate concepts from diffusion models, they often…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Chao Gong , Kai Chen , Zhipeng Wei , Jingjing Chen , Yu-Gang Jiang

We address the task of unsupervised Semantic Textual Similarity (STS) by ensembling diverse pre-trained sentence encoders into sentence meta-embeddings. We apply, extend and evaluate different meta-embedding methods from the word embedding…

Computation and Language · Computer Science 2020-06-25 Nina Poerner , Ulli Waltinger , Hinrich Schütze

Restoring low-resolution text images presents a significant challenge, as it requires maintaining both the fidelity and stylistic realism of the text in restored images. Existing text image restoration methods often fall short in hard…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Chenglu Pan , Xiaogang Xu , Ganggui Ding , Yunke Zhang , Wenbo Li , Jiarong Xu , Qingbiao Wu