中文
相关论文

相关论文: OCR-VQGAN: Taming Text-within-Image Generation

200 篇论文

Recent advances in image generation have achieved remarkable visual quality, while a fundamental challenge remains: Can image generation be controlled at the element level, enabling intuitive modifications such as adjusting shapes, altering…

计算机视觉与模式识别 · 计算机科学 2026-02-17 Lanqing Guo , Xi Liu , Yufei Wang , Zhihao Li , Siyu Huang

A picture is worth a thousand words, thus, it is crucial for conversational agents to understand, perceive, and effectively respond with pictures. However, we find that directly employing conventional image generation techniques is…

计算与语言 · 计算机科学 2024-02-09 Xiaowen Sun , Jiazhan Feng , Yuxuan Wang , Yuxuan Lai , Xingyu Shen , Dongyan Zhao

Industrial Retrieval-Augmented Generation (RAG) systems depend on optical character recognition (OCR) to transform visual documents into text. Existing OCR benchmarks rely on character-level metrics, which inadequately measure downstream…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Lin Sun , Wang Dexian , Jingang Huang , Linglin Zhang , Change Jia , Zhengwei Cheng , Xiangzheng Zhang

Unpaired image-to-image translation has broad applications in art, design, and scientific simulations. One early breakthrough was CycleGAN that emphasizes one-to-one mappings between two unpaired image domains via generative-adversarial…

计算机视觉与模式识别 · 计算机科学 2022-10-19 Dmitrii Torbunov , Yi Huang , Haiwang Yu , Jin Huang , Shinjae Yoo , Meifeng Lin , Brett Viren , Yihui Ren

Optical Character Recognition (OCR), the task of extracting textual information from scanned documents is a vital and broadly used technology for digitizing and indexing physical documents. Existing technologies perform well for clean…

计算机视觉与模式识别 · 计算机科学 2022-05-18 Daniel Rotman , Ophir Azulai , Inbar Shapira , Yevgeny Burshtein , Udi Barzelay

Text-to-image diffusion models have demonstrated remarkable capabilities in transforming textual prompts into coherent images, yet the computational cost of their inference remains a persistent challenge. To address this issue, we present…

计算机视觉与模式识别 · 计算机科学 2023-12-08 Yanwu Xu , Yang Zhao , Zhisheng Xiao , Tingbo Hou

Despite significant advancements in Large Vision Language Models (LVLMs), a gap remains, particularly regarding their interpretability and how they locate and interpret textual information within images. In this paper, we explore various…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Ingeol Baek , Hwan Chang , Sunghyun Ryu , Hwanhee Lee

Scalable Vector Graphics (SVG) are an essential format for technical illustration and digital design, offering precise resolution independence and flexible semantic editability. In practice, however, original vector source files are…

计算机视觉与模式识别 · 计算机科学 2026-03-26 Qijia He , Xunmei Liu , Hammaad Memon , Ziang Li , Zixian Ma , Jaemin Cho , Jason Ren , Daniel S Weld , Ranjay Krishna

The degradation in the underwater images is due to wavelength-dependent light attenuation, scattering, and to the diversity of the water types in which they are captured. Deep neural networks take a step in this field, providing autonomous…

计算机视觉与模式识别 · 计算机科学 2023-02-03 Rita Pucci , Christian Micheloni , Niki Martinel

In this paper, we focus on generating realistic images from text descriptions. Current methods first generate an initial image with rough shape and color, and then refine the initial image to a high-resolution one. Most existing…

计算机视觉与模式识别 · 计算机科学 2019-04-03 Minfeng Zhu , Pingbo Pan , Wei Chen , Yi Yang

Academic documents are packed with texts, equations, tables, and figures, requiring comprehensive understanding for accurate Optical Character Recognition (OCR). While end-to-end OCR methods offer improved accuracy over layout-based…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Yu Sun , Dongzhan Zhou , Chen Lin , Conghui He , Wanli Ouyang , Han-Sen Zhong

Text Recognition is one of the challenging tasks of computer vision with considerable practical interest. Optical character recognition (OCR) enables different applications for automation. This project focuses on word detection and…

计算机视觉与模式识别 · 计算机科学 2020-04-20 Ebin Zacharias , Martin Teuchler , Bénédicte Bernier

We present DeepSeek-OCR as an initial investigation into the feasibility of compressing long contexts via optical 2D mapping. DeepSeek-OCR consists of two components: DeepEncoder and DeepSeek3B-MoE-A570M as the decoder. Specifically,…

计算机视觉与模式识别 · 计算机科学 2025-10-22 Haoran Wei , Yaofeng Sun , Yukun Li

Scene text recognition is an important and challenging task in computer vision. However, most prior works focus on recognizing pre-defined words, while there are various out-of-vocabulary (OOV) words in real-world applications. In this…

计算机视觉与模式识别 · 计算机科学 2024-03-13 Xuhua Ren , Hengcan Shi , Jin Li

Text contained in an image carries high-level semantics that can be exploited to achieve richer image understanding. In particular, the mere presence of text provides strong guiding content that should be employed to tackle a diversity of…

计算机视觉与模式识别 · 计算机科学 2020-01-15 Andres Mafla , Sounak Dey , Ali Furkan Biten , Lluis Gomez , Dimosthenis Karatzas

We present OvSGTR, a novel transformer-based framework for fully open-vocabulary scene graph generation that overcomes the limitations of traditional closed-set models. Conventional methods restrict both object and relationship recognition…

计算机视觉与模式识别 · 计算机科学 2025-05-27 Zuyao Chen , Jinlin Wu , Zhen Lei , Chang Wen Chen

Generating texts which express complex ideas spanning multiple sentences requires a structured representation of their content (document plan), but these representations are prohibitively expensive to manually produce. In this work, we…

计算与语言 · 计算机科学 2022-03-28 Rik Koncel-Kedziorski , Dhanush Bekal , Yi Luan , Mirella Lapata , Hannaneh Hajishirzi

In the last few years, we have witnessed the rise of a series of deep learning methods to generate synthetic images that look extremely realistic. These techniques prove useful in the movie industry and for artistic purposes. However, they…

计算机视觉与模式识别 · 计算机科学 2022-03-07 Sara Mandelli , Nicolò Bonettini , Paolo Bestagini , Stefano Tubaro

This research addresses a critical challenge in the field of generative models, particularly in the generation and evaluation of synthetic images. Given the inherent complexity of generative models and the absence of a standardized…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Majid Memari , Khaled R. Ahmed , Shahram Rahimi , Noorbakhsh Amiri Golilarz

Generating photo-realistic images from a text description is a challenging problem in computer vision. Previous works have shown promising performance to generate synthetic images conditional on text by Generative Adversarial Networks…

计算机视觉与模式识别 · 计算机科学 2021-07-29 Tao Hu , Chengjiang Long , Chunxia Xiao