English
Related papers

Related papers: Textual Visual Semantic Dataset for Text Spotting

200 papers

Many tasks are related to determining if a particular text string exists in an image. In this work, we propose a new framework that learns this task in an end-to-end way. The framework takes an image and a text string as input and then…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Dafang He , Yeqing Li , Alexander Gorban , Derrall Heath , Julian Ibarz , Qian Yu , Daniel Kifer , C. Lee Giles

Recent models for cross-modal retrieval have benefited from an increasingly rich understanding of visual scenes, afforded by scene graphs and object interactions to mention a few. This has resulted in an improved matching between the visual…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Andrés Mafla , Rafael Sampaio de Rezende , Lluís Gómez , Diane Larlus , Dimosthenis Karatzas

Understanding a visual scene incorporates objects, relationships, and context. Traditional methods working on an image mostly focus on object detection and fail to capture the relationship between the objects. Relationships can give rich…

Computer Vision and Pattern Recognition · Computer Science 2019-12-03 Himangi Mittal , Ajith Abraham , Anuja Arora

Text in natural images contains rich semantics that are often highly relevant to objects or scene. In this paper, we focus on the problem of fully exploiting scene text for visual understanding. The main idea is combining word…

Computer Vision and Pattern Recognition · Computer Science 2017-05-31 Xiang Bai , Mingkun Yang , Pengyuan Lyu , Yongchao Xu , Jiebo Luo

We introduce a data-driven approach for interactively synthesizing in-the-wild images from semantic label maps. Our approach is dramatically different from recent work in this space, in that we make use of no learning. Instead, our approach…

Computer Vision and Pattern Recognition · Computer Science 2019-06-12 Aayush Bansal , Yaser Sheikh , Deva Ramanan

Image-text retrieval of natural scenes has been a popular research topic. Since image and text are heterogeneous cross-modal data, one of the key challenges is how to learn comprehensive yet unified representations to express the…

Computer Vision and Pattern Recognition · Computer Science 2019-10-14 Sijin Wang , Ruiping Wang , Ziwei Yao , Shiguang Shan , Xilin Chen

Image-text matching has been a hot research topic bridging the vision and language areas. It remains challenging because the current representation of image usually lacks global semantic concepts as in its corresponding text caption. To…

Computer Vision and Pattern Recognition · Computer Science 2019-09-09 Kunpeng Li , Yulun Zhang , Kai Li , Yuanyuan Li , Yun Fu

Scene text spotting aims to detect and recognize the entire word or sentence with multiple characters in natural images. It is still challenging because ambiguity often occurs when the spacing between characters is large or the characters…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Wenhai Wang , Xuebo Liu , Xiaozhong Ji , Enze Xie , Ding Liang , Zhibo Yang , Tong Lu , Chunhua Shen , Ping Luo

Most existing scene text detectors focus on detecting characters or words that only capture partial text messages due to missing contextual information. For a better understanding of text in scenes, it is more desired to detect contextual…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Chuhui Xue , Jiaxing Huang , Shijian Lu , Changhu Wang , Song Bai

Research in the Vision and Language area encompasses challenging topics that seek to connect visual and textual information. When the visual information is related to videos, this takes us into Video-Text Research, which includes several…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Jesus Perez-Martin , Benjamin Bustos , Silvio Jamil F. Guimarães , Ivan Sipiran , Jorge Pérez , Grethel Coello Said

In this paper, we aim to learn associations between visual attributes of fonts and the verbal context of the texts they are typically applied to. Compared to related work leveraging the surrounding visual context, we choose to focus only on…

Computation and Language · Computer Science 2020-05-05 Amirreza Shirani , Franck Dernoncourt , Jose Echevarria , Paul Asente , Nedim Lipka , Thamar Solorio

Information surrounds people in modern life. Text is a very efficient type of information that people use for communication for centuries. However, automated text-in-the-wild recognition remains a challenging problem. The major limitation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Igor Markov , Sergey Nesteruk , Andrey Kuznetsov , Denis Dimitrov

Representing the semantics of words is a long-standing problem for the natural language processing community. Most methods compute word semantics given their textual context in large corpora. More recently, researchers attempted to…

Computation and Language · Computer Science 2017-11-10 Éloi Zablocki , Benjamin Piwowarski , Laure Soulier , Patrick Gallinari

End-to-end scene text spotting has attracted great attention in recent years due to the success of excavating the intrinsic synergy of the scene text detection and recognition. However, recent state-of-the-art methods usually incorporate…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Mingxin Huang , Yuliang Liu , Zhenghao Peng , Chongyu Liu , Dahua Lin , Shenggao Zhu , Nicholas Yuan , Kai Ding , Lianwen Jin

Object detection is a fundamental task in computer vision, requiring large annotated datasets that are difficult to collect, as annotators need to label objects and their bounding boxes. Thus, it is a significant challenge to use cheaper…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Achiya Jerbi , Roei Herzig , Jonathan Berant , Gal Chechik , Amir Globerson

Recently, end-to-end text spotting that aims to detect and recognize text from cluttered images simultaneously has received particularly growing interest in computer vision. Different from the existing approaches that formulate text…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Hao Wang , Pu Lu , Hui Zhang , Mingkun Yang , Xiang Bai , Yongchao Xu , Mengchao He , Yongpan Wang , Wenyu Liu

Text spotting is an interesting research problem as text may appear at any random place and may occur in various forms. Moreover, ability to detect text opens the horizons for improving many advanced computer vision problems. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2017-12-14 Aarushi Agrawal , Prerana Mukherjee , Siddharth Srivastava , Brejesh Lall

Scene-text spotting is a task that predicts a text area on natural scene images and recognizes its text characters simultaneously. It has attracted much attention in recent years due to its wide applications. Existing research has mainly…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Masato Fujitake

Recent works in the text recognition area have pushed forward the recognition results to the new horizons. But for a long time a lack of large human-labeled natural text recognition datasets has been forcing researchers to use synthetic…

Computer Vision and Pattern Recognition · Computer Science 2021-07-30 Vladimir Loginov

Existing scene text spotters are designed to locate and transcribe texts from images. However, it is challenging for a spotter to achieve precise detection and recognition of scene texts simultaneously. Inspired by the glimpse-focus…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Jiahao Lyu , Jin Wei , Gangyan Zeng , Zeng Li , Enze Xie , Wei Wang , Yu Zhou