English
Related papers

Related papers: Looking and Listening: Audio Guided Text Recogniti…

200 papers

Audio-LLM introduces audio modality into a large language model (LLM) to enable a powerful LLM to recognize, understand, and generate audio. However, during speech recognition in noisy environments, we observed the presence of illusions and…

Sound · Computer Science 2024-08-20 Yangze Li , Xiong Wang , Songjun Cao , Yike Zhang , Long Ma , Lei Xie

Scene text recognition has attracted increasing interest in recent years due to its wide range of applications in multilingual translation, autonomous driving, etc. In this report, we describe our solution to the Out of Vocabulary Scene…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Zhangzi Zhu , Chuhui Xue , Yu Hao , Wenqing Zhang , Song Bai

Accurate text recognition in low-light environments is essential for intelligent systems in applications ranging from autonomous vehicles to smart surveillance. However, challenges such as poor illumination and noise interference remain…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Xuanshuo Fu , Lei Kang , Ernest Valveny , Dimosthenis Karatzas , Javier Vazquez-Corral

Employing a dictionary can efficiently rectify the deviation between the visual prediction and the ground truth in scene text recognition methods. However, the independence of the dictionary on the visual features may lead to incorrect…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Jiajun Wei , Hongjian Zhan , Xiao Tu , Yue Lu , Umapada Pal

In this paper, we propose a novel method based on character sequence-to-sequence models to correct documents already processed with Optical Character Recognition (OCR) systems. The main contribution of this paper is a set of strategies to…

Computation and Language · Computer Science 2022-01-26 Juan Ramirez-Orta , Eduardo Xamena , Ana Maguitman , Evangelos Milios , Axel J. Soto

Scene text recognition has witnessed rapid development with the advance of convolutional neural networks. Nonetheless, most of the previous methods may not work well in recognizing text with low resolution which is often seen in natural…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Wenjia Wang , Enze Xie , Peize Sun , Wenhai Wang , Lixun Tian , Chunhua Shen , Ping Luo

Audio captioning is an important research area that aims to generate meaningful descriptions for audio clips. Most of the existing research extracts acoustic features of audio clips as input to encoder-decoder and transformer architectures…

Sound · Computer Science 2022-04-20 Ayşegül Özkaya Eren , Mustafa Sert

Optical Character Recognition (OCR), the task of extracting textual information from scanned documents is a vital and broadly used technology for digitizing and indexing physical documents. Existing technologies perform well for clean…

Computer Vision and Pattern Recognition · Computer Science 2022-05-18 Daniel Rotman , Ophir Azulai , Inbar Shapira , Yevgeny Burshtein , Udi Barzelay

Recently, models based on deep neural networks have dominated the fields of scene text detection and recognition. In this paper, we investigate the problem of scene text spotting, which aims at simultaneous text detection and recognition in…

Computer Vision and Pattern Recognition · Computer Science 2018-08-02 Pengyuan Lyu , Minghui Liao , Cong Yao , Wenhao Wu , Xiang Bai

Deep learning, with its robust aotomatic feature extraction capabilities, has demonstrated significant success in audio signal processing. Typically, these methods rely on static, pre-collected large-scale datasets for training, performing…

Sound · Computer Science 2024-12-19 Qisheng Xu , Yulin Sun , Yi Su , Qian Zhu , Xiaoyi Tan , Hongyu Wen , Zijian Gao , Kele Xu , Yong Dou , Dawei Feng

This work presents a method for visual text recognition without using any paired supervisory data. We formulate the text recognition task as one of aligning the conditional distribution of strings predicted from given text images, with…

Computer Vision and Pattern Recognition · Computer Science 2018-12-11 Ankush Gupta , Andrea Vedaldi , Andrew Zisserman

Connectionist Temporal Classification (CTC) and attention mechanism are two main approaches used in recent scene text recognition works. Compared with attention-based methods, CTC decoder has a much shorter inference time, yet a lower…

Computer Vision and Pattern Recognition · Computer Science 2020-02-05 Wenyang Hu , Xiaocong Cai , Jun Hou , Shuai Yi , Zhiping Lin

We present the first approach to automated audio captioning. We employ an encoder-decoder scheme with an alignment model in between. The input to the encoder is a sequence of log mel-band energies calculated from an audio file, while the…

Sound · Computer Science 2017-10-25 Konstantinos Drossos , Sharath Adavanne , Tuomas Virtanen

In the past, Acoustic Scene Classification systems have been based on hand crafting audio features that are input to a classifier. Nowadays, the common trend is to adopt data driven techniques, e.g., deep learning, where audio…

Sound · Computer Science 2018-06-29 Eduardo Fonseca , Rong Gong , Xavier Serra

The requiring of large amounts of annotated training data has become a common constraint on various deep learning systems. In this paper, we propose a weakly supervised scene text detection method (WeText) that trains robust and accurate…

Computer Vision and Pattern Recognition · Computer Science 2017-10-16 Shangxuan Tian , Shijian Lu , Chongshou Li

Text detection in natural scene images has applications for autonomous driving, navigation help for elderly and blind people. However, the research on Urdu text detection is usually hindered by lack of data resources. We have developed a…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Hazrat Ali

Despite the ubiquity of mobile and wearable text messaging applications, the problem of keyboard text decoding is not tackled sufficiently in the light of the enormous success of the deep learning Recurrent Neural Network (RNN) and…

Computation and Language · Computer Science 2017-09-20 Shaona Ghosh , Per Ola Kristensson

Recognition systems are commonly designed to authenticate users at the access control levels of a system. A number of voice recognition methods have been developed using a pitch estimation process which are very vulnerable in low Signal to…

Sound · Computer Science 2020-09-08 Aman Chadha , Divya Jyoti , M. Mani Roja

Billions of public domain documents remain trapped in hard copy or lack an accurate digitization. Modern natural language processing methods cannot be used to index, retrieve, and summarize their texts; conduct computational textual…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Tom Bryan , Jacob Carlson , Abhishek Arora , Melissa Dell

The accuracy of Optical Character Recognition (OCR) is crucial to the success of subsequent applications used in text analyzing pipeline. Recent models of OCR post-processing significantly improve the quality of OCR-generated text, but are…

Computer Vision and Pattern Recognition · Computer Science 2016-11-22 Jie Mei , Aminul Islam , Yajing Wu , Abidalrahman Moh'd , Evangelos E. Milios