English
Related papers

Related papers: LanideNN: Multilingual Language Identification on …

200 papers

Building speech recognizers in multiple languages typically involves replicating a monolingual training recipe for each language, or utilizing a multi-task learning approach where models for different languages have separate output labels…

Computation and Language · Computer Science 2017-11-08 Suyoun Kim , Michael L. Seltzer

The performance of multilingual pretrained models is highly dependent on the availability of monolingual or parallel text present in a target language. Thus, the majority of the world's languages cannot benefit from recent progress in NLP…

Computation and Language · Computer Science 2022-04-07 Xinyi Wang , Sebastian Ruder , Graham Neubig

For endangered languages, data collection campaigns have to accommodate the challenge that many of them are from oral tradition, and producing transcriptions is costly. Therefore, it is fundamental to translate them into a widely spoken…

Computation and Language · Computer Science 2020-03-31 Marcely Zanon Boito , Aline Villavicencio , Laurent Besacier

Massive web-crawled image-text datasets lay the foundation for recent progress in multimodal learning. These datasets are designed with the goal of training a model to do well on standard computer vision benchmarks, many of which, however,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Thao Nguyen , Matthew Wallingford , Sebastin Santy , Wei-Chiu Ma , Sewoong Oh , Ludwig Schmidt , Pang Wei Koh , Ranjay Krishna

Natural language processing (NLP) techniques have become mainstream in the recent decade. Most of these advances are attributed to the processing of a single language. More recently, with the extensive growth of social media platforms focus…

Computation and Language · Computer Science 2022-01-12 Ramchandra Joshi , Raviraj Joshi

Text-to-image person re-identification (ReID) retrieves pedestrian images according to textual descriptions. Manually annotating textual descriptions is time-consuming, restricting the scale of existing datasets and therefore the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Wentao Tan , Changxing Ding , Jiayu Jiang , Fei Wang , Yibing Zhan , Dapeng Tao

In this paper, we propose a novel approach for text detec- tion in natural images. Both local and global cues are taken into account for localizing text lines in a coarse-to-fine pro- cedure. First, a Fully Convolutional Network (FCN) model…

Computer Vision and Pattern Recognition · Computer Science 2016-04-19 Zheng Zhang , Chengquan Zhang , Wei Shen , Cong Yao , Wenyu Liu , Xiang Bai

Language Identification (LID) is a crucial preliminary process in the field of Automatic Speech Recognition (ASR) that involves the identification of a spoken language from audio samples. Contemporary systems that can process speech in…

Machine Learning · Computer Science 2026-03-04 Atanu Mandal , Santanu Pal , Indranil Dutta , Mahidas Bhattacharya , Sudip Kumar Naskar

Probing the multilingual knowledge of linguistic structure in LLMs, often characterized as sequence labeling, faces challenges with maintaining output templates in current text-to-text prompting strategies. To solve this, we introduce a…

Computation and Language · Computer Science 2025-11-07 Ercong Nie , Shuzhou Yuan , Bolei Ma , Helmut Schmid , Michael Färber , Frauke Kreuter , Hinrich Schütze

Multilingual language models often perform unevenly across different languages due to limited generalization capabilities for some languages. This issue is significant because of the growing interest in making universal language models that…

Computation and Language · Computer Science 2024-10-11 Gürkan Soykan , Gözde Gül Şahin

Automatic hate speech detection in online social networks is an important open problem in Natural Language Processing (NLP). Hate speech is a multidimensional issue, strongly dependant on language and cultural factors. Despite its…

Computation and Language · Computer Science 2021-05-03 Aymé Arango , Jorge Pérez , Barbara Poblete

The quality of a multilingual speech recognition system can be improved by adaptation methods if the input language is specified. For systems that can accept multilingual inputs, the popular approach is to apply a language identifier to the…

Computation and Language · Computer Science 2020-05-05 Van Huy Nguyen , Thi Quynh Khanh Dinh , Truong Thinh Nguyen , Dang Khoa Mac

In many multilingual text classification problems, the documents in different languages often share the same set of categories. To reduce the labeling cost of training a classification model for each individual language, it is important to…

Computation and Language · Computer Science 2012-07-03 Yuhong Guo , Min Xiao

The ability to describe images with natural language sentences is the hallmark for image and language understanding. Such a system has wide ranging applications such as annotating images and using natural sentences to search for images.In…

Machine Learning · Computer Science 2016-01-15 Afroze Ibrahim Baqapuri

This paper addresses spoken language identification (SLI) and speech recognition of multilingual broadcast and institutional speech, real application scenarios that have been rarely addressed in the SLI literature. Observing that in these…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-14 Martina Valente , Fabio Brugnara , Giovanni Morrone , Enrico Zovato , Leonardo Badino

Cross-lingual representations have the potential to make NLP techniques available to the vast majority of languages in the world. However, they currently require large pretraining corpora or access to typologically similar languages. In…

Computation and Language · Computer Science 2021-06-22 Wei Zhao , Steffen Eger , Johannes Bjerva , Isabelle Augenstein

Language identification for code-switching (CS), the phenomenon of alternating between two or more languages in conversations, has traditionally been approached under the assumption of a single language per token. However, if at least one…

Computation and Language · Computer Science 2019-04-04 Manuel Mager , Özlem Çetinoğlu , Katharina Kann

This paper develops an approach to language identification in which the set of languages considered by the model depends on the geographic origin of the text in question. Given that many digital corpora can be geo-referenced at the country…

Computation and Language · Computer Science 2024-03-18 Jonathan Dunn , Lane Edwards-Brown

We describe an LSTM-based model which we call Byte-to-Span (BTS) that reads text as bytes and outputs span annotations of the form [start, length, label] where start positions, lengths, and labels are separate entries in our vocabulary.…

Computation and Language · Computer Science 2016-04-05 Dan Gillick , Cliff Brunk , Oriol Vinyals , Amarnag Subramanya

We propose a new approach to natural language understanding in which we consider the input text as an image and apply 2D Convolutional Neural Networks to learn the local and global semantics of the sentences from the variations ofthe visual…