English
Related papers

Related papers: Language Detection Engine for Multilingual Texting…

200 papers

Large language models (LLMs) are trained on text-only data that go far beyond the languages with paired speech and text data. At the same time, Dual Encoder (DE) based retrieval systems project queries and documents into the same embedding…

Computation and Language · Computer Science 2024-07-11 Frank Palma Gomez , Ramon Sanabria , Yun-hsuan Sung , Daniel Cer , Siddharth Dalmia , Gustavo Hernandez Abrego

Recent advancements in large language models (LLMs) have remarkably enhanced performances on a variety of tasks in multiple languages. However, tokenizers in LLMs trained primarily on English-centric corpora often overly fragment a text…

Computation and Language · Computer Science 2024-08-07 Jimin Hong , Gibbeum Lee , Jaewoong Cho

Large language models (LLMs) have transformed human writing by enhancing grammar correction, content expansion, and stylistic refinement. However, their widespread use raises concerns about authorship, originality, and ethics, even…

Computation and Language · Computer Science 2024-10-21 Zhen Tao , Zhiyu Li , Runyu Chen , Dinghao Xi , Wei Xu

Document comparison typically relies on optical character recognition (OCR) as its core technology. However, OCR requires the selection of appropriate language models for each document and the performance of multilingual or hybrid models…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Doyoung Park , Naresh Reddy Yarram , Sunjin Kim , Minkyu Kim , Seongho Cho , Taehee Lee

Spoken language identification (LID) technologies have improved in recent years from discriminating largely distinct languages to discriminating highly similar languages or even dialects of the same language. One aspect that has been mostly…

Audio and Speech Processing · Electrical Eng. & Systems 2020-01-30 Andrew Titus , Jan Silovsky , Nanxin Chen , Roger Hsiao , Mary Young , Arnab Ghoshal

Rich textual and topological information of textual graphs need to be modeled in real-world applications such as webpages, e-commerce, and academic articles. Practitioners have been long following the path of adopting a shallow text encoder…

Computation and Language · Computer Science 2024-07-25 Yun Zhu , Yaoke Wang , Haizhou Shi , Siliang Tang

Recent LLMs are able to generate high-quality multilingual texts, indistinguishable for humans from authentic human-written ones. Research in machine-generated text detection is however mostly focused on the English language and longer…

Computation and Language · Computer Science 2025-07-28 Dominik Macko , Jakub Kopal , Robert Moro , Ivan Srba

Finding ways to accelerate text input for individuals with profound motor impairments has been a long-standing area of research. Closing the speed gap for augmentative and alternative communication (AAC) devices such as eye-tracking…

Detecting AI-generated text is an increasing necessity to combat misuse of LLMs in education, business compliance, journalism, and social media, where synthetic fluency can mask misinformation or deception. While prior detectors often rely…

Computation and Language · Computer Science 2026-02-26 Advik Raj Basani , Pin-Yu Chen

There are more than 7,000 languages around the world, and current Large Language Models (LLMs) only support hundreds of languages. Dictionary-based prompting methods can enhance translation on them, but most methods use all the available…

Computation and Language · Computer Science 2026-05-20 Hongyuan Lu , Zixuan Li , Zefan Zhang , Wai Lam

Language Identification (LID) is a challenging task, especially when the input texts are short and noisy such as posts and statuses on social media or chat logs on gaming forums. The task has been tackled by either designing a feature set…

Computation and Language · Computer Science 2019-10-16 Duy Tin Vo , Richard Khoury

The prevalence of Large Language Models (LLMs) for generating multilingual text and source code has only increased the imperative for machine-generated content detectors to be accurate and efficient across domains. Current detectors,…

Computation and Language · Computer Science 2025-10-23 Shriyansh Agrawal , Aidan Lau , Sanyam Shah , Ahan M R , Kevin Zhu , Sunishchal Dev , Vasu Sharma

Recent advancements in Generative AI and Large Language Models (LLMs) have enabled the creation of highly realistic synthetic content, raising concerns about the potential for malicious use, such as misinformation and manipulation.…

Computation and Language · Computer Science 2025-06-02 Andrea Pedrotti , Michele Papucci , Cristiano Ciaccio , Alessio Miaschi , Giovanni Puccetti , Felice Dell'Orletta , Andrea Esuli

The burgeoning progress in the field of Large Language Models (LLMs) heralds significant benefits due to their unparalleled capacities. However, it is critical to acknowledge the potential misuse of these models, which could give rise to a…

Computation and Language · Computer Science 2023-08-07 Haolan Zhan , Xuanli He , Qiongkai Xu , Yuxiang Wu , Pontus Stenetorp

The Large Language Model (LLM) is widely employed for tasks such as intelligent assistants, text summarization, translation, and multi-modality on mobile phones. However, the current methods for on-device LLM deployment maintain slow…

Computation and Language · Computer Science 2024-07-08 Luchang Li , Sheng Qian , Jie Lu , Lunxi Yuan , Rui Wang , Qin Xie

The task of automatically identifying a language used in a given text is called Language Identification (LI). India is a multilingual country and many Indians especially youths are comfortable with Hindi and English, in addition to their…

Computation and Language · Computer Science 2022-11-21 H. L. Shashirekha , F. Balouchzahi , M. D. Anusha , G. Sidorov

This research conducts a comparative study on multilingual text classification methods, utilizing deep learning and embedding visualization. The study employs LangDetect, LangId, FastText, and Sentence Transformer on a dataset encompassing…

Computation and Language · Computer Science 2023-12-08 Arinjay Wyawhare

This paper proposes a new hierarchical MDL-based model for a joint detection and classification of multilingual text lines in im- ages taken by hand-held cameras. The majority of related text detec- tion methods assume alphabet-based…

Computer Vision and Pattern Recognition · Computer Science 2016-11-25 Igor Milevskiy , Yuri Boykov

The rapid adoption of large language models (LLMs) in customer service introduces new risks, as malicious actors can exploit them to conduct large-scale user impersonation through machine-generated text (MGT). Current MGT detection methods…

Computation and Language · Computer Science 2025-08-27 Angela Yifei Yuan , Haoyi Li , Soyeon Caren Han , Christopher Leckie

Multilingual end-to-end (E2E) models have shown great promise in expansion of automatic speech recognition (ASR) coverage of the world's languages. They have shown improvement over monolingual systems, and have simplified training and…

Audio and Speech Processing · Electrical Eng. & Systems 2019-09-13 Anjuli Kannan , Arindrima Datta , Tara N. Sainath , Eugene Weinstein , Bhuvana Ramabhadran , Yonghui Wu , Ankur Bapna , Zhifeng Chen , Seungji Lee