English
Related papers

Related papers: AfroLID: A Neural Language Identification Tool for…

200 papers

Identifying closely related languages at sentence level is difficult, in particular because it is often impossible to assign a sentence to a single language. In this paper, we focus on multi-label sentence-level Scandinavian language…

In this paper we present our submission for the NorSID Shared Task as part of the 2025 VarDial Workshop (Scherrer et al., 2025), consisting of three tasks: Intent Detection, Slot Filling and Dialect Identification, evaluated using data in…

Computation and Language · Computer Science 2025-01-10 Jaione Bengoetxea , Mikel Zubillaga , Ekhi Azurmendi , Maite Heredia , Julen Etxaniz , Markel Ferro , Jeremy Barnes

Existing AI bias evaluation benchmarks largely reflect Western perspectives, leaving African contexts underrepresented and enabling harmful stereotypes in applications across various domains. To address this gap, we introduce AfriStereo,…

Computation and Language · Computer Science 2025-12-01 Yann Le Beux , Oluchi Audu , Oche D. Ankeli , Dhananjay Balakrishnan , Melissah Weya , Marie D. Ralaiarinosy , Ignatius Ezeani

Over the last few years natural language interfaces (NLI) for databases have gained significant traction both in academia and industry. These systems use very different approaches as described in recent survey papers. However, these systems…

Databases · Computer Science 2019-09-05 Katrin Affolter , Kurt Stockinger , Abraham Bernstein

Neural retrieval and GPT-style generative models rely on large, high-quality supervised data, which is still scarce for low-resource languages such as Amharic. We release an Amharic data resource consisting of two datasets that supports…

Computation and Language · Computer Science 2026-02-11 Tilahun Yeshambel , Moncef Garouani , Josiane Mothe

Phishing attacks represent a significant cybersecurity threat, necessitating adaptive detection techniques. This study explores few-shot Adaptive Linguistic Prompting (ALP) in detecting phishing webpages through the multimodal capabilities…

Computation and Language · Computer Science 2025-08-26 Atharva Bhargude , Ishan Gonehal , Dave Yoon , Kaustubh Vinnakota , Chandler Haney , Aaron Sandoval , Kevin Zhu

This paper provides language identification models for low- and under-resourced languages in the Pacific region with a focus on previously unavailable Austronesian languages. Accurate language identification is an important part of…

Computation and Language · Computer Science 2022-06-10 Jonathan Dunn , Wikke Nijhof

This paper describes the WiLI-2018 benchmark dataset for monolingual written natural language identification. WiLI-2018 is a publicly available, free of charge dataset of short text extracts from Wikipedia. It contains 1000 paragraphs of…

Computer Vision and Pattern Recognition · Computer Science 2018-01-25 Martin Thoma

High-resource languages such as English, enables the pretraining of high-quality large language models (LLMs). The same can not be said for most other languages as LLMs still underperform for non-English languages, likely due to a gap in…

Computation and Language · Computer Science 2025-02-20 Jiayi Wang , Yao Lu , Maurice Weber , Max Ryabinin , David Adelani , Yihong Chen , Raphael Tang , Pontus Stenetorp

Large language models hold significant promise in multilingual applications. However, inherent biases stemming from predominantly English-centric pre-training have led to the widespread practice of pre-translation, i.e., translating…

Computation and Language · Computer Science 2024-03-11 Yotam Intrator , Matan Halfon , Roman Goldenberg , Reut Tsarfaty , Matan Eyal , Ehud Rivlin , Yossi Matias , Natalia Aizenberg

In the pursuit of supporting more languages around the world, tools that characterize properties of languages play a key role in expanding the existing multilingual NLP research. In this study, we focus on a widely used typological…

Computation and Language · Computer Science 2024-05-21 Hasti Toossi , Guo Qing Huai , Jinyu Liu , Eric Khiu , A. Seza Doğruöz , En-Shiun Annie Lee

Advances in Natural Language Processing (NLP) have revolutionized the way researchers and practitioners address crucial societal problems. Large language models are now the standard to develop state-of-the-art solutions for text detection…

Machine Learning · Computer Science 2022-05-20 Gaurav Verma , Rohit Mujumdar , Zijie J. Wang , Munmun De Choudhury , Srijan Kumar

This paper introduces and motivates the use of hybrid robust feature extraction technique for spoken language identification (LID) system. The speech recognizers use a parametric form of a signal to get the most important distinguishable…

Sound · Computer Science 2010-03-31 Pawan Kumar , Astik Biswas , A . N. Mishra , Mahesh Chandra

The growing importance of culturally-aware natural language processing systems has led to an increasing demand for resources that capture sociopragmatic phenomena across diverse languages. Nevertheless, Arabic-language resources for…

Text-rich images, where text serves as the central visual element guiding the overall understanding, are prevalent in real-world applications, such as presentation slides, scanned documents, and webpage snapshots. Tasks involving multiple…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Mengzhao Jia , Wenhao Yu , Kaixin Ma , Tianqing Fang , Zhihan Zhang , Siru Ouyang , Hongming Zhang , Dong Yu , Meng Jiang

The identification of analytic tasks from free text is critical for visualization-oriented natural language interfaces (V-NLIs) to suggest effective visualizations. However, it is challenging due to the ambiguity and complexity nature of…

Computation and Language · Computer Science 2020-12-04 Siwei Fu , Kai Xiong , Xiaodong Ge , Siliang Tang , Wei Chen , Yingcai Wu

Open-source large language models (LLMs) have gained significant strength across diverse fields. Nevertheless, the majority of studies primarily concentrate on English, with only limited exploration into the realm of multilingual abilities.…

Computation and Language · Computer Science 2024-02-20 Haoyu Wang , Shuo Wang , Yukun Yan , Xujia Wang , Zhiyu Yang , Yuzhuang Xu , Zhenghao Liu , Liner Yang , Ning Ding , Xu Han , Zhiyuan Liu , Maosong Sun

Extensive works have tackled Language Identification (LID) in the speech domain, however their application to the singing voice trails and performances on Singing Language Identification (SLID) can be improved leveraging recent progresses…

Sound · Computer Science 2021-06-01 Lenny Renault , Andrea Vaglio , Romain Hennequin

There are more than 7,000 languages around the world, and current Large Language Models (LLMs) only support hundreds of languages. Dictionary-based prompting methods can enhance translation on them, but most methods use all the available…

Computation and Language · Computer Science 2026-05-20 Hongyuan Lu , Zixuan Li , Zefan Zhang , Wai Lam

We introduce FinNLI, a benchmark dataset for Financial Natural Language Inference (FinNLI) across diverse financial texts like SEC Filings, Annual Reports, and Earnings Call transcripts. Our dataset framework ensures diverse…

Computation and Language · Computer Science 2025-04-24 Jabez Magomere , Elena Kochkina , Samuel Mensah , Simerjot Kaur , Charese H. Smiley