English
Related papers

Related papers: Scaling Native Language Identification with Transf…

200 papers

This paper demonstrates that a progressively aligned language model can effectively bridge frozen vision encoders and large language models (LLMs). While the fundamental architecture and pre-training methods of vision encoders and LLMs have…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Junfei Xiao , Zheng Xu , Alan Yuille , Shen Yan , Boyu Wang

Language Identification (LI) is crucial for various natural language processing tasks, serving as a foundational step in applications such as sentiment analysis, machine translation, and information retrieval. In multilingual societies like…

Computation and Language · Computer Science 2025-03-13 Aniket Deroy , Subhankar Maity

Modular deep learning has been proposed for the efficient adaption of pre-trained models to new tasks, domains and languages. In particular, combining language adapters with task adapters has shown potential where no supervised data exists…

Computation and Language · Computer Science 2024-12-18 Jenny Kunz , Oskar Holmström

Despite the growing progress in Natural Language Inference (NLI) research, resources for the Bengali language remain extremely limited. Existing Bengali NLI datasets exhibit several inconsistencies, including annotation errors, ambiguous…

Computation and Language · Computer Science 2025-11-13 Farah Binta Haque , Md Yasin , Shishir Saha , Md Shoaib Akhter Rafi , Farig Sadeque

Natural Language Processing (NLP) helps empower intelligent machines by enhancing a better understanding of the human language for linguistic-based human-computer communication. Recent developments in computational power and the advent of…

Computation and Language · Computer Science 2021-03-02 Amirsina Torfi , Rouzbeh A. Shirvani , Yaser Keneshloo , Nader Tavaf , Edward A. Fox

Generative Large Language Models (LLMs) hold significant promise in healthcare, demonstrating capabilities such as passing medical licensing exams and providing clinical knowledge. However, their current use as information retrieval tools…

Autonomous tuning of particle accelerators is an active and challenging field of research with the goal of enabling novel accelerator technologies cutting-edge high-impact applications, such as physics discovery, cancer research and…

Computation and Language · Computer Science 2024-05-16 Jan Kaiser , Annika Eichler , Anne Lauscher

Nature language inference (NLI) task is a predictive task of determining the inference relationship of a pair of natural language sentences. With the increasing popularity of NLI, many state-of-the-art predictive models have been proposed…

Computation and Language · Computer Science 2018-11-13 Haohan Wang , Da Sun , Eric P. Xing

Pre-trained transformer language models (LMs) have in recent years become the dominant paradigm in applied NLP. These models have achieved state-of-the-art performance on tasks such as information extraction, question answering, sentiment…

Computation and Language · Computer Science 2025-04-14 Aidan Mannion , Thierry Chevalier , Didier Schwab , Lorraine Geouriot

Entity Matching (EM) involves identifying different data representations referring to the same entity from multiple data sources and is typically formulated as a binary classification problem. It is a challenging problem in data integration…

Computation and Language · Computer Science 2023-05-31 John Bosco Mugeni , Steven Lynden , Toshiyuki Amagasa , Akiyoshi Matono

This paper addresses spoken language identification (SLI) and speech recognition of multilingual broadcast and institutional speech, real application scenarios that have been rarely addressed in the SLI literature. Observing that in these…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-14 Martina Valente , Fabio Brugnara , Giovanni Morrone , Enrico Zovato , Leonardo Badino

Evaluating answers from state-of-the-art large language models (LLMs) is challenging: lexical metrics miss semantic nuances, whereas "LLM-as-Judge" scoring is computationally expensive. We re-evaluate a lightweight alternative --…

Computation and Language · Computer Science 2025-11-12 Sai Shridhar Balamurali , Lu Cheng

One of the challenges in a task oriented natural language application like the Google Assistant, Siri, or Alexa is to localize the output to many languages. This paper explores doing this by applying machine translation to the English…

Computation and Language · Computer Science 2021-07-12 Scott Roy , Cliff Brunk , Kyu-Young Kim , Justin Zhao , Markus Freitag , Mihir Kale , Gagan Bansal , Sidharth Mudgal , Chris Varano

We introduce MorphNLI, a modular step-by-step approach to natural language inference (NLI). When classifying the premise-hypothesis pairs into {entailment, contradiction, neutral}, we use a language model to generate the necessary edits to…

Computation and Language · Computer Science 2026-02-16 Vlad Andrei Negru , Robert Vacareanu , Camelia Lemnaru , Mihai Surdeanu , Rodica Potolea

Neural Network Language Models (NNLMs) for Virtual Assistants (VAs) are generally language-, region-, and in some cases, device-dependent, which increases the effort to scale and maintain them. Combining NNLMs for one or more of the…

Computation and Language · Computer Science 2024-03-28 Rricha Jalota , Lyan Verwimp , Markus Nussbaum-Thom , Amr Mousa , Arturo Argueta , Youssef Oualil

Deep learning models have achieved remarkable success in natural language inference (NLI) tasks. While these models are widely explored, they are hard to interpret and it is often unclear how and why they actually work. In this paper, we…

Computation and Language · Computer Science 2019-05-21 Reza Ghaeini , Xiaoli Z. Fern , Prasad Tadepalli

Transformer, as one of the most advanced neural network models in Natural Language Processing (NLP), exhibits diverse applications in the field of anomaly detection. To inspire research on Transformer-based anomaly detection, this review…

Machine Learning · Computer Science 2024-02-15 Mingrui Ma , Lansheng Han , Chunjie Zhou

Sign Language Translation (SLT) is a challenging task that aims to generate spoken language sentences from sign language videos, both of which have different grammar and word/gloss order. From a Neural Machine Translation (NMT) perspective,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Ozge Mercanoglu Sincan , Necati Cihan Camgoz , Richard Bowden

Spoken language recognition (SLR) is the task of automatically identifying the language present in a speech signal. Existing SLR models are either too computationally expensive or too large to run effectively on devices with limited…

Computation and Language · Computer Science 2023-06-06 Oriol Nieto , Zeyu Jin , Franck Dernoncourt , Justin Salamon

Current Natural Language Inference (NLI) models achieve impressive results, sometimes outperforming humans when evaluating on in-distribution test sets. However, as these models are known to learn from annotation artefacts and dataset…

Computation and Language · Computer Science 2022-10-24 Joe Stacey , Pasquale Minervini , Haim Dubossarsky , Marek Rei