English
Related papers

Related papers: Controlled Evaluation of Syntactic Knowledge in Mu…

200 papers

Propositional Linear Temporal Logic (LTL) is a popular formalism for specifying desirable requirements and security and privacy policies for software, networks, and systems. Yet expressing such requirements and policies in LTL remains…

Logic in Computer Science · Computer Science 2026-04-09 Priscilla Kyei Danso , Mohammad Saqib Hasan , Niranjan Balasubramanian , Omar Chowdhury

Text Simplification is a task that has been minimally explored for low-resource languages. Consequently, there are only a few manually curated datasets. In this paper, we present a human curated sentence-level text simplification dataset…

Computation and Language · Computer Science 2024-12-03 Surangika Ranathunga , Rumesh Sirithunga , Himashi Rathnayake , Lahiru De Silva , Thamindu Aluthwala , Saman Peramuna , Ravi Shekhar

The deployment of Large Language Models (LLMs) in real-world applications presents both opportunities and challenges, particularly in multilingual and code-mixed communication settings. This research evaluates the performance of seven…

Computation and Language · Computer Science 2024-06-14 Millicent Ochieng , Varun Gumma , Sunayana Sitaram , Jindong Wang , Vishrav Chaudhary , Keshet Ronen , Kalika Bali , Jacki O'Neill

Pre-trained multilingual language models play an important role in cross-lingual natural language understanding tasks. However, existing methods did not focus on learning the semantic structure of representation, and thus could not optimize…

Computation and Language · Computer Science 2022-11-03 Mingqi Li , Fei Ding , Dan Zhang , Long Cheng , Hongxin Hu , Feng Luo

Current large language models (LLMs) often exhibit imbalances in multilingual capabilities and cultural adaptability, largely attributed to their English-centric pre-training data. In this paper, we introduce and investigate cross-lingual…

Computation and Language · Computer Science 2026-04-13 Yangfan Ye , Xiaocheng Feng , Xiachong Feng , Libo Qin , Yichong Huang , Lei Huang , Weitao Ma , Qichen Hong , Zhirui Zhang , Yunfei Lu , Xiaohui Yan , Duyu Tang , Dandan Tu , Bing Qin

Despite the widespread availability of LLMs, there remains a substantial gap in their capabilities and availability across diverse languages. One approach to address these issues has been to take an existing pre-trained LLM and continue to…

Computation and Language · Computer Science 2024-07-19 Zoltan Csaki , Bo Li , Jonathan Li , Qiantong Xu , Pian Pawakapan , Leon Zhang , Yun Du , Hengyu Zhao , Changran Hu , Urmish Thakker

Large-scale Pretrained Language Models (LLMs), such as ChatGPT and GPT4, have shown strong abilities in multilingual translations, without being explicitly trained on parallel corpora. It is interesting how the LLMs obtain their ability to…

Computation and Language · Computer Science 2024-04-16 Jiahuan Li , Hao Zhou , Shujian Huang , Shanbo Cheng , Jiajun Chen

Although LLMs have attained significant success in high-resource languages, their capacity in low-resource linguistic environments like Kannada and Arabic is not yet fully understood. This work benchmarking the performance of multilingual…

Computation and Language · Computer Science 2025-07-29 Maitha Alshehhi , Ahmed Sharshar , Mohsen Guizani

Many attempts have been made in multilingual NLP to ensure that pre-trained language models, such as mBERT or GPT2 get better and become applicable to low-resource languages. To achieve multilingualism for pre-trained language models…

Computation and Language · Computer Science 2024-06-25 Jesse Atuhurra , Hiroyuki Shindo , Hidetaka Kamigaito , Taro Watanabe

This paper describes the University of Maryland's submission to the Special Task on Formality Control for Spoken Language Translation at \iwslt, which evaluates translation from English into 6 languages with diverse grammatical formality…

Computation and Language · Computer Science 2022-05-16 Elijah Rippeth , Sweta Agrawal , Marine Carpuat

Evaluating instruction-tuned Large Language Models (LLMs) in Hindi is challenging due to a lack of high-quality benchmarks, as direct translation of English datasets fails to capture crucial linguistic and cultural nuances. To address this,…

Computation and Language · Computer Science 2025-10-16 Anusha Kamath , Kanishk Singla , Rakesh Paul , Raviraj Joshi , Utkarsh Vaidya , Sanjay Singh Chauhan , Niranjan Wartikar

A recent study (Kuribayashi et al., 2025) has shown that human sentence processing behavior, typically measured on syntactically unchallenging constructions, can be effectively modeled using surprisal from early layers of large language…

Computation and Language · Computer Science 2026-04-21 Tatsuki Kuribayashi , Alex Warstadt , Yohei Oseki , Ethan Gotlieb Wilcox

While automatic metrics drive progress in Machine Translation (MT) and Text Summarization (TS), existing metrics have been developed and validated almost exclusively for English and other high-resource languages. This narrow focus leaves…

Computation and Language · Computer Science 2025-10-09 Amir Hossein Yari , Kalmit Kulkarni , Ahmad Raza Khan , Fajri Koto

Language models (LMs) have demonstrated remarkable proficiency in generating linguistically coherent text, sparking discussions about their relevance to understanding human language learnability. However, a significant gap exists between…

Computation and Language · Computer Science 2024-05-14 Yulu Qin , Wentao Wang , Brenden M. Lake

Large Language Models (LLMs) have demonstrated exceptional natural language understanding abilities and have excelled in a variety of natural language processing (NLP)tasks in recent years. Despite the fact that most LLMs are trained…

Computation and Language · Computer Science 2023-10-25 Xiang Zhang , Senyu Li , Bradley Hauer , Ning Shi , Grzegorz Kondrak

Recent advances in training multilingual language models on large datasets seem to have shown promising results in knowledge transfer across languages and achieve high performance on downstream tasks. However, we question to what extent the…

Computation and Language · Computer Science 2024-02-06 Sara Rajaee , Christof Monz

Transformer-based language models (LMs) continue to achieve state-of-the-art performance on natural language processing (NLP) benchmarks, including tasks designed to mimic human-inspired "commonsense" competencies. To better understand the…

Computation and Language · Computer Science 2022-05-13 Antonio Laverghetta , Animesh Nighojkar , Jamshidbek Mirzakhalov , John Licato

This chapter critically examines the potential contributions of modern language models to theoretical linguistics. Despite their focus on engineering goals, these models' ability to acquire sophisticated linguistic knowledge from mere…

Computation and Language · Computer Science 2024-08-15 Raphaël Millière

Neural language modeling (LM) has led to significant improvements in several applications, including Automatic Speech Recognition. However, they typically require large amounts of training data, which is not available for many domains and…

Computation and Language · Computer Science 2019-06-05 Navid Rekabsaz , Nikolaos Pappas , James Henderson , Banriskhem K. Khonglah , Srikanth Madikeri

The rise of digital misinformation has heightened interest in using multilingual Large Language Models (LLMs) for fact-checking. This study systematically evaluates translation bias and the effectiveness of LLMs for cross-lingual claim…

Computation and Language · Computer Science 2024-10-15 Aryan Singhal , Veronica Shao , Gary Sun , Ryan Ding , Jonathan Lu , Kevin Zhu