English
Related papers

Related papers: Beyond English: Evaluating LLMs for Arabic Grammat…

200 papers

Recent claims suggest that large language models (LMs) underperform humans in comprehending minimally complex English statements (Dentella et al., 2024). Here, we revisit those findings and argue that human performance was overestimated,…

Computation and Language · Computer Science 2025-05-15 Adele E Goldberg , Supantho Rakshit , Jennifer Hu , Kyle Mahowald

The NLI4CT task assesses Natural Language Inference systems in predicting whether hypotheses entail or contradict evidence from Clinical Trial Reports. In this study, we evaluate various Large Language Models (LLMs) with multiple…

Computation and Language · Computer Science 2024-04-02 Aryo Pradipta Gema , Giwon Hong , Pasquale Minervini , Luke Daines , Beatrice Alex

The predominance of English and Latin-based large language models (LLMs) has led to a notable deficit in native Arabic LLMs. This discrepancy is accentuated by the prevalent inclusion of English tokens in existing Arabic models, detracting…

Computation and Language · Computer Science 2024-02-27 Anis Koubaa , Adel Ammar , Lahouari Ghouti , Omar Najar , Serry Sibaee

This paper presents a simple recipe to train state-of-the-art multilingual Grammatical Error Correction (GEC) models. We achieve this by first proposing a language-agnostic method to generate a large number of synthetic examples. The second…

Computation and Language · Computer Science 2022-08-10 Sascha Rothe , Jonathan Mallinson , Eric Malmi , Sebastian Krause , Aliaksei Severyn

Recently, Large Language Models (LLMs) have been widely studied by researchers for their roles in various downstream NLP tasks. As a fundamental task in the NLP field, Chinese Grammatical Error Correction (CGEC) aims to correct all…

Computation and Language · Computer Science 2024-09-20 Yinghui Li , Shang Qin , Haojing Huang , Yangning Li , Libo Qin , Xuming Hu , Wenhao Jiang , Hai-Tao Zheng , Philip S. Yu

Providing effective feedback is important for student learning in programming problem-solving. In this sense, Large Language Models (LLMs) have emerged as potential tools to automate feedback generation. However, their reliability and…

Software Engineering · Computer Science 2025-03-20 Priscylla Silva , Evandro Costa

This study evaluates the performance of Large Language Models (LLMs) as an Artificial Intelligence-based tutor for a university course. In particular, different advanced techniques are utilized, such as prompt engineering,…

In the rapidly evolving field of natural language processing, the translation of linguistic descriptions into mathematical formulation of optimization problems presents a formidable challenge, demanding intricate understanding and…

Computation and Language · Computer Science 2024-03-05 Tasnim Ahmed , Salimur Choudhury

Recent work on Grammatical Error Correction (GEC) has highlighted the importance of language modeling in that it is certainly possible to achieve good performance by comparing the probabilities of the proposed edits. At the same time,…

Computation and Language · Computer Science 2019-06-06 Dimitrios Alikaniotis , Vipul Raheja

In the current era of digital communication and widespread use of social media, it is crucial to develop an understanding of persuasive techniques employed in written text. This knowledge is essential for effectively discerning accurate…

Computation and Language · Computer Science 2024-05-22 Abdurahmman Alzahrani , Eyad Babkier , Faisal Yanbaawi , Firas Yanbaawi , Hassan Alhuzali

This paper investigates various approaches using Large Language Models (LLMs) to identify gaps and misconceptions in students' self-explanations of specific instructional material, in our case explanations of code examples. This research is…

Computers and Society · Computer Science 2025-01-22 Priti Oli , Rabin Banjade , Andrew M. Olney , Vasile Rus

Large language models (LLMs), such as GPT-4, PaLM, and LLaMa, have been shown to achieve remarkable performance across a variety of natural language tasks. Recent advancements in instruction tuning bring LLMs with ability in following…

Computation and Language · Computer Science 2023-09-12 Vu-Thuan Doan , Quoc-Truong Truong , Duc-Vu Nguyen , Vinh-Tiep Nguyen , Thuy-Ngan Nguyen Luu

Systematic reviews are vital for guiding practice, research, and policy, yet they are often slow and labour-intensive. Large language models (LLMs) could offer a way to speed up and automate systematic reviews, but their performance in such…

Computation and Language · Computer Science 2024-04-11 Qusai Khraisha , Sophie Put , Johanna Kappenberg , Azza Warraitch , Kristin Hadfield

Large Language Models (LLMs) have shown impressive results in multiple domains of natural language processing (NLP) but are mainly focused on the English language. Recently, more LLMs have incorporated a larger proportion of multilingual…

Pre-trained Language Models (PLMs) have the potential to transform mental health support by providing accessible and culturally sensitive resources. However, despite this potential, their effectiveness in mental health care and specifically…

Computation and Language · Computer Science 2024-06-25 Hassan Alhuzali , Ashwag Alasmari

This study explores enhancing grammatical error correction (GEC) through artificial error generation (AEG) using language models (LMs). Specifically, we fine-tune Llama 2-based LMs for error generation and find that this approach yields…

Computation and Language · Computer Science 2024-10-07 Agnes Luhtaru , Taido Purason , Martin Vainikko , Maksym Del , Mark Fishel

Grammatical error correction is a significant task in NLP. Traditional methods based on encoder-decoder models have achieved certain success, but the application of LLMs in this field is still underexplored. Current research predominantly…

Computation and Language · Computer Science 2025-08-27 Yilin Li , Xunjian Yin , Yilin Chen , Xiaojun Wan

Building high-quality large language models (LLMs) for enterprise Arabic applications remains challenging due to the limited availability of digitized Arabic data. In this work, we present a data synthesis and refinement strategy to help…

Previously, neural methods in grammatical error correction (GEC) did not reach state-of-the-art results compared to phrase-based statistical machine translation (SMT) baselines. We demonstrate parallels between neural GEC and low-resource…

Computation and Language · Computer Science 2018-04-18 Marcin Junczys-Dowmunt , Roman Grundkiewicz , Shubha Guha , Kenneth Heafield

As educational systems evolve, ensuring that assessment items remain aligned with content standards is essential for maintaining fairness and instructional relevance. Traditional human alignment reviews are accurate but slow and…

Artificial Intelligence · Computer Science 2025-11-26 Farzan Karimi-Malekabadi , Pooya Razavi , Sonya Powers