English
Related papers

Related papers: Performance of Recent Large Language Models for a …

200 papers

Large Language Models (LLMs) have demonstrated remarkable success across a wide range of tasks and domains. However, their performance in low-resource language translation, particularly when translating into these languages, remains…

Large language models (LLMs) have achieved impressive results in a wide range of natural language applications. However, they often struggle to recognize low-resource languages, in particular African languages, which are not well…

Computation and Language · Computer Science 2025-04-10 Happy Buzaaba , Alexander Wettig , David Ifeoluwa Adelani , Christiane Fellbaum

Although LLMs have attained significant success in high-resource languages, their capacity in low-resource linguistic environments like Kannada and Arabic is not yet fully understood. This work benchmarking the performance of multilingual…

Computation and Language · Computer Science 2025-07-29 Maitha Alshehhi , Ahmed Sharshar , Mohsen Guizani

Purpose: The performance of three different large language models (LLMS) (GPT-3.5, GPT-4, and PaLM2) in answering ophthalmology professional questions was evaluated and compared with that of three different professional populations (medical…

Computation and Language · Computer Science 2023-11-10 Jason Holmes , Shuyuan Ye , Yiwei Li , Shi-Nan Wu , Zhengliang Liu , Zihao Wu , Jinyu Hu , Huan Zhao , Xi Jiang , Wei Liu , Hong Wei , Jie Zou , Tianming Liu , Yi Shao

Large language models (LLMs) have revolutionized the state-of-the-art of many different natural language processing tasks. Although serving LLMs is computationally and memory demanding, the rise of Small Language Models (SLMs) offers new…

Computation and Language · Computer Science 2025-08-11 Pol G. Recasens , Yue Zhu , Chen Wang , Eun Kyung Lee , Olivier Tardieu , Alaa Youssef , Jordi Torres , Josep Ll. Berral

Large Language Models (LLMs) demonstrate capabilities in code generation, potentially boosting developer productivity. However, their adoption remains limited by high computational costs, among other factors. Small Language Models (SLMs)…

Software Engineering · Computer Science 2025-09-23 Débora Souza , Rohit Gheyi , Lucas Albuquerque , Gustavo Soares , Márcio Ribeiro

Large Language Models (LLMs), such as Generative Pre-trained Transformers (GPTs) are revolutionizing the generation of human-like text, producing contextually relevant and syntactically correct content. Despite challenges like biases and…

Computation and Language · Computer Science 2025-08-04 Alper Yaman , Jannik Schwab , Christof Nitsche , Abhirup Sinha , Marco Huber

Recent large language models (LLMs) demonstrate impressive capabilities in handling long contexts, some exhibiting near-perfect recall on synthetic retrieval tasks. However, these evaluations have mainly focused on English text and involved…

Computation and Language · Computer Science 2024-10-15 Ameeta Agrawal , Andy Dang , Sina Bagheri Nezhad , Rhitabrat Pokharel , Russell Scheinberg

The landscape of Large Language Models remains predominantly English-centric, resulting in a significant performance gap for other major languages, such as French, especially in the context of Small Language Models (SLMs). Existing…

Computation and Language · Computer Science 2026-02-10 Maxence Lasbordes , Sinoué Gad

Software languages evolve over time for reasons such as feature additions. When grammars evolve, textual instances that originally conformed to them may become outdated. While model-driven engineering provides many techniques for…

Software Engineering · Computer Science 2026-02-13 Weixing Zhang , Bowen Jiang , Yuhong Fu , Anne Koziolek , Regina Hebig , Daniel Strüber

"Bigger the better" has been the predominant trend in recent Large Language Models (LLMs) development. However, LLMs do not suit well for scenarios that require on-device processing, energy efficiency, low memory footprint, and response…

Computation and Language · Computer Science 2024-02-27 Omkar Thawakar , Ashmal Vayani , Salman Khan , Hisham Cholakal , Rao M. Anwer , Michael Felsberg , Tim Baldwin , Eric P. Xing , Fahad Shahbaz Khan

Large Language Models (LLMs) have emerged as one of the most important breakthroughs in NLP for their impressive skills in language generation and other language-specific tasks. Though LLMs have been evaluated in various tasks, mostly in…

Computation and Language · Computer Science 2024-03-20 Mohsinul Kabir , Mohammed Saidul Islam , Md Tahmid Rahman Laskar , Mir Tafseer Nayeem , M Saiful Bari , Enamul Hoque

This paper presents a study on strategies to enhance the translation capabilities of large language models (LLMs) in the context of machine translation (MT) tasks. The paper proposes a novel paradigm consisting of three stages: Secondary…

Computation and Language · Computer Science 2024-04-16 Jiaxin Guo , Hao Yang , Zongyao Li , Daimeng Wei , Hengchao Shang , Xiaoyu Chen

Spell correction is still a challenging problem for low-resource languages (LRLs). While pretrained language models (PLMs) have been employed for spell correction, their use is still limited to a handful of languages, and there has been no…

Computation and Language · Computer Science 2025-12-12 Akesh Gunathilake , Nadil Karunarathna , Tharusha Bandaranayake , Nisansa de Silva , Surangika Ranathunga

Despite the recent popularity of Large Language Models (LLMs) in Machine Translation (MT), their performance in low-resource languages (LRLs) still lags significantly behind Neural Machine Translation (NMT) models. In this work, we explore…

Computation and Language · Computer Science 2024-10-07 Vivek Iyer , Bhavitvya Malik , Pavel Stepachev , Pinzhen Chen , Barry Haddow , Alexandra Birch

Background: Log messages provide valuable information about the status of software systems. This information is provided in an unstructured fashion and automated approaches are applied to extract relevant parameters. To ease this process,…

Software Engineering · Computer Science 2024-09-05 Merve Astekin , Max Hort , Leon Moonen

Recently, Large Language Models (LLMs) have shown impressive language capabilities. While most of the existing LLMs have very unbalanced performance across different languages, multilingual alignment based on translation parallel data is an…

Computation and Language · Computer Science 2024-06-19 Shimao Zhang , Changjiang Gao , Wenhao Zhu , Jiajun Chen , Xin Huang , Xue Han , Junlan Feng , Chao Deng , Shujian Huang

In recent years, large language models (LLMs) have achieved remarkable success in natural language processing (NLP). LLMs require an extreme amount of parameters to attain high performance. As models grow into the trillion-parameter range,…

Computation and Language · Computer Science 2024-09-10 Zhyar Rzgar K Rostam , Sándor Szénási , Gábor Kertész

Large Language Models (LLMs) have demonstrated impressive capabilities across a range of scientific tasks including mathematics, physics, and chemistry. Despite their successes, the effectiveness of LLMs in handling complex statistical…

Computation and Language · Computer Science 2024-10-11 Yizhang Zhu , Shiyin Du , Boyan Li , Yuyu Luo , Nan Tang

Large language models (LLMs) have shown exceptional performance across various text generation tasks but remain under-explored in the patent domain, which offers highly structured and precise language. This paper constructs a dataset to…

Computation and Language · Computer Science 2025-05-27 Lekang Jiang , Caiqi Zhang , Pascal A Scherz , Stephan Goetz