English
Related papers

Related papers: Performance Evaluation of Large Language Models in…

200 papers

The application of large language models (LLMs) to healthcare information extraction has emerged as a promising approach. This study evaluates the classification performance of five open-source LLMs: GEMMA-3-27B-IT, LLAMA3-70B, LLAMA4-109B,…

Computation and Language · Computer Science 2025-05-09 Yuting Guo , Abeed Sarker

Given a document in a source language, cross-lingual summarization (CLS) aims to generate a summary in a different target language. Recently, the emergence of Large Language Models (LLMs), such as GPT-3.5, ChatGPT and GPT-4, has attracted…

Computation and Language · Computer Science 2023-10-25 Jiaan Wang , Yunlong Liang , Fandong Meng , Beiqi Zou , Zhixu Li , Jianfeng Qu , Jie Zhou

Large Language Models (LLMs) have shown significant advances in the past year. In addition to new versions of GPT and Llama, several other LLMs have been introduced recently. Some of these are open models available for download and…

Computation and Language · Computer Science 2024-08-01 Ravindu Jayakody , Gihan Dias

Background and Aims: This study evaluates the medical reasoning performance of large language models (LLMs) and vision language models (VLMs) in gastroenterology. Methods: We used 300 gastroenterology board exam-style multiple-choice…

Bengali social media platforms have witnessed a sharp increase in hate speech, disproportionately affecting women and adolescents. While datasets such as BD-SHS provide a basis for structured evaluation, most prior approaches rely on either…

Computation and Language · Computer Science 2026-02-24 Akif Islam , Mohd Ruhul Ameen

Large language models (LLMs) have demonstrated potential applications in medicine, yet data privacy and computational burden limit their deployment in healthcare institutions. Open-source and lightweight versions of LLMs emerge as potential…

Machine Learning · Computer Science 2024-07-24 Qiuhong Wei , Ying Cui , Mengwei Ding , Yanqin Wang , Lingling Xiang , Zhengxiong Yao , Ceran Chen , Ying Long , Zhezhen Jin , Ximing Xu

Large language models (LLMs) have achieved remarkable success across various natural language processing tasks. However, most LLM models use traditional tokenizers like BPE and SentencePiece, which fail to capture the finer nuances of a…

Computation and Language · Computer Science 2025-05-26 Pramit Bhattacharyya , Arnab Bhattacharya

Generating discharge summaries is a crucial yet time-consuming task in clinical practice, essential for conveying pertinent patient information and facilitating continuity of care. Recent advancements in large language models (LLMs) have…

Computation and Language · Computer Science 2025-07-01 Yiming Li , Fang Li , Kirk Roberts , Licong Cui , Cui Tao , Hua Xu

Bengali text classification is a Significant task in natural language processing (NLP), where text is categorized into predefined labels. Unlike English, Bengali faces challenges due to the lack of extensive annotated datasets and…

Computation and Language · Computer Science 2026-01-21 Md Mahmudul Hoque , Md Mehedi Hassain , Md Hojaifa Tanvir , Rahul Nandy

Large Language Models (LLMs) have demonstrated promise in medical knowledge assessments, yet their practical utility in real-world clinical decision-making remains underexplored. In this study, we evaluated the performance of three…

Computation and Language · Computer Science 2025-12-30 Mengdi Chai , Ali R. Zomorrodi

While Machine Learning (ML) and Deep Learning (DL) models have been widely used for diabetes prediction, the use of Large Language Models (LLMs) for structured numerical data is still not well explored. In this study, we test the…

Computation and Language · Computer Science 2025-06-19 Shadman Sakib , Oishy Fatema Akhand , Ajwad Abrar

Reading comprehension systems for low-resource languages face significant challenges in handling unanswerable questions. These systems tend to produce unreliable responses when correct answers are absent from context. To solve this problem,…

Computation and Language · Computer Science 2026-03-06 Abrar Eyasir , Tahsin Ahmed , Muhammad Ibrahim

$\textbf{Objectives}$: Large Language Models (LLMs) such as ChatGPT and Med-PaLM have excelled in various medical question-answering tasks. However, these English-centric models encounter challenges in non-English clinical settings,…

Computation and Language · Computer Science 2024-01-31 Jiageng Wu , Xian Wu , Zhaopeng Qiu , Minghui Li , Yingying Zhang , Yefeng Zheng , Changzheng Yuan , Jie Yang

We analyze the performance of large language models (LLMs) on Text Style Transfer (TST), specifically focusing on sentiment transfer and text detoxification across three languages: English, Hindi, and Bengali. Text Style Transfer involves…

Computation and Language · Computer Science 2024-08-28 Sourabrata Mukherjee , Atul Kr. Ojha , Ondřej Dušek

As an Indo-Aryan language with limited available data, Chakma remains largely underrepresented in language models. In this work, we introduce a novel corpus of contextually coherent Bangla-transliterated Chakma, curated from Chakma…

Computation and Language · Computer Science 2025-11-27 Adity Khisa , Nusrat Jahan Lia , Tasnim Mahfuz Nafis , Zarif Masud , Tanzir Pial , Shebuti Rayana , Ahmedul Kabir

Large language models (LLMs) have achieved impressive results in high-resource languages like English, yet their effectiveness in low-resource and morphologically rich languages remains underexplored. In this paper, we present a…

Computation and Language · Computer Science 2026-02-13 Chengxuan Xia , Qianye Wu , Hongbin Guan , Sixuan Tian , Yilun Hao , Xiaoyu Wu

We propose a novel three-step prompt-tuning method for Bengali Grammatical Error Explanation (BGEE) using state-of-the-art large language models (LLMs) such as GPT-4, GPT-3.5 Turbo, and Llama-2-70b. Our approach involves identifying and…

Computation and Language · Computer Science 2025-04-09 Subhankar Maity , Aniket Deroy

Recent advances in Multilingual Large Language Models (MLLMs) have significantly enhanced cross-lingual conversational capabilities, yet modeling culturally nuanced and context-dependent communication remains a critical bottleneck.…

Computation and Language · Computer Science 2026-05-22 Md. Asaduzzaman Shuvo , Mahedi Hasan , Md. Tashin Parvez , Azizul Haque Noman , Md. Shafayet Hossain Ovi

Each new generation of English-oriented Large Language Models (LLMs) exhibits enhanced cross-lingual transfer capabilities and significantly outperforms older LLMs on low-resource languages. This prompts the question: Is there a need for…

Computation and Language · Computer Science 2024-12-16 Tamzeed Mahfuz , Satak Kumar Dey , Ruwad Naswan , Hasnaen Adil , Khondker Salman Sayeed , Haz Sameen Shahgir