English
Related papers

Related papers: Performance Evaluation of Lightweight Open-source …

200 papers

Background: Log messages provide valuable information about the status of software systems. This information is provided in an unstructured fashion and automated approaches are applied to extract relevant parameters. To ease this process,…

Software Engineering · Computer Science 2024-09-05 Merve Astekin , Max Hort , Leon Moonen

Large Language Models (LLMs) have demonstrated promise in medical knowledge assessments, yet their practical utility in real-world clinical decision-making remains underexplored. In this study, we evaluated the performance of three…

Computation and Language · Computer Science 2025-12-30 Mengdi Chai , Ali R. Zomorrodi

Large Language Models (LLMs) have demonstrated remarkable performance across various information-seeking and reasoning tasks. These computational systems drive state-of-the-art dialogue systems, such as ChatGPT and Bard. They also carry…

Computation and Language · Computer Science 2023-10-13 Siyuan Brandon Loh , Aravind Sesagiri Raamkumar

Objective: To evaluate the efficiency of large language models (LLMs) such as ChatGPT to assist in diagnosing neuro-ophthalmic diseases based on detailed case descriptions. Methods: We selected 22 different case reports of neuro-ophthalmic…

Computers and Society · Computer Science 2023-09-25 Yeganeh Madadi , Mohammad Delsoz , Priscilla A. Lao , Joseph W. Fong , TJ Hollingsworth , Malik Y. Kahook , Siamak Yousefi

Background and Aims: This study evaluates the medical reasoning performance of large language models (LLMs) and vision language models (VLMs) in gastroenterology. Methods: We used 300 gastroenterology board exam-style multiple-choice…

As large language models (LLMs) become more common in educational tools and programming environments, questions arise about how these systems should interact with users. This study investigates how different interaction styles with…

Human-Computer Interaction · Computer Science 2025-07-08 Kai Deng

Upon its release in late 2022, ChatGPT has brought a seismic shift in the entire landscape of AI, both in research and commerce. Through instruction-tuning a large language model (LLM) with supervised fine-tuning and reinforcement learning…

Computation and Language · Computer Science 2024-01-17 Hailin Chen , Fangkai Jiao , Xingxuan Li , Chengwei Qin , Mathieu Ravaut , Ruochen Zhao , Caiming Xiong , Shafiq Joty

Purpose: The performance of three different large language models (LLMS) (GPT-3.5, GPT-4, and PaLM2) in answering ophthalmology professional questions was evaluated and compared with that of three different professional populations (medical…

Computation and Language · Computer Science 2023-11-10 Jason Holmes , Shuyuan Ye , Yiwei Li , Shi-Nan Wu , Zhengliang Liu , Zihao Wu , Jinyu Hu , Huan Zhao , Xi Jiang , Wei Liu , Hong Wei , Jie Zou , Tianming Liu , Yi Shao

Large language models (LLMs) have rapidly advanced in clinical decision-making, yet the deployment of proprietary systems is hindered by privacy concerns and reliance on cloud-based infrastructure. Open-source alternatives allow local…

Computation and Language · Computer Science 2026-04-29 Alif Munim , Jun Ma , Omar Ibrahim , Alhusain Abdalla , Shuolin Yin , Leo Chen , Bo Wang

The application of large language models (LLMs) to healthcare information extraction has emerged as a promising approach. This study evaluates the classification performance of five open-source LLMs: GEMMA-3-27B-IT, LLAMA3-70B, LLAMA4-109B,…

Computation and Language · Computer Science 2025-05-09 Yuting Guo , Abeed Sarker

Although both Google Gemini (1.5 Flash) and ChatGPT (4o and 4o-mini) give research quality evaluation scores that correlate positively with expert scores in nearly all fields, and more strongly that citations in most, it is not known…

Digital Libraries · Computer Science 2025-08-12 Mike Thelwall

Incorporating large language models (LLMs) in medical question answering demands more than high average accuracy: a model that returns substantively different answers each time it is queried is not a reliable medical tool. Online health…

Information Retrieval · Computer Science 2026-04-14 Avi-ad Avraam Buskila

Large Language Models (LLMs) are advanced Artificial Intelligence (AI) systems that have undergone extensive training using large datasets in order to understand and produce language that closely resembles that of humans. These models have…

Software Engineering · Computer Science 2023-08-10 Alessio Buscemi

The integration of Artificial Intelligence (AI) in healthcare presents a transformative potential for enhancing operational efficiency and health outcomes. Large Language Models (LLMs), such as ChatGPT, have shown their capabilities in…

Computation and Language · Computer Science 2024-05-03 Dou Liu , Ying Han , Xiandi Wang , Xiaomei Tan , Di Liu , Guangwu Qian , Kang Li , Dan Pu , Rong Yin

Effective physician-patient communications in pre-diagnostic environments, and most specifically in complex and sensitive medical areas such as infertility, are critical but consume a lot of time and, therefore, cause clinic workflows to…

Computation and Language · Computer Science 2025-04-02 Dou Liu , Ying Long , Sophia Zuoqiu , Tian Tang , Rong Yin

Recent advances in large language models (LLMs) have shown impressive ability in biomedical question-answering, but have not been adequately investigated for more specific biomedical applications. This study investigates the performance of…

Computation and Language · Computer Science 2024-03-29 Shan Chen , Yingya Li , Sheng Lu , Hoang Van , Hugo JWL Aerts , Guergana K. Savova , Danielle S. Bitterman

Large language models (LLMs), such as GPT-4, PaLM, and LLaMa, have been shown to achieve remarkable performance across a variety of natural language tasks. Recent advancements in instruction tuning bring LLMs with ability in following…

Computation and Language · Computer Science 2023-09-12 Vu-Thuan Doan , Quoc-Truong Truong , Duc-Vu Nguyen , Vinh-Tiep Nguyen , Thuy-Ngan Nguyen Luu

Large language models (LLMs), such as ChatGPT, have received substantial attention due to their capabilities for understanding and generating human language. While there has been a burgeoning trend in research focusing on the employment of…

Background: Advances in artificial intelligence, particularly large language models (LLMs), have the potential to enhance technical expertise in magnetic resonance imaging (MRI), regardless of operator skill or geographic location. Methods:…

Medical Physics · Physics 2024-11-20 Alan B McMillan

We introduce ChatGLM, an evolving family of large language models that we have been developing over time. This report primarily focuses on the GLM-4 language series, which includes GLM-4, GLM-4-Air, and GLM-4-9B. They represent our most…