中文
相关论文

相关论文: Benchmarking Open-Source Large Language Models on …

200 篇论文

Purpose: We investigated the utilization of privacy-preserving, locally-deployed, open-source Large Language Models (LLMs) to extract diagnostic information from free-text cardiovascular magnetic resonance (CMR) reports. Materials and…

计算机与社会 · 计算机科学 2025-06-03 Sina Amirrajab , Volker Vehof , Michael Bietenbeck , Ali Yilmaz

Large language models (LLMs) have rapidly advanced in clinical decision-making, yet the deployment of proprietary systems is hindered by privacy concerns and reliance on cloud-based infrastructure. Open-source alternatives allow local…

计算与语言 · 计算机科学 2026-04-29 Alif Munim , Jun Ma , Omar Ibrahim , Alhusain Abdalla , Shuolin Yin , Leo Chen , Bo Wang

Both encoder-only models (e.g., BERT, RoBERTa) and large language models (LLMs, e.g., Llama3) have been widely used for text classification tasks. However, there is a lack of systematic studies comparing the performance of encoder-based…

计算与语言 · 计算机科学 2025-05-13 Hang Zhao , Qile P. Chen , Yijing Barry Zhang , Gang Yang

Medical reports contain rich clinical information but are often unstructured and written in domain-specific language, posing challenges for information extraction. While proprietary large language models (LLMs) have shown promise in…

计算与语言 · 计算机科学 2026-03-12 Luc Builtjes , Joeran Bosma , Mathias Prokop , Bram van Ginneken , Alessa Hering

Large Language Models (LLMs) are revolutionizing medical diagnostics by enhancing both disease classification and clinical decision-making. In this study, we evaluate the performance of two LLM- based diagnostic tools, DeepSeek R1 and O3…

计算与语言 · 计算机科学 2025-06-23 Gaurav Kumar Gupta , Pranal Pande , Nirajan Acharya , Aniket Kumar Singh , Suman Niroula

The advancement of Large Language Models (LLMs) has significantly impacted biomedical Natural Language Processing (NLP), enhancing tasks such as named entity recognition, relation extraction, event extraction, and text classification. In…

计算与语言 · 计算机科学 2025-03-04 Zaifu Zhan , Shuang Zhou , Huixue Zhou , Jiawen Deng , Yu Hou , Jeremy Yeung , Rui Zhang

With the increasing application of large language models (LLMs) in the medical domain, evaluating these models' performance using benchmark datasets has become crucial. This paper presents a comprehensive survey of various benchmark…

This study evaluates how well large language models (LLMs) can classify ICD-10 codes from hospital discharge summaries, a critical but error-prone task in healthcare. Using 1,500 summaries from the MIMIC-IV dataset and focusing on the 10…

计算与语言 · 计算机科学 2025-07-08 Akram Mustafa , Usman Naseem , Mostafa Rahimi Azghadi

This paper presents the overview of the development and fine-tuning of large language models (LLMs) designed specifically for answering medical questions. We are mainly improving the accuracy and efficiency of providing reliable answers to…

计算与语言 · 计算机科学 2025-01-30 Aysegul Ucar , Soumik Nayak , Anunak Roy , Burak Taşcı , Gülay Taşcı

Identifying medication discontinuations in electronic health records (EHRs) is vital for patient safety but is often hindered by information being buried in unstructured notes. This study aims to evaluate the capabilities of advanced…

计算与语言 · 计算机科学 2025-11-10 Chong Shao , Douglas Snyder , Chiran Li , Bowen Gu , Kerry Ngan , Chun-Ting Yang , Jiageng Wu , Richard Wyss , Kueiyu Joshua Lin , Jie Yang

Purpose: This study aims to evaluate the effectiveness of large language models (LLMs) in automating disease annotation of CT radiology reports. We compare a rule-based algorithm (RBA), RadBERT, and three lightweight open-weight LLMs for…

Large language models (LLMs) have made significant advancements in natural language processing (NLP). Broad corpora capture diverse patterns but can introduce irrelevance, while focused corpora enhance reliability by reducing misleading…

Recently, Large Language Models (LLMs) have gained significant traction in medical domain, especially in developing a QA systems to Medical QA systems for enhancing access to healthcare in low-resourced settings. This paper compares five…

计算与语言 · 计算机科学 2026-02-17 Shefayat E Shams Adib , Ahmed Alfey Sani , Ekramul Alam Esham , Ajwad Abrar , Tareque Mohmud Chowdhury

Large Language Models (LLMs) have emerged as transformative tools in the healthcare sector, demonstrating remarkable capabilities in natural language understanding and generation. However, their proficiency in numerical reasoning,…

人工智能 · 计算机科学 2025-01-27 Arjun R. Malghan

Large language models (LLMs) have demonstrated impressive performance across various domains. However, for clinical diagnosis, higher expectations are required for LLM's reliability and sensitivity: thinking like physicians and remaining…

计算与语言 · 计算机科学 2025-04-21 Chenwei Yan , Xiangling Fu , Yuxuan Xiong , Tianyi Wang , Siu Cheung Hui , Ji Wu , Xien Liu

Open-weight versions of large language models (LLMs) are rapidly advancing, with state-of-the-art models like DeepSeek-V3 now performing comparably to proprietary LLMs. This progression raises the question of whether small open-weight LLMs…

计算与语言 · 计算机科学 2025-09-24 Damian Stachura , Joanna Konieczna , Artur Nowak

The rapid advancement of Large Language Models (LLMs) has led to a multitude of application opportunities. One traditional task for Information Retrieval systems is the summarization and classification of texts, both of which are important…

计算与语言 · 计算机科学 2025-02-25 Gautam Kishore Shahi , Oliver Hummel

Incorporating large language models (LLMs) in medical question answering demands more than high average accuracy: a model that returns substantively different answers each time it is queried is not a reliable medical tool. Online health…

信息检索 · 计算机科学 2026-04-14 Avi-ad Avraam Buskila

Large language models (LLMs) are capable of many natural language tasks, yet they are far from perfect. In health applications, grounding and interpreting domain-specific and non-linguistic data is crucial. This paper investigates the…

计算与语言 · 计算机科学 2024-04-30 Yubin Kim , Xuhai Xu , Daniel McDuff , Cynthia Breazeal , Hae Won Park

Large language models (LLMs) have shown considerable promise in clinical natural language processing, yet few domain-specific datasets exist to rigorously evaluate their performance on radiology tasks. In this work, we introduce an…

计算与语言 · 计算机科学 2025-11-18 Namu Park , Giridhar Kaushik Ramachandran , Kevin Lybarger , Fei Xia , Ozlem Uzuner , Meliha Yetisgen , Martin Gunn