中文
相关论文

相关论文: Systematic Evaluation of Large Language Models for…

200 篇论文

Effective clinical history taking is a foundational yet underexplored component of clinical reasoning. While large language models (LLMs) have shown promise on static benchmarks, they often fall short in dynamic, multi-turn diagnostic…

计算与语言 · 计算机科学 2026-01-30 Yang Zhou , Zhenting Sheng , Mingrui Tan , Yuting Song , Jun Zhou , Yu Heng Kwan , Lian Leng Low , Yang Bai , Yong Liu

Large language models (LLMs) have demonstrated remarkable success in NLP tasks. However, there is a paucity of studies that attempt to evaluate their performances on social media-based health-related natural language processing tasks, which…

计算与语言 · 计算机科学 2024-03-29 Yuting Guo , Anthony Ovadje , Mohammed Ali Al-Garadi , Abeed Sarker

Although supervised machine learning is popular for information extraction from clinical notes, creating large annotated datasets requires extensive domain expertise and is time-consuming. Meanwhile, large language models (LLMs) have…

计算与语言 · 计算机科学 2024-01-26 Madhumita Sushil , Travis Zack , Divneet Mandair , Zhiwei Zheng , Ahmed Wali , Yan-Ning Yu , Yuwei Quan , Atul J. Butte

We evaluate four state-of-the-art instruction-tuned large language models (LLMs) -- ChatGPT, Flan-T5 UL2, Tk-Instruct, and Alpaca -- on a set of 13 real-world clinical and biomedical natural language processing (NLP) tasks in English, such…

计算与语言 · 计算机科学 2024-06-11 Yanis Labrak , Mickael Rouvier , Richard Dufour

With the advent of artificial intelligence (AI), many researchers are attempting to extract structured information from document-level biomedical literature by fine-tuning large language models (LLMs). However, they face significant…

神经与进化计算 · 计算机科学 2026-02-26 Lei Zhao , Ling Kang , Quan Guo

Recently, Large Language Models (LLM) have demonstrated impressive capability to solve a wide range of tasks. However, despite their success across various tasks, no prior work has investigated their capability in the biomedical domain yet.…

计算与语言 · 计算机科学 2024-02-21 Israt Jahan , Md Tahmid Rahman Laskar , Chun Peng , Jimmy Huang

Clinical natural language processing (NLP) models have shown promise for supporting hospital discharge planning by leveraging narrative clinical documentation. However, note-based models are particularly vulnerable to temporal and lexical…

计算与语言 · 计算机科学 2026-02-20 Ha Na Cho , Sairam Sutari , Alexander Lopez , Hansen Bow , Kai Zheng

Large Language Models (LLMs) demonstrate remarkable versatility in various NLP tasks but encounter distinct challenges in biomedical due to the complexities of language and data scarcity. This paper investigates LLMs application in the…

Clinical patient notes are critical for documenting patient interactions, diagnoses, and treatment plans in medical practice. Ensuring accurate evaluation of these notes is essential for medical education and certification. However, manual…

计算与语言 · 计算机科学 2024-01-25 Jingyu Xu , Yifeng Jiang , Bin Yuan , Shulin Li , Tianbo Song

Large language models (LLMs) show promise for extracting clinically meaningful information from unstructured health records, yet their translation into real-world settings is constrained by the lack of scalable and trustworthy validation…

Large language models (LLMs) have recently showcased remarkable capabilities, spanning a wide range of tasks and applications, including those in the medical domain. Models like GPT-4 excel in medical question answering but may face…

Electronic Patient Record (EPR) systems contain valuable clinical information, but much of it is trapped in unstructured text, limiting its use for research and decision-making. Large language models can extract such information but require…

Large Language Models (LLMs) have shown strong performance on NLP classification tasks. However, they typically rely on aggregated labels-often via majority voting-which can obscure the human disagreement inherent in subjective annotations.…

计算与语言 · 计算机科学 2025-06-09 Benedetta Muscato , Yue Li , Gizem Gezici , Zhixue Zhao , Fosca Giannotti

Integrating novel medical concepts and relationships into existing ontologies can significantly enhance their coverage and utility for both biomedical research and clinical applications. Clinical notes, as unstructured documents rich with…

人工智能 · 计算机科学 2025-11-21 Guanchen Wu , Yuzhang Xie , Huanwei Wu , Zhe He , Hui Shao , Xiao Hu , Carl Yang

This study evaluates how well large language models (LLMs) can classify ICD-10 codes from hospital discharge summaries, a critical but error-prone task in healthcare. Using 1,500 summaries from the MIMIC-IV dataset and focusing on the 10…

计算与语言 · 计算机科学 2025-07-08 Akram Mustafa , Usman Naseem , Mostafa Rahimi Azghadi

Trained on a vast amount of data, Large Language models (LLMs) have achieved unprecedented success and generalization in modeling fairly complex textual inputs in the abstract space, making them powerful tools for zero-shot learning. Such…

计算机视觉与模式识别 · 计算机科学 2023-05-19 Shervin Ardeshir

Large language models (LLMs), including zero-shot and few-shot paradigms, have shown promising capabilities in clinical text generation. However, real-world applications face two key challenges: (1) patient data is highly unstructured,…

计算与语言 · 计算机科学 2025-07-10 Garapati Keerthana , Manik Gupta

Many natural language processing (NLP) tasks rely on labeled data to train machine learning models with high performance. However, data annotation is time-consuming and expensive, especially when the task involves a large amount of data or…

计算与语言 · 计算机科学 2024-04-08 Xingwei He , Zhenghao Lin , Yeyun Gong , A-Long Jin , Hang Zhang , Chen Lin , Jian Jiao , Siu Ming Yiu , Nan Duan , Weizhu Chen

Discharge communication is a critical yet underexplored component of patient care, where the goal shifts from diagnosis to education. While recent large language model (LLM) benchmarks emphasize in-visit diagnostic reasoning, they fail to…

计算与语言 · 计算机科学 2025-09-22 Zonghai Yao , Michael Sun , Won Seok Jang , Sunjae Kwon , Soie Kwon , Hong Yu

Large Language Models (LLMs) have demonstrated potential in predicting mental health outcomes from online text, yet traditional classification methods often lack interpretability and robustness. This study evaluates structured reasoning…

计算与语言 · 计算机科学 2026-01-09 Avinash Patil , Amardeep Kour Gedhu