中文
相关论文

相关论文: ClinicRealm: Re-evaluating Large Language Models w…

200 篇论文

Europe's healthcare systems require enhanced interoperability and digitalization, driving a demand for innovative solutions to process legacy clinical data. This paper presents the results of our project, which aims to leverage Large…

计算与语言 · 计算机科学 2025-07-09 Aynur Guluzade , Naguib Heiba , Zeyd Boukhers , Florim Hamiti , Jahid Hasan Polash , Yehya Mohamad , Carlos A Velasco

Rare diseases, including Inborn Errors of Metabolism (IEM), pose significant diagnostic challenges. Case reports serve as key but computationally underutilized resources to inform diagnosis. Clinical dense information extraction refers to…

计算与语言 · 计算机科学 2025-05-26 Xiao Yu Cindy Zhang , Carlos R. Ferreira , Francis Rossignol , Raymond T. Ng , Wyeth Wasserman , Jian Zhu

The recent success of large language models (LLMs) has paved the way for their adoption in the high-stakes domain of healthcare. Specifically, the application of LLMs in patient-trial matching, which involves assessing patient eligibility…

人工智能 · 计算机科学 2023-12-18 Mauro Nievas , Aditya Basu , Yanshan Wang , Hrituraj Singh

Large language models (LLMs) show significant potential in healthcare, prompting numerous benchmarks to evaluate their capabilities. However, concerns persist regarding the reliability of these benchmarks, which often lack clinical…

计算与语言 · 计算机科学 2026-04-30 Wenting Chen , Guo Yu , Yiu-Fai Cheung , Meidan Ding , Jie Liu , Zizhan Ma , Wenxuan Wang , Linlin Shen

Large language models (LLMs) are emerging as promising tools for mental health care, offering scalable support through their ability to generate human-like responses. However, the effectiveness of these models in clinical settings remains…

人工智能 · 计算机科学 2024-08-22 Yining Hua , Hongbin Na , Zehan Li , Fenglin Liu , Xiao Fang , David Clifton , John Torous

Objective: This study aims to summarize the usage of Large Language Models (LLMs) in the process of creating a scientific review. We look at the range of stages in a review that can be automated and assess the current state-of-the-art…

数字图书馆 · 计算机科学 2025-05-16 Dmitry Scherbakov , Nina Hubig , Vinita Jansari , Alexander Bakumenko , Leslie A. Lenert

A long-running goal of the clinical NLP community is the extraction of important variables trapped in clinical notes. However, roadblocks have included dataset shift from the general domain and a lack of public clinical corpora and…

计算与语言 · 计算机科学 2022-12-01 Monica Agrawal , Stefan Hegselmann , Hunter Lang , Yoon Kim , David Sontag

The introduction of Large Language Models (LLMs), and the vast volume of publicly available medical data, amplified the application of NLP to the medical domain. However, LLMs are pretrained on data that are not explicitly relevant to the…

计算与语言 · 计算机科学 2023-12-12 Chris Solomou

Purpose: In this paper, we present an automated method for article classification, leveraging the power of Large Language Models (LLM). The primary focus is on the field of ophthalmology, but the model is extendable to other fields.…

Clinical reasoning in medicine is a hypothesis-driven process where physicians refine diagnoses from limited information through targeted history, physical examination, and diagnostic investigations. In contrast, current medical benchmarks…

机器学习 · 计算机科学 2025-10-14 Christopher Chiu , Silviu Pitis , Mihaela van der Schaar

The rapid advancement of large language models (LLMs) has accelerated their integration into clinical decision support, particularly in prescription review. To enable systematic and fine-grained evaluation, we developed RxBench, a…

Prompt learning is a new paradigm in the Natural Language Processing (NLP) field which has shown impressive performance on a number of natural language tasks with common benchmarking text datasets in full, few-shot, and zero-shot…

计算与语言 · 计算机科学 2022-05-12 Niall Taylor , Yi Zhang , Dan Joyce , Alejo Nevado-Holgado , Andrey Kormilitzin

This study aims to guide language model selection by investigating: 1) the necessity of finetuning versus zero-shot usage, 2) the benefits of domain-adjacent versus generic pretrained models, 3) the value of further domain-specific…

计算与语言 · 计算机科学 2025-09-25 Lovedeep Gondara , Jonathan Simkin , Graham Sayle , Shebnum Devji , Gregory Arbour , Raymond Ng

Multimodal large language models (LLMs) are increasingly explored as automated evaluators in clinical settings, yet their scoring behavior on ordinal clinical scales remains poorly understood. We benchmark three frontier LLM families…

Large language models (LLMs) have achieved strong performance on medical exam-style tasks, motivating growing interest in their deployment in real-world clinical settings. However, clinical decision-making is inherently safety-critical,…

计算与语言 · 计算机科学 2026-04-13 Xiaohan Ren , Chenxiao Fan , Wenyin Ma , Hongliang He , Chongming Gao , Xiaoyan Zhao , Fuli Feng

This paper presents the overview of the development and fine-tuning of large language models (LLMs) designed specifically for answering medical questions. We are mainly improving the accuracy and efficiency of providing reliable answers to…

计算与语言 · 计算机科学 2025-01-30 Aysegul Ucar , Soumik Nayak , Anunak Roy , Burak Taşcı , Gülay Taşcı

Pretrained Large Language Models (LLMs) have achieved remarkable success across diverse domains, with education and research emerging as particularly impactful areas. Among current state-of-the-art LLMs, ChatGPT and DeepSeek exhibit strong…

人工智能 · 计算机科学 2025-12-10 Md Mostafizer Rahman , Ariful Islam Shiplu , Md Faizul Ibne Amin , Yutaka Watanobe , Lu Peng

Large Language Models (LLMs) have shown promise in various domains, including healthcare, with significant potential to transform mental health applications by enabling scalable and accessible solutions. This study aims to provide a…

人工智能 · 计算机科学 2025-11-25 Abdelrahman Hanafi , Mohammed Saad , Noureldin Zahran , Radwa J. Hanafy , Mohammed E. Fouda

Large language models have exhibited exceptional performance on various Natural Language Processing (NLP) tasks, leveraging techniques such as the pre-training, and instruction fine-tuning. Despite these advances, their effectiveness in…

计算与语言 · 计算机科学 2023-06-19 Guangyu Wang , Guoxing Yang , Zongxin Du , Longjun Fan , Xiaohu Li

In this paper, we demonstrate a surprising capability of large language models (LLMs): given only input feature names and a description of a prediction task, they are capable of selecting the most predictive features, with performance…

机器学习 · 计算机科学 2025-04-21 Daniel P. Jeong , Zachary C. Lipton , Pradeep Ravikumar