English
Related papers

Related papers: LongHealth: A Question Answering Benchmark with Lo…

200 papers

This paper introduces a system that integrates large language models (LLMs) into the clinical trial retrieval process, enhancing the effectiveness of matching patients with eligible trials while maintaining information privacy and allowing…

Information Retrieval · Computer Science 2024-11-01 Georgios Peikos , Pranav Kasela , Gabriella Pasi

Large language models (LLMs) have attracted significant attention for potential applications in digital health, while their application in mental health is subject to ongoing debate. This systematic review aims to evaluate the usage of LLMs…

Computers and Society · Computer Science 2024-08-14 Zhijun Guo , Alvina Lai , Johan Hilge Thygesen , Joseph Farrington , Thomas Keen , Kezhi Li

Recently, there has been a growing interest among large language model (LLM) developers in LLM-based document reading systems, which enable users to upload their own documents and pose questions related to the document contents, going…

Computation and Language · Computer Science 2024-07-16 Anni Zou , Wenhao Yu , Hongming Zhang , Kaixin Ma , Deng Cai , Zhuosheng Zhang , Hai Zhao , Dong Yu

Large language models (LLMs) are currently being used to answer medical questions across a variety of clinical domains. Recent top-performing commercial LLMs, in particular, are also capable of citing sources to support their responses. In…

Computation and Language · Computer Science 2024-02-06 Kevin Wu , Eric Wu , Ally Cassasola , Angela Zhang , Kevin Wei , Teresa Nguyen , Sith Riantawan , Patricia Shi Riantawan , Daniel E. Ho , James Zou

Medical reports contain rich clinical information but are often unstructured and written in domain-specific language, posing challenges for information extraction. While proprietary large language models (LLMs) have shown promise in…

Computation and Language · Computer Science 2026-03-12 Luc Builtjes , Joeran Bosma , Mathias Prokop , Bram van Ginneken , Alessa Hering

Deploying Large Language Models (LLMs) in medical applications requires fact-checking capabilities to ensure patient safety and regulatory compliance. We introduce MedFact, a challenging Chinese medical fact-checking benchmark with 2,116…

Computation and Language · Computer Science 2025-11-18 Jiayi He , Yangmin Huang , Qianyun Du , Xiangying Zhou , Zhiyang He , Jiaxue Hu , Xiaodong Tao , Lixian Lai

The rapid advancement of large language models (LLMs) has accelerated their integration into clinical decision support, particularly in prescription review. To enable systematic and fine-grained evaluation, we developed RxBench, a…

Computation and Language · Computer Science 2025-12-03 Yan Yang , Mouxiao Bian , Peiling Li , Bingjian Wen , Ruiyao Chen , Kangkun Mao , Xiaojun Ye , Tianbin Li , Pengcheng Chen , Bing Han , Jie Xu , Kaifeng Qiu , Junyan Wu

Clinical problem-solving requires processing of semantic medical knowledge such as illness scripts and numerical medical knowledge of diagnostic tests for evidence-based decision-making. As large language models (LLMs) show promising…

Lab results are often confusing and hard to understand. Large language models (LLMs) such as ChatGPT have opened a promising avenue for patients to get their questions answered. We aim to assess the feasibility of using LLMs to generate…

Computation and Language · Computer Science 2024-04-23 Zhe He , Balu Bhasuran , Qiao Jin , Shubo Tian , Karim Hanna , Cindy Shavor , Lisbeth Garcia Arguello , Patrick Murray , Zhiyong Lu

Objective: Large language models (LLMs) are attracting increasing interest in healthcare. This commentary evaluates the potential of LLMs to improve clinical prediction models (CPMs) for diagnostic and prognostic tasks, with a focus on…

Computers and Society · Computer Science 2025-11-07 Yusuf Yildiz , Goran Nenadic , Meghna Jani , David A. Jenkins

This study evaluates the performance of several Large Language Models (LLMs) on MedRedQA, a dataset of consumer-based medical questions and answers by verified experts extracted from the AskDocs subreddit. While LLMs have shown proficiency…

Computation and Language · Computer Science 2025-01-03 Moaiz Abrar , Yusuf Sermet , Ibrahim Demir

The proliferation of Large Language Models (LLMs) in medicine has enabled impressive capabilities, yet a critical gap remains in their ability to perform systematic, transparent, and verifiable reasoning, a cornerstone of clinical practice.…

Computation and Language · Computer Science 2025-08-04 Wenxuan Wang , Zizhan Ma , Meidan Ding , Shiyi Zheng , Shengyuan Liu , Jie Liu , Jiaming Ji , Wenting Chen , Xiang Li , Linlin Shen , Yixuan Yuan

Large-scale language models (LLMs) often offer clinical judgments based on incomplete information, increasing the risk of misdiagnosis. Existing studies have primarily evaluated confidence in single-turn, static settings, overlooking the…

Computation and Language · Computer Science 2026-01-23 Zhiyao Ren , Yibing Zhan , Siyuan Liang , Guozheng Ma , Baosheng Yu , Dacheng Tao

As large language models (LLMs) become primary sources of health information for millions, their accuracy in women's health remains critically unexamined. We introduce the Women's Health Benchmark (WHB), the first benchmark evaluating LLM…

Large Language Models (LLMs) have demonstrated remarkable versatility in recent years, offering potential applications across specialized domains such as healthcare and medicine. Despite the availability of various open-source LLMs tailored…

Computation and Language · Computer Science 2024-07-18 Yanis Labrak , Adrien Bazoge , Emmanuel Morin , Pierre-Antoine Gourraud , Mickael Rouvier , Richard Dufour

Large Language Models (LLMs) are often proposed as tools to streamline clinical documentation, a task viewed as both high-volume and low-risk. However, even seemingly straightforward applications of LLMs raise complex sociotechnical…

Human-Computer Interaction · Computer Science 2025-09-05 Kristina L. Kupferschmidt , Kieran O'Doherty , Joshua A. Skorburg

Large Language Models (LLMs) have demonstrated significant promise for various applications in healthcare. However, their efficacy in the Arabic medical domain remains unexplored due to the lack of high-quality domain-specific datasets and…

Computation and Language · Computer Science 2025-08-25 Mouath Abu Daoud , Chaimae Abouzahir , Leen Kharouf , Walid Al-Eisawi , Nizar Habash , Farah E. Shamout

This paper studies the performance of large language models (LLMs), particularly regarding demographic fairness, in solving real-world healthcare tasks. We evaluate state-of-the-art LLMs with three prevalent learning frameworks across six…

Computation and Language · Computer Science 2024-12-10 Yue Zhou , Barbara Di Eugenio , Lu Cheng

Large language models (LLMs) are transforming the ways the general public accesses and consumes information. Their influence is particularly pronounced in pivotal sectors like healthcare, where lay individuals are increasingly appropriating…

Computation and Language · Computer Science 2023-10-24 Yiqiao Jin , Mohit Chandra , Gaurav Verma , Yibo Hu , Munmun De Choudhury , Srijan Kumar

Summarizing consumer health questions (CHQs) can ease communication in healthcare, but unfaithful summaries that misrepresent medical details pose serious risks. We propose a framework that combines TextRank-based sentence extraction and…

Computation and Language · Computer Science 2025-11-17 Ajwad Abrar , Nafisa Tabassum Oeshy , Prianka Maheru , Farzana Tabassum , Tareque Mohmud Chowdhury