English
Related papers

Related papers: A dataset and benchmark for hospital course summar…

200 papers

There is increasing interest in the application large language models (LLMs) to the medical field, in part because of their impressive performance on medical exam questions. While promising, exam questions do not reflect the complexity of…

This paper studies how to effectively build meeting summarization systems for real-world usage using large language models (LLMs). For this purpose, we conduct an extensive evaluation and comparison of various closed-source and open-source…

Computation and Language · Computer Science 2023-11-09 Md Tahmid Rahman Laskar , Xue-Yong Fu , Cheng Chen , Shashi Bhushan TN

Both medical care and observational studies in oncology require a thorough understanding of a patient's disease progression and treatment history, often elaborately documented in clinical notes. Despite their vital role, no current oncology…

Computation and Language · Computer Science 2024-03-18 Madhumita Sushil , Vanessa E. Kennedy , Divneet Mandair , Brenda Y. Miao , Travis Zack , Atul J. Butte

This research paper investigates the application of Large Language Models (LLMs) in healthcare, specifically focusing on enhancing medical decision support through Retrieval-Augmented Generation (RAG) integrated with hospital-specific data…

Computation and Language · Computer Science 2025-05-07 Mohammad Shoaib Ansari , Mohd Sohail Ali Khan , Shubham Revankar , Aditya Varma , Anil S. Mokhade

Evaluating text summarization has been a challenging task in natural language processing (NLP). Automatic metrics which heavily rely on reference summaries are not suitable in many situations, while human evaluation is time-consuming and…

Computation and Language · Computer Science 2024-07-02 Huyen Nguyen , Haihua Chen , Lavanya Pobbathi , Junhua Ding

The rapid progress in Large Language Models (LLMs) has prompted the creation of numerous benchmarks to evaluate their capabilities.This study focuses on the Comprehensive Medical Benchmark in Chinese (CMB), showcasing how dataset diversity…

Computation and Language · Computer Science 2024-10-01 Jingwei Zhu , Minghuan Tan , Min Yang , Ruixue Li , Hamid Alinejad-Rokny

While large language models (LLMs) can already achieve strong performance on standard generic summarization benchmarks, their performance on more complex summarization task settings is less studied. Therefore, we benchmark LLMs on…

Computation and Language · Computer Science 2024-07-15 Yixin Liu , Alexander R. Fabbri , Jiawen Chen , Yilun Zhao , Simeng Han , Shafiq Joty , Pengfei Liu , Dragomir Radev , Chien-Sheng Wu , Arman Cohan

Many large language models (LLMs) for medicine have largely been evaluated on short texts, and their ability to handle longer sequences such as a complete electronic health record (EHR) has not been systematically explored. Assessing these…

Computation and Language · Computer Science 2023-11-17 Mihir Parmar , Aakanksha Naik , Himanshu Gupta , Disha Agrawal , Chitta Baral

Summarization of clinical narratives is a long-standing research problem. Here, we introduce the task of hospital-course summarization. Given the documentation authored throughout a patient's hospitalization, generate a paragraph that tells…

Computation and Language · Computer Science 2021-05-04 Griffin Adams , Emily Alsentzer , Mert Ketenci , Jason Zucker , Noémie Elhadad

Clinical summarization is crucial in healthcare as it distills complex medical data into digestible information, enhancing patient understanding and care management. Large language models (LLMs) have shown significant potential in…

Computation and Language · Computer Science 2025-08-21 Anindya Bijoy Das , Shibbir Ahmed , Shahnewaz Karim Sakib

Large Language Models (LLMs), being generic task solvers, are versatile. However, despite the vast amount of data they are trained on, there are speculations about their adaptation capabilities to a new domain. Additionally, the simple…

Computation and Language · Computer Science 2025-09-03 Anum Afzal , Mehul Kumawat , Florian Matthes

This study reviewed the use of Large Language Models (LLMs) in healthcare, focusing on their training corpora, customization techniques, and evaluation metrics. A systematic search of studies from 2021 to 2024 identified 61 articles. Four…

Computation and Language · Computer Science 2025-02-18 Shuqi Yang , Mingrui Jing , Shuai Wang , Jiaxin Kou , Manfei Shi , Weijie Xing , Yan Hu , Zheng Zhu

Large language models (LLMs) such as ChatGPT are fine-tuned on large and diverse instruction-following corpora, and can generalize to new tasks. However, those instruction-tuned LLMs often perform poorly in specialized medical natural…

Computation and Language · Computer Science 2025-03-11 Yujuan Velvin Fu , Giridhar Kaushik Ramachandran , Namu Park , Kevin Lybarger , Fei Xia , Ozlem Uzuner , Meliha Yetisgen

Large Language Models (LLMs), particularly those similar to ChatGPT, have significantly influenced the field of Natural Language Processing (NLP). While these models excel in general language tasks, their performance in domain-specific…

Computation and Language · Computer Science 2024-01-02 Omid Rohanian , Mohammadmahdi Nouriborji , David A. Clifton

Large language models (LLMs) are increasingly used in clinical settings, yet their performance in veterinary medicine remains underexplored. We evaluated three commercially available veterinary-focused LLM summarization tools (Product 1…

Computation and Language · Computer Science 2025-10-03 Tyler J Poore , Christopher J Pinard , Aleena Shabbir , Andrew Lagree , Andre Telfer , Kuan-Chuen Wu

Recent advancements in large language models (LLMs) have transformed the field of question answering (QA). However, evaluating LLMs in the medical field is challenging due to the lack of standardized and comprehensive datasets. To address…

Computation and Language · Computer Science 2023-10-24 Junling Liu , Peilin Zhou , Yining Hua , Dading Chong , Zhongyu Tian , Andrew Liu , Helin Wang , Chenyu You , Zhenhua Guo , Lei Zhu , Michael Lingzhi Li

The automation of news analysis and summarization presents a promising solution to the challenge of processing and analyzing vast amounts of information prevalent in today's information society. Large Language Models (LLMs) have…

Artificial Intelligence · Computer Science 2025-02-25 Lionel Richy Panlap Houamegni , Fatih Gedikli

Recently, Large Language Models (LLM) have demonstrated impressive capability to solve a wide range of tasks. However, despite their success across various tasks, no prior work has investigated their capability in the biomedical domain yet.…

Computation and Language · Computer Science 2024-02-21 Israt Jahan , Md Tahmid Rahman Laskar , Chun Peng , Jimmy Huang

Background: Clinical documentation represents a significant burden for healthcare providers, with physicians spending up to 2 hours daily on administrative tasks. Recent advances in large language models (LLMs) offer promising solutions,…

Computation and Language · Computer Science 2025-07-08 Johnson Thomas , Ayush Mudgal , Wendao Liu , Nisten Tahiraj , Zeeshaan Mohammed , Dhruv Diddi

To support software developers in understanding and maintaining programs, various automatic (source) code summarization techniques have been proposed to generate a concise natural language summary (i.e., comment) for a given code snippet.…

Software Engineering · Computer Science 2025-08-26 Weisong Sun , Yun Miao , Yuekang Li , Hongyu Zhang , Chunrong Fang , Yi Liu , Gelei Deng , Yang Liu , Zhenyu Chen