English
Related papers

Related papers: Self-Verification Improves Few-Shot Clinical Infor…

200 papers

Despite their strong performance, large language models (LLMs) face challenges in real-world application of lexical simplification (LS), particularly in privacy-sensitive and resource-constrained environments. Moreover, since vulnerable…

Computation and Language · Computer Science 2025-09-30 Akio Hayakawa , Stefan Bott , Horacio Saggion

We investigate the effectiveness of fine-tuning large language models (LLMs) on small medical datasets for text classification and named entity recognition tasks. Using a German cardiology report dataset and the i2b2 Smoking Challenge…

Computation and Language · Computer Science 2025-03-28 Noah Losch , Lucas Plagwitz , Antonius Büscher , Julian Varghese

Physician burnout in the United States has reached critical levels, driven in part by the administrative burden of Electronic Health Record (EHR) documentation and complex diagnostic codes. To relieve this strain and maintain strict patient…

Information Retrieval · Computer Science 2026-03-25 Peter Hartnett , Chung-Chi Huang , Sarah Hartnett , David Hartnett

Large Language Models (LLMs) have demonstrated substantial progress in biomedical and clinical applications, motivating rigorous evaluation of their ability to answer nuanced, evidence-based questions. We curate a multi-source benchmark…

Computation and Language · Computer Science 2025-09-16 Can Wang , Yiqun Chen

Background: Recent advancements in large language models (LLMs) offer potential benefits in healthcare, particularly in processing extensive patient records. However, existing benchmarks do not fully assess LLMs' capability in handling…

Large language models (LLMs) are increasingly used to extract structured information from free-text clinical records, but prior work often focuses on single tasks, limited models, and English-language reports. We evaluated 15 open-weight…

Generative Large Language Models (LLMs) such as GPT-3 are capable of generating highly fluent responses to a wide variety of user prompts. However, LLMs are known to hallucinate facts and make non-factual statements which can undermine…

Computation and Language · Computer Science 2023-10-12 Potsawee Manakul , Adian Liusie , Mark J. F. Gales

Large Language Models (LLMs) have swiftly emerged as vital resources for different applications in the biomedical and healthcare domains; however, these models encounter issues such as generating inaccurate information or hallucinations.…

Computation and Language · Computer Science 2024-05-06 Mingchen Li , Halil Kilicoglu , Hua Xu , Rui Zhang

The increasing proliferation of misinformation and its alarming impact have motivated both industry and academia to develop approaches for misinformation detection and fact checking. Recent advances on large language models (LLMs) have…

Computation and Language · Computer Science 2024-07-22 Sahar Tahmasebi , Eric Müller-Budack , Ralph Ewerth

Recent Language Models (LMs) have shown impressive capabilities in generating texts with the knowledge internalized in parameters. Yet, LMs often generate the factually incorrect responses to the given queries, since their knowledge may be…

Computation and Language · Computer Science 2023-10-20 Jinheon Baek , Soyeong Jeong , Minki Kang , Jong C. Park , Sung Ju Hwang

A long-running goal of the clinical NLP community is the extraction of important variables trapped in clinical notes. However, roadblocks have included dataset shift from the general domain and a lack of public clinical corpora and…

Computation and Language · Computer Science 2022-12-01 Monica Agrawal , Stefan Hegselmann , Hunter Lang , Yoon Kim , David Sontag

Large Language Models (LLMs) such as GPT-4 have shown enough promise in the few-shot learning context to suggest use in the generation of "silver" data and refinement of new ontologies through iterative application and review. Such…

Artificial Intelligence · Computer Science 2024-08-05 Steven Fincke , Adrien Bibal , Elizabeth Boschee

Analyzing vast textual data and summarizing key information from electronic health records imposes a substantial burden on how clinicians allocate their time. Although large language models (LLMs) have shown promise in natural language…

Large language models (LLMs) have shown promise in safety-critical applications such as healthcare, yet the ability to quantify performance has lagged. An example of this challenge is in evaluating a summary of the patient's medical record.…

Computation and Language · Computer Science 2024-11-13 Elliot Schumacher , Daniel Rosenthal , Dhruv Naik , Varun Nair , Luladay Price , Geoffrey Tso , Anitha Kannan

The automatic extraction of key-value information from handwritten documents is a key challenge in document analysis. A reliable extraction is a prerequisite for the mass digitization efforts of many archives. Large Vision Language Models…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Fabian Wolf , Oliver Tüselmann , Arthur Matei , Lukas Hennies , Christoph Rass , Gernot A. Fink

The field of healthcare has increasingly turned its focus towards Large Language Models (LLMs) due to their remarkable performance. However, their performance in actual clinical applications has been underexplored. Traditional evaluations…

Large language models (LLMs) demonstrate remarkable medical expertise, but data privacy concerns impede their direct use in healthcare environments. Although offering improved data privacy protection, domain-specific small language models…

Computation and Language · Computer Science 2024-05-17 Xinlu Zhang , Shiyang Li , Xianjun Yang , Chenxin Tian , Yao Qin , Linda Ruth Petzold

The rapid dissemination of information through social media and the Internet has posed a significant challenge for fact-checking, among others in identifying check-worthy claims that fact-checkers should pay attention to, i.e. filtering…

Computation and Language · Computer Science 2024-06-27 Yufeng Li , Rrubaa Panchendrarajan , Arkaitz Zubiaga

Fact-checking for health-related content is challenging due to the limited availability of annotated training data. In this study, we propose a synthetic data generation pipeline that leverages large language models (LLMs) to augment…

Artificial Intelligence · Computer Science 2025-08-29 Jingze Zhang , Jiahe Qian , Yiliang Zhou , Yifan Peng

Attribution and fact verification are critical challenges in natural language processing for assessing information reliability. While automated systems and Large Language Models (LLMs) aim to retrieve and select concise evidence to support…

Computation and Language · Computer Science 2026-01-30 Guy Alt , Eran Hirsch , Serwar Basch , Ido Dagan , Oren Glickman