English
Related papers

Related papers: Domain-Adapted Small Language Models for Reliable …

200 papers

Clinicians often need to retrieve patient-specific information from electronic health records (EHRs), a task that is time-consuming and error-prone. We present a locally deployable Clinical Contextual Question Answering (CCQA) framework…

Computation and Language · Computer Science 2026-03-30 Mikko Saukkoriipi , Nicole Hernandez , Jaakko Sahlsten , Kimmo Kaski , Otso Arponen

Large Language Models (LLM) hold potential to support dairy scholars and farmers by supporting decision-making and broadening access to knowledge for stakeholders with limited technical expertise. However, the substantial computational…

Artificial Intelligence · Computer Science 2025-12-17 Enhong Liu , Haiyu Yang , Miel Hostens

Large language models (LLMs) have achieved remarkable progress across domains and applications but face challenges such as high fine-tuning costs, inference latency, limited edge deployability, and reliability concerns. Small language…

Computation and Language · Computer Science 2025-11-06 Fali Wang , Jihai Chen , Shuhua Yang , Ali Al-Lawati , Linli Tang , Hui Liu , Suhang Wang

Research on emergency and mass casualty incident (MCI) triage has been limited by the absence of openly usable, reproducible benchmarks. Yet these scenarios demand rapid identification of the patients most in need, where accurate…

Machine Learning · Computer Science 2026-03-31 Joshua Sebastian , Karma Tobden , KMA Solaiman

Rare diseases, including Inborn Errors of Metabolism (IEM), pose significant diagnostic challenges. Case reports serve as key but computationally underutilized resources to inform diagnosis. Clinical dense information extraction refers to…

Computation and Language · Computer Science 2025-05-26 Xiao Yu Cindy Zhang , Carlos R. Ferreira , Francis Rossignol , Raymond T. Ng , Wyeth Wasserman , Jian Zhu

The emergence of Small Language Models (SLMs) as privacy-preserving alternatives for sensitive applications raises a fundamental question about their inherent understanding capabilities compared to Large Language Models (LLMs). This paper…

Computation and Language · Computer Science 2025-07-15 Hong Jia , Shiya Fu , Feng Xia , Vassilis Kostakos , Ting Dang

Large language models (LLMs) have shown strong performance on clinical de-identification, the task of identifying sensitive identifiers to protect privacy. However, previous work has not examined their generalizability between formats,…

Computation and Language · Computer Science 2026-02-19 Noopur Zambare , Kiana Aghakasiri , Carissa Lin , Carrie Ye , J. Ross Mitchell , Mohamed Abdalla

Online patient inquiries are often informal, incomplete, and written before professional assessment, yet they must still be routed to an appropriate level of clinical follow-up. We study this as a four-class actionable triage task --…

Computation and Language · Computer Science 2026-05-18 Liqi Zhou , Jiafu Li

Large language models (LLMs) excel at diverse tasks, but their deployment on resource-constrained devices remains challenging. Existing methods like quantization, pruning, and distillation can reduce memory footprint but often demand…

Artificial Intelligence · Computer Science 2025-12-23 Siddharth Tandon

The application of large language models (LLMs) to healthcare information extraction has emerged as a promising approach. This study evaluates the classification performance of five open-source LLMs: GEMMA-3-27B-IT, LLAMA3-70B, LLAMA4-109B,…

Computation and Language · Computer Science 2025-05-09 Yuting Guo , Abeed Sarker

Large Language Models (LLMs) have been shown to encode clinical knowledge. Many evaluations, however, rely on structured question-answer benchmarks, overlooking critical challenges of interpreting and reasoning about unstructured clinical…

Computation and Language · Computer Science 2026-04-01 Meghal Dani , Muthu Jeyanthi Prakash , Filip Rosa , Zeynep Akata , Stefanie Liebe

In enterprise search, building high-quality datasets at scale remains a central challenge due to the difficulty of acquiring labeled data. To resolve this challenge, we propose an efficient approach to fine-tune small language models (SLMs)…

Clinical document classification is essential for converting unstructured medical texts into standardised ICD-10 diagnoses, yet it faces challenges due to complex medical language, privacy constraints, and limited annotated datasets. Large…

Computation and Language · Computer Science 2026-02-03 Akram Mustafa , Usman Naseem , Mostafa Rahimi Azghadi

Although recent advances in scaling large language models (LLMs) have resulted in improvements on many NLP tasks, it remains unclear whether these models trained primarily with general web text are the right tool in highly specialized,…

Environmental, Social, and Governance (ESG) considerations play a central role in contemporary financial decision-making. In parallel, Large Language Model (LLM) applications in this domain have primarily emphasized well-defined…

Computational Engineering, Finance, and Science · Computer Science 2026-05-01 Gabriel Assis , Ayrton Surica , Pedro Kroll , Gabriela Aires , Darian Rabbani , Edson Bollis , Lucas Pellicer , Aline Paes

Large Language Models (LLMs) have demonstrated remarkable proficiency in language comprehension and generation; however, their widespread adoption is constrained by substantial bandwidth and computational demands. While pruning and low-rank…

Computation and Language · Computer Science 2025-10-31 Zeliang Zong , Kai Zhang , Zheyang Li , Wenming Tan , Ye Ren , Yiyan Zhai , Jilin Hu

Small open-source language models are gaining attention for healthcare applications in low-resource settings where cloud infrastructure and GPU hardware may be unavailable. However, the reliability of these models under different phrasings…

Computation and Language · Computer Science 2026-03-18 Shravani Hariprasad

Large language models (LLMs) show promise for supporting clinicians in diagnostic communication by generating explanations and guidance for patients. Yet their ability to produce outputs that are both understandable and empathetic remains…

Computation and Language · Computer Science 2025-11-04 Jianzhou Yao , Shunchang Liu , Guillaume Drui , Rikard Pettersson , Alessandro Blasimme , Sara Kijewski

Contemporary large language models (LLMs) may have utility for processing unstructured, narrative free-text clinical data contained in electronic health records (EHRs) -- a particularly important use-case for mental health where a majority…

Artificial Intelligence · Computer Science 2024-04-01 Niall Taylor , Andrey Kormilitzin , Isabelle Lorge , Alejo Nevado-Holgado , Dan W Joyce

This study explores the potential of small language model(SLM) ensembles to achieve accuracy comparable to proprietary large language models (LLMs). We propose Ensemble Bayesian Inference (EBI), a novel approach that applies Bayesian…

Computation and Language · Computer Science 2025-12-23 Haru-Tada Sato , Fuka Matsuzaki , Jun-ichiro Takahashi