English
Related papers

Related papers: Training a Large Language Model for Medical Coding…

200 papers

Large language models (LLMs) have shown potential in biomedical applications, leading to efforts to fine-tune them on domain-specific data. However, the effectiveness of this approach remains unclear. This study evaluates the performance of…

Despite significant progress in applying large language models (LLMs) to the medical domain, several limitations still prevent them from practical applications. Among these are the constraints on model size and the lack of cohort-specific…

Artificial Intelligence · Computer Science 2024-09-26 Yishu Wei , Xindi Wang , Hanley Ong , Yiliang Zhou , Adam Flanders , George Shih , Yifan Peng

The challenge of accessing historical patient data for clinical research, while adhering to privacy regulations, is a significant obstacle in medical science. An innovative approach to circumvent this issue involves utilising synthetic…

Computation and Language · Computer Science 2024-03-15 Erlend Frayling , Jake Lever , Graham McDonald

Large language models exhibit promising general capabilities but often lack specialized knowledge for domain-specific tasks. Developing domain experts from a base model enables a range of applications without prohibitive training costs.…

Computation and Language · Computer Science 2023-11-02 Zhen Guo , Yining Hua

Code completion is a prominent application of Large Language Models (LLMs) in software engineering. Due to the near real-time response requirements of this task, base models with small to medium-sized parameters are typically employed,…

Software Engineering · Computer Science 2025-09-18 Dongjun Yu , Xiao Yan , Zhenrui Li , Jipeng Xiao , Haochuan He , Yongda Yu , Hao Zhang , Guoping Rong , Xiaobo Huang

We release Code Llama, a family of large language models for code based on Llama 2 providing state-of-the-art performance among open models, infilling capabilities, support for large input contexts, and zero-shot instruction following…

Advances in Large Language Models (LLMs) have led to significant interest in their potential to support human experts across a range of domains, including public health. In this work we present automated evaluations of LLMs for public…

The process of matching patients with suitable clinical trials is essential for advancing medical research and providing optimal care. However, current approaches face challenges such as data standardization, ethical considerations, and a…

Computation and Language · Computer Science 2023-08-08 Jiayi Yuan , Ruixiang Tang , Xiaoqian Jiang , Xia Hu

Instruction Fine-Tuning (IFT) significantly enhances the zero-shot capabilities of pretrained Large Language Models (LLMs). While coding data is known to boost LLM reasoning abilities during pretraining, its role in activating internal…

Artificial Intelligence · Computer Science 2024-12-13 Xinlu Zhang , Zhiyu Zoey Chen , Xi Ye , Xianjun Yang , Lichang Chen , William Yang Wang , Linda Ruth Petzold

Recently, Large Language Models (LLMs) have showcased remarkable capabilities in natural language understanding. While demonstrating proficiency in everyday conversations and question-answering situations, these models frequently struggle…

Computation and Language · Computer Science 2023-08-28 Chaoyi Wu , Weixiong Lin , Xiaoman Zhang , Ya Zhang , Yanfeng Wang , Weidi Xie

Recent breakthroughs in large language models (LLMs) offer unprecedented natural language understanding and generation capabilities. However, existing surveys on LLMs in biomedicine often focus on specific applications or model…

Instruction-tuning language models has become a crucial step in aligning them for general use. Typically, this process involves extensive training on large datasets, incurring high training costs. In this paper, we introduce a novel…

Computation and Language · Computer Science 2024-02-19 Dheeraj Mekala , Alex Nguyen , Jingbo Shang

Large Language Models (LLMs) have become a pivotal research area, potentially making beneficial contributions in fields like healthcare where they can streamline automated billing and decision support. However, the frequent use of…

Computation and Language · Computer Science 2024-06-10 Simon A. Lee , Timothy Lindsey

Clinicians often need to retrieve patient-specific information from electronic health records (EHRs), a task that is time-consuming and error-prone. We present a locally deployable Clinical Contextual Question Answering (CCQA) framework…

Computation and Language · Computer Science 2026-03-30 Mikko Saukkoriipi , Nicole Hernandez , Jaakko Sahlsten , Kimmo Kaski , Otso Arponen

Clinical Question Answering (QA) systems enable doctors to quickly access patient information from electronic health records (EHRs). However, training these systems requires significant annotated data, which is limited due to the expertise…

Computation and Language · Computer Science 2024-12-09 Fan Bai , Keith Harrigian , Joel Stremmel , Hamid Hassanzadeh , Ardavan Saeedi , Mark Dredze

Large Language Models (LLMs) like GPT-4o can help automate text classification tasks at low cost and scale. However, there are major concerns about the validity and reliability of LLM outputs. By contrast, human coding is generally more…

Computation and Language · Computer Science 2025-01-17 Conrad Borchers , Danielle R. Thomas , Jionghao Lin , Ralph Abboud , Kenneth R. Koedinger

This study aims to explore the implementation of Natural Language Processing (NLP) and machine learning (ML) techniques to automate the coding of medical letters with visualised explainability and light-weighted local computer settings.…

Computation and Language · Computer Science 2024-07-19 Jamie Glen , Lifeng Han , Paul Rayson , Goran Nenadic

Large language models (LLMs) have demonstrated remarkable success in NLP tasks. However, there is a paucity of studies that attempt to evaluate their performances on social media-based health-related natural language processing tasks, which…

Computation and Language · Computer Science 2024-03-29 Yuting Guo , Anthony Ovadje , Mohammed Ali Al-Garadi , Abeed Sarker

Large language models (LLMs) can potentially democratize access to medical knowledge. While many efforts have been made to harness and improve LLMs' medical knowledge and reasoning capacities, the resulting models are either closed-source…

The precipitous rise and adoption of Large Language Models (LLMs) have shattered expectations with the fastest adoption rate of any consumer-facing technology in history. Healthcare, a field that traditionally uses NLP techniques, was bound…

Computation and Language · Computer Science 2023-10-10 Surjya Ray , Pratik Mehta , Hongen Zhang , Ada Chaman , Jian Wang , Chung-Jen Ho , Michael Chiou , Tashfeen Suleman