English
Related papers

Related papers: Can GPT-3.5 Generate and Code Discharge Summaries?

200 papers

Generalist foundation models such as GPT-4 have displayed surprising capabilities in a wide variety of domains and tasks. Yet, there is a prevalent assumption that they cannot match specialist capabilities of fine-tuned models. For example,…

Today, AI technology is showing its strengths in almost every industry and walks of life. From text generation, text summarization, chatbots, NLP is being used widely. One such paradigm is automatic code generation. An AI could be…

Artificial Intelligence · Computer Science 2021-08-24 Aishwarya Narasimhan , Krishna Prasad Agara Venkatesha Rao , Veena M B

Objectives: Large language models (LLMs) are increasingly used for clinical text summarization, yet structured methods to assess associated patient safety risks remain limited. Failure Mode, Effects, and Criticality Analysis (FMECA)…

We introduce a new benchmark, ChartMimic, aimed at assessing the visually-grounded code generation capabilities of large multimodal models (LMMs). ChartMimic utilizes information-intensive visual charts and textual instructions as inputs,…

Software Engineering · Computer Science 2025-03-03 Cheng Yang , Chufan Shi , Yaxin Liu , Bo Shui , Junjie Wang , Mohan Jing , Linran Xu , Xinyu Zhu , Siheng Li , Yuxiang Zhang , Gongye Liu , Xiaomei Nie , Deng Cai , Yujiu Yang

This paper evaluates the capability of two state-of-the-art artificial intelligence (AI) models, GPT-3.5 and Bard, in generating Java code given a function description. We sourced the descriptions from CodingBat.com, a popular online…

Software Engineering · Computer Science 2023-05-17 Giuseppe Destefanis , Silvia Bartolucci , Marco Ortu

GPT-3.5 and GPT-4 are the two most widely used large language model (LLM) services. However, when and how these models are updated over time is opaque. Here, we evaluate the March 2023 and June 2023 versions of GPT-3.5 and GPT-4 on several…

Computation and Language · Computer Science 2023-11-01 Lingjiao Chen , Matei Zaharia , James Zou

High-throughput phenotyping automates the mapping of patient signs to standardized ontology concepts and is essential for precision medicine. This study evaluates the automation of phenotyping of clinical summaries from the Online Mendelian…

Computation and Language · Computer Science 2025-06-11 Daniel B. Hier , S. Ilyas Munzir , Anne Stahlfeld , Tayo Obafemi-Ajayi , Michael D. Carrithers

Clinical notes are often stored in unstructured or semi-structured formats after extraction from electronic medical record (EMR) systems, which complicates their use for secondary analysis and downstream clinical applications. Reliable…

Computation and Language · Computer Science 2025-12-30 Risha Surana , Adrian Law , Sunwoo Kim , Rishab Sridhar , Angxiao Han , Peiyu Hong

In this research, we uses the DistilBERT model to generate extractive summary and the T5 model to generate abstractive summaries. Also, we generate hybrid summaries by combining both DistilBERT and T5 models. Central to our research is the…

Computation and Language · Computer Science 2024-05-08 Hassan Shakil , Zeydy Ortiz , Grant C. Forbes

Objective. Natural language processing methods for medical auto-coding, or automatic generation of medical billing codes from electronic health records, generally assign each code independently of the others. They may thus assign codes for…

Computation and Language · Computer Science 2015-10-19 Michael Subotin , Anthony R. Davis

Timeseries regression models often struggle to leverage large volumes of labeled multimodal data, particularly when the data are irregularly sampled or contain missing values. This is common in domains like healthcare and predictive…

Machine Learning · Computer Science 2026-05-18 Antoine Honoré , Ming Xiao

We generated 25000 conversations labeled with Big Five Personality traits using prompt programming at GPT-3. Then we train Big Five classification models with these data and evaluate them with 2500 data from generated dialogues and real…

Human-Computer Interaction · Computer Science 2023-03-23 Eason Chen

This thesis delves into a fortiori arguments in deductive reasoning, underscoring their relevance in various domains such as law, philosophy, and artificial intelligence. The research is centred on employing GPT-3.5-turbo to automate the…

Artificial Intelligence · Computer Science 2023-11-23 Yanyi Pu

This paper studies recent developments in large language models' (LLM) abilities to pass assessments in introductory and intermediate Python programming courses at the postsecondary level. The emergence of ChatGPT resulted in heated debates…

Computers and Society · Computer Science 2023-10-05 Jaromir Savelka , Arav Agarwal , Marshall An , Chris Bogart , Majd Sakr

Participant recruitment based on unstructured medical texts such as clinical notes and radiology reports has been a challenging yet important task for the cohort establishment in clinical research. Recently, Large Language Models (LLMs)…

Computation and Language · Computer Science 2023-07-24 Zihan Guan , Zihao Wu , Zhengliang Liu , Dufan Wu , Hui Ren , Quanzheng Li , Xiang Li , Ninghao Liu

This study presents three deidentified large medical text datasets, named DISCHARGE, ECHO and RADIOLOGY, which contain 50K, 16K and 378K pairs of report and summary that are derived from MIMIC-III, respectively. We implement convincing…

Computation and Language · Computer Science 2023-02-09 Yunqi Zhu , Xuebing Yang , Yuanyuan Wu , Wensheng Zhang

Large Language Models (LLMs) have advanced rapidly as tools for automating code generation in scientific research, yet their ability to interpret and use unfamiliar Python APIs for complex computational experiments remains poorly…

Software Engineering · Computer Science 2025-09-17 Nuno Fachada , Daniel Fernandes , Carlos M. Fernandes , Bruno D. Ferreira-Saraiva , João P. Matos-Carvalho

Automatic ICD coding, the task of assigning disease and procedure codes to electronic medical records, is crucial for clinical documentation and billing. While existing methods primarily enhance model understanding of code hierarchies and…

Computation and Language · Computer Science 2025-11-11 Tuan-Dung Le , Shohreh Haddadan , Thanh Q. Thieu

Large Language Models (LLMs) such as GPT & Llama have demonstrated significant achievements in summarization tasks but struggle with factual inaccuracies, a critical issue in clinical NLP applications where errors could lead to serious…

Computation and Language · Computer Science 2024-10-04 Prakamya Mishra , Zonghai Yao , Parth Vashisht , Feiyun Ouyang , Beining Wang , Vidhi Dhaval Mody , Hong Yu

Automatic ICD coding is the task of assigning codes from the International Classification of Diseases (ICD) to medical notes. These codes describe the state of the patient and have multiple applications, e.g., computer-assisted diagnosis or…

Computation and Language · Computer Science 2021-04-15 Damian Pascual , Sandro Luck , Roger Wattenhofer