English
Related papers

Related papers: Selective Fine-Tuning of GPT Architectures for Par…

200 papers

Electronic health records contain inconsistently structured or free-text data, requiring efficient preprocessing to enable predictive health care models. Although artificial intelligence-driven natural language processing tools show promise…

The large language model called ChatGPT has drawn extensively attention because of its human-like expression and reasoning abilities. In this study, we investigate the feasibility of using ChatGPT in experiments on using ChatGPT to…

Computation and Language · Computer Science 2024-10-22 Qing Lyu , Josh Tan , Michael E. Zapadka , Janardhana Ponnatapura , Chuang Niu , Kyle J. Myers , Ge Wang , Christopher T. Whitlow

Medical image analysis using deep learning is often challenged by limited labeled data and high annotation costs. Fine-tuning the entire network in label-limited scenarios can lead to overfitting and suboptimal performance. Recently, prompt…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Fan Bai , Ke Yan , Xiaoyu Bai , Xinyu Mao , Xiaoli Yin , Jingren Zhou , Yu Shi , Le Lu , Max Q. -H. Meng

Few-shot learning and parameter-efficient fine-tuning (PEFT) are crucial to overcome the challenges of data scarcity and ever growing language model sizes. This applies in particular to specialized scientific domains, where researchers…

Computation and Language · Computer Science 2025-09-18 Jonas Rieger , Mattes Ruckdeschel , Gregor Wiedemann

Patient-trial matching requires reasoning over long, heterogeneous electronic health records (EHRs) and complex eligibility criteria, posing significant challenges for scalability, generalization, and computational efficiency. Existing…

Computation and Language · Computer Science 2026-04-27 Xiaodi Li , Yang Xiao , Munhwan Lee , Konstantinos Leventakos , Young J. Juhn , David Jones , Terence T. Sio , Wei Liu , Maria Vassilaki , Nansu Zong

Parameter-efficient transfer learning (PETL) is proposed as a cost-effective way to transfer pre-trained models to downstream tasks, avoiding the high cost of updating entire large-scale pre-trained models (LPMs). In this work, we present…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Yijin Huang , Pujin Cheng , Roger Tam , Xiaoying Tang

BACKGROUND: Radiology reports are typically written in a free-text format, making clinical information difficult to extract and use. Recently the adoption of structured reporting (SR) has been recommended by various medical societies thanks…

Clinical notes in electronic health records contain highly heterogeneous writing styles, including non-standard terminology or abbreviations. Using these notes in predictive modeling has traditionally required preprocessing (e.g. taking…

Machine Learning · Computer Science 2019-11-18 Jonas Kemp , Alvin Rajkomar , Andrew M. Dai

Recently, the increasing demand for superior medical services has highlighted the discrepancies in the medical infrastructure. With big data, especially texts, forming the foundation of medical services, there is an exigent need for…

Computation and Language · Computer Science 2024-07-17 Yuanhe Tian , Ruyi Gan , Yan Song , Jiaxing Zhang , Yongdong Zhang

There is a long history of building predictive models in healthcare using tabular data from electronic medical records. However, these models fail to extract the information found in unstructured clinical notes, which document diagnosis,…

Computation and Language · Computer Science 2025-04-18 David Anderson , Michaela Anderson , Margret Bjarnadottir , Stephen Mahar , Shriyan Reyya

Objective To solve major clinical natural language processing (NLP) tasks using a unified text-to-text learning architecture based on a generative large language model (LLM) via prompt tuning. Methods We formulated 7 key clinical NLP tasks…

Computation and Language · Computer Science 2023-12-12 Cheng Peng , Xi Yang , Aokun Chen , Zehao Yu , Kaleb E Smith , Anthony B Costa , Mona G Flores , Jiang Bian , Yonghui Wu

High-throughput phenotyping, the automated mapping of patient signs and symptoms to standardized ontology concepts, is essential to gaining value from electronic health records (EHR) in the support of precision medicine. Despite…

Artificial Intelligence · Computer Science 2024-06-24 Syed I. Munzir , Daniel B. Hier , Chelsea Oommen , Michael D. Carrithers

High-throughput phenotyping automates the mapping of patient signs to standardized ontology concepts and is essential for precision medicine. This study evaluates the automation of phenotyping of clinical summaries from the Online Mendelian…

Computation and Language · Computer Science 2025-06-11 Daniel B. Hier , S. Ilyas Munzir , Anne Stahlfeld , Tayo Obafemi-Ajayi , Michael D. Carrithers

Clinical trial eligibility matching is a critical yet often labor-intensive and error-prone step in medical research, as it ensures that participants meet precise criteria for safe and reliable study outcomes. Recent advances in Natural…

Machine Learning · Computer Science 2025-03-04 Muhammad Talha Sharif , Abdul Rehman

Patient experience and care quality are crucial for a hospital's sustainability and reputation. The analysis of patient feedback offers valuable insight into patient satisfaction and outcomes. However, the unstructured nature of these…

Computation and Language · Computer Science 2025-02-21 Hajar Sakai , Sarah S. Lam , Mohammadsadegh Mikaeili , Joshua Bosire , Franziska Jovin

This research on data extraction methods applies recent advances in natural language processing to evidence synthesis based on medical texts. Texts of interest include abstracts of clinical trials in English and in multilingual contexts.…

Computation and Language · Computer Science 2020-01-31 Lena Schmidt , Julie Weeds , Julian P. T. Higgins

In the context of medical imaging and machine learning, one of the most pressing challenges is the effective adaptation of pre-trained models to specialized medical contexts. Despite the availability of advanced pre-trained models, their…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Ana Davila , Jacinto Colan , Yasuhisa Hasegawa

State-of-the-art performance on language understanding tasks is now achieved with increasingly large networks; the current record holder has billions of parameters. Given a language model pre-trained on massive unlabeled text corpora, only…

Computation and Language · Computer Science 2020-04-30 Evani Radiya-Dixit , Xin Wang

Machine Translation models are trained to translate a variety of documents from one language into another. However, models specifically trained for a particular characteristics of the documents tend to perform better. Fine-tuning is a…

Computation and Language · Computer Science 2019-10-09 Alberto Poncelas , Gideon Maillette de Buy Wenniger , Andy Way

Medical consultation dialogues contain critical clinical information, yet their unstructured nature hinders effective utilization in diagnosis and treatment. Traditional methods, relying on rule-based or shallow machine learning techniques,…

Computation and Language · Computer Science 2025-04-24 Shuguang Zhao , Qiangzhong Feng , Zhiyang He , Peipei Sun , Yingying Wang , Xiaodong Tao , Xiaoliang Lu , Mei Cheng , Xinyue Wu , Yanyan Wang , Wei Liang