English
Related papers

Related papers: Benchmarking large language models for biomedical …

200 papers

Clinical documentation is a critical factor for patient safety, diagnosis, and continuity of care. The administrative burden of EHRs is a significant factor in physician burnout. This is a critical issue for low-resource languages,…

Computation and Language · Computer Science 2026-03-27 Mohammed Nowshad Ruhani Chowdhury , Mohammed Nowaz Rabbani Chowdhury , Sakari Lukkarinen

Large language models (LLMs) with billions of parameters and pretrained on massive amounts of data are now capable of near or better than state-of-the-art performance in a variety of downstream natural language processing tasks. Neural…

Computation and Language · Computer Science 2024-07-08 Victor Agostinelli , Max Wild , Matthew Raffel , Kazi Ahmed Asif Fuad , Lizhong Chen

The exponential growth of online textual content across diverse domains has necessitated advanced methods for automated text classification. Large Language Models (LLMs) based on transformer architectures have shown significant success in…

Computation and Language · Computer Science 2025-09-09 Zhyar Rzgar K Rostam , Gábor Kertész

This paper assesses the potential for the large language models (LLMs) GPT-4 and GPT-3.5 to aid in deriving insight from education feedback surveys. Exploration of LLM use cases in education has focused on teaching and learning, with less…

Computation and Language · Computer Science 2024-06-28 Michael J. Parker , Caitlin Anderson , Claire Stone , YeaRim Oh

Large Language Models revolutionized NLP and showed dramatic performance improvements across several tasks. In this paper, we investigated the role of such language models in text classification and how they compare with other approaches…

Computation and Language · Computer Science 2025-02-21 Sowmya Vajjala , Shwetali Shimangaud

This paper describes a rapid feasibility study of using GPT-4, a large language model (LLM), to (semi)automate data extraction in systematic reviews. Despite the recent surge of interest in LLMs there is still a lack of understanding of how…

Computation and Language · Computer Science 2025-02-14 Lena Schmidt , Kaitlyn Hair , Sergio Graziosi , Fiona Campbell , Claudia Kapp , Alireza Khanteymoori , Dawn Craig , Mark Engelbert , James Thomas

Natural language processing (NLP) in the medical domain can underperform in real-world applications involving small datasets in a non-English language with few labeled samples and imbalanced classes. There is yet no consensus on how to…

Computation and Language · Computer Science 2024-10-01 Vincent Beliveau , Helene Kaas , Martin Prener , Claes N. Ladefoged , Desmond Elliott , Gitte M. Knudsen , Lars H. Pinborg , Melanie Ganz

Executing computer programs described in natural language has long been a pursuit of computer science. With the advent of enhanced natural language understanding capabilities exhibited by large language models (LLMs), the path toward this…

Computation and Language · Computer Science 2024-03-15 Xin Zheng , Qiming Zhu , Hongyu Lin , Yaojie Lu , Xianpei Han , Le Sun

Pre-trained language models (PLMs) have achieved remarkable success in NLP tasks. Despite the great success, mainstream solutions largely follow the pre-training then finetuning paradigm, which brings in both high deployment costs and low…

Computation and Language · Computer Science 2023-05-03 Xiang Li , Xin Jiang , Xuying Meng , Aixin Sun , Yequan Wang

Patient experience and care quality are crucial for a hospital's sustainability and reputation. The analysis of patient feedback offers valuable insight into patient satisfaction and outcomes. However, the unstructured nature of these…

Computation and Language · Computer Science 2025-02-21 Hajar Sakai , Sarah S. Lam , Mohammadsadegh Mikaeili , Joshua Bosire , Franziska Jovin

Large Language Models (LLMs), such as Generative Pre-trained Transformers (GPTs) are revolutionizing the generation of human-like text, producing contextually relevant and syntactically correct content. Despite challenges like biases and…

Computation and Language · Computer Science 2025-08-04 Alper Yaman , Jannik Schwab , Christof Nitsche , Abhirup Sinha , Marco Huber

The biomedical domain has sparked a significant interest in the field of Natural Language Processing (NLP), which has seen substantial advancements with pre-trained language models (PLMs). However, comparing these models has proven…

Despite the success of large language models (LLMs) on general-purpose tasks, their performance in highly specialized domains such as biomedicine remains unsatisfactory. A key limitation is the inability of LLMs to effectively leverage…

Computation and Language · Computer Science 2026-05-08 Xin Gao , Ruiyi Zhang , Meixi Du , Peijia Qin , Pengtao Xie

Recently, the fast development of Large Language Models (LLMs) such as ChatGPT has significantly advanced NLP tasks by enhancing the capabilities of conversational models. However, the application of LLMs in the recommendation domain has…

Information Retrieval · Computer Science 2023-08-24 Junling Liu , Chao Liu , Peilin Zhou , Qichen Ye , Dading Chong , Kang Zhou , Yueqi Xie , Yuwei Cao , Shoujin Wang , Chenyu You , Philip S. Yu

With the rapid development of natural language processing (NLP) technology, large-scale pre-trained language models such as GPT-3 have become a popular research object in NLP field. This paper aims to explore sentiment analysis optimization…

Computation and Language · Computer Science 2024-05-17 Tong Zhan , Chenxi Shi , Yadong Shi , Huixiang Li , Yiyu Lin

Despite their strong linguistic capabilities, Large Language Models (LLMs) are computationally demanding and require substantial resources for fine-tuning, which is unadapted to privacy and budget constraints of many healthcare settings. To…

Computation and Language · Computer Science 2026-04-30 Pierre Epron , Adrien Coulet , Mehwish Alam

Assessing learners in ill-defined domains, such as scenario-based human tutoring training, is an area of limited research. Equity training requires a nuanced understanding of context, but do contemporary large language models (LLMs) have a…

Human-Computer Interaction · Computer Science 2025-01-14 Sanjit Kakarla , Conrad Borchers , Danielle Thomas , Shambhavi Bhushan , Kenneth R. Koedinger

Large Language Models (LLMs) have the potential to semi-automate some process mining (PM) analyses. While commercial models are already adequate for many analytics tasks, the competitive level of open-source LLMs in PM tasks is unknown. In…

Computation and Language · Computer Science 2024-07-19 Alessandro Berti , Humam Kourani , Wil M. P. van der Aalst

IMPORTANCE The response effectiveness of different large language models (LLMs) and various individuals, including medical students, graduate students, and practicing physicians, in pediatric ophthalmology consultations, has not been…

Computation and Language · Computer Science 2023-11-09 Jason Holmes , Rui Peng , Yiwei Li , Jinyu Hu , Zhengliang Liu , Zihao Wu , Huan Zhao , Xi Jiang , Wei Liu , Hong Wei , Jie Zou , Tianming Liu , Yi Shao

Large Language models (LLMs), such as ChatGPT, have gained popularity in recent years with the advancement of Natural Language Processing (NLP), with use cases spanning many disciplines and daily lives as well. LLMs inherit explicit and…

Computation and Language · Computer Science 2025-12-01 Fatima Kazi