English
Related papers

Related papers: Systematic Evaluation of Large Language Models for…

200 papers

Deploying large language models (LLMs) is challenging because they are memory inefficient and compute-intensive for practical applications. In reaction, researchers train smaller task-specific models by either finetuning with human labels…

Computation and Language · Computer Science 2023-07-06 Cheng-Yu Hsieh , Chun-Liang Li , Chih-Kuan Yeh , Hootan Nakhost , Yasuhisa Fujii , Alexander Ratner , Ranjay Krishna , Chen-Yu Lee , Tomas Pfister

The advancements in large language models (LLMs) have brought significant progress in NLP tasks. However, if a task cannot be fully described in prompts, the models could fail to carry out the task. In this paper, we propose a simple yet…

Computation and Language · Computer Science 2025-06-10 Hwiyeol Jo , Hyunwoo Lee , Kang Min Yoo , Taiwoo Park

The rapid advancement of large language models (LLMs) has opened new boundaries in the extraction and synthesis of medical knowledge, particularly within evidence synthesis. This paper reviews the state-of-the-art applications of LLMs in…

Vision-language models (VLMs) like CLIP have demonstrated impressive zero-shot ability in image classification tasks by aligning text and images but suffer inferior performance compared with task-specific expert models. On the contrary,…

Artificial Intelligence · Computer Science 2025-02-04 Jia Zhang , Zhi Zhou , Lan-Zhe Guo , Yu-Feng Li

Purpose: This study aims to evaluate the effectiveness of large language models (LLMs) in automating disease annotation of CT radiology reports. We compare a rule-based algorithm (RBA), RadBERT, and three lightweight open-weight LLMs for…

Cancer stage classification is important for making treatment and care management plans for oncology patients. Information on staging is often included in unstructured form in clinical, pathology, radiology and other free-text reports in…

Computation and Language · Computer Science 2024-09-04 Chia-Hsuan Chang , Mary M. Lucas , Grace Lu-Yao , Christopher C. Yang

In the era of increasingly sophisticated natural language processing (NLP) systems, large language models (LLMs) have demonstrated remarkable potential for diverse applications, including tasks requiring nuanced textual understanding and…

Computation and Language · Computer Science 2025-05-16 Poli Apollinaire Nemkova , Solomon Ubani , Mark V. Albert

Recent studies have demonstrated the great potential of Large Language Models (LLMs) serving as zero-shot relevance rankers. The typical approach involves making comparisons between pairs or lists of documents. Although effective, these…

Information Retrieval · Computer Science 2023-11-06 Weiwei Sun , Zheng Chen , Xinyu Ma , Lingyong Yan , Shuaiqiang Wang , Pengjie Ren , Zhumin Chen , Dawei Yin , Zhaochun Ren

Pretrained large language models (LLMs) are widely used in many sub-fields of natural language processing (NLP) and generally known as excellent few-shot learners with task-specific exemplars. Notably, chain of thought (CoT) prompting, a…

Computation and Language · Computer Science 2023-01-31 Takeshi Kojima , Shixiang Shane Gu , Machel Reid , Yutaka Matsuo , Yusuke Iwasawa

Large language models (LLMs) are increasingly adopted in educational technologies for a variety of tasks, from generating instructional materials and assisting with assessment design to tutoring. While prior work has investigated how models…

Computation and Language · Computer Science 2025-12-24 Kirk Vanacore , Rene F. Kizilcec

Skill Extraction involves identifying skills and qualifications mentioned in documents such as job postings and resumes. The task is commonly tackled by training supervised models using a sequence labeling approach with BIO tags. However,…

Computation and Language · Computer Science 2024-02-07 Khanh Cao Nguyen , Mike Zhang , Syrielle Montariol , Antoine Bosselut

This paper addresses the challenges posed by the unstructured nature and high-dimensional semantic complexity of electronic health record texts. A deep learning method based on attention mechanisms is proposed to achieve unified modeling…

Computation and Language · Computer Science 2025-07-03 Ting Xu , Xiaoxiao Deng , Xiandong Meng , Haifeng Yang , Yan Wu

Purpose: In this paper, we present an automated method for article classification, leveraging the power of Large Language Models (LLM). The primary focus is on the field of ophthalmology, but the model is extendable to other fields.…

Objective: Develop a cost-effective, large language model (LLM)-based pipeline for automatically extracting Review of Systems (ROS) entities from clinical notes. Materials and Methods: The pipeline extracts ROS section from the clinical…

Computation and Language · Computer Science 2026-05-15 Hieu Nghiem , Zhuqi Miao , Hemanth Reddy Singareddy , Jivan Lamichhane , Abdulaziz Ahmed , Johnson Thomas , Dursun Delen , William Paiva

Objective: Clinical documentation contains factual, diagnostic, and management errors that can compromise patient safety. Large language models (LLMs) may help detect and correct such errors, but their behavior under different prompting…

Computation and Language · Computer Science 2025-11-27 Farzad Ahmed , Joniel Augustine Jerome , Meliha Yetisgen , Özlem Uzuner

Recent studies are leveraging advancements in large language models (LLMs) trained on extensive internet-crawled text data to generate textual descriptions of downstream classes in CLIP-based zero-shot image classification. While most of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Tong Liang , Jim Davis

Collecting labeled datasets in finance is challenging due to scarcity of domain experts and higher cost of employing them. While Large Language Models (LLMs) have demonstrated remarkable performance in data annotation tasks on general…

Computation and Language · Computer Science 2024-03-28 Toyin Aguda , Suchetha Siddagangappa , Elena Kochkina , Simerjot Kaur , Dongsheng Wang , Charese Smiley , Sameena Shah

As a cornerstone of patient care, clinical decision-making significantly influences patient outcomes and can be enhanced by large language models (LLMs). Although LLMs have demonstrated remarkable performance, their application to visual…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Ji Young Byun , Young-Jin Park , Navid Azizan , Rama Chellappa

The extraction of critical patient information from Electronic Health Records (EHRs) poses significant challenges due to the complexity and unstructured nature of the data. Traditional machine learning approaches often fail to capture…

Computation and Language · Computer Science 2025-09-03 Zhimeng Luo , Abhibha Gupta , Adam Frisch , Daqing He

Large language models (LLMs) have achieved strong performance on medical exam-style tasks, motivating growing interest in their deployment in real-world clinical settings. However, clinical decision-making is inherently safety-critical,…

Computation and Language · Computer Science 2026-04-13 Xiaohan Ren , Chenxiao Fan , Wenyin Ma , Hongliang He , Chongming Gao , Xiaoyan Zhao , Fuli Feng
‹ Prev 1 4 5 6 7 8 10 Next ›