English
Related papers

Related papers: Large Language Models for Biomedical Text Simplifi…

200 papers

We conduct investigations on clinical text machine translation by examining multilingual neural network models using deep learning such as Transformer based structures. Furthermore, to address the language resource imbalance issue, we also…

Computation and Language · Computer Science 2024-02-22 Lifeng Han , Serge Gladkoff , Gleb Erofeev , Irina Sorokina , Betty Galiano , Goran Nenadic

While recent advancements in commercial large language models (LM) have shown promising results in medical tasks, their closed-source nature poses significant privacy and security concerns, hindering their widespread use in the medical…

Computation and Language · Computer Science 2024-07-02 Hyunjae Kim , Hyeon Hwang , Jiwoo Lee , Sihyeon Park , Dain Kim , Taewhoo Lee , Chanwoong Yoon , Jiwoong Sohn , Donghee Choi , Jaewoo Kang

Brief hospital course (BHC) summaries are clinical documents that summarize a patient's hospital stay. While large language models (LLMs) depict remarkable capabilities in automating real-world tasks, their capabilities for healthcare…

Clinical studies often require understanding elements of a patient's narrative that exist only in free text clinical notes. To transform notes into structured data for downstream use, these elements are commonly extracted and normalized to…

Computation and Language · Computer Science 2020-08-03 Monica Agrawal , Chloe O'Connell , Yasmin Fatemi , Ariel Levy , David Sontag

This paper describes our approach to the SemEval-2024 safe biomedical Natural Language Inference for Clinical Trials (NLI4CT) task, which concerns classifying statements about Clinical Trial Reports (CTRs). We explored the capabilities of…

Computation and Language · Computer Science 2024-08-07 Artur Guimarães , Bruno Martins , João Magalhães

Proprietary Large Language Models (LLMs), such as ChatGPT, have garnered significant attention due to their exceptional capabilities in handling a diverse range of tasks. Recent studies demonstrate that open-sourced smaller foundational…

Computation and Language · Computer Science 2023-10-10 Yue Zhang , Leyang Cui , Deng Cai , Xinting Huang , Tao Fang , Wei Bi

Large Language Models (LLM) have taken the front seat in most of the news since November 2022, when ChatGPT was introduced. After more than one year, one of the major reasons companies are resistant to adopting them is the limited…

Artificial Intelligence · Computer Science 2024-03-13 Carlo Lipizzi

Multimodal large language models (MLLMs) have made significant strides, yet they face challenges in the medical domain due to limited specialized knowledge. While recent medical MLLMs demonstrate strong performance in lab settings, they…

Computation and Language · Computer Science 2024-10-22 Junda Wang , Yujan Ting , Eric Z. Chen , Hieu Tran , Hong Yu , Weijing Huang , Terrence Chen

Pre-training large-scale neural language models on raw texts has made a significant contribution to improving transfer learning in natural language processing (NLP). With the introduction of transformer-based language models, such as…

Computation and Language · Computer Science 2024-05-08 Shoya Wada , Toshihiro Takeda , Shiro Manabe , Shozo Konishi , Jun Kamohara , Yasushi Matsumura

Medical reasoning in large language models (LLMs) aims to emulate clinicians' diagnostic thinking, but current benchmarks such as MedQA-USMLE, MedMCQA, and PubMedQA often mix reasoning with factual recall. We address this by separating 11…

Language models (LMs) pretrained on a large text corpus and fine-tuned on a downstream text corpus and fine-tuned on a downstream task becomes a de facto training strategy for several natural language processing (NLP) tasks. Recently, an…

Computation and Language · Computer Science 2021-07-23 Junghoon Lee , Jounghee Kim , Pilsung Kang

Scientific workflow systems are increasingly popular for expressing and executing complex data analysis pipelines over large datasets, as they offer reproducibility, dependability, and scalability of analyses by automatic parallelization on…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-09 Mario Sänger , Ninon De Mecquenem , Katarzyna Ewa Lewińska , Vasilis Bountris , Fabian Lehmann , Ulf Leser , Thomas Kosch

Multi-modal learning has significantly advanced generative AI, especially in vision-language modeling. Innovations like GPT-4V and open-source projects such as LLaVA have enabled robust conversational agents capable of zero-shot task…

Computation and Language · Computer Science 2024-06-17 Zekai Chen , Arda Pekis , Kevin Brown

Coreference resolution in biomedical texts presents unique challenges due to complex domain-specific terminology, high ambiguity in mention forms, and long-distance dependencies between coreferring expressions. In this work, we present a…

Computation and Language · Computer Science 2025-10-30 Nourah M Salem , Elizabeth White , Michael Bada , Lawrence Hunter

We propose a combined three pre-trained language models (XLM-R, BART, and DeBERTa-V3) as an empower of contextualized embedding for named entity recognition. Our model achieves a 92.9% F1 score on the test set and ranks 5th on the…

Computation and Language · Computer Science 2022-12-15 Xuan-Dung Doan

Lab results are often confusing and hard to understand. Large language models (LLMs) such as ChatGPT have opened a promising avenue for patients to get their questions answered. We aim to assess the feasibility of using LLMs to generate…

Computation and Language · Computer Science 2024-04-23 Zhe He , Balu Bhasuran , Qiao Jin , Shubo Tian , Karim Hanna , Cindy Shavor , Lisbeth Garcia Arguello , Patrick Murray , Zhiyong Lu

Despite the purported multilingual proficiency of instruction-finetuned large language models (LLMs) such as ChatGPT and Bard, the linguistic inclusivity of these models remains insufficiently explored. Considering this constraint, we…

We present MSAs winning system for the BAREC 2025 Shared Task on fine-grained Arabic readability assessment, achieving first place in six of six tracks. Our approach is a confidence-weighted ensemble of four complementary transformer models…

Computation and Language · Computer Science 2025-09-15 Mohamed Basem , Mohamed Younes , Seif Ahmed , Abdelrahman Moustafa

The development of open-source, multilingual medical language models can benefit a wide, linguistically diverse audience from different regions. To promote this domain, we present contributions from the following: First, we construct a…

Computation and Language · Computer Science 2024-06-04 Pengcheng Qiu , Chaoyi Wu , Xiaoman Zhang , Weixiong Lin , Haicheng Wang , Ya Zhang , Yanfeng Wang , Weidi Xie

Background: The potential of large language models (LLMs) to automate and support pharmacoepidemiologic study design is an emerging area of interest, yet their reliability remains insufficiently characterized. General-purpose LLMs often…

Computation and Language · Computer Science 2026-04-21 Xinyao Zhang , Nicole Sonne Heckmann , Manuela Del Castillo Suero , Francesco Paolo Speca , Maurizio Sessa