English
Related papers

Related papers: BPQA Dataset: Evaluating How Well Language Models …

200 papers

Recent advances in natural language processing (NLP) have been driven bypretrained language models like BERT, RoBERTa, T5, and GPT. Thesemodels excel at understanding complex texts, but biomedical literature, withits domain-specific…

Computation and Language · Computer Science 2025-07-28 K. Sahit Reddy , N. Ragavenderan , Vasanth K. , Ganesh N. Naik , Vishalakshi Prabhu , Nagaraja G. S

This study investigated the application of Large Language Models (LLMs) for simplifying biomedical texts to enhance health literacy. Using a public dataset, which included plain language adaptations of biomedical abstracts, we developed and…

Computation and Language · Computer Science 2025-12-19 Primoz Kocbek , Leon Kopitar , Gregor Stiglic

Large Language Models (LLMs) hold promise in addressing complex medical problems. However, while most prior studies focus on improving accuracy and reasoning abilities, a significant bottleneck in developing effective healthcare agents lies…

Computation and Language · Computer Science 2025-10-06 Weikang Qiu , Tinglin Huang , Ryan Rullo , Yucheng Kuang , Ali Maatouk , S. Raquel Ramos , Rex Ying

Large Language Models (LLMs) have demonstrated substantial progress in biomedical and clinical applications, motivating rigorous evaluation of their ability to answer nuanced, evidence-based questions. We curate a multi-source benchmark…

Computation and Language · Computer Science 2025-09-16 Can Wang , Yiqun Chen

Mental health remains a challenging problem all over the world, with issues like depression, anxiety becoming increasingly common. Large Language Models (LLMs) have seen a vast application in healthcare, specifically in answering medical…

Computation and Language · Computer Science 2025-02-24 Suraj Racha , Prashant Joshi , Anshika Raman , Nikita Jangid , Mridul Sharma , Ganesh Ramakrishnan , Nirmal Punjabi

Objectives: To evaluate the current limitations of large language models (LLMs) in medical question answering, focusing on the quality of datasets used for their evaluation. Materials and Methods: Widely-used benchmark datasets, including…

Computation and Language · Computer Science 2025-07-15 Mahmoud Alwakeel , Aditya Nagori , Vijay Krishnamoorthy , Rishikesan Kamaleswaran

Medical question answering (QA) systems have the potential to answer clinicians uncertainties about treatment and diagnosis on demand, informed by the latest evidence. However, despite the significant progress in general QA made by the NLP…

Computation and Language · Computer Science 2021-09-23 Gregory Kell , Iain J. Marshall , Byron C. Wallace , Andre Jaun

The potential to provide patients with faster information access while allowing medical specialists to concentrate on critical tasks makes medical domain dialog agents appealing. However, the integration of large-language models (LLMs) into…

Computation and Language · Computer Science 2023-08-30 Fabian Lechner , Allison Lahnala , Charles Welch , Lucie Flek

The adoption of large language models (LLMs) to assist clinicians has attracted remarkable attention. Existing works mainly adopt the close-ended question-answering (QA) task with answer options for evaluation. However, many clinical…

Medical consumer question answering (CQA) is crucial for empowering patients by providing personalized and reliable health information. Despite recent advances in large language models (LLMs) for medical QA, consumer-oriented and…

Computation and Language · Computer Science 2025-05-27 Naghmeh Jamali , Milad Mohammadi , Danial Baledi , Zahra Rezvani , Hesham Faili

Machine reading comprehension has made great progress in recent years owing to large-scale annotated datasets. In the clinical domain, however, creating such datasets is quite difficult due to the domain expertise required for annotation.…

Computation and Language · Computer Science 2020-05-05 Xiang Yue , Bernal Jimenez Gutierrez , Huan Sun

The rapid growth of biomedical literature poses challenges for manual knowledge curation and synthesis. Biomedical Natural Language Processing (BioNLP) automates the process. While Large Language Models (LLMs) have shown promise in general…

Although large language models (LLMs) often produce impressive outputs, it remains unclear how they perform in real-world scenarios requiring strong reasoning skills and expert domain knowledge. We set out to investigate whether close- and…

Computation and Language · Computer Science 2023-12-27 Valentin Liévin , Christoffer Egeberg Hother , Andreas Geert Motzfeldt , Ole Winther

The integration of Large Language Models (LLMs) into the healthcare domain has the potential to significantly enhance patient care and support through the development of empathetic, patient-facing chatbots. This study investigates an…

Computation and Language · Computer Science 2024-05-28 Man Luo , Christopher J. Warren , Lu Cheng , Haidar M. Abdul-Muhsin , Imon Banerjee

Medical reasoning in large language models (LLMs) aims to emulate clinicians' diagnostic thinking, but current benchmarks such as MedQA-USMLE, MedMCQA, and PubMedQA often mix reasoning with factual recall. We address this by separating 11…

Passively collected behavioral health data from ubiquitous sensors holds significant promise to provide mental health professionals insights from patient's daily lives; however, developing analysis tools to use this data in clinical…

Recent advancements in Large Language Models (LLMs) and Large Vision Language Models (LVLMs) have enabled general-purpose systems to demonstrate promising capabilities in complex reasoning tasks, including those in the medical domain.…

Computation and Language · Computer Science 2026-05-19 Rafid Ahmed , Intesar Tahmid , Mir Sazzat Hossain , Tasnimul Hossain Tomal , Md Fahim , Md Farhad Alam Bhuiyan

Generating discharge summaries is a crucial yet time-consuming task in clinical practice, essential for conveying pertinent patient information and facilitating continuity of care. Recent advancements in large language models (LLMs) have…

Computation and Language · Computer Science 2025-07-01 Yiming Li , Fang Li , Kirk Roberts , Licong Cui , Cui Tao , Hua Xu

Social telehealth has revolutionized healthcare by enabling patients to share symptoms and receive medical consultations remotely. Users frequently post symptoms on social media and online health platforms, generating a vast repository of…

Computation and Language · Computer Science 2025-02-04 Malak Mohamed , Rokaia Emad , Ali Hamdi

The rapidly increasing volume of electronic health record (EHR) data underscores a pressing need to unlock biomedical knowledge from unstructured clinical texts to support advancements in data-driven clinical systems, including patient…

Computation and Language · Computer Science 2025-10-21 Manuela Daniela Danu , George Marica , Constantin Suciu , Lucian Mihai Itu , Oladimeji Farri