English
Related papers

Related papers: Med42 -- Evaluating Fine-Tuning Strategies for Med…

200 papers

While large language models (LLMs) achieve near-perfect scores on medical licensing exams, these evaluations inadequately reflect the complexity and diversity of real-world clinical practice. We introduce MedHELM, an extensible evaluation…

Recent advancements in artificial intelligence (AI), especially large language models (LLMs), have significantly advanced healthcare applications and demonstrated potentials in intelligent medical treatment. However, there are conspicuous…

Computation and Language · Computer Science 2025-05-26 Qinkai Yu , Mingyu Jin , Dong Shu , Chong Zhang , Lizhou Fan , Wenyue Hua , Suiyuan Zhu , Yanda Meng , Zhenting Wang , Mengnan Du , Yongfeng Zhang

Automated Program Repair (APR) has evolved significantly with the advent of Large Language Models (LLMs). Fine-tuning LLMs for program repair is a recent avenue of research, with many dimensions which have not been explored. Existing work…

Software Engineering · Computer Science 2025-09-08 André Silva , Sen Fang , Martin Monperrus

Large language models (LLMs) excel on many NLP benchmarks, but their behavior on real-world, semi-structured prediction remains underexplored. We present LlaMADRS, a benchmark for structured clinical assessment from dialogue built on the…

Human-Computer Interaction · Computer Science 2026-04-23 Gaoussou Youssouf Kebe , Jeffrey M. Girard , Einat Liebenthal , Justin Baker , Fernando De la Torre , Louis-Philippe Morency

The recent success of large language models (LLMs) has paved the way for their adoption in the high-stakes domain of healthcare. Specifically, the application of LLMs in patient-trial matching, which involves assessing patient eligibility…

Artificial Intelligence · Computer Science 2023-12-18 Mauro Nievas , Aditya Basu , Yanshan Wang , Hrituraj Singh

Pharmaceutical three-dimensional (3D) printing is an advanced fabrication technology with the potential to enable truly personalised dosage forms. Recent studies have integrated artificial intelligence (AI) to accelerate formulation and…

Artificial Intelligence · Computer Science 2026-05-19 Adeshola Okubena , Yusuf Ali Mohammed , Moe Elbadawi

As Large Language Models (LLMs) are increasingly integrated into healthcare to address complex inquiries, ensuring their reliability remains a critical challenge. Recent studies have highlighted that generic LLMs often struggle in clinical…

Computation and Language · Computer Science 2026-04-01 Bian Sun , Zhenjian Wang , Orvill de la Torre , Zirui Wang

Large language models (LLMs) show promise for improving the efficiency of qualitative analysis in large, multi-site health-services research. Yet methodological guidance for LLM integration into qualitative analysis and evidence of their…

Computation and Language · Computer Science 2026-01-22 Sasha Ronaghi , Emma-Louise Aveling , Maria Levis , Rachel Lauren Ross , Emily Alsentzer , Sara Singer

Large Language Models are traditionally finetuned on large instruction datasets. However recent studies suggest that small, high-quality datasets can suffice for general purpose instruction following. This lack of consensus surrounding…

Machine Learning · Computer Science 2023-12-29 Aditi Jha , Sam Havens , Jeremy Dohmann , Alex Trott , Jacob Portes

The recent success of Large Language Models (LLMs) has garnered significant attention in both academia and industry. Prior research on LLMs has primarily focused on enhancing or leveraging their generalization capabilities in zero- and…

Computation and Language · Computer Science 2024-04-01 Shulin Liu , Chengcheng Xu , Hao Liu , Tinghao Yu , Tao Yang

Automated code smell detection faces persistent challenges due to the subjectivity of heuristic rules and the limited performance of traditional ML/DL models. While Large Language Models (LLMs) offer a promising alternative, their adoption…

Software Engineering · Computer Science 2026-03-30 Beiqi Zhang , Peng Liang , Xin Zhou , Xiyu Zhou , David Lo , Qiong Feng , Zengyang Li , Lin Li

Artificial intelligence (AI) is widely deployed to solve problems related to marketing attribution and budget optimization. However, AI models can be quite complex, and it can be difficult to understand model workings and insights without…

Computation and Language · Computer Science 2024-04-23 Yilin Gao , Sai Kumar Arava , Yancheng Li , James W. Snyder

Matching patients to clinical trials is a key unsolved challenge in bringing new drugs to market. Today, identifying patients who meet a trial's eligibility criteria is highly manual, taking up to 1 hour per patient. Automated screening is…

Computation and Language · Computer Science 2024-04-11 Michael Wornow , Alejandro Lozano , Dev Dash , Jenelle Jindal , Kenneth W. Mahaffey , Nigam H. Shah

With the proliferation of open-sourced Large Language Models (LLMs) and efficient finetuning techniques, we are on the cusp of the emergence of numerous domain-specific LLMs that have been finetuned for expertise across specialized fields…

Computation and Language · Computer Science 2023-06-28 Teo Susnjak

We investigate fine-tuning Vision-Language Models (VLMs) for multi-task medical image understanding, focusing on detection, localization, and counting of findings in medical images. Our objective is to evaluate whether instruction-tuned…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Sushant Gautam , Michael A. Riegler , Pål Halvorsen

We study the limitations of Large Language Models (LLMs) for the task of response generation in human-machine dialogue. Several techniques have been proposed in the literature for different dialogue types (e.g., Open-Domain). However, the…

Computation and Language · Computer Science 2024-08-06 Simone Alghisi , Massimo Rizzoli , Gabriel Roccabruna , Seyed Mahed Mousavi , Giuseppe Riccardi

Large Language Models (LLMs) have shown promise in various domains, including healthcare, with significant potential to transform mental health applications by enabling scalable and accessible solutions. This study aims to provide a…

Artificial Intelligence · Computer Science 2025-11-25 Abdelrahman Hanafi , Mohammed Saad , Noureldin Zahran , Radwa J. Hanafy , Mohammed E. Fouda

Recent advancements in reasoning-enhanced large language models (LLMs), such as DeepSeek-R1 and OpenAI-o3, have demonstrated significant progress. However, their application in professional medical contexts remains underexplored,…

Computation and Language · Computer Science 2025-03-11 Pengcheng Qiu , Chaoyi Wu , Shuyu Liu , Weike Zhao , Zhuoxia Chen , Hongfei Gu , Chuanjin Peng , Ya Zhang , Yanfeng Wang , Weidi Xie

This paper investigates and validates the impact of fine-tuning on large language model performance, focusing on parameter-efficient methods (LoRA and QLoRA). We evaluate model capabilities across three key domains: (1) commonsense…

Computation and Language · Computer Science 2025-06-13 Qingda , Mai