English
Related papers

Related papers: BiomedXPro: Prompt Optimization for Explainable Di…

200 papers

Prompt tuning, like CoOp, has recently shown promising vision recognizing and transfer learning ability on various downstream tasks with the emergence of large pre-trained vision-language models like CLIP. However, we identify that existing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yongzhu Miao , Shasha Li , Jintao Tang , Ting Wang

Artificial Intelligence (AI) in skin disease diagnosis has improved significantly, but a major concern is that these models frequently show biased performance across subgroups, especially regarding sensitive attributes such as skin color.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Nusrat Munia , Abdullah-Al-Zubaer Imran

This paper introduces MMMU-Pro, a robust version of the Massive Multi-discipline Multimodal Understanding and Reasoning (MMMU) benchmark. MMMU-Pro rigorously assesses multimodal models' true understanding and reasoning capabilities through…

Computation and Language · Computer Science 2025-05-23 Xiang Yue , Tianyu Zheng , Yuansheng Ni , Yubo Wang , Kai Zhang , Shengbang Tong , Yuxuan Sun , Botao Yu , Ge Zhang , Huan Sun , Yu Su , Wenhu Chen , Graham Neubig

One of the major barriers to using large language models (LLMs) in medicine is the perception they use uninterpretable methods to make clinical decisions that are inherently different from the cognitive processes of clinicians. In this…

Computation and Language · Computer Science 2023-08-15 Thomas Savage , Ashwin Nayak , Robert Gallo , Ekanath Rangan , Jonathan H Chen

Bone health studies are crucial in medical practice for the early detection and treatment of Osteopenia and Osteoporosis. Clinicians usually make a diagnosis based on densitometry (DEXA scans) and patient history. The applications of AI in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Alvaro Lopez Pellicer , Andre Mariucci , Plamen Angelov , Marwan Bukhari , Jemma G. Kerns

Large language models (LLMs) have demonstrated increasingly sophisticated performance in medical and other fields of knowledge. Traditional methods of creating specialist LLMs require extensive fine-tuning and training of models on large…

Computation and Language · Computer Science 2025-02-25 Sean Wu , Michael Koo , Fabien Scalzo , Ira Kurtz

Artificial intelligence has become pervasive across disciplines and fields, and biomedical image and signal processing is no exception. The growing and widespread interest on the topic has triggered a vast research activity that is…

Machine Learning · Computer Science 2022-07-12 Guang Yang , Arvind Rao , Christine Fernandez-Maloigne , Vince Calhoun , Gloria Menegaz

Medical vision-language pre-training (Med-VLP) models have recently accelerated the fast-growing medical diagnostics application. However, most Med-VLP models learn task-specific representations independently from scratch, thereby leading…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Chenlu Zhan , Yufei Zhang , Yu Lin , Gaoang Wang , Hongwei Wang

Accurate and early diagnosis of malignant melanoma is critical for improving patient outcomes. While convolutional neural networks (CNNs) have shown promise in dermoscopic image analysis, they often neglect clinical metadata and require…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Jihyun Moon , Charmgil Hong

Large Language models (LLMs) have emerged as powerful tools for addressing challenges across diverse domains. Notably, recent studies have demonstrated that large language models significantly enhance the efficiency of biomolecular analysis…

Computation and Language · Computer Science 2025-03-07 Jiyue Jiang , Zikang Wang , Yuheng Shan , Heyan Chai , Jiayi Li , Zixian Ma , Xinrui Zhang , Yu Li

Vision-language foundation models (VLMs) have shown great potential in feature transfer and generalization across a wide spectrum of medical-related downstream tasks. However, fine-tuning these models is resource-intensive due to their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Ye Du , Nanxi Yu , Shujun Wang

Prompt engineering significantly influences the reliability and clinical utility of Large Language Models (LLMs) in medical applications. Current optimization approaches inadequately address domain-specific medical knowledge and safety…

Computation and Language · Computer Science 2025-08-26 Yinda Chen , Yangfan He , Jing Yang , Dapeng Zhang , Zhenlong Yuan , Muhammad Attique Khan , Jamel Baili , Por Lip Yee

Visual explanation (attention)-guided learning uses not only labels but also explanations to guide model reasoning process. While visual attention-guided learning has shown promising results, it requires a large number of explanation…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Yifei Zhang , Siyi Gu , Bo Pan , Guangji Bai , Meikang Qiu , Xiaofeng Yang , Liang Zhao

Relation extraction is a core problem for natural language processing in the biomedical domain. Recent research on relation extraction showed that prompt-based learning improves the performance on both fine-tuning on full training set and…

Computation and Language · Computer Science 2022-04-25 Hui-Syuan Yeh , Thomas Lavergne , Pierre Zweigenbaum

Large language models (LLMs) have become widely adopted as automated judges for evaluating AI-generated content. Despite their success, aligning LLM-based evaluations with human judgments remains challenging. While supervised fine-tuning on…

Artificial Intelligence · Computer Science 2026-02-13 Bo Pan , Xuan Kan , Kaitai Zhang , Yan Yan , Shunwen Tan , Zihao He , Zixin Ding , Junjie Wu , Liang Zhao

Vision generation remains a challenging frontier in artificial intelligence, requiring seamless integration of visual understanding and generative capabilities. In this paper, we propose a novel framework, Vision-Driven Prompt Optimization…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Leo Franklin , Apiradee Boonmee , Kritsada Wongsuwan

Prompt engineering is a technique that involves augmenting a large pre-trained model with task-specific hints, known as prompts, to adapt the model to new tasks. Prompts can be created manually as natural language instructions or generated…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Jindong Gu , Zhen Han , Shuo Chen , Ahmad Beirami , Bailan He , Gengyuan Zhang , Ruotong Liao , Yao Qin , Volker Tresp , Philip Torr

Large language models used for clinical abstraction are sensitive to prompt wording, yet most work treats prompts as fixed and studies uncertainty in isolation. We argue these should be treated jointly. Across two clinical tasks (MedAlign…

Computation and Language · Computer Science 2026-02-02 Arinbjörn Kolbeinsson , Daniel Timbie , Sajjan Narsinghani , Sanjay Hariharan

Multi-modal data abounds in biomedicine, such as radiology images and reports. Interpreting this data at scale is essential for improving clinical care and accelerating clinical research. Biomedical text with its complex semantics poses…

While reasoning-enhanced large language models perform strongly on English medical tasks, a persistent multilingual gap remains, with substantially weaker reasoning in local languages, limiting equitable global medical deployment. To bridge…