English
Related papers

Related papers: BiomedXPro: Prompt Optimization for Explainable Di…

200 papers

Prompting is fundamental to unlocking the full potential of large language models. To automate and enhance this process, automatic prompt optimization (APO) has been developed, demonstrating effectiveness primarily in text-only input…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Qipeng Zhu , Yanzhe Chen , Huasong Zhong , Yan Li , Jie Chen , Zhixin Zhang , Junping Zhang , Zhenheng Yang

Synthetic data has become a cornerstone for scaling large language models, yet its multilingual use remains bottlenecked by translation-based prompts. This strategy inherits English-centric framing and style and neglects cultural…

Computation and Language · Computer Science 2025-10-23 David Mora , Viraat Aryabumi , Wei-Yin Ko , Sara Hooker , Julia Kreutzer , Marzieh Fadaee

The task of medical image recognition is notably complicated by the presence of varied and multiple pathological indications, presenting a unique challenge in multi-label classification with unseen labels. This complexity underlines the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Yaoqin Ye , Junjie Zhang , Hongwei Shi

As powerful pre-trained vision-language models (VLMs) like CLIP gain prominence, numerous studies have attempted to combine VLMs for downstream tasks. Among these, prompt learning has been validated as an effective method for adapting to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Yu Du , Tong Niu , Rong Zhao

Multimodal language models (MLMs) show promise for clinical decision support and diagnostic reasoning, raising the prospect of end-to-end automated medical image interpretation. However, clinicians are highly selective in adopting AI tools;…

Artificial Intelligence · Computer Science 2025-08-06 Mahtab Bigverdi , Wisdom Ikezogwo , Kevin Zhang , Hyewon Jeong , Mingyu Lu , Sungjae Cho , Linda Shapiro , Ranjay Krishna

As the field of healthcare increasingly adopts artificial intelligence, it becomes important to understand which types of explanations increase transparency and empower users to develop confidence and trust in the predictions made by…

Artificial Intelligence · Computer Science 2025-05-16 Felix Liedeker , Olivia Sanchez-Graillet , Moana Seidler , Christian Brandt , Jörg Wellmer , Philipp Cimiano

Clinical reasoning in medicine is a hypothesis-driven process where physicians refine diagnoses from limited information through targeted history, physical examination, and diagnostic investigations. In contrast, current medical benchmarks…

Machine Learning · Computer Science 2025-10-14 Christopher Chiu , Silviu Pitis , Mihaela van der Schaar

Remarkable success of modern image-based AI methods and the resulting interest in their applications in critical decision-making processes has led to a surge in efforts to make such intelligent systems transparent and explainable. The need…

Artificial Intelligence · Computer Science 2020-11-30 Adriano Lucieri , Muhammad Naseer Bajwa , Andreas Dengel , Sheraz Ahmed

Large Multimodal Models (LMMs), or Vision-Language Models (VLMs), have shown impressive capabilities in a wide range of visual tasks. However, they often struggle with fine-grained visual reasoning, failing to identify domain-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Yucheng Shi , Quanzheng Li , Jin Sun , Xiang Li , Ninghao Liu

Large Language Models (LLMs) perform best with well-crafted prompts, yet prompt engineering remains manual, inconsistent, and inaccessible to non-experts. We introduce Promptomatix, an automatic prompt optimization framework that transforms…

Computation and Language · Computer Science 2025-07-28 Rithesh Murthy , Ming Zhu , Liangwei Yang , Jielin Qiu , Juntao Tan , Shelby Heinecke , Caiming Xiong , Silvio Savarese , Huan Wang

The lack of transparency and explainability hinders the clinical adoption of Machine learning (ML) algorithms. While explainable artificial intelligence (XAI) methods have been proposed, little research has focused on the agreement between…

Machine Learning · Computer Science 2023-11-29 Aida Brankovic , Wenjie Huang , David Cook , Sankalp Khanna , Konstanty Bialkowski

Addressing the challenge of multimodal data fusion in high-dimensional biomedical informatics, we propose MMCTOP, a MultiModal Clinical-Trial Outcome Prediction framework that integrates heterogeneous biomedical signals spanning (i)…

Machine Learning · Computer Science 2025-12-29 Carolina Aparício , Qi Shi , Bo Wen , Tesfaye Yadete , Qiwei Han

Medical Vision-Language Models (Med-VLMs) have achieved expert-level proficiency in interpreting diagnostic imaging. However, current models are predominantly trained on professional literature, limiting their ability to communicate…

Computation and Language · Computer Science 2026-04-08 Han Jang , Junhyeok Lee , Heeseong Eum , Kyu Sung Choi

While existing large vision-language multimodal models focus on whole image understanding, there is a prominent gap in achieving region-specific comprehension. Current approaches that use textual coordinates or spatial encodings often fail…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Mu Cai , Haotian Liu , Dennis Park , Siva Karthik Mustikovela , Gregory P. Meyer , Yuning Chai , Yong Jae Lee

Cross-modal medical image translation is an essential task for synthesizing missing modality data for clinical diagnosis. However, current learning-based techniques have limitations in capturing cross-modal and global features, restricting…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Xuhang Chen , Chi-Man Pun , Shuqiang Wang

Recent advances in context optimization (CoOp) guided by large language model (LLM)-distilled medical semantic priors offer a scalable alternative to manual prompt engineering and full fine-tuning for adapting biomedical CLIP-based…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Minye Shao , Sihan Guo , Xinrun Li , Xingyu Miao , Haoran Duan , Yang Long

Despite the rapid expansion of Large Language Models (LLMs) in healthcare, robust and explainable evaluation of their ability to assess clinical trial reporting according to CONSORT standards remains an open challenge. In particular,…

Artificial Intelligence · Computer Science 2026-02-26 Sohyeon Jeon , Hyung-Chul Lee

Despite impressive recent advances in text-to-image diffusion models, obtaining high-quality images often requires prompt engineering by humans who have developed expertise in using them. In this work, we present NeuroPrompts, an adaptive…

Artificial Intelligence · Computer Science 2024-04-09 Shachar Rosenman , Vasudev Lal , Phillip Howard

Biomedical Vision--Language Models (VLMs) have shown remarkable promise in few-shot medical diagnosis but face a critical bottleneck: \textit{fragility to prompt variations}.Existing adaptation frameworks typically optimize visual and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Huanyang Tong , Kai Liu , Fangjun Kuang , Huiling Chen

Medical Vision-Language Models (MedVLMs) excel at perception tasks but struggle with complex clinical reasoning required in real-world scenarios. While reinforcement learning (RL) has been explored to enhance reasoning capabilities,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Meidan Ding , Jipeng Zhang , Wenxuan Wang , Haiqin Zhong , Xiaoling Luo , Wenting Chen , Linlin Shen