English
Related papers

Related papers: Insight: A Multi-Modal Diagnostic Pipeline using L…

200 papers

With the rapid progress of Multimodal LLMs, evaluating their mathematical reasoning capabilities has become an increasingly important research direction. In particular, visual-textual mathematical reasoning serves as a key indicator of an…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Hao Liang , Linzhuang Sun , Minxuan Zhou , Zirong Chen , Meiyi Qiang , Mingan Lin , Tianpeng Li , Fan Yang , Zenan Zhou , Wentao Zhang

In healthcare tabular predictions, classical models with feature engineering often outperform neural approaches. Recent advances in Large Language Models enable the integration of domain knowledge into feature engineering, offering a…

Machine Learning · Computer Science 2026-03-04 Zizheng Zhang , Yiming Li , Justin Xu , Jinyu Wang , Rui Wang , Lei Song , Jiang Bian , David W Eyre , Jingjing Fu

Multimodal large language models (MLLMs) have achieved significant success in the general field of image processing. Their emerging task generalization and freeform conversational capabilities can greatly facilitate medical diagnostic…

Image and Video Processing · Electrical Eng. & Systems 2024-09-17 Youzhu Jin , Yichen Zhang

The rise of Multimodal Large Language Models (MLLMs) has become a transformative force in the field of artificial intelligence, enabling machines to process and generate content across multiple modalities, such as text, images, audio, and…

Computation and Language · Computer Science 2025-12-09 Ming Li , Keyu Chen , Ziqian Bi , Ming Liu , Xinyuan Song , Zekun Jiang , Tianyang Wang , Benji Peng , Qian Niu , Junyu Liu , Jinlang Wang , Sen Zhang , Xuanhe Pan , Jiawei Xu , Pohsun Feng

Accurate dental diagnosis is essential for oral healthcare, yet many individuals lack access to timely professional evaluation. Existing AI-based methods primarily treat diagnosis as a visual pattern recognition task and do not reflect the…

Prompt learning has demonstrated impressive efficacy in the fine-tuning of multimodal large models to a wide range of downstream tasks. Nonetheless, applying existing prompt learning methods for the diagnosis of neurological disorder still…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Liang Peng , Songyue Cai , Zongqian Wu , Huifang Shang , Xiaofeng Zhu , Xiaoxiao Li

Artificial intelligence has demonstrated significant potential in clinical decision-making; however, developing models capable of adapting to diverse real-world scenarios and performing complex diagnostic reasoning remains a major…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Ronghao Xu , Zhen Huang , Yangbo Wei , Xiaoqian Zhou , Zikang Xu , Ting Liu , Zihang Jiang , S. Kevin Zhou

Background and Aims: Large language models (LLMs) have shown remarkable generalization and transfer capabilities by learning from vast corpora of text and web data. Their semantic representations allow cross-task knowledge transfer and…

Machine Learning · Computer Science 2025-09-25 Yuqi Jin , Zhenhao Shuai , Zihan Hu , Weiteng Zhang , Weihao Xie , Jianwei Shuai , Xian Shen , Zhen Feng

Accurate staging of Diabetic Retinopathy (DR) is essential for guiding timely interventions and preventing vision loss. However, current staging models are hardly interpretable, and most public datasets contain no clinical reasoning or…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Chenjun Li , Laurin Lux , Alexander H. Berger , Martin J. Menten , Mert R. Sabuncu , Johannes C. Paetzold

Biomedical research now commonly integrates diverse data types or views from the same individuals to better understand the pathobiology of complex diseases, but the challenge lies in meaningfully integrating these diverse views. Existing…

Machine Learning · Computer Science 2023-12-05 Sarthak Jain , Sandra E. Safo

Automatic differential diagnosis (DDx) is an essential medical task that generates a list of potential diseases as differentials based on patient symptom descriptions. In practice, interpreting these differential diagnoses yields…

Computation and Language · Computer Science 2024-11-08 Shuang Zhou , Mingquan Lin , Sirui Ding , Jiashuo Wang , Genevieve B. Melton , James Zou , Rui Zhang

Whole Slide Images (WSIs) exhibit hierarchical structure, where diagnostic information emerges from cellular morphology, regional tissue organization, and global context. Existing Computational Pathology (CPath) Multimodal Large Language…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Basit Alawode , Arif Mahmood , Muaz Khalifa Al-Radi , Shahad Albastaki , Asim Khan , Muhammad Bilal , Moshira Ali Abdalla , Mohammed Bennamoun , Sajid Javed

Medical large vision-language models (LVLMs) have demonstrated promising performance across various single-image question answering (QA) benchmarks, yet their capability in processing multi-image clinical scenarios remains underexplored.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Xikai Yang , Juzheng Miao , Yuchen Yuan , Jiaze Wang , Qi Dou , Jinpeng Li , Pheng-Ann Heng

Explainability is critical for the clinical adoption of medical visual question answering (VQA) systems, as physicians require transparent reasoning to trust AI-generated diagnoses. We present MedXplain-VQA, a comprehensive framework…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Hai-Dang Nguyen , Minh-Anh Dang , Minh-Tan Le , Minh-Tuan Le

Recent advances in large language models (LLMs) have shown promising results in medical diagnosis, with some studies indicating superior performance compared to human physicians in specific scenarios. However, the diagnostic capabilities of…

Artificial Intelligence · Computer Science 2025-03-24 Zhoujian Sun , Ziyi Liu , Cheng Luo , Jiebin Chu , Zhengxing Huang

Rapid advancements in imaging techniques and analytical methods over the past decade have revolutionized our ability to comprehensively probe the biological world at multiple scales, pinpointing the type, quantity, location, and even…

Artificial Intelligence · Computer Science 2025-10-02 Shanghang Zhang , Gaole Dai , Tiejun Huang , Jianxu Chen

Medical report interpretation plays a crucial role in healthcare, enabling both patient-facing explanations and effective information flow across clinical systems. While recent vision-language models (VLMs) and large language models (LLMs)…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Fangxin Shang , Yuan Xia , Dalu Yang , Yahui Wang , Binglin Yang

The complexity and heterogeneity of data in many real-world applications pose significant challenges for traditional machine learning and signal processing techniques. For instance, in medicine, effective analysis of diverse physiological…

Machine Learning · Computer Science 2024-08-16 Nimeesha Chan , Felix Parker , William Bennett , Tianyi Wu , Mung Yao Jia , James Fackler , Kimia Ghobadi

Machine learning (ML) is increasingly applied to Electronic Health Records (EHRs) to solve clinical prediction tasks. Although many ML models perform promisingly, issues with model transparency and interpretability limit their adoption in…

Human-Computer Interaction · Computer Science 2021-10-05 Furui Cheng , Dongyu Liu , Fan Du , Yanna Lin , Alexandra Zytek , Haomin Li , Huamin Qu , Kalyan Veeramachaneni

Clinical decision-making in emergency medicine demands rapid, accurate diagnoses under uncertainty. Despite benchmark progress, evidence for LLMs as interactive aids in live physician workflows remains sparse. MedSyn lets physicians…