English
Related papers

Related papers: HemBLIP: A Vision-Language Model for Interpretable…

200 papers

This paper introduces an innovative approach to Medical Vision-Language Pre-training (Med-VLP) area in the specialized context of radiograph representation learning. While conventional methods frequently merge textual annotations into…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Hanqi Jiang , Xixuan Hao , Yuzhou Huang , Chong Ma , Jiaxun Zhang , Yi Pan , Ruimao Zhang

Large Language Models (LLMs) have achieved remarkable success and have been applied across various scientific fields, including chemistry. However, many chemical tasks require the processing of visual information, which cannot be…

Vision Language Models (VLMs) encode multimodal inputs over large, complex, and difficult-to-interpret architectures, which limit transparency and trust. We propose a Multimodal Inversion for Model Interpretation and Conceptualization…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Animesh Jain , Alexandros Stergiou

Label-free approaches are attractive in cytological imaging due to their flexibility and cost efficiency. They are supported by machine learning methods, which, despite the lack of labeling and the associated lower contrast, can classify…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Stefan Röhrl , Johannes Groll , Manuel Lengl , Simon Schumann , Christian Klenk , Dominik Heim , Martin Knopp , Oliver Hayden , Klaus Diepold

Acute lymphoblastic leukemia (ALL) is a form of blood cancer that affects the white blood cells. ALL constitutes approximately 25% of pediatric cancers. Early diagnosis and treatment of ALL are crucial for improving patient outcomes. The…

Image and Video Processing · Electrical Eng. & Systems 2024-07-16 Dimitris Papaioannou , Ioannis Christou , Nikos Anagnou , Aristotelis Chatziioannou

Concept-based models naturally lend themselves to the development of inherently interpretable skin lesion diagnosis, as medical experts make decisions based on a set of visual patterns of the lesion. Nevertheless, the development of these…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Cristiano Patrício , Luís F. Teixeira , João C. Neves

Medical image classification is a critical problem for healthcare, with the potential to alleviate the workload of doctors and facilitate diagnoses of patients. However, two challenges arise when deploying deep learning models to real-world…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 An Yan , Yu Wang , Yiwu Zhong , Zexue He , Petros Karypis , Zihan Wang , Chengyu Dong , Amilcare Gentili , Chun-Nan Hsu , Jingbo Shang , Julian McAuley

Leukemia, a severe form of blood cancer, claims thousands of lives each year. This study focuses on the detection of Acute Lymphoblastic Leukemia (ALL) using advanced image processing and deep learning techniques. By leveraging recent…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Alaa Awad , Salah A. Aly

Automated white blood cell (WBC) classification is essential for leukemia screening but remains challenged by extreme class imbalance, long-tail distributions, and domain shift, leading deep models to overfit dominant classes and fail on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Duc T. Nguyen , Hoang-Long Nguyen , Huy-Hieu Pham

Vision-Language Models (VLMs) have shown promise in various 2D visual tasks, yet their readiness for 3D clinical diagnosis remains unclear due to stringent demands for recognition precision, reasoning ability, and domain knowledge. To…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Yixiong Chen , Wenjie Xiao , Pedro R. A. S. Bassi , Xinze Zhou , Sezgin Er , Ibrahim Ethem Hamamci , Zongwei Zhou , Alan Yuille

Concept Bottleneck Models (CBMs) are a prominent framework for interpretable AI that map learned visual features to a set of meaningful concepts for task-specific downstream predictions. Their sequential structure enhances transparency by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Mohamed Harmanani , Bining Long , Zhuoxin Guo , Paul F. R. Wilson , Amirhossein Sabour , Minh Nguyen Nhat To , Gabor Fichtinger , Purang Abolmaesumi , Parvin Mousavi

Recent progress in large language models (LLMs) has shown strong potential for multimodal reasoning beyond natural language. In this work, we explore the use of a fine-tuned Vision-Language Model (VLM), based on LLaMA 3.2, for classifying…

Machine Learning · Computer Science 2025-08-28 Dikshant Sagar , Kaiwen Yu , Alejandro Yankelevich , Jianming Bian , Pierre Baldi

The clinical adoption of artificial intelligence (AI) in medical imaging requires models that are both diagnostically accurate and interpretable to clinicians. While current multimodal biomedical foundation models prioritize performance,…

Automated analysis of peripheral blood smears for Acute Lymphoblastic Leukemia (ALL) is hindered by low contrast and substantial variability in cytoplasmic appearance, which complicate conventional membrane-based segmentation. We found that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Larissa Ferreira Rodrigues Moreira , Leonardo Gabriel Ferreira Rodrigues , Rodrigo Moreira , André Ricardo Backes

Trained on a vast amount of data, Large Language models (LLMs) have achieved unprecedented success and generalization in modeling fairly complex textual inputs in the abstract space, making them powerful tools for zero-shot learning. Such…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Shervin Ardeshir

Vision-Language Models (VLMs) facilitate medical visual question answering (MedVQA) by jointly interpreting images and text. However, existing models typically depend on large architectures and closed-set answers, which limits their…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Jiayan Yang , Zhuoyu Wu , Wenqi Fang

Current benchmarks for assessing vision-language models (VLMs) often focus on their perception or problem-solving capabilities and neglect other critical aspects such as fairness, multilinguality, or toxicity. Furthermore, they differ in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Tony Lee , Haoqin Tu , Chi Heem Wong , Wenhao Zheng , Yiyang Zhou , Yifan Mai , Josselin Somerville Roberts , Michihiro Yasunaga , Huaxiu Yao , Cihang Xie , Percy Liang

While Vision-Language Models (VLMs) have demonstrated significant potential in chemical visual understanding, current models are predominantly optimized for direct visual question-answering tasks. This paradigm often results in "black-box"…

Computation and Language · Computer Science 2026-04-09 Xuanle Zhao , Xinyuan Cai , Xiang Cheng , Xiuyi Chen , Bo Xu

Explainability is a key requirement for computer-aided diagnosis systems in clinical decision-making. Multiple instance learning with attention pooling provides instance-level explainability, however for many clinical applications a deeper,…

Image and Video Processing · Electrical Eng. & Systems 2023-03-16 Ario Sadafi , Oleksandra Adonkina , Ashkan Khakzar , Peter Lienemann , Rudolf Matthias Hehr , Daniel Rueckert , Nassir Navab , Carsten Marr

This paper features convolutional neural networks defined on hypercomplex algebras applied to classify lymphocytes in blood smear digital microscopic images. Such classification is helpful for the diagnosis of acute lymphoblast leukemia…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Guilherme Vieira , Marcos Eduardo Valle