English
Related papers

Related papers: Is ChatGPT-5 Ready for Mammogram VQA?

200 papers

Breast cancer is one of the deadliest cancer worldwide. Timely detection could reduce mortality rates. In the clinical routine, classifying benign and malignant tumors from ultrasound (US) imaging is a crucial but challenging task. An…

Image and Video Processing · Electrical Eng. & Systems 2021-01-01 Jorge F. Lazo , Sara Moccia , Emanuele Frontoni , Elena De Momi

MLLMs MLLMs are beginning to appear in clinical workflows, but their ability to perform complex medical reasoning remains unclear. We present Med-CMR, a fine-grained Medical Complex Multimodal Reasoning benchmark. Med-CMR distinguishes from…

The examination of chest X-ray images is a crucial component in detecting various thoracic illnesses. This study introduces a new image description generation model that integrates a Vision Transformer (ViT) encoder with cross-modal…

Image and Video Processing · Electrical Eng. & Systems 2025-04-24 Lakshita Agarwal , Bindu Verma

The large language model called ChatGPT has drawn extensively attention because of its human-like expression and reasoning abilities. In this study, we investigate the feasibility of using ChatGPT in experiments on using ChatGPT to…

Computation and Language · Computer Science 2024-10-22 Qing Lyu , Josh Tan , Michael E. Zapadka , Janardhana Ponnatapura , Chuang Niu , Kyle J. Myers , Ge Wang , Christopher T. Whitlow

Digital mammography is essential to breast cancer detection, and deep learning offers promising tools for faster and more accurate mammogram analysis. In radiology and other high-stakes environments, uninterpretable ("black box") deep…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Julia Yang , Alina Jade Barnett , Jon Donnelly , Satvik Kishore , Jerry Fang , Fides Regina Schwartz , Chaofan Chen , Joseph Y. Lo , Cynthia Rudin

A key promise of AI applications in healthcare is in increasing access to quality medical care in under-served populations and emerging markets. However, deep learning models are often only trained on data from advantaged populations that…

Image and Video Processing · Electrical Eng. & Systems 2019-11-04 Kevin Wu , Eric Wu , Yaping Wu , Hongna Tan , Greg Sorensen , Meiyun Wang , Bill Lotter

Our objective is to show the feasibility of using simulated mammograms to detect mammographically-occult (MO) cancer in women with dense breasts and a normal screening mammogram who could be triaged for additional screening with magnetic…

Image and Video Processing · Electrical Eng. & Systems 2021-09-28 Juhun Lee , Robert M. Nishikawa

Multimodal large language models (MLLMs) represent an evolutionary expansion in the capabilities of traditional large language models, enabling them to tackle challenges that surpass the scope of purely text-based applications. It leverages…

Computation and Language · Computer Science 2025-01-17 Jinlong He , Pengfei Li , Gang Liu , Genrong He , Zhaolin Chen , Shenjun Zhong

Breast cancer is the most commonly diagnosed cancer and the leading cause of cancer-related mortality in women globally. Mammography is essential for the early detection and diagnosis of breast lesions. Despite recent progress in foundation…

We present a quantitative evaluation to understand the effect of zero-shot large-language model (LLMs) and prompting uses on chart reading tasks. We asked LLMs to answer 107 visualization questions to compare inference accuracies between…

Human-Computer Interaction · Computer Science 2025-10-09 Kaichun Yang , Jian Chen

Answering semantically-complicated questions according to an image is challenging in Visual Question Answering (VQA) task. Although the image can be well represented by deep learning, the question is always simply embedded and cannot well…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 JianJian Cao , Xiameng Qin , Sanyuan Zhao , Jianbing Shen

While there is much excitement about the potential of large multimodal models (LMM), a comprehensive evaluation is critical to establish their true capabilities and limitations. In support of this aim, we evaluate two state-of-the-art LMMs,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Mengchen Liu , Chongyan Chen , Danna Gurari

In this paper, we study the application of GIST SVM in disease prediction (detection of cancer). Pattern classification problems can be effectively solved by Support vector machines. Here we propose a classifier which can differentiate…

Machine Learning · Computer Science 2012-03-07 S. Aruna , S. P. Rajagopalan , L. V. Nandakishore

Multimodal large language models (MLLMs) are designed to process and integrate information from multiple sources, such as text, speech, images, and videos. Despite its success in language understanding, it is critical to evaluate the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Hao Lu , Xuesong Niu , Jiyao Wang , Yin Wang , Qingyong Hu , Jiaqi Tang , Yuting Zhang , Kaishen Yuan , Bin Huang , Zitong Yu , Dengbo He , Shuiguang Deng , Hao Chen , Yingcong Chen , Shiguang Shan

Mammography is the most widely used gold standard for screening breast cancer, where, mass detection is considered as the prominent step. Detecting mass in the breast is, however, an arduous problem as they usually have large variations…

Computer Vision and Pattern Recognition · Computer Science 2019-07-11 Md. Kamrul Hasan , Tajwar Abrar Aleef

Visual Question-Answering (VQA) has become key to user experience, particularly after improved generalization capabilities of Vision-Language Models (VLMs). But evaluating VLMs for an application requirement using a standardized framework…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Neelabh Sinha , Vinija Jain , Aman Chadha

This retrospective study evaluated five VLMs (Qwen2.5, Phi-4, Gemma3, Llama3.2, and Mistral3.1) using the MedFMC dataset. This dataset includes 22,349 images from 7,461 patients encompassing chest radiography (19 disease multi-label…

Image and Video Processing · Electrical Eng. & Systems 2025-08-05 Gustav Müller-Franzes , Debora Jutz , Jakob Nikolas Kather , Christiane Kuhl , Sven Nebelung , Daniel Truhn

Educational scholars have analyzed various image data acquired from teaching and learning situations, such as photos that shows classroom dynamics, students' drawings with regard to the learning content, textbook illustrations, etc.…

Physics Education · Physics 2024-05-14 Gyeong-Geon Lee , Xiaoming Zhai

Vision Transformers $(\texttt{ViT})$ have become the architecture of choice for many computer vision tasks, yet their performance in computer-aided diagnostics remains limited. Focusing on breast cancer detection from mammograms, we…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Samyak Sanghvi , Piyush Miglani , Sarvesh Shashikumar , Kaustubh R Borgavi , Veenu Singla , Chetan Arora

Objective: Large language models (LLMs) are increasingly applied in biomedical settings, and existing benchmark datasets have played an important role in supporting model development and evaluation. However, these benchmarks often have…

Computation and Language · Computer Science 2026-01-21 Kriti Bhattarai , Vipina K. Keloth , Donald Wright , Andrew Loza , Yang Ren , Hua Xu