English
Related papers

Related papers: Is ChatGPT-5 Ready for Mammogram VQA?

200 papers

Breast cancer screening is one of the most common radiological tasks with over 39 million exams performed each year. While breast cancer screening has been one of the most studied medical imaging applications of artificial intelligence, the…

Image and Video Processing · Electrical Eng. & Systems 2022-11-22 Mateusz Buda , Ashirbani Saha , Ruth Walsh , Sujata Ghate , Nianyi Li , Albert Święcicki , Joseph Y. Lo , Maciej A. Mazurowski

Correctly assessing the malignancy of breast lesions identified during ultrasound examinations is crucial for effective clinical decision-making. However, the current "golden standard" relies on manual BI-RADS scoring by clinicians, often…

Machine Learning · Computer Science 2024-08-29 Alek Fröhlich , Thiago Ramos , Gustavo Cabello , Isabela Buzatto , Rafael Izbicki , Daniel Tiezzi

We propose a novel VQA dataset, BloomVQA, to facilitate comprehensive evaluation of large vision-language models on comprehension tasks. Unlike current benchmarks that often focus on fact-based memorization and simple reasoning tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Yunye Gong , Robik Shrestha , Jared Claypoole , Michael Cogswell , Arijit Ray , Christopher Kanan , Ajay Divakaran

Breast cancer remains a leading cause of cancer-related mortality among women worldwide. Ultrasound imaging, widely used due to its safety and cost-effectiveness, plays a key role in early detection, especially in patients with dense breast…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Mohammad Abbadi , Yassine Himeur , Shadi Atalla , Wathiq Mansoor

Breast density is an important risk factor for breast cancer that also affects the specificity and sensitivity of screening mammography. Current federal legislation mandates reporting of breast density for all women undergoing breast…

Motivation: Multi-omics integration can improve cancer subtyping, but modality informativeness and noise vary across cancer types and patients. Existing graph-based methods optimize modality weights jointly with the classification objective…

Machine Learning · Computer Science 2026-04-28 Boyang Fan , Hengchuang Yin , Siyu Yi , Yifan Wang , Zhicheng Li , Leijiyu Zhou , Jiancheng Lv , Wei Ju

Recent studies have demonstrated promising performance of ChatGPT and GPT-4 on several medical domain tasks. However, none have assessed its performance using a large-scale real-world electronic health record database, nor have evaluated…

Computation and Language · Computer Science 2023-07-18 Jingqing Zhang , Kai Sun , Akshay Jagadeesh , Mahta Ghahfarokhi , Deepa Gupta , Ashok Gupta , Vibhor Gupta , Yike Guo

Certain cancer types, notably pancreatic cancer, are difficult to detect at an early stage, motivating robust biomarker-based screening. Liquid biopsies enable non-invasive monitoring of circulating biomarkers, but typical machine learning…

Machine Learning · Computer Science 2025-11-21 Chongmin Lee , Jihie Kim

Large language models (LLMs), such as ChatGPT, have demonstrated impressive capabilities in various tasks and attracted an increasing interest as a natural language interface across many domains. Recently, large vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Zhihao Chen , Bin Hu , Chuang Niu , Tao Chen , Yuxin Li , Hongming Shan , Ge Wang

An advanced reliable low-cost form of screening method, Digital mammography has been used as an effective imaging method for breast cancer detection. With an increased focus on technologies to aid healthcare, Mammogram images have been…

Image and Video Processing · Electrical Eng. & Systems 2022-03-09 Marawan Elbatel

Medical visual question answering (Med-VQA) is a crucial multimodal task in clinical decision support and telemedicine. Recent methods fail to fully leverage domain-specific medical knowledge, making it difficult to accurately associate…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Xianyao Zheng , Hong Yu , Hui Cui , Changming Sun , Xiangyu Li , Ran Su , Leyi Wei , Jia Zhou , Junbo Wang , Qiangguo Jin

Domain specific large language models are increasingly used to support patient education, triage, and clinical decision making in ophthalmology, making rigorous evaluation essential to ensure safety and accuracy. This study evaluated four…

Early detection of breast cancer through screening mammography yields a 20-35% increase in survival rate; however, there are not enough radiologists to serve the growing population of women seeking screening mammography. Although commercial…

Computer Vision and Pattern Recognition · Computer Science 2020-01-24 Stefano Pedemonte , Brent Mombourquette , Alexis Goh , Trevor Tsue , Aaron Long , Sadanand Singh , Thomas Paul Matthews , Meet Shah , Jason Su

Deep learning object detection algorithm has been widely used in medical image analysis. Currently all the object detection tasks are based on the data annotated with object classes and their bounding boxes. On the other hand, medical…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Li Xiao , Cheng Zhu , Junjun Liu , Chunlong Luo , Peifang Liu , Yi Zhao

Digital Breast Tomosynthesis (DBT) is a widely used medical imaging modality for breast cancer screening and diagnosis, offering higher spatial resolution and greater detail through its 3D-like breast volume imaging capability. However, the…

Image and Video Processing · Electrical Eng. & Systems 2024-03-21 Yuexi Du , Regina J. Hooley , John Lewin , Nicha C. Dvornek

Large language models (LLMs) have rapidly advanced in clinical decision-making, yet the deployment of proprietary systems is hindered by privacy concerns and reliance on cloud-based infrastructure. Open-source alternatives allow local…

Computation and Language · Computer Science 2026-04-29 Alif Munim , Jun Ma , Omar Ibrahim , Alhusain Abdalla , Shuolin Yin , Leo Chen , Bo Wang

The recent development of high-throughput sequencing creates a large collection of multi-omics data, which enables researchers to better investigate cancer molecular profiles and cancer taxonomy based on molecular subtypes. Integrating…

Genomics · Quantitative Biology 2024-01-25 Bingjun Li , Sheida Nabavi

This study evaluates the performance of several Large Language Models (LLMs) on MedRedQA, a dataset of consumer-based medical questions and answers by verified experts extracted from the AskDocs subreddit. While LLMs have shown proficiency…

Computation and Language · Computer Science 2025-01-03 Moaiz Abrar , Yusuf Sermet , Ibrahim Demir

The integration of artificial intelligence into scientific research has reached a new pinnacle with GPT-4V, a large language model featuring enhanced vision capabilities, accessible through ChatGPT or an API. This study demonstrates the…

Artificial Intelligence · Computer Science 2025-08-19 Zhiling Zheng , Zhiguo He , Omar Khattab , Nakul Rampal , Matei A. Zaharia , Christian Borgs , Jennifer T. Chayes , Omar M. Yaghi

Advances in GPT-based large language models (LLMs) are revolutionizing natural language processing, exponentially increasing its use across various domains. Incorporating uni-directional attention, these autoregressive LLMs can generate…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Lalithkumar Seenivasan , Mobarakol Islam , Gokul Kannan , Hongliang Ren