English
Related papers

Related papers: MedVQA-TREE: A Multimodal Reasoning and Retrieval …

200 papers

Computer-aided diagnosis (CAD) systems play a crucial role in analyzing neuroimaging data for neurological and psychiatric disorders. However, small-sample studies suffer from low reproducibility, while large-scale datasets introduce…

Machine Learning · Computer Science 2025-08-12 Xinglin Zhao , Yanwen Wang , Xiaobo Liu , Yanrong Hao , Rui Cao , Xin Wen

Oral cancer is frequently diagnosed at later stages due to its similarity to other lesions. Existing research on computer aided diagnosis has made progress using deep learning; however, most approaches remain limited by small, imbalanced…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Joy Naoum , Revana Salama , Ali Hamdi

Compressed sensing MRI is a classic inverse problem in the field of computational imaging, accelerating the MR imaging by measuring less k-space data. The deep neural network models provide the stronger representation ability and faster…

Computer Vision and Pattern Recognition · Computer Science 2018-04-05 Zhiwen Fan , Liyan Sun , Xinghao Ding , Yue Huang , Congbo Cai , John Paisley

Within the domain of medical image analysis, three distinct methodologies have demonstrated commendable accuracy: Neural Networks, Decision Trees, and Ensemble-Based Learning Algorithms, particularly in the specialized context of genstro…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Zeshan Khan

Robust and accurate segmentation for elongated physiological structures is challenging, especially in the ambiguous region, such as the corneal endothelium microscope image with uneven illumination or the fundus image with disease…

Image and Video Processing · Electrical Eng. & Systems 2023-05-31 Yinglin Zhang , Ruiling Xi , Huazhu Fu , Dave Towey , RuiBin Bai , Risa Higashita , Jiang Liu

After natural disasters, accurate evaluations of damage to housing are important for insurance claims response and planning of resources. In this work, we introduce a novel multimodal retrieval-augmented generation (MM-RAG) framework. On…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Jiayi Miao , Dingxin Lu , Zhuqi Wang

This paper describes our approach to Subtask 1 of the ImageCLEFmed MEDVQA 2025 Challenge, which targets visual question answering (VQA) for gastrointestinal endoscopy. We adopt the Florence model-a large-scale multimodal foundation model-as…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Sujata Gaihre , Amir Thapa Magar , Prasuna Pokharel , Laxmi Tiwari

Cancer diagnosis, prognosis, and therapeutic response predictions are based on morphological information from histology slides and molecular profiles from genomic data. However, most deep learning-based objective outcome prediction and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Richard J. Chen , Ming Y. Lu , Jingwen Wang , Drew F. K. Williamson , Scott J. Rodig , Neal I. Lindeman , Faisal Mahmood

A popular testbed for deep learning has been multimodal recognition of human activity or gesture involving diverse inputs such as video, audio, skeletal pose and depth images. Deep learning architectures have excelled on such problems due…

Neural and Evolutionary Computing · Computer Science 2017-07-05 Dhanesh Ramachandram , Michal Lisicki , Timothy J. Shields , Mohamed R. Amer , Graham W. Taylor

This paper presents a novel pothole detection approach based on single-modal semantic segmentation. It first extracts visual features from input images using a convolutional neural network. A channel attention module then reweighs the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Jiahe Fan , Mohammud J. Bocus , Brett Hosking , Rigen Wu , Yanan Liu , Sergey Vityazev , Rui Fan

Multimodal survival prediction, a crucial yet challenging task, demands the integration of multimodal medical data (\eg Whole Slide Images (WSIs) and Genomic Profiles) to achieve accurate prognostic modeling. Given the inherent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Huayi Wang , Haochao Ying , Yuyang Xu , Qiyao Zheng , jun wang , Cheng Zhang , Ying Sun , Jian Wu

Despite advancements in Computer-Aided Diagnosis (CAD) systems, breast cancer remains one of the leading causes of cancer-related deaths among women worldwide. Recent breakthroughs in Artificial Intelligence (AI) have shown significant…

Image and Video Processing · Electrical Eng. & Systems 2025-05-09 Farnoush Bayatmakou , Reza Taleei , Milad Amir Toutounchian , Arash Mohammadi

Retinal vessel segmentation is crucial for intelligent ophthalmic diagnosis, yet it faces three major challenges: insufficient multi-scale feature fusion, disruption of contextual continuity, and noise interference. This study proposes a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Xinran Xu , Yuliang Ma , Sifu Cai , Ming Meng , Qiang Lv , Ruoyan Shi

Multimodal information is frequently available in medical tasks. By combining information from multiple sources, clinicians are able to make more accurate judgments. In recent years, multiple imaging techniques have been used in clinical…

Vision evaluations are typically done through multi-step processes. In most contemporary fields, experts analyze images using structured, evidence-based adaptive questioning. In plant pathology, botanists inspect leaf images, identify…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Syed Nazmus Sakib , Nafiul Haque , Shahrear Bin Amin , Hasan Muhammad Abdullah , Md. Mehedi Hasan , Mohammad Zabed Hossain , Shifat E. Arman

Clinical diagnosis is a highly specialized discipline requiring both domain expertise and strict adherence to rigorous guidelines. While current AI-driven medical research predominantly focuses on knowledge graphs or natural text…

Machine Learning · Computer Science 2025-12-12 Haolin Li , Tianjie Dai , Zhe Chen , Siyuan Du , Jiangchao Yao , Ya Zhang , Yanfeng Wang

Multimodal pathological images are usually in clinical diagnosis, but computer vision-based multimodal image-assisted diagnosis faces challenges with modality fusion, especially in the absence of expert-annotated data. To achieve the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Qinghua Lin , Guang-Hai Liu , Zuoyong Li , Yang Li , Yuting Jiang , Xiang Wu

Currently, a central challenge and bottleneck in the deployment and validation of computer-aided diagnosis (CAD) models within the field of medical imaging is data scarcity. For lung cancer, one of the most prevalent types worldwide,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 António Cardoso , Pedro Sousa , Tania Pereira , Hélder P. Oliveira

Deep learning based automated pathological diagnosis has markedly improved diagnostic efficiency and reduced variability between observers, yet its clinical adoption remains limited by opaque model decisions and a lack of traceable…

Multimodal Large Language Models (MLLMs) often struggle to accurately perceive fine-grained visual details, especially when targets are tiny or visually subtle. This challenge can be addressed through semantic-visual information fusion,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Yuxiang Shen , Hailong Huang , Zhenkun Gao , Xueheng Li , Man Zhou , Chengjun Xie , Haoxuan Che , Xuanhua He , Jie Zhang