English
Related papers

Related papers: VisionLLM-based Multimodal Fusion Network for Glot…

200 papers

Lung cancer is a severe menace to human health, due to which millions of people die because of late diagnoses of cancer; thus, it is vital to detect the disease as early as possible. The Computerized chest analysis Tomography of scan is…

Image and Video Processing · Electrical Eng. & Systems 2022-11-08 Ahmed Saihood , Hossein Karshenas , AhmadReza Naghsh Nilchi

Retinal image analysis is crucial for diagnosing and treating eye diseases, yet generating accurate medical reports from images remains challenging due to variability in image quality and pathology, especially with limited labeled data.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Teja Krishna Cherukuri , Nagur Shareef Shaik , Jyostna Devi Bodapati , Dong Hye Ye

Early and accurate detection of glaucoma is critical to prevent irreversible vision loss. However, existing methods often rely on unimodal data and lack interpretability, limiting their clinical utility. In this paper, we present GlaBoost,…

Machine Learning · Computer Science 2025-08-07 Cheng Huang , Weizheng Xie , Karanjit Kooner , Tsengdar Lee , Jui-Kai Wang , Jia Zhang

Deep learning relies heavily on data augmentation to mitigate limited data, especially in medical imaging. Recent multimodal learning integrates text and images for segmentation, known as referring or text-guided image segmentation.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Shurong Chai , Rahul Kumar JAIN , Rui Xu , Shaocong Mo , Ruibo Hou , Shiyu Teng , Jiaqing Liu , Lanfen Lin , Yen-Wei Chen

Vision-language models (VLMs) such as GPT (Generative Pre-Trained Transformer) have shown potential for medical image interpretation; however, challenges remain in generating reliable radiological findings in clinical practice, as…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Nanaka Hosokawa , Ryo Takahashi , Tomoya Kitano , Yukihiro Iida , Chisako Muramatsu , Tatsuro Hayashi , Yuta Seino , Xiangrong Zhou , Takeshi Hara , Akitoshi Katsumata , Hiroshi Fujita

Pulmonary nodules are an early sign of lung cancer, and detecting them early is vital for improving patient survival rates. Most current methods use only single Computed Tomography (CT) images to assess nodule malignancy. However, doctors…

Image and Video Processing · Electrical Eng. & Systems 2025-01-29 Yin Shen , Zhaojie Fang , Ke Zhuang , Guanyu Zhou , Xiao Yu , Yucheng Zhao , Yuan Tian , Ruiquan Ge , Changmiao Wang , Xiaopeng Fan , Ahmed Elazab

Lung cancer continues to be the leading cause of cancer-related deaths globally. Early detection and diagnosis of pulmonary nodules are essential for improving patient survival rates. Although previous research has integrated multimodal and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Xiao Yu , Zhaojie Fang , Guanyu Zhou , Yin Shen , Huoling Luo , Ye Li , Ahmed Elazab , Xiang Wan , Ruiquan Ge , Changmiao Wang

Large Language Models (LLMs), known for their versatility in textual data, are increasingly being explored for their potential to enhance medical image segmentation, a crucial task for accurate diagnostic imaging. This study explores…

Image and Video Processing · Electrical Eng. & Systems 2025-08-20 Gurucharan Marthi Krishna Kumar , Aman Chadha , Janine Mendola , Amir Shmuel

Vision-threatening eye diseases pose a major global health burden, with timely diagnosis limited by workforce shortages and restricted access to specialized care. While multimodal large language models (MLLMs) show promise for medical image…

The inability to interpret the model prediction in semantically and visually meaningful ways is a well-known shortcoming of most existing computer-aided diagnosis methods. In this paper, we propose MDNet to establish a direct multimodal…

Computer Vision and Pattern Recognition · Computer Science 2017-07-11 Zizhao Zhang , Yuanpu Xie , Fuyong Xing , Mason McGough , Lin Yang

Esophageal cancer is one of the most common types of cancer worldwide and ranks sixth in cancer-related mortality. Accurate computer-assisted diagnosis of cancer progression can help physicians effectively customize personalized treatment…

Image and Video Processing · Electrical Eng. & Systems 2024-05-17 Chengyu Wu , Chengkai Wang , Yaqi Wang , Huiyu Zhou , Yatao Zhang , Qifeng Wang , Shuai Wang

Object detection algorithms particularly those based on YOLO have demonstrated remarkable efficiency in balancing speed and accuracy. However, their application in brain tumour detection remains underexplored. This study proposes…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Thennarasi Balakrishnan , Sandeep Singh Sengar

Melanoma detection is vital for early diagnosis and effective treatment. While deep learning models on dermoscopic images have shown promise, they require specialized equipment, limiting their use in broader clinical settings. This study…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Volodymyr Sydorskyi , Igor Krashenyi , Oleksii Yakubenko

Recent advancements in artificial intelligence (AI) have precipitated significant breakthroughs in healthcare, particularly in refining diagnostic procedures. However, previous studies have often been constrained to limited functionalities.…

Artificial Intelligence · Computer Science 2024-07-08 Asma Alkhaldi , Raneem Alnajim , Layan Alabdullatef , Rawan Alyahya , Jun Chen , Deyao Zhu , Ahmed Alsinan , Mohamed Elhoseiny

Medical image retrieval aims to identify clinically relevant lesion cases to support diagnostic decision making, education, and quality control. In practice, retrieval queries often combine a reference lesion image with textual descriptors…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yuheng Wang , Yuji Lin , Jiayue Cai , Z. Jane Wang , Tim K. Lee

Deep learning has demonstrated remarkable success in medical image segmentation and computer-aided diagnosis. In particular, numerous advanced methods have achieved state-of-the-art performance in brain tumor segmentation from MRI scans.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Xiaoyu Shi , Rahul Kumar Jain , Yinhao Li , Ruibo Hou , Jingliang Cheng , Jie Bai , Guohua Zhao , Lanfen Lin , Rui Xu , Yen-wei Chen

Automated interlinear gloss prediction with neural networks is a promising approach to accelerate language documentation efforts. However, while state-of-the-art models like GlossLM achieve high scores on glossing benchmarks, user studies…

Computation and Language · Computer Science 2026-01-26 Michael Ginn , Lindia Tjuatja , Enora Rice , Ali Marashian , Maria Valentini , Jasmine Xu , Graham Neubig , Alexis Palmer

Multimodal deep learning has improved prognostic accuracy for brain tumours by integrating histopathology and genomic data, yet the contribution of volumetric MRI within unified survival frameworks remains unexplored. This pilot study…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Iain Swift , JingHua Ye

Breast cancer screening, primarily conducted through mammography, is often supplemented with ultrasound for women with dense breast tissue. However, existing deep learning models analyze each modality independently, missing opportunities to…

Image and Video Processing · Electrical Eng. & Systems 2023-11-16 Yiqiu Shen , Jungkyu Park , Frank Yeung , Eliana Goldberg , Laura Heacock , Farah Shamout , Krzysztof J. Geras

Large language models (LLMs) offer new opportunities for constructing knowledge graphs (KGs) from unstructured clinical narratives. However, existing approaches often rely on structured inputs and lack robust validation of factual accuracy…

Artificial Intelligence · Computer Science 2026-01-06 Udiptaman Das , Krishnasai B. Atmakuri , Duy Ho , Chi Lee , Yugyung Lee