中文
相关论文

相关论文: ProtoMedX: Towards Explainable Multi-Modal Prototy…

200 篇论文

Substantial advances in multi-modal Artificial Intelligence (AI) facilitate the combination of diverse medical modalities to achieve holistic health assessments. We present COMPRER , a novel multi-modal, multi-objective pretraining…

计算机视觉与模式识别 · 计算机科学 2024-03-18 Guy Lutsker , Hagai Rossman , Nastya Godiva , Eran Segal

The adoption of Deep Learning algorithms in the medical imaging field is a prominent area of research, with high potential for advancing AI-based Computer-aided diagnosis (AI-CAD) solutions. However, current solutions face challenges due to…

计算机视觉与模式识别 · 计算机科学 2024-12-30 Iury B. de A. Santos , André C. P. L. F. de Carvalho

Stroke is a major public health problem, affecting millions worldwide. Deep learning has recently demonstrated promise for enhancing the diagnosis and risk prediction of stroke. However, existing methods rely on costly medical imaging…

图像与视频处理 · 电气工程与系统科学 2025-12-17 Saeed Shurrab , Aadim Nepal , Terrence J. Lee-St. John , Nicola G. Ghazi , Bartlomiej Piechowski-Jozwiak , Farah E. Shamout

The rapid emergence of highly adaptable and reusable artificial intelligence (AI) models is set to revolutionize the medical field, particularly in the diagnosis and management of Parkinson's disease (PD). Currently, there are no effective…

机器学习 · 计算机科学 2025-02-18 Aite Zhao , Yongcan Liu , Xinglin Yu , Xinyue Xing

Knee Osteoarthritis (KOA) is a highly prevalent chronic musculoskeletal condition with no currently available treatment. The manifestation of KOA is heterogeneous and prediction of its progression is challenging. Current literature suggests…

图像与视频处理 · 电气工程与系统科学 2023-07-04 Egor Panfilov , Simo Saarakkala , Miika T. Nieminen , Aleksei Tiulpin

In this chapter we explore and evaluate methods for trabecular bone characterization and osteoporosis diagnosis with increased interest in sparse approximations. We first describe texture representation and classification techniques,…

计算机视觉与模式识别 · 计算机科学 2021-09-23 Sokratis Makrogiannis , Keni Zheng

Content-based medical image retrieval is an important diagnostic tool that improves the explainability of computer-aided diagnosis systems and provides decision making support to healthcare professionals. Medical imaging data, such as…

计算机视觉与模式识别 · 计算机科学 2022-11-23 Yunyan Xing , Benjamin J. Meyer , Mehrtash Harandi , Tom Drummond , Zongyuan Ge

Multimodal large models have shown great potential in automating pathology image analysis. However, current multimodal models for gastrointestinal pathology are constrained by both data quality and reasoning transparency: pervasive noise…

图像与视频处理 · 电气工程与系统科学 2025-07-25 Minxi Ouyang , Lianghui Zhu , Yaqing Bao , Qiang Huang , Jingli Ouyang , Tian Guan , Xitong Ling , Jiawen Li , Song Duan , Wenbin Dai , Li Zheng , Xuemei Zhang , Yonghong He

In this paper, an innovative multi-modal deep learning model is proposed to deeply integrate heterogeneous information from medical images and clinical reports. First, for medical images, convolutional neural networks were used to extract…

机器学习 · 计算机科学 2024-05-29 Ziyan Yao , Fei Lin , Sheng Chai , Weijie He , Lu Dai , Xinghui Fei

Melanoma detection is vital for early diagnosis and effective treatment. While deep learning models on dermoscopic images have shown promise, they require specialized equipment, limiting their use in broader clinical settings. This study…

计算机视觉与模式识别 · 计算机科学 2026-05-20 Volodymyr Sydorskyi , Igor Krashenyi , Oleksii Yakubenko

Large vision-language models (VLMs) have evolved from general-purpose applications to specialized use cases such as in the clinical domain, demonstrating potential for decision support in radiology. One promising application is assisting…

Multimodal medical imaging plays a pivotal role in clinical diagnosis and research, as it combines information from various imaging modalities to provide a more comprehensive understanding of the underlying pathology. Recently, deep…

Retinal disease diagnosis is critical in preventing vision loss and reducing socioeconomic burdens. Globally, over 2.2 billion people are affected by some form of vision impairment, resulting in annual productivity losses estimated at $411…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Youssef Sabiri , Walid Houmaidi , Amine Abouaomar

Tracking body fat percentage is essential for effective weight management, yet gold-standard methods such as DEXA scans remain expensive and inaccessible for most people. This study evaluates the feasibility of artificial intelligence (AI)…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Rayan Aldajani

Recent advancements in general-purpose or domain-specific multimodal large language models (LLMs) have witnessed remarkable progress for medical decision-making. However, they are designated for specific classification or generative tasks,…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Songtao Jiang , Tuo Zheng , Yan Zhang , Yeying Jin , Li Yuan , Zuozhu Liu

Colorectal cancer (CRC) ranks as the second leading cause of cancer-related deaths and the third most prevalent malignant tumour worldwide. Early detection of CRC remains problematic due to its non-specific and often embarrassing symptoms,…

机器学习 · 计算机科学 2025-04-25 Natalia Sikora , Robert L. Manschke , Alethea M. Tang , Peter Dunstan , Dean A. Harris , Su Yang

Computer-aided diagnosis for medical imaging is a well-studied field that aims to provide real-time decision support systems for physicians. These systems attempt to detect and diagnose a plethora of medical conditions across a variety of…

人工智能 · 计算机科学 2022-05-25 Glen Smith , Qiao Zhang , Christopher MacLellan

Explainability is critical for the clinical adoption of medical visual question answering (VQA) systems, as physicians require transparent reasoning to trust AI-generated diagnoses. We present MedXplain-VQA, a comprehensive framework…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Hai-Dang Nguyen , Minh-Anh Dang , Minh-Tan Le , Minh-Tuan Le

Recent studies show that deep learning models achieve good performance on medical imaging tasks such as diagnosis prediction. Among the models, multimodality has been an emerging trend, integrating different forms of data such as chest…

机器学习 · 计算机科学 2022-02-10 Haodi Zhang , Chenyu Xu , Peirou Liang , Ke Duan , Hao Ren , Weibin Cheng , Kaishun Wu

Musculoskeletal diseases such as sarcopenia and osteoporosis are major obstacles to health during aging. Although dual-energy X-ray absorptiometry (DXA) and computed tomography (CT) can be used to evaluate musculoskeletal conditions,…

计算机视觉与模式识别 · 计算机科学 2023-07-24 Yi Gu , Yoshito Otake , Keisuke Uemura , Masaki Takao , Mazen Soufi , Yuta Hiasa , Hugues Talbot , Seiji Okata , Nobuhiko Sugano , Yoshinobu Sato