中文
相关论文

相关论文: A multi-modal vision-language model for generaliza…

200 篇论文

Traditional Chinese medicine (TCM) tongue diagnosis, while clinically valuable, faces standardization challenges due to subjective interpretation and inconsistent imaging protocols, compounded by the lack of large-scale, annotated datasets…

图像与视频处理 · 电气工程与系统科学 2025-07-25 Xuebo Jin , Longfei Gao , Anshuo Tong , Zhengyang Chen , Jianlei Kong , Ning Sun , Huijun Ma , Qiang Wang , Yuting Bai , Tingli Su

Machine learning approaches hold great potential for the automated detection of lung nodules in chest radiographs, but training the algorithms requires vary large amounts of manually annotated images, which are difficult to obtain. Weak…

Cancer is a highly heterogeneous condition that can occur almost anywhere in the human body. 18F-fluorodeoxyglucose is an imaging modality commonly used to detect cancer due to its high sensitivity and clear visualisation of the pattern of…

图像与视频处理 · 电气工程与系统科学 2023-04-17 Ashay Patel , Petru-Danial Tudiosu , Walter H. L. Pinaya , Gary Cook , Vicky Goh , Sebastien Ourselin , M. Jorge Cardoso

Object detection and localization are crucial tasks for biomedical image analysis, particularly in the field of hematology where the detection and recognition of blood cells are essential for diagnosis and treatment decisions. While…

计算机视觉与模式识别 · 计算机科学 2023-12-19 Shun Liu , Jianan Zhang , Ruocheng Song , Teik Toe Teoh

Recent advances in deep learning have completely transformed the domain of computational pathology (CPath). More specifically, it has altered the diagnostic workflow of pathologists by integrating foundation models (FMs) and vision-language…

机器学习 · 计算机科学 2024-09-19 Dibaloke Chanda , Milan Aryal , Nasim Yahya Soltani , Masoud Ganji

Fundus diseases are major causes of visual impairment and blindness worldwide, especially in underdeveloped regions, where the shortage of ophthalmologists hinders timely diagnosis. AI-assisted fundus image analysis has several advantages,…

Radiology is a vital and complex component of modern clinical workflow and covers many tasks. Recently, vision-language (VL) foundation models in medicine have shown potential in processing multimodal information, offering a unified…

计算机视觉与模式识别 · 计算机科学 2024-09-25 Xiaohong Liu , Guoxing Yang , Yulin Luo , Jiaji Mao , Xiang Zhang , Ming Gao , Shanghang Zhang , Jun Shen , Guangyu Wang

We define a representation framework for extracting spatial information from radiology reports (Rad-SpRL). We annotated a total of 2000 chest X-ray reports with 4 spatial roles corresponding to the common radiology entities. Our focus is on…

计算与语言 · 计算机科学 2019-08-14 Surabhi Datta , Yuqi Si , Laritza Rodriguez , Sonya E Shooshan , Dina Demner-Fushman , Kirk Roberts

Significant advancements in AI-driven multimodal medical image diagnosis have led to substantial improvements in ophthalmic disease identification in recent years. However, acquiring paired multimodal ophthalmic images remains prohibitively…

计算机视觉与模式识别 · 计算机科学 2025-09-11 Zhihao Zhao , Yinzheng Zhao , Junjie Yang , Xiangtong Yao , Quanmin Liang , Daniel Zapp , Kai Huang , Nassir Navab , M. Ali Nasseri

Vision-Language Models (VLMs) have demonstrated significant potential in medical image analysis, yet their application in intraoral photography remains largely underexplored due to the lack of fine-grained, annotated datasets and…

计算机视觉与模式识别 · 计算机科学 2026-04-17 Meng-Xun Li , Wen-Hui Deng , Zhi-Xing Wu , Chun-Xiao Jin , Jia-Min Wu , Yue Han , James Kit Hon Tsoi , Gui-Song Xia , Cui Huang

Anatomical landmark detection in medical images is essential for various clinical and research applications, including disease diagnosis and surgical planning. However, manual landmark annotation is time-consuming and requires significant…

图像与视频处理 · 电气工程与系统科学 2025-07-22 Soorena Salari , Arash Harirpoush , Hassan Rivaz , Yiming Xiao

Chest x-rays are the most common radiology studies for diagnosing lung and heart disease. Hence, a system for automated pre-reporting of pathologic findings on chest x-rays would greatly enhance radiologists' productivity. To this end, we…

图像与视频处理 · 电气工程与系统科学 2020-06-15 Adora M. DSouza , Anas Z. Abidin , Axel Wismüller

In diagnostic reports, experts encode complex imaging data into clinically actionable information. They describe subtle pathological findings that are meaningful in their anatomical context. Reports follow relatively consistent structures,…

计算机视觉与模式识别 · 计算机科学 2026-04-16 Felicia Bader , Philipp Seeböck , Anastasia Bartashova , Ulrike Attenberger , Georg Langs

We propose a framework for localization and classification of masses in breast ultrasound (BUS) images. We have experimentally found that training convolutional neural network based mass detectors with large, weakly annotated datasets…

计算机视觉与模式识别 · 计算机科学 2019-01-24 Seung Yeon Shin , Soochahn Lee , Il Dong Yun , Sun Mi Kim , Kyoung Mu Lee

Due to the rapid advancements in recent years, medical image analysis is largely dominated by deep learning (DL). However, building powerful and robust DL models requires training with large multi-party datasets. While multiple stakeholders…

Despite the recent advances in automatically describing image contents, their applications have been mostly limited to image caption datasets containing natural images (e.g., Flickr 30k, MSCOCO). In this paper, we present a deep learning…

计算机视觉与模式识别 · 计算机科学 2016-03-29 Hoo-Chang Shin , Kirk Roberts , Le Lu , Dina Demner-Fushman , Jianhua Yao , Ronald M Summers

Visual explanation methods have an important role in the prognosis of the patients where the annotated data is limited or unavailable. There have been several attempts to use gradient-based attribution methods to localize pathology from…

图像与视频处理 · 电气工程与系统科学 2021-06-24 Ugur Demir , Ismail Irmakci , Elif Keles , Ahmet Topcu , Ziyue Xu , Concetto Spampinato , Sachin Jambawalikar , Evrim Turkbey , Baris Turkbey , Ulas Bagci

Deep learning has shown recent success in classifying anomalies in chest x-rays, but datasets are still small compared to natural image datasets. Supervision of abnormality localization has been shown to improve trained models, partially…

Landmark localization is a challenging problem in computer vision with a multitude of applications. Recent deep learning based methods have shown improved results by regressing likelihood maps instead of regressing the coordinates directly.…

计算机视觉与模式识别 · 计算机科学 2019-08-06 Brian Teixeira , Birgi Tamersoy , Vivek Singh , Ankur Kapoor