English
Related papers

Related papers: UniBiomed: A Universal Foundation Model for Ground…

200 papers

Medical Visual Language Models have shown great potential in various healthcare applications, including medical image captioning and diagnostic assistance. However, most existing models rely on text-based instructions, limiting their…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Tan-Hanh Pham , Chris Ngo , Trong-Duong Bui , Minh Luu Quang , Tan-Huong Pham , Truong-Son Hy

Recent advancements in deep learning have significantly revolutionized the field of clinical diagnosis and treatment, offering novel approaches to improve diagnostic precision and treatment efficacy across diverse clinical domains, thus…

Artificial Intelligence · Computer Science 2024-12-04 Kai Sun , Siyan Xue , Fuchun Sun , Haoran Sun , Yu Luo , Ling Wang , Siyuan Wang , Na Guo , Lei Liu , Tian Zhao , Xinzhou Wang , Lei Yang , Shuo Jin , Jun Yan , Jiahong Dong

Image processing, including image restoration, image enhancement, etc., involves generating a high-quality clean image from a degraded input. Deep learning-based methods have shown superior performance for various image processing tasks in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Huiyu Duan , Xiongkuo Min , Sijing Wu , Wei Shen , Guangtao Zhai

The ability for a human to understand an Artificial Intelligence (AI) model's decision-making process is critical in enabling stakeholders to visualize model behavior, perform model debugging, promote trust in AI models, and assist in…

Machine Learning · Computer Science 2022-03-07 Yiwei Lyu , Paul Pu Liang , Zihao Deng , Ruslan Salakhutdinov , Louis-Philippe Morency

Magnetic resonance imaging~(MRI) have played a crucial role in brain disease diagnosis, with which a range of computer-aided artificial intelligence methods have been proposed. However, the early explorations usually focus on the limited…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Jiayu Lei , Lisong Dai , Haoyun Jiang , Chaoyi Wu , Xiaoman Zhang , Yao Zhang , Jiangchao Yao , Weidi Xie , Yanyong Zhang , Yuehua Li , Ya Zhang , Yanfeng Wang

Medical image segmentation supports clinical workflows by precisely delineating anatomical structures and lesions. However, medical image datasets medical image datasets suffer from acquisition noise and annotation ambiguity, causing…

Artificial Intelligence · Computer Science 2026-04-14 Ruiyang Li , Fang Liu , Licheng Jiao , Xinglin Xie , Jiayao Hao , Shuo Li , Xu Liu , Jingyi Yang , Lingling Li , Puhua Chen , Wenping Ma

One principal impediment in the successful deployment of AI-based Computer-Aided Diagnosis (CAD) systems in clinical workflows is their lack of transparent decision making. Although commonly used eXplainable AI methods provide some insight…

Artificial Intelligence · Computer Science 2022-01-05 Adriano Lucieri , Muhammad Naseer Bajwa , Stephan Alexander Braun , Muhammad Imran Malik , Andreas Dengel , Sheraz Ahmed

In this paper, an innovative multi-modal deep learning model is proposed to deeply integrate heterogeneous information from medical images and clinical reports. First, for medical images, convolutional neural networks were used to extract…

Machine Learning · Computer Science 2024-05-29 Ziyan Yao , Fei Lin , Sheng Chai , Weijie He , Lu Dai , Xinghui Fei

Recent advancements in mixed-modal generative have opened new avenues for developing unified biomedical assistants capable of analyzing biomedical images, answering complex questions about them, and generating multimodal patient reports.…

Artificial Intelligence · Computer Science 2025-04-24 Hritik Bansal , Daniel Israel , Siyan Zhao , Shufan Li , Tung Nguyen , Aditya Grover

AUCMEDI is a Python-based framework for medical image classification. In this paper, we evaluate the capabilities of AUCMEDI, by applying it to multiple datasets. Datasets were specifically chosen to cover a variety of medical disciplines…

Image and Video Processing · Electrical Eng. & Systems 2022-10-21 Simone Mayer , Dominik Müller , Frank Kramer

Accurate disease interpretation from radiology remains challenging due to imaging heterogeneity. Achieving expert-level diagnostic decisions requires integration of subtle image features with clinical knowledge. Yet major vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Difei Gu , Yunhe Gao , Mu Zhou , Dimitris Metaxas

Advances in foundation modeling have reshaped computational pathology. However, the increasing number of available models and lack of standardized benchmarks make it increasingly complex to assess their strengths, limitations, and potential…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Andrew Zhang , Guillaume Jaume , Anurag Vaidya , Tong Ding , Faisal Mahmood

Multimodal functional neuroimaging enables systematic analysis of brain mechanisms and provides discriminative representations for brain-computer interface (BCI) decoding. However, its acquisition is constrained by high costs and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Weiheng Yao , Xuhang Chen , Shuqiang Wang

Vision-Language Foundation Models (VLMs), trained on large-scale multimodal datasets, have driven significant advances in Artificial Intelligence (AI) by enabling rich cross-modal reasoning. Despite their success in general domains,…

Widespread clinical deployment of computer-aided diagnosis (CAD) systems is hindered by the challenge of integrating with existing hospital IT infrastructure. Here, we introduce VisionCAD, a vision-based radiological assistance framework…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Jiaming Li , Junlei Wu , Sheng Wang , Honglin Xiong , Jiangdong Cai , Zihao Zhao , Yitao Zhu , Yuan Yin , Dinggang Shen , Qian Wang

Multimodal large language models have advanced rapidly, but their adoption in medicine is constrained by limited domain coverage, imperfect modality alignment, and insufficient grounded reasoning. We introduce MedMO, a medical multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Ankan Deria , Komal Kumar , Adinath Madhavrao Dukre , Eran Segal , Salman Khan , Imran Razzak

Ultrasound imaging is one of the most widely used diagnostic modalities, offering real-time, radiation-free assessment across diverse clinical domains. However, interpretation of ultrasound images remains challenging due to high noise…

Image and Video Processing · Electrical Eng. & Systems 2025-11-10 Youssef Megahed , Robin Ducharme , Aylin Erman , Mark Walker , Steven Hawken , Adrian D. C. Chan

Radiology is a vital and complex component of modern clinical workflow and covers many tasks. Recently, vision-language (VL) foundation models in medicine have shown potential in processing multimodal information, offering a unified…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Xiaohong Liu , Guoxing Yang , Yulin Luo , Jiaji Mao , Xiang Zhang , Ming Gao , Shanghang Zhang , Jun Shen , Guangyu Wang

Foundational models, pretrained on a large scale, have demonstrated substantial success across non-medical domains. However, training these models typically requires large, comprehensive datasets, which contrasts with the smaller and more…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Raphael Schäfer , Till Nicke , Henning Höfener , Annkristin Lange , Dorit Merhof , Friedrich Feuerhake , Volkmar Schulz , Johannes Lotz , Fabian Kiessling

Fine-grained and instance-level recognition methods are commonly trained and evaluated on specific domains, in a model per domain scenario. Such an approach, however, is impractical in real large-scale applications. In this work, we address…