English
Related papers

Related papers: Leveraging Foundation Models for Content-Based Ima…

200 papers

Foundation models (FMs), large neural networks pretrained on extensive and diverse datasets, have revolutionized artificial intelligence and shown significant promise in medical imaging by enabling robust performance with limited labeled…

Image and Video Processing · Electrical Eng. & Systems 2025-06-17 Salah Ghamizi , Georgia Kanli , Yu Deng , Magali Perquin , Olivier Keunen

Radiology is a vital and complex component of modern clinical workflow and covers many tasks. Recently, vision-language (VL) foundation models in medicine have shown potential in processing multimodal information, offering a unified…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Xiaohong Liu , Guoxing Yang , Yulin Luo , Jiaji Mao , Xiang Zhang , Ming Gao , Shanghang Zhang , Jun Shen , Guangyu Wang

Pneumothorax, a collapsed or dropped lung, is a fatal condition typically detected on a chest X-ray by an experienced radiologist. Due to shortage of such experts, automated detection systems based on deep neural networks have been…

Image and Video Processing · Electrical Eng. & Systems 2020-07-31 Antonio Sze-To , Hamid Tizhoosh

From self-supervised, vision-only models to contrastive visual-language frameworks, computational pathology has rapidly evolved in recent years. Generative AI "co-pilots" now demonstrate the ability to mine subtle, sub-visual tissue cues…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Mohsin Bilal , Aadam , Manahil Raza , Youssef Altherwy , Anas Alsuhaibani , Abdulrahman Abduljabbar , Fahdah Almarshad , Paul Golding , Nasir Rajpoot

We extend the task of composed image retrieval, where an input query consists of an image and short textual description of how to modify the image. Existing methods have only been applied to non-complex images within narrow domains, such as…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Zheyuan Liu , Cristian Rodriguez-Opazo , Damien Teney , Stephen Gould

Trademark Image Retrieval is playing a vital role as a part of CBIR System. Trademark is of great significance because it carries the status value of any company. To retrieve such a fake or copied trademark we design a retrieval system…

Computer Vision and Pattern Recognition · Computer Science 2015-04-14 Saurabh Agarwal , Punit Kumar Johari

Introduction of Convolutional Neural Networks has improved results on almost every image-based problem and Content-Based Image Retrieval is not an exception. But the CNN features, being rotation invariant, creates problems to build a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Subhadip Maji , Smarajit Bose

Multimodal medical image fusion (MMIF) aims to integrate images from different modalities to produce a comprehensive image that enhances medical diagnosis by accurately depicting organ structures, tissue textures, and metabolic information.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Tao Luo , Weihua Xu

Current Computer-Aided Diagnosis (CAD) methods mainly depend on medical images. The clinical information, which usually needs to be considered in practical clinical diagnosis, has not been fully employed in CAD. In this paper, we propose a…

Image and Video Processing · Electrical Eng. & Systems 2021-03-11 Songxiao Yang , Xiabi Liu , Zhongshu Zheng , Wei Wang , Xiaohong Ma

Accurate segmentation of organs and tumors in CT and MRI scans is essential for diagnosis, treatment planning, and disease monitoring. While deep learning has advanced automated segmentation, most models remain task-specific, lacking…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Yuheng Li , Yizhou Wu , Yuxiang Lai , Mingzhe Hu , Xiaofeng Yang

One important challenge in modern Content-Based Medical Image Retrieval (CBMIR) approaches is represented by the semantic gap, related to the complexity of the medical knowledge. Among the methods that are able to close this gap in CBMIR,…

Information Retrieval · Computer Science 2008-12-01 Roxana Teodorescu , Daniel Racoceanu , Wee-Kheng Leow , Vladimir Cretu

While Model Based Iterative Reconstruction (MBIR) of CT scans has been shown to have better image quality than Filtered Back Projection (FBP), its use has been limited by its high computational cost. More recently, deep convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2018-12-21 Amirkoushyar Ziabari , Dong Hye Ye , Somesh Srivastava , Ken D. Sauer , Jean-Baptiste Thibault , Charles A. Bouman

Foundation vision-language models are currently transforming computer vision, and are on the rise in medical imaging fueled by their very promising generalization capabilities. However, the initial attempts to transfer this new paradigm to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Julio Silva-Rodríguez , Hadi Chakor , Riadh Kobbi , Jose Dolz , Ismail Ben Ayed

3D image reconstruction from a limited number of 2D images has been a long-standing challenge in computer vision and image analysis. While deep learning-based approaches have achieved impressive performance in this area, existing deep…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Nivetha Jayakumar , Tonmoy Hossain , Miaomiao Zhang

The morphologies of astronomical sources are highly complex, making it essential not only to classify the identified sources into their predefined categories but also to determine the sources that are most similar to a given query source.…

Image and Video Processing · Electrical Eng. & Systems 2024-10-14 Steven Ndungu , Trienko Grobler , Stefan J. Wijnholds , George Azzopardi

The deep learning field is converging towards the use of general foundation models that can be easily adapted for diverse tasks. While this paradigm shift has become common practice within the field of natural language processing, progress…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Joana Palés Huix , Adithya Raju Ganeshan , Johan Fredin Haslum , Magnus Söderberg , Christos Matsoukas , Kevin Smith

Computer Aid Diagnosis (CAD) has developed digital pathology with Deep Learning (DL)-based tools to assist pathologists in decision-making. Content-Based Histopathological Image Retrieval (CBHIR) is a novel tool to seek highly correlated…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Zahra Tabatabaei , Adrián Colomer , JAvier Oliver Moll , Valery Naranjo

To handle the large scale of whole slide images in computational pathology, most approaches first tessellate the images into smaller patches, extract features from these patches, and finally aggregate the feature vectors with…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Benedikt Roth , Valentin Koch , Sophia J. Wagner , Julia A. Schnabel , Carsten Marr , Tingying Peng

Foundation models have demonstrated remarkable potential in medical domain. However, their application to complex cardiovascular diagnostics remains underexplored. In this paper, we present Cardiac-CLIP, a multi-modal foundation model…