English
Related papers

Related papers: Knowledge-enhanced Visual-Language Pre-training on…

200 papers

Mammography remains the most prevalent imaging tool for early breast cancer screening. The language used to describe abnormalities in mammographic reports is based on the breast Imaging Reporting and Data System (BI-RADS). Assigning a…

Image and Video Processing · Electrical Eng. & Systems 2020-05-12 Said Boumaraf , Xiabi Liu , Chokri Ferkous , Xiaohong Ma

Multi-label classification of chest X-ray images is frequently performed using discriminative approaches, i.e. learning to map an image directly to its binary labels. Such approaches make it challenging to incorporate auxiliary information…

Artificial Intelligence · Computer Science 2021-03-11 Anjany Sekuboyina , Daniel Oñoro-Rubio , Jens Kleesiek , Brandon Malone

Automatic radiology report generation is a promising application of multimodal deep learning, aiming to reduce reporting workload and improve consistency. However, current state-of-the-art (SOTA) systems - such as Multimodal AI for…

Few-shot anomaly detection (FSAD) aims to detect unseen anomaly regions with the guidance of very few normal support images from the same class. Existing FSAD methods usually find anomalies by directly designing complex text prompts to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Fenfang Tao , Guo-Sen Xie , Fang Zhao , Xiangbo Shu

Recent advancements in artificial intelligence (AI) have precipitated significant breakthroughs in healthcare, particularly in refining diagnostic procedures. However, previous studies have often been constrained to limited functionalities.…

Artificial Intelligence · Computer Science 2024-07-08 Asma Alkhaldi , Raneem Alnajim , Layan Alabdullatef , Rawan Alyahya , Jun Chen , Deyao Zhu , Ahmed Alsinan , Mohamed Elhoseiny

Developing deep learning models to analyze histology images has been computationally challenging, as the massive size of the images causes excessive strain on all parts of the computing pipeline. This paper proposes a novel deep…

Image and Video Processing · Electrical Eng. & Systems 2021-01-13 Joseph DiPalma , Arief A. Suriawinata , Laura J. Tafe , Lorenzo Torresani , Saeed Hassanpour

Large language models (LLMs) have recently demonstrated their potential in clinical applications, providing valuable medical knowledge and advice. For example, a large dialog LLM like ChatGPT has successfully passed part of the US medical…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Sheng Wang , Zihao Zhao , Xi Ouyang , Qian Wang , Dinggang Shen

Deep anomaly detection models using a supervised mode of learning usually work under a closed set assumption and suffer from overfitting to previously seen rare anomalies at training, which hinders their applicability in a real scenario. In…

Image and Video Processing · Electrical Eng. & Systems 2020-10-26 Behzad Bozorgtabar , Dwarikanath Mahapatra , Guillaume Vray , Jean-Philippe Thiran

Semi-supervised medical image segmentation aims to leverage minimal expert annotations, yet remains confronted by challenges in maintaining high-quality consistency learning. Excessive perturbations can degrade alignment and hinder precise…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Wenbo Xiao , Zhihao Xu , Guiping Liang , Yangjun Deng , Yi Xiao

Unsupervised anomaly detection (UAD) methods are trained with normal (or healthy) images only, but during testing, they are able to classify normal and abnormal (or disease) images. UAD is an important medical image analysis (MIA) method to…

Image and Video Processing · Electrical Eng. & Systems 2023-08-16 Yu Tian , Fengbei Liu , Guansong Pang , Yuanhong Chen , Yuyuan Liu , Johan W. Verjans , Rajvinder Singh , Gustavo Carneiro

Contrastive visual language pretraining has emerged as a powerful method for either training new language-aware image encoders or augmenting existing pretrained models with zero-shot visual recognition capabilities. However, existing works…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Ming Y. Lu , Bowen Chen , Andrew Zhang , Drew F. K. Williamson , Richard J. Chen , Tong Ding , Long Phi Le , Yung-Sung Chuang , Faisal Mahmood

Chest X-Ray imaging is one of the most common radiological tools for detection of various pathologies related to the chest area and lung function. In a clinical setting, automated assessment of chest radiographs has the potential of…

Machine Learning · Computer Science 2022-10-31 David Biesner , Helen Schneider , Benjamin Wulff , Ulrike Attenberger , Rafet Sifa

In recent years, zero-shot and few-shot learning in visual grounding have garnered considerable attention, largely due to the success of large-scale vision-language pre-training on expansive datasets such as LAION-5B and DataComp-1B.…

Artificial Intelligence · Computer Science 2024-10-07 Sen Jia , Lei Li

Few-shot learning in medical image classification presents a significant challenge due to the limited availability of annotated data and the complex nature of medical imagery. In this work, we propose Adaptive Vision-Language Fine-tuning…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Harrison Fuller , Fernando Gabriela Garcia , Victor Flores

When reading images, radiologists generate text reports describing the findings therein. Current state-of-the-art computer-aided diagnosis tools utilize a fixed set of predefined categories automatically extracted from these medical reports…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Constantin Seibold , Simon Reiß , M. Saquib Sarfraz , Rainer Stiefelhagen , Jens Kleesiek

Spoken communication plays a central role in clinical workflows. In radiology, for example, most reports are created through dictation. Yet, nearly all medical AI systems rely exclusively on written text. In this work, we address this gap…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-06 Lukas Buess , Jan Geier , David Bani-Harouni , Chantal Pellegrini , Matthias Keicher , Paula Andrea Perez-Toro , Nassir Navab , Andreas Maier , Tomas Arias-Vergara

Modern deep learning implementations for medical imaging usually rely on large labeled datasets. These datasets are often difficult to obtain due to privacy concerns, high costs, and even scarcity of cases. In this paper, a label-efficient…

Image and Video Processing · Electrical Eng. & Systems 2025-07-11 Heet Nitinkumar Dalsania

Retrieving rare and safety-critical driving scenarios from large-scale datasets is essential for building robust autonomous driving (AD) systems. As dataset sizes continue to grow, the key challenge shifts from collecting more data to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Felix Embacher , Jonas Uhrig , Marius Cordts , Markus Enzweiler

Language identification (LID) recognizes the language of a spoken utterance automatically. According to recent studies, LID models trained with an automatic speech recognition (ASR) task perform better than those trained with a LID task…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-17 Jinseok Park , Hyung Yong Kim , Jihwan Park , Byeong-Yeol Kim , Shukjae Choi , Yunkyu Lim

Entity resolution has been an essential and well-studied task in data cleaning research for decades. Existing work has discussed the feasibility of utilizing pre-trained language models to perform entity resolution and achieved promising…

Computation and Language · Computer Science 2023-01-13 Liri Fang , Lan Li , Yiren Liu , Vetle I. Torvik , Bertram Ludäscher