中文
相关论文

相关论文: Knowledge-enhanced Visual-Language Pre-training on…

200 篇论文

Temporal understanding in autonomous driving (AD) remains a significant challenge, even for recent state-of-the-art (SoTA) Vision-Language Models (VLMs). Prior work has introduced datasets and benchmarks aimed at improving temporal…

The challenge of learning a new concept, object, or a new medical disease recognition without receiving any examples beforehand is called Zero-Shot Learning (ZSL). One of the major issues in deep learning based methodologies such as in…

计算机视觉与模式识别 · 计算机科学 2020-12-01 Mahdi Rezaei , Mahsa Shahidi

Large language models (LLMs) have demonstrated notable potential in medical applications, yet they face substantial challenges in handling complex real-world clinical diagnoses using conventional prompting methods. Current prompt…

Automated analysis of chest radiography using deep learning has tremendous potential to enhance the clinical diagnosis of diseases in patients. However, deep learning models typically require large amounts of annotated data to achieve high…

计算机视觉与模式识别 · 计算机科学 2023-04-10 Keegan Quigley , Miriam Cha , Ruizhi Liao , Geeticka Chauhan , Steven Horng , Seth Berkowitz , Polina Golland

Medical image interpretation using deep learning has shown promise but often requires extensive expert-annotated datasets. To reduce this annotation burden, we develop an Image-Graph Contrastive Learning framework that pairs chest X-rays…

图像与视频处理 · 电气工程与系统科学 2024-05-17 Sameer Khanna , Daniel Michael , Marinka Zitnik , Pranav Rajpurkar

The integration of artificial intelligence in medical imaging has shown tremendous potential, yet the relationship between pre-trained knowledge and performance in cross-modality learning remains unclear. This study investigates how…

计算机视觉与模式识别 · 计算机科学 2025-02-20 Yang Yan , Bingqing Yue , Qiaxuan Li , Man Huang , Jingyu Chen , Zhenzhong Lan

Few-shot learning presents a critical solution for cancer diagnosis in computational pathology (CPath), addressing fundamental limitations in data availability, particularly the scarcity of expert annotations and patient privacy…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Zhengrui Guo , Conghao Xiong , Jiabo Ma , Qichen Sun , Lishuang Feng , Jinzhuo Wang , Hao Chen

Due to the scarcity of annotated data in the medical domain, few-shot learning may be useful for medical image analysis tasks. We design a few-shot learning method using an ensemble of random subspaces for the diagnosis of chest x-rays…

计算机视觉与模式识别 · 计算机科学 2023-09-04 Kshitiz , Garvit Garg , Angshuman Paul

Automated diagnostic assistants in healthcare necessitate accurate AI models that can be trained with limited labeled data, can cope with severe class imbalances and can support simultaneous prediction of multiple disease conditions. To…

计算机视觉与模式识别 · 计算机科学 2021-02-11 Deepta Rajan , Jayaraman J. Thiagarajan , Alexandros Karargyris , Satyananda Kashyap

The brittleness of finetuned language model performance on out-of-distribution (OOD) test samples in unseen domains has been well-studied for English, yet is unexplored for multi-lingual models. Therefore, we study generalization to OOD…

计算与语言 · 计算机科学 2023-11-14 Maarten De Raedt , Semere Kiros Bitew , Fréderic Godin , Thomas Demeester , Chris Develder

Convolutional neural networks (ConvNets) are the actual standard for image recognizement and classification. On the present work we develop a Computer Aided-Diagnosis (CAD) system using ConvNets to classify a x-rays chest images dataset in…

计算机视觉与模式识别 · 计算机科学 2018-06-05 Vinicius Pavanelli Vianna

Recently, Multimodal Large Language Models (MLLMs) have demonstrated exceptional capabilities in visual understanding and reasoning across various vision-language tasks. However, we found that MLLMs cannot process effectively from…

计算机视觉与模式识别 · 计算机科学 2025-09-26 Bangyan Li , Wenxuan Huang , Zhenkun Gao , Yeqiang Wang , Yunhang Shen , Jingzhong Lin , Ling You , Yuxiang Shen , Shaohui Lin , Wanli Ouyang , Yuling Sun

Large-scale multimodal representation learning successfully optimizes for zero-shot transfer at test time. Yet the standard pretraining paradigm (contrastive learning on large amounts of image-text data) does not explicitly encourage…

计算机视觉与模式识别 · 计算机科学 2024-11-25 Karsten Roth , Zeynep Akata , Dima Damen , Ivana Balažević , Olivier J. Hénaff

This paper provides a critical review of the literature on deep learning applications in breast tumor diagnosis using ultrasound and mammography images. It also summarizes recent advances in computer-aided diagnosis (CAD) systems, which…

图像与视频处理 · 电气工程与系统科学 2020-10-05 Yuliana Jiménez-Gaona , María José Rodríguez-Álvarez , Vasudevan Lakshminarayanan

Building a highly accurate predictive model for classification and localization of abnormalities in chest X-rays usually requires a large number of manually annotated labels and pixel regions (bounding boxes) of abnormalities. However, it…

计算机视觉与模式识别 · 计算机科学 2022-05-06 Yan Han , Chongyan Chen , Ahmed Tewfik , Benjamin Glicksberg , Ying Ding , Yifan Peng , Zhangyang Wang

Masked Autoencoder (MAE) has recently been shown to be effective in pre-training Vision Transformers (ViT) for natural image analysis. By reconstructing full images from partially masked inputs, a ViT encoder aggregates contextual…

图像与视频处理 · 电气工程与系统科学 2023-04-24 Lei Zhou , Huidong Liu , Joseph Bae , Junjun He , Dimitris Samaras , Prateek Prasanna

The chest X-ray is often utilized for diagnosing common thoracic diseases. In recent years, many approaches have been proposed to handle the problem of automatic diagnosis based on chest X-rays. However, the scarcity of labeled data for…

图像与视频处理 · 电气工程与系统科学 2023-06-05 Weizhi Nie , Chen Zhang , Dan Song , Lina Zhao , Yunpeng Bai , Keliang Xie , Anan Liu

Recent advancements in Computer Assisted Diagnosis have shown promising performance in medical imaging tasks, particularly in chest X-ray analysis. However, the interaction between these models and radiologists has been primarily limited to…

计算机视觉与模式识别 · 计算机科学 2024-04-04 Yunsoo Kim , Jinge Wu , Yusuf Abdulle , Yue Gao , Honghan Wu

Vision-language models (VLMs) have shown strong promise for medical image analysis, but most remain opaque, offering predictions without the transparent, stepwise reasoning clinicians rely on. We present a framework that brings…

Open-vocabulary object detection (OVOD) enables novel category detection via vision-language alignment, but massive model sizes hinder deployment on resource-constrained devices. While quantization offers practical compression, we reveal…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Jinyeong Park , Donghwa Kang , Brent ByungHoon Kang , Hyeongboo Baek , Jibum Kim