English
Related papers

Related papers: Geometry-Aware Uncertainty Coresets for Robust Vis…

200 papers

In histopathology, tissue sections are typically stained using common H&E staining or special stains (MAS, PAS, PASM, etc.) to clearly visualize specific tissue structures. The rapid advancement of deep learning offers an effective solution…

Image and Video Processing · Electrical Eng. & Systems 2025-04-23 Zizhi Chen , Xinyu Zhang , Minghao Han , Yizhou Liu , Ziyun Qian , Weifeng Zhang , Xukun Zhang , Jingwei Wei , Lihua Zhang

Although foundational vision-language models (VLMs) have proven to be very successful for various semantic discrimination tasks, they still struggle to perform faithfully for fine-grained categorization. Moreover, foundational models…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Soumitri Chattopadhyay , Sanket Biswas , Emanuele Vivoli , Josep Lladós

Learning inter-image similarity is crucial for 3D medical images self-supervised pre-training, due to their sharing of numerous same semantic regions. However, the lack of the semantic prior in metrics and the semantic-independent variation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Yuting He , Guanyu Yang , Rongjun Ge , Yang Chen , Jean-Louis Coatrieux , Boyu Wang , Shuo Li

Medical Vision-language models (VLMs) have shown remarkable performances in various medical imaging domains such as histo\-pathology by leveraging pre-trained, contrastive models that exploit visual and textual information. However,…

Vision-Language Models (VLMs) learn powerful multimodal representations through large-scale image-text pretraining, but adapting them to hierarchical classification is underexplored. Standard approaches treat labels as flat categories and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Jiayu Li , Rajesh Gangireddy , Samet Akcay , Wei Cheng , Juhua Hu

Vision-Language Models (VLMs) have emerged as the dominant approach for zero-shot recognition, adept at handling diverse scenarios and significant distribution changes. However, their deployment in risk-sensitive areas requires a deeper…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Weijie Tu , Weijian Deng , Dylan Campbell , Stephen Gould , Tom Gedeon

Large-scale multi-modal deep learning models have revolutionized domains such as healthcare, highlighting the importance of computational power. However, in resource-constrained regions like Low and Middle-Income Countries (LMICs), limited…

Vision language models (VLMs) show promise in medical diagnosis, but their performance across demographic subgroups when using in-context learning (ICL) remains poorly understood. We examine how the demographic composition of demonstration…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Sonnet Xu , Joseph Janizek , Yixing Jiang , Roxana Daneshjou

Recently, Large Language Models (LLMs) have been serving as general-purpose interfaces, posing a significant demand for comprehensive visual knowledge. However, it remains unclear how well current LLMs and their visually augmented…

Computation and Language · Computer Science 2023-10-24 Heming Xia , Qingxiu Dong , Lei Li , Jingjing Xu , Tianyu Liu , Ziwei Qin , Zhifang Sui

Fine-tuned vision-language models (VLMs) often capture spurious correlations between image features and textual attributes, resulting in degraded zero-shot performance at test time. Existing approaches for addressing spurious correlations…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Maya Varma , Jean-Benoit Delbrouck , Zhihong Chen , Akshay Chaudhari , Curtis Langlotz

In incomplete multi-view clustering (IMVC), missing data induce prototype shifts within views and semantic inconsistencies across views. A feasible solution is to explore cross-view consistency in paired complete observations, further…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Yuzhuo Dai , Jiaqi Jin , Zhibin Dong , Siwei Wang , Xinwang Liu , En Zhu , Xihong Yang , Xinbiao Gan , Yu Feng

Modern Vision-Language Models (VLMs) achieve strong semantic recognition, yet remain brittle on elementary spatial relations such as left of, on, behind, and between. One cause of this failure arises before language reasoning begins: the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Renjie Gu , Kaichen Zhou , Yan Luo , Mengyu Wang

Pre-trained Vision-Language Models (VLMs) utilizing extensive image-text paired data have demonstrated unprecedented image-text association capabilities, achieving remarkable results across various downstream tasks. A critical challenge is…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Zilun Zhang , Tiancheng Zhao , Yulong Guo , Jianwei Yin

Automated radiology report generation is key for reducing radiologist workload and improving diagnostic consistency, yet generating accurate reports for 3D medical imaging remains challenging. Existing vision-language models face two…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Pengcheng Shi , Minghui Zhang , Kehan Song , Jiaqi Liu , Yun Gu , Xinglin Zhang

The pre-trained vision-language model, exemplified by CLIP, advances zero-shot semantic segmentation by aligning visual features with class embeddings through a transformer decoder to generate semantic masks. Despite its effectiveness,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Zicheng Zhang , Tong Zhang , Yi Zhu , Jianzhuang Liu , Xiaodan Liang , QiXiang Ye , Wei Ke

Vision-language models (VLMs) frequently generate hallucinated content plausible but incorrect claims about image content. We propose a training-free self-correction framework enabling VLMs to iteratively refine responses through…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Kassoum Sanogo , Renzo Ardiccioni

Vision-language models (VLMs) have shown a promising ability in image geolocation, but they still lack structured geographic reasoning and the capacity for autonomous self-evolution. Existing methods predominantly rely on implicit…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Chenjie Yang , Yutian Jiang , Yutong Deng , Chenyu Wu

Achieving human-like reasoning in deep learning models for complex tasks in unknown environments remains a critical challenge in embodied intelligence. While advanced vision-language models (VLMs) excel in static scene understanding, their…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Jinzhou Tang , Jusheng zhang , Sidi Liu , Waikit Xiu , Qinhan Lv , Xiying Li

In this work, we address in-context learning (ICL) for the task of image segmentation, introducing a novel approach that adapts a modern Video Object Segmentation (VOS) technique for visual in-context learning. This adaptation is inspired…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Thomas Foster , Ioana Croitoru , Robert Dorfman , Christoffer Edlund , Thomas Varsavsky , Jon Almazán

Large Vision-Language Models offer a new paradigm for AI-driven image understanding, enabling models to perform tasks without task-specific training. This flexibility holds particular promise across medicine, where expert-annotated data is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Anita Rau , Mark Endo , Josiah Aklilu , Jaewoo Heo , Khaled Saab , Alberto Paderno , Jeffrey Jopling , F. Christopher Holsinger , Serena Yeung-Levy