English
Related papers

Related papers: Multi-Grained Vision-Language Alignment for Domain…

200 papers

Multimodal Large Language Models (MLLMs) have recently received substantial interest, which shows their emerging potential as general-purpose models for various vision-language tasks. MLLMs involve significant external knowledge within…

Multimedia · Computer Science 2024-10-21 Muhe Ding , Yang Ma , Pengda Qin , Jianlong Wu , Yuhong Li , Liqiang Nie

Semi-supervised Domain Generalization (SSDG) addresses the challenge of generalizing to unseen target domains with limited labeled data. Existing SSDG methods highlight the importance of achieving high pseudo-labeling (PL) accuracy and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Muditha Fernando , Kajhanan Kailainathan , Krishnakanth Nagaratnam , Isuranga Udaravi Bandara Senavirathne , Ranga Rodrigo

Large annotated datasets are essential for training robust Computer-Aided Diagnosis (CAD) models for breast cancer detection or risk prediction. However, acquiring such datasets with fine-detailed annotation is both costly and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Shunjie-Fabian Zheng , Hyeonjun Lee , Thijs Kooi , Ali Diba

Dense visual perception tasks have been constrained by their reliance on predefined categories, limiting their applicability in real-world scenarios where visual concepts are unbounded. While Vision-Language Models (VLMs) like CLIP have…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Junjie Wang , Keyu Chen , Yulin Li , Bin Chen , Hengshuang Zhao , Xiaojuan Qi , Zhuotao Tian

Multiple Instance Learning (MIL) is the leading approach for whole slide image (WSI) classification, enabling efficient analysis of gigapixel pathology slides. Recent work has introduced vision-language models (VLMs) into MIL pipelines to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Ngoc Bui Lam Quang , Nam Le Nguyen Binh , Thanh-Huy Nguyen , Le Thien Phuc Nguyen , Quan Nguyen , Ulas Bagci

CLIP has shown impressive results in aligning images and texts at scale. However, its ability to capture detailed visual features remains limited because CLIP matches images and texts at a global level. To address this issue, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Rui Xiao , Sanghwan Kim , Mariana-Iuliana Georgescu , Zeynep Akata , Stephan Alaniz

Domain generalization person re-identification (DG-ReID) aims to train a model on source domains and generalize well on unseen domains. Vision Transformer usually yields better generalization ability than common CNN networks under…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Hao Ni , Yuke Li , Lianli Gao , Heng Tao Shen , Jingkuan Song

Person re-identification becomes a more and more important task due to its wide applications. In practice, person re-identification still remains challenging due to the variation of person pose, different lighting, occlusion, misalignment,…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Honglong Cai , Zhiguan Wang , Jinxing Cheng

Face anti-spoofing approach based on domain generalization(DG) has drawn growing attention due to its robustness forunseen scenarios. Existing DG methods assume that the do-main label is known.However, in real-world applications,…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Zhihong Chen , Taiping Yao , Kekai Sheng , Shouhong Ding , Ying Tai , Jilin Li , Feiyue Huang , Xinyu Jin

Large pre-trained vision-language models, such as CLIP, have shown remarkable generalization capabilities across various tasks when appropriate text prompts are provided. However, adapting these models to specific domains, like remote…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Qinglong Cao , Zhengqin Xu , Yuntian Chen , Chao Ma , Xiaokang Yang

Current vision-language models (VLMs) show exceptional abilities across diverse tasks, such as visual question answering. To enhance user experience, recent studies investigate VLM personalization to understand user-provided concepts.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Ruichuan An , Sihan Yang , Ming Lu , Renrui Zhang , Kai Zeng , Yulin Luo , Jiajun Cao , Hao Liang , Ying Chen , Qi She , Shanghang Zhang , Wentao Zhang

Knowledge retrieval with multi-modal queries plays a crucial role in supporting knowledge-intensive multi-modal applications. However, existing methods face challenges in terms of their effectiveness and training efficiency, especially when…

Information Retrieval · Computer Science 2024-01-17 Xinwei Long , Jiali Zeng , Fandong Meng , Zhiyuan Ma , Kaiyan Zhang , Bowen Zhou , Jie Zhou

Vision-Language Models (VLMs) have demonstrated great potential in interpreting remote sensing (RS) images through language-guided semantic. However, the effectiveness of these VLMs critically depends on high-quality image-text training…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Dilxat Muhtar , Enzhuo Zhang , Zhenshi Li , Feng Gu , Yanglangxing He , Pengfeng Xiao , Xueliang Zhang

Domain generalization (DG) has attracted much attention in person re-identification (ReID) recently. It aims to make a model trained on multiple source domains generalize to an unseen target domain. Although achieving promising progress,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Lei Qi , Jiaqi Liu , Lei Wang , Yinghuan Shi , Xin Geng

The recent advancements in Generative Adversarial Networks (GANs) and the emergence of Diffusion models have significantly streamlined the production of highly realistic and widely accessible synthetic content. As a result, there is a…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Sohail Ahmed Khan , Duc-Tien Dang-Nguyen

Recent advances in instruction-tuned Large Vision-Language Models (LVLMs) have imbued the models with the ability to generate high-level, image-grounded explanations with ease. While such capability is largely attributed to the rich world…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Jeonghwan Kim , Heng Ji

Mammography screening is an essential tool for early detection of breast cancer. The speed and accuracy of mammography interpretation have the potential to be improved with deep learning methods. However, the development of a foundation…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Yuexi Du , Lihui Chen , Nicha C. Dvornek

Vision-language models like CLIP show impressive ability to align images and text, but their training on short, concise captions makes them struggle with lengthy, detailed descriptions. Recent advances mitigate this challenge by leveraging…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Chau Truong , Hieu Ta Quang , Dung D. Le

Multiple instance learning (MIL)-based framework has become the mainstream for processing the whole slide image (WSI) with giga-pixel size and hierarchical image context in digital pathology. However, these methods heavily depend on a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Jiangbo Shi , Chen Li , Tieliang Gong , Yefeng Zheng , Huazhu Fu

Recent studies have utilized visual large language models (VLMs) to answer not only "Is this face a forgery?" but also "Why is the face a forgery?" These studies introduced forgery-related attributes, such as forgery location and type, to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Tao Chen , Jingyi Zhang , Decheng Liu , Chunlei Peng