English
Related papers

Related papers: Multi-Grained Vision-Language Alignment for Domain…

200 papers

Any entity in the visual world can be hierarchically grouped based on shared characteristics and mapped to fine-grained sub-categories. While Multi-modal Large Language Models (MLLMs) achieve strong performance on coarse-grained visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Hulingxiao He , Zijun Geng , Yuxin Peng

Generalizable person Re-Identification (ReID) has attracted growing attention in recent computer vision community. In this work, we construct a structural causal model among identity labels, identity-specific factors (clothes/shoes color…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Yi-Fan Zhang , Zhang Zhang , Da Li , Zhen Jia , Liang Wang , Tieniu Tan

In recent times, Vision-Language Models (VLMs) have been trained under two predominant paradigms. Generative training has enabled Multimodal Large Language Models (MLLMs) to tackle various complex tasks, yet issues such as hallucinations…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Wei Chow , Juncheng Li , Qifan Yu , Kaihang Pan , Hao Fei , Zhiqi Ge , Shuai Yang , Siliang Tang , Hanwang Zhang , Qianru Sun

Having revolutionized natural language processing (NLP) applications, large language models (LLMs) are expanding into the realm of multimodal inputs. Owing to their ability to interpret images, multimodal LLMs (MLLMs) have been primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Jusung Lee , Sungguk Cha , Younghyun Lee , Cheoljong Yang

In the field of Class Incremental Object Detection (CIOD), creating models that can continuously learn like humans is a major challenge. Pseudo-labeling methods, although initially powerful, struggle with multi-scenario incremental learning…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Junsu Kim , Yunhoe Ku , Jihyeon Kim , Junuk Cha , Seungryul Baek

Large Vision Language Models (VLMs) effectively bridge the modality gap through extensive pretraining, acquiring sophisticated visual representations aligned with language. However, it remains underexplored whether these representations,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Jiahao Guo , Sinan Du , Jingfeng Yao , Wenyu Liu , Bo Li , Haoxiang Cao , Kun Gai , Chun Yuan , Kai Wu , Xinggang Wang

Video-based Visible-Infrared Person Re-Identification (VVI-ReID) aims to match pedestrian sequences across modalities by extracting modality-invariant sequence-level features. As a high-level semantic representation, language provides a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Shuang Li , Jiaxu Leng , Changjiang Kuang , Mingpi Tan , Xinbo Gao

Vision-language pretraining models have made significant progress in bridging remote sensing imagery with natural language. However, existing approaches often fail to effectively integrate multi-granular visual and textual information,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Xiao Yang , Ronghao Fu , Zhuoran Duan , Zhiwen Lin , Xueyan Liu , Bo Yang

Large-scale contrastive pre-training produces powerful Vision-and-Language Models (VLMs) capable of generating representations (embeddings) effective for a wide variety of visual and multimodal tasks. However, these pretrained embeddings…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Nikolaos-Antonios Ypsilantis , Kaifeng Chen , André Araujo , Ondřej Chum

Methods based on Contrastive Language-Image Pre-training (CLIP) are nowadays extensively used in support of vision-and-language tasks involving remote sensing data, such as cross-modal retrieval. The adaptation of CLIP to this specific…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 João Daniel Silva , Joao Magalhaes , Devis Tuia , Bruno Martins

Classical person re-identification approaches assume that a person of interest has appeared across different cameras and can be queried by one of the existing images. However, in real-world surveillance scenarios, frequently no visual…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Ammarah Farooq , Muhammad Awais , Fei Yan , Josef Kittler , Ali Akbari , Syed Safwan Khalid

In multi-label classification, machine learning encounters the challenge of domain generalization when handling tasks with distributions differing from the training data. Existing approaches primarily focus on vision object recognition and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Yuxin Qiao , Keqin Li , Junhong Lin , Rong Wei , Chufeng Jiang , Yang Luo , Haoyu Yang

Recently, large-scale vision-language pre-trained models like CLIP have shown impressive performance in image re-identification (ReID). In this work, we explore whether self-supervision can aid in the use of CLIP for image ReID tasks.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Bin Wang , Yuying Liang , Lei Cai , Huakun Huang , Huanqiang Zeng

Vision-Language Models (VLMs) demonstrate remarkable general-purpose capabilities but often fall short in specialized domains such as medical imaging or geometric problem-solving. Supervised Fine-Tuning (SFT) can enhance performance within…

Computation and Language · Computer Science 2026-02-12 Yuming Yan , Shuo Yang , Kai Tang , Sihong Chen , Yang Zhang , Ke Xu , Dan Hu , Qun Yu , Pengfei Hu , Edith C. H. Ngai

Language-guided grasping has emerged as a promising paradigm for enabling robots to identify and manipulate target objects through natural language instructions, yet it remains highly challenging in cluttered or occluded scenes. Existing…

Robotics · Computer Science 2026-02-05 Rui Tang , Guankun Wang , Long Bai , Huxin Gao , Jiewen Lai , Chi Kit Ng , Jiazheng Wang , Fan Zhang , Hongliang Ren

Aerial-Ground Person Re-Identification (AGPReID) remains highly challenging due to drastic viewpoint variations between drones and fixed cameras. Existing methods typically follow a view-invariant paradigm, aligning shared features across…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Quan Zhang , Zeqiang Cai , Peiming Zhao , Jingze Wu , Cailun Wu , Hongbo Chen , Jianhuang Lai

Language-guided long-horizon manipulation of deformable objects presents significant challenges due to high degrees of freedom, complex dynamics, and the need for accurate vision-language grounding. In this work, we focus on multi-step…

A visual-language model (VLM) pre-trained on natural images and text pairs poses a significant barrier when applied to medical contexts due to domain shift. Yet, adapting or fine-tuning these VLMs for medical use presents considerable…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Aisha Urooj Khan , John Garrett , Tyler Bradshaw , Lonie Salkowski , Jiwoong Jason Jeong , Amara Tariq , Imon Banerjee

In recent years, multimodal large language models (MLLMs) have made significant strides by training on vast high-quality image-text datasets, enabling them to generally understand images well. However, the inherent difficulty in explicitly…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yuanze Lin , Yunsheng Li , Dongdong Chen , Weijian Xu , Ronald Clark , Philip Torr , Lu Yuan

The combination of global and partial features has been an essential solution to improve discriminative performances in person re-identification (Re-ID) tasks. Previous part-based methods mainly focus on locating regions with specific…

Computer Vision and Pattern Recognition · Computer Science 2018-08-15 Guanshuo Wang , Yufeng Yuan , Xiong Chen , Jiwei Li , Xi Zhou