English
Related papers

Related papers: Vision-Language Pre-training with Object Contrasti…

200 papers

Existing approaches to vision-language pre-training (VLP) heavily rely on an object detector based on bounding boxes (regions), where salient objects are first detected from images and then a Transformer-based model is used for cross-modal…

Multimedia · Computer Science 2021-08-24 Ming Yan , Haiyang Xu , Chenliang Li , Bin Bi , Junfeng Tian , Min Gui , Wei Wang

Vision-Language Pre-training (VLP) has advanced the performance of many vision-language tasks, such as image-text retrieval, visual entailment, and visual reasoning. The pre-training mostly utilizes lexical databases and image queries in…

Computation and Language · Computer Science 2023-06-30 Yasmine Karoui , Rémi Lebret , Negar Foroutan , Karl Aberer

An effective pre-training framework with universal 3D representations is extremely desired in perceiving large-scale dynamic scenes. However, establishing such an ideal framework that is both task-generic and label-efficient poses a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Haoming Chen , Zhizhong Zhang , Yanyun Qu , Ruixin Zhang , Xin Tan , Yuan Xie

Recently, Vision-Language Pre-training (VLP) techniques have greatly benefited various vision-language tasks by jointly learning visual and textual representations, which intuitively helps in Optical Character Recognition (OCR) tasks due to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Chuhui Xue , Wenqing Zhang , Yu Hao , Shijian Lu , Philip Torr , Song Bai

Although large-scale video-language pre-training models, which usually build a global alignment between the video and the text, have achieved remarkable progress on various downstream tasks, the idea of adopting fine-grained information…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Weihong Zhong , Mao Zheng , Duyu Tang , Xuan Luo , Heng Gong , Xiaocheng Feng , Bing Qin

To act in the world, a model must name what it sees and know where it is in 3D. Today's vision-language models (VLMs) excel at open-ended 2D description and grounding, yet multi-object 3D detection remains largely missing from the VLM…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yunze Man , Shihao Wang , Guowen Zhang , Johan Bjorck , Zhiqi Li , Liang-Yan Gui , Jim Fan , Jan Kautz , Yu-Xiong Wang , Zhiding Yu

Recent works have shown huge success of deep learning models for common in vocabulary (IV) scene text recognition. However, in real-world scenarios, out-of-vocabulary (OOV) words are of great importance and SOTA recognition models usually…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Jinshui Hu , Chenyu Liu , Qiandong Yan , Xuyang Zhu , Jiajia Wu , Jun Du , Lirong Dai

3D visual grounding aims to localize the unique target described by natural languages in 3D scenes. The significant gap between 3D and language modalities makes it a notable challenge to distinguish multiple similar objects through the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Feng Xiao , Hongbin Xu , Guocan Zhao , Wenxiong Kang

Recently, vision-language joint representation learning has proven to be highly effective in various scenarios. In this paper, we specifically adapt vision-language joint learning for scene text detection, a task that intrinsically involves…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Sibo Song , Jianqiang Wan , Zhibo Yang , Jun Tang , Wenqing Cheng , Xiang Bai , Cong Yao

Multimodal large language models (MLLMs) have shown strong vision-language reasoning abilities but still lack robust 3D spatial understanding, which is critical for autonomous driving. This limitation stems from two key challenges: (1) the…

Artificial Intelligence · Computer Science 2025-09-09 Ruixun Liu , Lingyu Kong , Derun Li , Hang Zhao

In pursuit of detecting unstinted objects that extend beyond predefined categories, prior arts of open-vocabulary object detection (OVD) typically resort to pretrained vision-language models (VLMs) for base-to-novel category generalization.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Chuhan Zhang , Chaoyang Zhu , Pingcheng Dong , Long Chen , Dong Zhang

Open-set perception in complex traffic environments poses a critical challenge for autonomous driving systems, particularly in identifying previously unseen object categories, which is vital for ensuring safety. Visual Language Models…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Fuhao Chang , Shuxin Li , Yabei Li , Lei He

Recent advancements in integrating tactile sensing with vision-language models (VLMs) have demonstrated remarkable potential for robotic multimodal perception. However, existing tactile descriptions remain limited to superficial attributes…

Open-world instance-level scene understanding aims to locate and recognize unseen object categories that are not present in the annotated dataset. This task is challenging because the model needs to both localize novel 3D objects and infer…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Runyu Ding , Jihan Yang , Chuhui Xue , Wenqing Zhang , Song Bai , Xiaojuan Qi

3D object segmentation with Large Language Models (LLMs) has become a prevailing paradigm due to its broad semantics, task flexibility, and strong generalization. However, this paradigm is hindered by representation misalignment: LLMs…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Zhuoxu Huang , Mingqi Gao , Jungong Han

The scale and quality of point cloud datasets constrain the advancement of point cloud learning. Recently, with the development of multi-modal learning, the incorporation of domain-agnostic prior knowledge from other modalities, such as…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Yanmin Wu , Qiankun Gao , Renrui Zhang , Jian Zhang

Vision-language models (VLMs) have shown promise in 2D medical image analysis, but extending them to 3D remains challenging due to the high computational demands of volumetric data and the difficulty of aligning 3D spatial features with…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Yu Xin , Gorkem Can Ates , Kuang Gong , Wei Shao

Recent developments in Multimodal Large Language Models (MLLMs) have significantly improved Vision-Language (VL) reasoning in 2D domains. However, extending these capabilities to 3D scene understanding remains a major challenge. Existing 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Haijier Chen , Bo Xu , Shoujian Zhang , Haoze Liu , Jiaxuan Lin , Jingrong Wang

We introduce Ilov3Splat, a novel framework for instance-level open-vocabulary 3D scene understanding built on 3D Gaussian Splatting (3D-GS). Most prior work depends on 2D rendering-based matching or point-level semantic association, which…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Binh Long Nguyen , Kien Nguyen , Sridha Sridharan , Clinton Fookes , Peyman Moghadam

The past few years have witnessed the great success and prevalence of self-supervised representation learning within the language and 2D vision communities. However, such advancements have not been fully migrated to the field of 3D point…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Qijian Zhang , Junhui Hou