English
Related papers

Related papers: ClipCrop: Conditioned Cropping Driven by Vision-La…

200 papers

Incidental supervision from language has become a popular approach for learning generic visual representations that can be prompted to perform many recognition tasks in computer vision. We conduct an in-depth exploration of the CLIP model…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Sachit Menon , Ishaan Preetam Chandratreya , Carl Vondrick

CLIP is a discriminative model trained to align images and text in a shared embedding space. Due to its multimodal structure, it serves as the backbone of many generative pipelines, where a decoder is trained to map from the shared space…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Antonio D'Orazio , Maria Rosaria Briglia , Donato Crisostomi , Dario Loi , Emanuele Rodolà , Iacopo Masi

Vision-language models (VLMs) like CLIP have showcased a remarkable ability to extract transferable features for downstream tasks. Nonetheless, the training process of these models is usually based on a coarse-grained contrastive loss…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Ali Abdollah , Amirmohammad Izadi , Armin Saghafian , Reza Vahidimajd , Mohammad Mozafari , Amirreza Mirzaei , Mohammadmahdi Samiei , Mahdieh Soleymani Baghshah

Contrastive Language-Image Pre-training (CLIP) has achieved widely applications in various computer vision tasks, e.g., text-to-image generation, Image-Text retrieval and Image captioning. However, CLIP suffers from high memory and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Kangjie Zhang , Wenxuan Huang , Xin Zhou , Boxiang Zhou , Dejia Song , Yuan Xie , Baochang Zhang , Lizhuang Ma , Nemo Chen , Xu Tang , Yao Hu , Shaohui Lin

This study aims to explore efficient tuning methods for the screenshot captioning task. Recently, image captioning has seen significant advancements, but research in captioning tasks for mobile screens remains relatively scarce. Current…

Machine Learning · Computer Science 2023-09-27 Ching-Yu Chiang , I-Hua Chang , Shih-Wei Liao

Contrastive Language-Image Pre-training (CLIP) on large-scale image-caption datasets learns representations that can achieve remarkable zero-shot generalization. However, such models require a massive amount of pre-training data. Improving…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Siddharth Joshi , Arnav Jain , Ali Payani , Baharan Mirzasoleiman

Contrastive language-image pretraining (CLIP) using image-text pairs has achieved impressive results on image classification in both zero-shot and transfer learning settings. However, we show that directly applying such models to recognize…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Yiwu Zhong , Jianwei Yang , Pengchuan Zhang , Chunyuan Li , Noel Codella , Liunian Harold Li , Luowei Zhou , Xiyang Dai , Lu Yuan , Yin Li , Jianfeng Gao

Recently, large-scale pre-trained vision-language models (e.g. CLIP and ALIGN) have demonstrated remarkable effectiveness in acquiring transferable visual representations. To leverage the valuable knowledge encoded within these models for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Yi Zhang , Ce Zhang , Xueting Hu , Zhihai He

Recently, vision model pre-training has evolved from relying on manually annotated datasets to leveraging large-scale, web-crawled image-text data. Despite these advances, there is no pre-training method that effectively exploits the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Chenyu Yang , Xizhou Zhu , Jinguo Zhu , Weijie Su , Junjie Wang , Xuan Dong , Wenhai Wang , Lewei Lu , Bin Li , Jie Zhou , Yu Qiao , Jifeng Dai

Recent development in vision-language approaches has instigated a paradigm shift in learning visual recognition models from language supervision. These approaches align objects with language queries (e.g. "a photo of a cat") and improve the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Liunian Harold Li , Zi-Yi Dou , Nanyun Peng , Kai-Wei Chang

Given a query composed of a reference image and a relative caption, the Composed Image Retrieval goal is to retrieve images visually similar to the reference one that integrates the modifications expressed by the caption. Given that recent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Alberto Baldrati , Marco Bertini , Tiberio Uricchio , Alberto del Bimbo

Contrastive models like CLIP have been shown to learn robust representations of images that capture both semantics and style. To leverage these representations for image generation, we propose a two-stage model: a prior that generates a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Aditya Ramesh , Prafulla Dhariwal , Alex Nichol , Casey Chu , Mark Chen

The emergence of CLIP has opened the way for open-world image perception. The zero-shot classification capabilities of the model are impressive but are harder to use for dense tasks such as image segmentation. Several methods have proposed…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Monika Wysoczańska , Michaël Ramamonjisoa , Tomasz Trzciński , Oriane Siméoni

Recent approaches have shown that large-scale vision-language models such as CLIP can improve semantic segmentation performance. These methods typically aim for pixel-level vision-language alignment, but often rely on low resolution image…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Anurag Das , Xinting Hu , Li Jiang , Bernt Schiele

Describing images with text is a fundamental problem in vision-language research. Current studies in this domain mostly focus on single image captioning. However, in various real applications (e.g., image editing, difference interpretation,…

Computation and Language · Computer Science 2019-06-20 Hao Tan , Franck Dernoncourt , Zhe Lin , Trung Bui , Mohit Bansal

Vision language models have played a key role in extracting meaningful features for various robotic applications. Among these, Contrastive Language-Image Pretraining (CLIP) is widely used in robotic tasks that require both vision and…

Robotics · Computer Science 2024-09-27 Nghia Nguyen , Minh Nhat Vu , Tung D. Ta , Baoru Huang , Thieu Vo , Ngan Le , Anh Nguyen

Task-oriented object detection aims to find objects suitable for accomplishing specific tasks. As a challenging task, it requires simultaneous visual data processing and reasoning under ambiguous semantics. Recent solutions are mainly…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Hanning Chen , Wenjun Huang , Yang Ni , Sanggeon Yun , Yezi Liu , Fei Wen , Alvaro Velasquez , Hugo Latapie , Mohsen Imani

Contrastive Language-Image Pre-training (CLIP)~\citep{radford2021learning} has emerged as a pivotal model in computer vision and multimodal learning, achieving state-of-the-art performance at aligning visual and textual representations…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Shaoan Xie , Lingjing Kong , Yujia Zheng , Yu Yao , Zeyu Tang , Eric P. Xing , Guangyi Chen , Kun Zhang

Vision-Language Pretraining (VLP) has achieved remarkable success across various downstream tasks, but such gains are largely driven by scaling up on training data. Yet, literature methods treat image-text pairs as isolated training…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Wenbo Lu

In this paper, we tackle an emerging computer vision task, open-vocabulary universal image segmentation, that aims to perform semantic/instance/panoptic segmentation (background semantic labeling + foreground instance segmentation) for…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Zheng Ding , Jieke Wang , Zhuowen Tu