中文
相关论文

相关论文: CILF-CIAE: CLIP-driven Image-Language Fusion for C…

200 篇论文

Contrastive language-image pre-training (CLIP) is a powerful vision-language model that has shown great benefits for various tasks. However, we have identified some issues with its explainability, which undermine its credibility and limit…

计算机视觉与模式识别 · 计算机科学 2024-09-17 Yi Li , Hualiang Wang , Yiqun Duan , Jiheng Zhang , Xiaomeng Li

The advancements in computer vision and image processing techniques have led to emergence of new application in the domain of visual surveillance, targeted advertisement, content-based searching, and human-computer interaction etc. Out of…

计算机视觉与模式识别 · 计算机科学 2024-03-21 Aakash Singh , Vivek Kumar Singh

Fonts convey different impressions to readers. These impressions often come from the font shapes. However, the correlation between fonts and their impression is weak and unstable because impressions are subjective. To capture such weak and…

计算机视觉与模式识别 · 计算机科学 2024-02-27 Yugo Kubota , Daichi Haraguchi , Seiichi Uchida

Density ratio estimation is a core concept in statistical machine learning because it provides a unified mechanism for tasks such as importance weighting, divergence estimation, and likelihood-free inference, but its potential in vision and…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Fumiya Uchiyama , Rintaro Yanagi , Shohei Taniguchi , Shota Takashiro , Masahiro Suzuki , Hirokatsu Kataoka , Yusuke Iwasawa , Yutaka Matsuo

Contrastive Language-Image Pre-training (CLIP) stands as one of the most effective and scalable methods for training transferable vision models using paired image and text data. CLIP models are trained using contrastive loss, which…

计算机视觉与模式识别 · 计算机科学 2023-10-31 Lijie Fan , Dilip Krishnan , Phillip Isola , Dina Katabi , Yonglong Tian

Recent advances in vision language models (VLM) have been driven by contrastive models such as CLIP, which learn to associate visual information with their corresponding text descriptions. However, these models have limitations in…

计算机视觉与模式识别 · 计算机科学 2025-02-21 Rim Assouel , Pietro Astolfi , Florian Bordes , Michal Drozdzal , Adriana Romero-Soriano

Contrastive Language-Image Pretraining (CLIP) stands out as a prominent method for image representation learning. Various neural architectures, spanning Transformer-based models like Vision Transformers (ViTs) to Convolutional Networks…

Contrastive Language-Image Pretraining (CLIP) has emerged as a novel paradigm to learn visual models from language supervision. While researchers continue to push the frontier of CLIP, reproducing these works remains challenging. This is…

计算机视觉与模式识别 · 计算机科学 2022-03-14 Yufeng Cui , Lichen Zhao , Feng Liang , Yangguang Li , Jing Shao

Person re-identification (ReID) has recently benefited from large pretrained vision-language models such as Contrastive Language-Image Pre-Training (CLIP). However, the absence of concrete descriptions necessitates the use of implicit text…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Qianru Han , Xinwei He , Zhi Liu , Sannyuya Liu , Ying Zhang , Jinhai Xiang

Given a query composed of a reference image and a relative caption, the Composed Image Retrieval goal is to retrieve images visually similar to the reference one that integrates the modifications expressed by the caption. Given that recent…

计算机视觉与模式识别 · 计算机科学 2023-08-23 Alberto Baldrati , Marco Bertini , Tiberio Uricchio , Alberto del Bimbo

Leveraging StyleGAN's expressivity and its disentangled latent codes, existing methods can achieve realistic editing of different visual attributes such as age and gender of facial images. An intriguing yet challenging problem arises: Can…

计算机视觉与模式识别 · 计算机科学 2022-07-13 Yingchen Yu , Fangneng Zhan , Rongliang Wu , Jiahui Zhang , Shijian Lu , Miaomiao Cui , Xuansong Xie , Xian-Sheng Hua , Chunyan Miao

Image enhancement is a significant research area in the fields of computer vision and image processing. In recent years, many learning-based methods for image enhancement have been developed, where the Look-up-table (LUT) has proven to be…

计算机视觉与模式识别 · 计算机科学 2023-11-23 Weiwen Chen , Qiuhong Ke , Zinuo Li

We explore social perception of human faces in CLIP, a widely used open-source vision-language model. To this end, we compare the similarity in CLIP embeddings between different textual prompts and a set of face images. Our textual prompts…

计算机视觉与模式识别 · 计算机科学 2025-09-16 Carina I. Hausladen , Manuel Knott , Colin F. Camerer , Pietro Perona

In learning vision-language representations from web-scale data, the contrastive language-image pre-training (CLIP) mechanism has demonstrated a remarkable performance in many vision tasks. However, its application to the widely studied…

计算机视觉与模式识别 · 计算机科学 2024-07-09 Fengchuang Xing , Mingjie Li , Yuan-Gen Wang , Guopu Zhu , Xiaochun Cao

In this paper, we explore the potential of Vision-Language Models (VLMs), specifically CLIP, in predicting visual object relationships, which involves interpreting visual features from images into language-based relations. Current…

计算机视觉与模式识别 · 计算机科学 2023-07-20 Rakshith Subramanyam , T. S. Jayram , Rushil Anirudh , Jayaraman J. Thiagarajan

Class-incremental Learning (CIL) enables the model to incrementally absorb knowledge from new classes and build a generic classifier across all previously encountered classes. When the model optimizes with new classes, the knowledge of…

计算机视觉与模式识别 · 计算机科学 2025-03-31 Juncen Guo , Xiaoguang Zhu , Liangyu Teng , Hao Yang , Jing Liu , Yang Liu , Liang Song

This work aims to adapt large-scale pre-trained vision-language models, such as contrastive language-image pretraining (CLIP), to enhance the performance of object reidentification (Re-ID) across various supervision settings. Although…

计算机视觉与模式识别 · 计算机科学 2026-01-15 Jiachen Li , Xiaojin Gong

Contrastive Language-Image Pre-training (CLIP) exhibits strong zero-shot classification ability on various image-level tasks, leading to the research to adapt CLIP for pixel-level open-vocabulary semantic segmentation without additional…

计算机视觉与模式识别 · 计算机科学 2024-11-22 Lin Sun , Jiale Cao , Jin Xie , Xiaoheng Jiang , Yanwei Pang

Age estimation from facial images is a complex and multifaceted challenge in computer vision. In this study, we present a novel hybrid architecture that combines ConvNeXt, a state-of-the-art advancement of convolutional neural networks…

计算机视觉与模式识别 · 计算机科学 2025-11-04 Gaby Maroun , Salah Eddine Bekhouche , Fadi Dornaika

The large-scale pretrained model CLIP, trained on 400 million image-text pairs, offers a promising paradigm for tackling vision tasks, albeit at the image level. Later works, such as DenseCLIP and LSeg, extend this paradigm to dense…

计算机视觉与模式识别 · 计算机科学 2023-10-12 Ke Jin , Wankou Yang