English
Related papers

Related papers: SpeechCLIP+: Self-supervised multi-task representa…

200 papers

Existing semantic segmentation approaches are often limited by costly pixel-wise annotations and predefined classes. In this work, we present CLIP-S$^4$ that leverages self-supervised pixel representation learning and vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Wenbin He , Suphanut Jamonnak , Liang Gou , Liu Ren

Lipreading is a challenging cross-modal task that aims to convert visual lip movements into spoken text. Existing lipreading methods often extract visual features that include speaker-specific lip attributes (e.g., shape, color, texture),…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Yu Li , Feng Xue , Shujie Li , Jinrui Zhang , Shuang Yang , Dan Guo , Richang Hong

Open-vocabulary semantic segmentation requires models to effectively integrate visual representations with open-vocabulary semantic labels. While Contrastive Language-Image Pre-training (CLIP) models shine in recognizing visual concepts…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Mengcheng Lan , Chaofeng Chen , Yiping Ke , Xinjiang Wang , Litong Feng , Wayne Zhang

Photo search, the task of retrieving images based on textual queries, has witnessed significant advancements with the introduction of CLIP (Contrastive Language-Image Pretraining) model. CLIP leverages a vision-language pre training…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Naresh Kumar Lahajal , Harini S

CLIP (Contrastive Language-Image Pre-Training) has shown remarkable zero-shot transfer capabilities in cross-modal correlation tasks such as visual classification and image retrieval. However, its performance in cross-modal generation tasks…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Junyang Wang , Yi Zhang , Ming Yan , Ji Zhang , Jitao Sang

Contrastive language-image pre-training (CLIP) models have demonstrated considerable success across various vision-language tasks, such as text-to-image retrieval, where the model is required to effectively process natural language input to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Hyunjae Kim , Seunghyun Yoon , Trung Bui , Handong Zhao , Quan Tran , Franck Dernoncourt , Jaewoo Kang

Medical image segmentation is a cornerstone of computer-assisted diagnosis and treatment planning. While recent multimodal vision-language models have shown promise in enhancing semantic understanding through textual descriptions, their…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Saivan Talaei , Fatemeh Daneshfar , Abdulhady Abas Abdullah , Mustaqeem Khan

In this study, we present synchronous bilingual Connectionist Temporal Classification (CTC), an innovative framework that leverages dual CTC to bridge the gaps of both modality and language in the speech translation (ST) task. Utilizing…

Computation and Language · Computer Science 2023-09-22 Chen Xu , Xiaoqian Liu , Erfeng He , Yuhao Zhang , Qianqian Dong , Tong Xiao , Jingbo Zhu , Dapeng Man , Wu Yang

Large-scale vision-language models like CLIP have demonstrated impressive open-vocabulary capabilities for image-level tasks, excelling in recognizing what objects are present. However, they struggle with pixel-level recognition tasks like…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Heeseong Shin , Chaehyun Kim , Sunghwan Hong , Seokju Cho , Anurag Arnab , Paul Hongsuck Seo , Seungryong Kim

Contrastive Language-Image Pretraining (CLIP) has achieved remarkable success, leading to rapid advancements in multimodal studies. However, CLIP faces a notable challenge in terms of inefficient data utilization. It relies on a single…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Yu Zhang , Qi Zhang , Zixuan Gong , Yiwei Shi , Yepeng Liu , Duoqian Miao , Yang Liu , Ke Liu , Kun Yi , Wei Fan , Liang Hu , Changwei Wang

As a pioneering vision-language model, CLIP (Contrastive Language-Image Pre-training) has achieved significant success across various domains and a wide range of downstream vision-language tasks. However, the text encoders in popular CLIP…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Mothilal Asokan , Kebin Wu , Fatima Albreiki

Inspired by the remarkable zero-shot generalization capacity of vision-language pre-trained model, we seek to leverage the supervision from CLIP model to alleviate the burden of data labeling. However, such supervision inevitably contains…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Junchu Huang , Weijie Chen , Shicai Yang , Di Xie , Shiliang Pu , Yueting Zhuang

In rapidly evolving field of vision-language models (VLMs), contrastive language-image pre-training (CLIP) has made significant strides, becoming foundation for various downstream tasks. However, relying on one-to-one (image, text)…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Haicheng Wang , Chen Ju , Weixiong Lin , Shuai Xiao , Mengting Chen , Yixuan Huang , Chang Liu , Mingshuai Yao , Jinsong Lan , Ying Chen , Qingwen Liu , Yanfeng Wang

Image captioning, a fundamental task in vision-language understanding, seeks to generate accurate natural language descriptions for provided images. Current image captioning approaches heavily rely on high-quality image-caption pairs, which…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Chuanyang Jin

We propose EnCLAP, a novel framework for automated audio captioning. EnCLAP employs two acoustic representation models, EnCodec and CLAP, along with a pretrained language model, BART. We also introduce a new training objective called masked…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-01 Jaeyeon Kim , Jaeyoon Jung , Jinjoo Lee , Sang Hoon Woo

Contrastive vision-language models continue to be the dominant approach for image and text retrieval. Contrastive Language-Image Pre-training (CLIP) trains two neural networks in contrastive manner to align their image and text embeddings…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Kwun Ho Ngan , Saman Sadeghi Afgeh , Joe Townsend , Artur d'Avila Garcez

Real-time speech-to-speech (S2S) models excel at generating natural, low-latency conversational responses but often lack deep knowledge and semantic understanding. Conversely, cascaded systems combining automatic speech recognition, a…

Computation and Language · Computer Science 2026-05-26 So Kuroki , Yotaro Kubo , Takuya Akiba , Yujin Tang

The age estimation task aims to predict the age of an individual by analyzing facial features in an image. The development of age estimation can improve the efficiency and accuracy of various applications (e.g., age verification and secure…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Yuntao Shou , Wei Ai , Tao Meng , Nan Yin , Keqin Li

Contrastive Language-Image Pre-training (CLIP) stands as one of the most effective and scalable methods for training transferable vision models using paired image and text data. CLIP models are trained using contrastive loss, which…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Lijie Fan , Dilip Krishnan , Phillip Isola , Dina Katabi , Yonglong Tian

Methods based on Contrastive Language-Image Pre-training (CLIP) are nowadays extensively used in support of vision-and-language tasks involving remote sensing data, such as cross-modal retrieval. The adaptation of CLIP to this specific…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 João Daniel Silva , Joao Magalhaes , Devis Tuia , Bruno Martins