English
Related papers

Related papers: CLAP-S: Support Set Based Adaptation for Downstrea…

200 papers

As machine learning evolves, domain generalization (DG) and domain adaptation (DA) have become crucial for enhancing model robustness across diverse environments. Contrastive Language-Image Pretraining (CLIP) plays a significant role in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Jindong Li , Yongguang Li , Yali Fu , Jiahong Liu , Yixin Liu , Menglin Yang , Irwin King

Large pre-trained vision-language models, such as CLIP, have shown remarkable generalization capabilities across various tasks when appropriate text prompts are provided. However, adapting these models to specific domains, like remote…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Qinglong Cao , Zhengqin Xu , Yuntian Chen , Chao Ma , Xiaokang Yang

We propose Domain-Conditioned Meta-Contrastive Learning, a framework for improving the cross-domain generalization of vision-language models. While contrastive models such as CLIP achieve strong performance through large-scale training,…

Optimization and Control · Mathematics 2026-03-31 Merham Fouladvand , Peuroly Batra

Robot grasping of desktop object is widely used in intelligent manufacturing, logistics, and agriculture.Although vision-language models (VLMs) show strong potential for robotic manipulation, their deployment in low-level grasping faces key…

Robotics · Computer Science 2026-04-14 Yiran Ling , Wenxuan Li , Siying Dong , Yize Zhang , Xiaoyao Huang , Jing Jiang , Ruonan Li , Jie Liu

We present a noise-robust adaptation control strategy for block-online supervised acoustic system identification by exploiting a noise dictionary. The proposed algorithm takes advantage of the pronounced spectral structure which…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-04 Thomas Haubner , Andreas Brendel , Mohamed Elminshawi , Walter Kellermann

We introduce ParaSpeechCLAP, a dual-encoder contrastive model that maps speech and text style captions into a common embedding space, supporting a wide range of intrinsic (speaker-level) and situational (utterance-level) descriptors (such…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-31 Anuj Diwan , Eunsol Choi , David Harwath

Speech Emotion Recognition (SER) in real-world scenarios remains challenging due to severe class imbalance and the prevalence of spontaneous, natural speech. While recent approaches leverage self-supervised learning (SSL) representations…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-26 Lucas H. Ueda , João G. T. Lima , Paula D. P. Costa

Zero-shot anomaly detection (ZSAD) enables anomaly detection without normal samples from target categories, addressing scenarios where task-specific training data is unavailable. However, existing ZSAD methods either neglect adaptation of…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Kiyoon Jeong , Jaehyuk Heo , Junyeong Son , Pilsung Kang

Recognizing underwater targets from acoustic signals is a challenging task owing to the intricate ocean environments and variable underwater channels. While deep learning-based systems have become the mainstream approach for underwater…

Sound · Computer Science 2024-02-21 Yuan Xie , Jiawei Ren , Ji Xu

Pre-trained vision-language models, e.g. CLIP, have been increasingly used to address the challenging Open-Vocabulary Segmentation (OVS) task, benefiting from their well-aligned vision-text embedding space. Typical solutions involve either…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Siyu Jiao , Hongguang Zhu , Jiannan Huang , Yao Zhao , Yunchao Wei , Humphrey Shi

Domain adaptation, a pivotal branch of transfer learning, aims to enhance the performance of machine learning models when deployed in target domains with distinct data distributions. This is particularly critical for object detection tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Helia Mohamadi , Mohammad Ali Keyvanrad , Mohammad Reza Mohammadi

In recent years, the focus on anomaly detection and localization in industrial inspection tasks has intensified. While existing studies have demonstrated impressive outcomes, they often rely heavily on extensive training datasets or robust…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Ho-Weng Lee , Shang-Hong Lai

Fundus image classification is crucial in the computer aided diagnosis tasks, but label noise significantly impairs the performance of deep neural networks. To address this challenge, we propose a robust framework, Self-Supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Mengwen Ye , Yingzi Huangfu , You Li , Zekuan Yu

CLIP has demonstrated strong generalization in visual domains through natural language supervision, even for video action recognition. However, most existing approaches that adapt CLIP for action recognition have primarily focused on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Hyo Jin Jon , Longbin Jin , Eun Yi Kim

Contrastive Language-Image Pre-training (CLIP) models excel in zero-shot classification, yet face challenges in complex multi-object scenarios. This study offers a comprehensive analysis of CLIP's limitations in these contexts using a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Reza Abbasi , Ali Nazari , Aminreza Sefid , Mohammadali Banayeeanzade , Mohammad Hossein Rohban , Mahdieh Soleymani Baghshah

The continual learning setting aims to learn new tasks over time without forgetting the previous ones. The literature reports several significant efforts to tackle this problem with limited or no access to previous task data. Among such…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Vishal Thengane , Salman Khan , Munawar Hayat , Fahad Khan

Structured pruning is a commonly used convolutional neural network (CNN) compression approach. Pruning rate setting is a fundamental problem in structured pruning. Most existing works introduce too many additional learnable parameters to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Pucheng Zhai , Kailing Guo , Fang Liu , Xiaofen Xing , Xiangmin Xu

Point cloud classification refers to the process of assigning semantic labels or categories to individual points within a point cloud data structure. Recent works have explored the extension of pre-trained CLIP to 3D recognition. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Shuvozit Ghose , Yang Wang

As online music consumption increasingly shifts towards playlist-based listening, the task of playlist continuation, in which an algorithm suggests songs to extend a playlist in a personalized and musically cohesive manner, has become vital…

Information Retrieval · Computer Science 2024-06-21 Rebecca Salganik , Xiaohao Liu , Yunshan Ma , Jian Kang , Tat-Seng Chua

Contrastive Language-Image Pre-training (CLIP) has been shown to learn visual representations with great transferability, which achieves promising accuracy for zero-shot classification. To further improve its downstream performance,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Ziyu Guo , Renrui Zhang , Longtian Qiu , Xianzheng Ma , Xupeng Miao , Xuming He , Bin Cui