English
Related papers

Related papers: HCL-TAT: A Hybrid Contrastive Learning Method for …

200 papers

Existing video highlight detection methods, although advanced, struggle to generalize well to all test videos. These methods typically employ a generic highlight detection model for each test video, which is suboptimal as it fails to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Zahidul Islam , Sujoy Paul , Mrigank Rochan

State-of-the-art pre-trained image models predominantly adopt a two-stage approach: initial unsupervised pre-training on large-scale datasets followed by task-specific fine-tuning using Cross-Entropy loss~(CE). However, it has been…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Zijun Long , George Killick , Lipeng Zhuang , Gerardo Aragon-Camarasa , Zaiqiao Meng , Richard Mccreadie

Most few-shot learning works rely on the same domain assumption between the base and the target tasks, hindering their practical applications. This paper proposes an adaptive transformer network (ADAPTER), a simple but effective solution…

Machine Learning · Computer Science 2024-01-26 Naeem Paeedeh , Mahardhika Pratama , Muhammad Anwar Ma'sum , Wolfgang Mayer , Zehong Cao , Ryszard Kowlczyk

Self-supervised learning (especially contrastive learning) has attracted great interest due to its huge potential in learning discriminative representations in an unsupervised manner. Despite the acknowledged successes, existing contrastive…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Guangrun Wang , Keze Wang , Guangcong Wang , Philip H. S. Torr , Liang Lin

Vision-Language Models (VLMs) such as CLIP demonstrate strong zero-shot generalization, but their performance significantly degrades in cross-domain scenarios with scarce target-domain training data (Cross-Domain Few-Shot Learning, CDFSL).…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Shuai Yi , Yixiong Zou , Yuhua Li , Ruixuan Li

State-of-the-art model for zero-shot cross-lingual spoken language understanding performs cross-lingual unsupervised contrastive learning to achieve the label-agnostic semantic alignment between each utterance and its code-switched data.…

Computation and Language · Computer Science 2024-05-13 Bowen Xing , Ivor W. Tsang

Recently, meta-learning has been shown as a promising way to solve few-shot learning. In this paper, inspired by the human cognition process which utilizes both prior-knowledge and vision attention in learning new knowledge, we present a…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Yunxiao Qin , Weiguo Zhang , Chenxu Zhao , Zezheng Wang , Xiangyu Zhu , Guojun Qi , Jingping Shi , Zhen Lei

Few-Shot Learning (FSL) aims to improve a model's generalization capability in low data regimes. Recent FSL works have made steady progress via metric learning, meta learning, representation learning, etc. However, FSL remains challenging…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Meng Ye , Xiao Lin , Giedrius Burachas , Ajay Divakaran , Yi Yao

The majority of existing few-shot learning methods describe image relations with binary labels. However, such binary relations are insufficient to teach the network complicated real-world relations, due to the lack of decision smoothness.…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Hongguang Zhang , Piotr Koniusz , Songlei Jian , Hongdong Li , Philip H. S. Torr

The successful application of deep learning to many visual recognition tasks relies heavily on the availability of a large amount of labeled data which is usually expensive to obtain. The few-shot learning problem has attracted increasing…

Machine Learning · Computer Science 2020-03-11 Zhongjie Yu , Lin Chen , Zhongwei Cheng , Jiebo Luo

Although few-shot action recognition based on metric learning paradigm has achieved significant success, it fails to address the following issues: (1) inadequate action relation modeling and underutilization of multi-modal information; (2)…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Long Deng , Ziqiang Li , Bingxin Zhou , Zhongming Chen , Ao Li , Yongxin Ge

Conventional detection networks usually need abundant labeled training samples, while humans can learn new concepts incrementally with just a few examples. This paper focuses on a more challenging but realistic class-incremental few-shot…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Pengyang Li , Yanan Li , Han Cui , Donghui Wang

Relation classification (RC) task is one of fundamental tasks of information extraction, aiming to detect the relation information between entity pairs in unstructured natural language text and generate structured data in the form of…

Computation and Language · Computer Science 2021-01-12 Yan Xiao , Yaochu Jin , Kuangrong Hao

Humans exhibit a remarkable ability to learn quickly from a limited number of labeled samples, a capability that starkly contrasts with that of current machine learning systems. Unsupervised Few-Shot Learning (U-FSL) seeks to bridge this…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Zhenyu Zhang , Guangyao Chen , Yixiong Zou , Zhimeng Huang , Yuhua Li , Ruixuan Li

Incorporating auxiliary modalities such as images into event detection models has attracted increasing interest over the last few years. The complexity of natural language in describing situations has motivated researchers to leverage the…

Computation and Language · Computer Science 2023-06-06 Farhad Moghimifar , Fatemeh Shiri , Van Nguyen , Reza Haffari , Yuan-Fang Li

Despite its empirical success, the theoretical foundations of self-supervised contrastive learning (CL) are not yet fully established. In this work, we address this gap by showing that standard CL objectives implicitly approximate a…

Machine Learning · Computer Science 2025-11-12 Achleshwar Luthra , Tianbao Yang , Tomer Galanti

Vision-language foundation models have been incredibly successful in a wide range of downstream computer vision tasks using adaptation methods. However, due to the high cost of obtaining pre-training datasets, pairs with weak image-text…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Wenshuo Peng , Kaipeng Zhang , Yue Yang , Hao Zhang , Yu Qiao

Meta-learning represents a strong class of approaches for solving few-shot learning tasks. Nonetheless, recent research suggests that simply pre-training a generic encoder can potentially surpass meta-learning algorithms. In this paper, we…

Machine Learning · Computer Science 2025-03-14 Wei Cui , Tongzi Wu , Jesse C. Cresswell , Yi Sui , Keyvan Golestan

Video anomaly detection aims to identify abnormal events that occurred in videos. Since anomalous events are relatively rare, it is not feasible to collect a balanced dataset and train a binary classifier to solve the task. Thus, most…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Guangyu Sun , Zhang Liu , Lianggong Wen , Jing Shi , Chenliang Xu

Efficiently adapting large Vision-Language Models (VLMs) like CLIP for few-shot learning poses challenges in balancing pre-trained knowledge retention and task-specific adaptation. Existing methods often overlook valuable structural…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Dazhi Huang