English
Related papers

Related papers: CATALOG: A Camera Trap Language-guided Contrastive…

200 papers

Contrastive learning has recently demonstrated great potential for unsupervised pre-training in 3D scene understanding tasks. However, most existing work randomly selects point features as anchors while building contrast, leading to a clear…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Kangcheng Liu , Xinhu Zheng , Chaoqun Wang , Kai Tang , Ming Liu , Baoquan Chen

Leveraging pre-trained 2D image representations in behavior cloning policies has achieved great success and has become a standard approach for robotic manipulation. However, such representations fail to capture the 3D spatial information…

Robotics · Computer Science 2026-05-07 I-Chun Arthur Liu , Krzysztof Choromanski , Sandy Huang , Connor Schenck

Few-shot learning aims to train models that can be generalized to novel classes with only a few samples. Recently, a line of works are proposed to enhance few-shot learning with accessible semantic information from class names. However,…

Machine Learning · Computer Science 2023-07-11 Zihao Jiang , Yunkai Dang , Dong Pang , Huishuai Zhang , Weiran Huang

Contrastively trained vision-language models have achieved remarkable progress in vision and language representation learning, leading to state-of-the-art models for various downstream multimodal tasks. However, recent research has…

Computation and Language · Computer Science 2023-10-26 Harman Singh , Pengchuan Zhang , Qifan Wang , Mengjiao Wang , Wenhan Xiong , Jingfei Du , Yu Chen

Task-incremental continual learning refers to continually training a model in a sequence of tasks while overcoming the problem of catastrophic forgetting (CF). The issue arrives for the reason that the learned representations are forgotten…

Machine Learning · Computer Science 2023-05-23 Yun Luo , Xiaotian Lin , Zhen Yang , Fandong Meng , Jie Zhou , Yue Zhang

Food image classification is the fundamental step in image-based dietary assessment, which aims to estimate participants' nutrient intake from eating occasion images. A common challenge of food images is the intra-class diversity and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Xinyue Pan , Jiangpeng He , Fengqing Zhu

Label distributions in camera-trap images are highly imbalanced and long-tailed, resulting in neural networks tending to be biased towards head-classes that appear frequently. Although long-tail learning has been extremely explored to…

Computer Vision and Pattern Recognition · Computer Science 2022-02-17 Byeongjun Park , Jeongsoo Kim , Seungju Cho , Heeseon Kim , Changick Kim

Few-shot classification and meta-learning methods typically struggle to generalize across diverse domains, as most approaches focus on a single dataset, failing to transfer knowledge across various seen and unseen domains. Existing…

Machine Learning · Computer Science 2025-10-07 Kristi Topollai , Anna Choromanska

In neutrino physics, analyses often depend on large simulated datasets, making it essential for models to generalise effectively to real-world detector data. Contrastive learning, a well-established technique in deep learning, offers a…

High Energy Physics - Experiment · Physics 2025-05-23 Alex Wilkinson , Radi Radev , Saul Alonso-Monsalve

Face anti-spoofing (FAS) or presentation attack detection is an essential component of face recognition systems deployed in security-critical applications. Existing FAS methods have poor generalizability to unseen spoof types, camera…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Koushik Srivatsan , Muzammal Naseer , Karthik Nandakumar

Zero-shot classification of image scenes which can recognize the image scenes that are not seen in the training stage holds great promise of lowering the dependence on large numbers of labeled samples. To address the zero-shot image scene…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Chun Liu , Suqiang Ma , Zheng Li , Wei Yang , Zhigang Han

Domain Generalization (DG) is essentially a sub-branch of out-of-distribution generalization, which trains models from multiple source domains and generalizes to unseen target domains. Recently, some domain generalization algorithms have…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Zining Chen , Weiqiu Wang , Zhicheng Zhao , Aidong Men

Contrastive learning is commonly used as a method of self-supervised learning with the "anchor" and "positive" being two random augmentations of a given input image, and the "negative" is the set of all other images. However, the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Rishab Balasubramanian , Kunal Rathore

Although an object may appear in numerous contexts, we often describe it in a limited number of ways. Language allows us to abstract away visual variation to represent and communicate concepts. Building on this intuition, we propose an…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Mohamed El Banani , Karan Desai , Justin Johnson

Contrastive learning has revolutionized the field of computer vision, learning rich representations from unlabeled data, which generalize well to diverse vision tasks. Consequently, it has become increasingly important to explain these…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Fawaz Sammani , Boris Joukovsky , Nikos Deligiannis

Text-image cross-modal retrieval is a challenging task in the field of language and vision. Most previous approaches independently embed images and sentences into a joint embedding space and compare their similarities. However, previous…

Computer Vision and Pattern Recognition · Computer Science 2019-09-13 Zihao Wang , Xihui Liu , Hongsheng Li , Lu Sheng , Junjie Yan , Xiaogang Wang , Jing Shao

Adapting machine learning models to medical time series across different domains remains a challenge due to complex temporal dependencies and dynamic distribution shifts. Current approaches often focus on isolated feature representations,…

Machine Learning · Computer Science 2025-09-23 YongKyung Oh , Alex Bui

Self-Supervised Contrastive Learning has proven effective in deriving high-quality representations from unlabeled data. However, a major challenge that hinders both unimodal and multimodal contrastive learning is feature suppression, a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Jihai Zhang , Xiang Lan , Xiaoye Qu , Yu Cheng , Mengling Feng , Bryan Hooi

This paper proposes a novel Zero-Shot Action Recognition~(ZSAR) method based on contrastive learning. In ZSAR, we aim to classify examples from classes that were missing during training. Two well-known problems remain in ZSAR: the semantic…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Valter Estevam , Rayson Laroca , Helio Pedrini , David Menotti

In this work, we evaluate contrastive models for the task of image retrieval. We hypothesise that models that are learned to encode semantic similarity among instances via discriminative learning should perform well on the task of image…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Tarun Krishna , Kevin McGuinness , Noel O'Connor