English
Related papers

Related papers: VLM-NCD:Novel Class Discovery with Vision-Based La…

200 papers

In this paper, we tackle the problem of novel visual category discovery, i.e., grouping unlabelled images from new classes into different semantic partitions by leveraging a labelled dataset that contains images from other different but…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Bingchen Zhao , Kai Han

Continuous Generalized Category Discovery (C-GCD) aims to continually discover novel classes from unlabelled image sets while maintaining performance on old classes. In this paper, we propose a novel learning framework, dubbed Neighborhood…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Ye Wang , Yaxiong Wang , Guoshuai Zhao , Xueming Qian

We tackle the problem of novel class discovery and localization (NCDL). In this setting, we assume a source dataset with supervision for only some object classes. Instances of other classes need to be discovered, classified, and localized…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Vladimir Fomenko , Ismail Elezi , Deva Ramanan , Laura Leal-Taixé , Aljoša Ošep

In Large Visual Language Models (LVLMs), the efficacy of In-Context Learning (ICL) remains limited by challenges in cross-modal interactions and representation disparities. To overcome these challenges, we introduce a novel Visual…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Yucheng Zhou , Xiang Li , Qianning Wang , Jianbing Shen

In the field of continual learning, relying on so-called oracles for novelty detection is commonplace albeit unrealistic. This paper introduces CONCLAD ("COntinuous Novel CLAss Detector"), a comprehensive solution to the under-explored…

Machine Learning · Computer Science 2024-12-17 Amanda Rios , Ibrahima Ndiour , Parual Datta , Omesh Tickoo , Nilesh Ahuja

Generalized Category Discovery (GCD) requires a model to both classify known categories and cluster unknown categories in unlabeled data. Prior methods leveraged self-supervised pre-training combined with supervised fine-tuning on the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Rabah Ouldnoughi , Chia-Wen Kuo , Zsolt Kira

Generalized category discovery (GCD) is a recently proposed open-world problem, which aims to automatically cluster partially labeled data. The main challenge is that the unlabeled data contain instances that are not only from known…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Nan Pu , Zhun Zhong , Nicu Sebe

Deep learning-based models encounter challenges when processing long-tailed data in the real world. Existing solutions usually employ some balancing strategies or transfer learning to deal with the class imbalance problem, based on the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Changyao Tian , Wenhai Wang , Xizhou Zhu , Jifeng Dai , Yu Qiao

Long-tailed visual recognition has received increasing attention in recent years. Due to the extremely imbalanced data distribution in long-tailed learning, the learning process shows great uncertainties. For example, the predictions of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Zichang Tan , Jun Li , Jinhao Du , Jun Wan , Zhen Lei , Guodong Guo

We tackle the problem of novel class discovery, which aims to learn novel classes without supervision based on labeled data from known classes. A key challenge lies in transferring the knowledge in the known-class data to the learning of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Peiyan Gu , Chuyu Zhang , Ruijie Xu , Xuming He

Long-tailed imbalance distribution is a common issue in practical computer vision applications. Previous works proposed methods to address this problem, which can be categorized into several classes: re-sampling, re-weighting, transfer…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Pengxiao Han , Changkun Ye , Jieming Zhou , Jing Zhang , Jie Hong , Xuesong Li

Deep long-tailed learning, one of the most challenging problems in visual recognition, aims to train well-performing deep models from a large number of images that follow a long-tailed class distribution. In the last decade, deep learning…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Yifan Zhang , Bingyi Kang , Bryan Hooi , Shuicheng Yan , Jiashi Feng

For visual recognition, knowledge distillation typically involves transferring knowledge from a large, well-trained teacher model to a smaller student model. In this paper, we introduce an effective method to distill knowledge from an…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Zaiwei Zhang , Gregory P. Meyer , Zhichao Lu , Ashish Shrivastava , Avinash Ravichandran , Eric M. Wolff

Generalized Category Discovery (GCD) aims to identify a mix of known and novel categories within unlabeled data sets, providing a more realistic setting for image recognition. Essentially, GCD needs to remember existing patterns thoroughly…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Xinzi Cao , Xiawu Zheng , Guanhong Wang , Weijiang Yu , Yunhang Shen , Ke Li , Yutong Lu , Yonghong Tian

In this paper, we consider a real-world scenario where a model that is trained on pre-defined classes continually encounters unlabeled data that contains both known and novel classes. The goal is to continually discover novel classes while…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Yanan Wu , Zhixiang Chi , Yang Wang , Songhe Feng

Out-of-distribution (OOD) detection is essential for reliable and trustworthy machine learning. Recent multi-modal OOD detection leverages textual information from in-distribution (ID) class names for visual OOD detection, yet it currently…

Computation and Language · Computer Science 2023-10-13 Yi Dai , Hao Lang , Kaisheng Zeng , Fei Huang , Yongbin Li

Discovering novel concepts in unlabelled datasets and in a continuous manner is an important desideratum of lifelong learners. In the literature such problems have been partially addressed under very restricted settings, where novel classes…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Mingxuan Liu , Subhankar Roy , Zhun Zhong , Nicu Sebe , Elisa Ricci

Novel class discovery (NCD) aims to infer novel categories in an unlabeled dataset by leveraging prior knowledge of a labeled set comprising disjoint but related classes. Given that most existing literature focuses primarily on utilizing…

Machine Learning · Computer Science 2023-06-07 Ziyun Li , Jona Otholt , Ben Dai , Di Hu , Christoph Meinel , Haojin Yang

Object detectors are typically trained once and for all on a fixed set of classes. However, this closed-world assumption is unrealistic in practice, as new classes will inevitably emerge after the detector is deployed in the wild. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Tyler L. Hayes , César R. de Souza , Namil Kim , Jiwon Kim , Riccardo Volpi , Diane Larlus

Generalized category discovery (GCD) is a recently proposed open-world task. Given a set of images consisting of labeled and unlabeled instances, the goal of GCD is to automatically cluster the unlabeled samples using information…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Xiangli Yang , Xinglin Pan , Irwin King , Zenglin Xu