中文
相关论文

相关论文: VLM-NCD:Novel Class Discovery with Vision-Based La…

200 篇论文

In this paper, we tackle the problem of novel visual category discovery, i.e., grouping unlabelled images from new classes into different semantic partitions by leveraging a labelled dataset that contains images from other different but…

计算机视觉与模式识别 · 计算机科学 2022-01-04 Bingchen Zhao , Kai Han

Continuous Generalized Category Discovery (C-GCD) aims to continually discover novel classes from unlabelled image sets while maintaining performance on old classes. In this paper, we propose a novel learning framework, dubbed Neighborhood…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Ye Wang , Yaxiong Wang , Guoshuai Zhao , Xueming Qian

We tackle the problem of novel class discovery and localization (NCDL). In this setting, we assume a source dataset with supervision for only some object classes. Instances of other classes need to be discovered, classified, and localized…

计算机视觉与模式识别 · 计算机科学 2022-12-01 Vladimir Fomenko , Ismail Elezi , Deva Ramanan , Laura Leal-Taixé , Aljoša Ošep

In Large Visual Language Models (LVLMs), the efficacy of In-Context Learning (ICL) remains limited by challenges in cross-modal interactions and representation disparities. To overcome these challenges, we introduce a novel Visual…

计算机视觉与模式识别 · 计算机科学 2024-02-20 Yucheng Zhou , Xiang Li , Qianning Wang , Jianbing Shen

In the field of continual learning, relying on so-called oracles for novelty detection is commonplace albeit unrealistic. This paper introduces CONCLAD ("COntinuous Novel CLAss Detector"), a comprehensive solution to the under-explored…

机器学习 · 计算机科学 2024-12-17 Amanda Rios , Ibrahima Ndiour , Parual Datta , Omesh Tickoo , Nilesh Ahuja

Generalized Category Discovery (GCD) requires a model to both classify known categories and cluster unknown categories in unlabeled data. Prior methods leveraged self-supervised pre-training combined with supervised fine-tuning on the…

计算机视觉与模式识别 · 计算机科学 2023-05-18 Rabah Ouldnoughi , Chia-Wen Kuo , Zsolt Kira

Generalized category discovery (GCD) is a recently proposed open-world problem, which aims to automatically cluster partially labeled data. The main challenge is that the unlabeled data contain instances that are not only from known…

计算机视觉与模式识别 · 计算机科学 2023-03-31 Nan Pu , Zhun Zhong , Nicu Sebe

Deep learning-based models encounter challenges when processing long-tailed data in the real world. Existing solutions usually employ some balancing strategies or transfer learning to deal with the class imbalance problem, based on the…

计算机视觉与模式识别 · 计算机科学 2022-07-20 Changyao Tian , Wenhai Wang , Xizhou Zhu , Jifeng Dai , Yu Qiao

Long-tailed visual recognition has received increasing attention in recent years. Due to the extremely imbalanced data distribution in long-tailed learning, the learning process shows great uncertainties. For example, the predictions of…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Zichang Tan , Jun Li , Jinhao Du , Jun Wan , Zhen Lei , Guodong Guo

We tackle the problem of novel class discovery, which aims to learn novel classes without supervision based on labeled data from known classes. A key challenge lies in transferring the knowledge in the known-class data to the learning of…

计算机视觉与模式识别 · 计算机科学 2023-08-28 Peiyan Gu , Chuyu Zhang , Ruijie Xu , Xuming He

Long-tailed imbalance distribution is a common issue in practical computer vision applications. Previous works proposed methods to address this problem, which can be categorized into several classes: re-sampling, re-weighting, transfer…

计算机视觉与模式识别 · 计算机科学 2024-04-24 Pengxiao Han , Changkun Ye , Jieming Zhou , Jing Zhang , Jie Hong , Xuesong Li

Deep long-tailed learning, one of the most challenging problems in visual recognition, aims to train well-performing deep models from a large number of images that follow a long-tailed class distribution. In the last decade, deep learning…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Yifan Zhang , Bingyi Kang , Bryan Hooi , Shuicheng Yan , Jiashi Feng

For visual recognition, knowledge distillation typically involves transferring knowledge from a large, well-trained teacher model to a smaller student model. In this paper, we introduce an effective method to distill knowledge from an…

计算机视觉与模式识别 · 计算机科学 2024-09-02 Zaiwei Zhang , Gregory P. Meyer , Zhichao Lu , Ashish Shrivastava , Avinash Ravichandran , Eric M. Wolff

Generalized Category Discovery (GCD) aims to identify a mix of known and novel categories within unlabeled data sets, providing a more realistic setting for image recognition. Essentially, GCD needs to remember existing patterns thoroughly…

计算机视觉与模式识别 · 计算机科学 2025-03-06 Xinzi Cao , Xiawu Zheng , Guanhong Wang , Weijiang Yu , Yunhang Shen , Ke Li , Yutong Lu , Yonghong Tian

In this paper, we consider a real-world scenario where a model that is trained on pre-defined classes continually encounters unlabeled data that contains both known and novel classes. The goal is to continually discover novel classes while…

计算机视觉与模式识别 · 计算机科学 2023-10-19 Yanan Wu , Zhixiang Chi , Yang Wang , Songhe Feng

Out-of-distribution (OOD) detection is essential for reliable and trustworthy machine learning. Recent multi-modal OOD detection leverages textual information from in-distribution (ID) class names for visual OOD detection, yet it currently…

计算与语言 · 计算机科学 2023-10-13 Yi Dai , Hao Lang , Kaisheng Zeng , Fei Huang , Yongbin Li

Discovering novel concepts in unlabelled datasets and in a continuous manner is an important desideratum of lifelong learners. In the literature such problems have been partially addressed under very restricted settings, where novel classes…

计算机视觉与模式识别 · 计算机科学 2024-08-26 Mingxuan Liu , Subhankar Roy , Zhun Zhong , Nicu Sebe , Elisa Ricci

Novel class discovery (NCD) aims to infer novel categories in an unlabeled dataset by leveraging prior knowledge of a labeled set comprising disjoint but related classes. Given that most existing literature focuses primarily on utilizing…

机器学习 · 计算机科学 2023-06-07 Ziyun Li , Jona Otholt , Ben Dai , Di Hu , Christoph Meinel , Haojin Yang

Object detectors are typically trained once and for all on a fixed set of classes. However, this closed-world assumption is unrealistic in practice, as new classes will inevitably emerge after the detector is deployed in the wild. In this…

计算机视觉与模式识别 · 计算机科学 2024-05-01 Tyler L. Hayes , César R. de Souza , Namil Kim , Jiwon Kim , Riccardo Volpi , Diane Larlus

Generalized category discovery (GCD) is a recently proposed open-world task. Given a set of images consisting of labeled and unlabeled instances, the goal of GCD is to automatically cluster the unlabeled samples using information…

计算机视觉与模式识别 · 计算机科学 2023-10-31 Xiangli Yang , Xinglin Pan , Irwin King , Zenglin Xu