English
Related papers

Related papers: Automatic Attack Discovery for Few-Shot Class-Incr…

200 papers

Federated Class Incremental Learning (FCIL) is a critical yet largely underexplored issue that deals with the dynamic incorporation of new classes within federated learning (FL). Existing methods often employ generative adversarial networks…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Naibo Wang , Yuchen Deng , Wenjie Feng , Jianwei Yin , See-Kiong Ng

Deep models, e.g., CNNs and Vision Transformers, have achieved impressive achievements in many vision tasks in the closed world. However, novel classes emerge from time to time in our ever-changing world, requiring a learning system to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Da-Wei Zhou , Qi-Wei Wang , Zhi-Hong Qi , Han-Jia Ye , De-Chuan Zhan , Ziwei Liu

Recently, Transformer-based robotic manipulation methods utilize multi-view spatial representations and language instructions to learn robot motion trajectories by leveraging numerous robot demonstrations. However, the collection of robot…

Robotics · Computer Science 2025-04-23 Mingchen Song , Xiang Deng , Guoqiang Zhong , Qi Lv , Jia Wan , Yinchuan Li , Jianye Hao , Weili Guan

Scenarios in which restrictions in data transfer and storage limit the possibility to compose a single dataset -- also exploiting different data sources -- to perform a batch-based training procedure, make the development of robust models…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Lorenzo Pellegrini , Guido Borghi , Annalisa Franco , Davide Maltoni

Algorithm selection is commonly used to predict the best solver from a portfolio per per-instance. In many real scenarios, instances arrive in a stream: new instances become available over time, while the number of class labels can also…

Machine Learning · Computer Science 2025-06-03 Mate Botond Nemeth , Emma Hart , Kevin Sim , Quentin Renau

In-context Learning (ICL) is one of the key methods for enhancing the performance of large language models on specific tasks by providing a set of few-shot examples. However, the ICL capability of different types of models shows significant…

Computation and Language · Computer Science 2024-01-11 Ding Chen , Shichao Song , Qingchen Yu , Zhiyu Li , Wenjin Wang , Feiyu Xiong , Bo Tang

Humans are capable of learning new concepts from only a few (labeled) exemplars, incrementally and continually. This happens within the context that we can differentiate among the exemplars, and between the exemplars and large amounts of…

Machine Learning · Computer Science 2022-02-08 Daniel T. Chang

As unlabeled data carry rich task-relevant information, they are proven useful for few-shot learning of language model. The question is how to effectively make use of such data. In this work, we revisit the self-training technique for…

Computation and Language · Computer Science 2021-10-05 Yiming Chen , Yan Zhang , Chen Zhang , Grandee Lee , Ran Cheng , Haizhou Li

Anomaly detection in computational workflows is critical for ensuring system reliability and security. However, traditional rule-based methods struggle to detect novel anomalies. This paper leverages large language models (LLMs) for…

Software Engineering · Computer Science 2024-07-26 Hongwei Jin , George Papadimitriou , Krishnan Raghavan , Pawel Zuk , Prasanna Balaprakash , Cong Wang , Anirban Mandal , Ewa Deelman

Machine learning has been highly successful in data-intensive applications but is often hampered when the data set is small. Recently, Few-Shot Learning (FSL) is proposed to tackle this problem. Using prior knowledge, FSL can rapidly…

Machine Learning · Computer Science 2020-03-31 Yaqing Wang , Quanming Yao , James Kwok , Lionel M. Ni

This paper focuses on Federated Domain-Incremental Learning (FDIL) where each client continues to learn incremental tasks where their domain shifts from each other. We propose a novel adaptive knowledge matching-based personalized FDIL…

Machine Learning · Computer Science 2024-07-19 Yichen Li , Wenchao Xu , Haozhao Wang , Ruixuan Li , Yining Qi , Jingcai Guo

Exemplar-Free Class Incremental Learning (efCIL) aims to continuously incorporate the knowledge from new classes while retaining previously learned information, without storing any old-class exemplars (i.e., samples). For this purpose,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Libo Huang , Zhulin An , Yan Zeng , Chuanguang Yang , Xinqiang Yu , Yongjun Xu

Current research on class-incremental learning primarily focuses on single-label classification tasks. However, real-world applications often involve multi-label scenarios, such as image retrieval and medical imaging. Therefore, this paper…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Chenhao Ding , Songlin Dong , Zhengdong Zhou , Jizhou Han , Qiang Wang , Yuhang He , Yihong Gong

Federated Learning (FL) aims at unburdening the training of deep models by distributing computation across multiple devices (clients) while safeguarding data privacy. On top of that, Federated Continual Learning (FCL) also accounts for data…

Machine Learning · Computer Science 2025-05-27 Riccardo Salami , Pietro Buzzega , Matteo Mosconi , Mattia Verasani , Simone Calderara

Few-shot learning (FSL) is an emergent paradigm of learning that attempts to learn to reason with low sample complexity to mimic the way humans learn, generalise and extrapolate from only a few seen examples. While FSL attempts to mimic…

Machine Learning · Computer Science 2023-12-08 Jaron Mar , Jiamou Liu

The task of Few-shot learning (FSL) aims to transfer the knowledge learned from base categories with sufficient labelled data to novel categories with scarce known information. It is currently an important research question and has great…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Chengming Xu , Chen Liu , Xinwei Sun , Siqian Yang , Yabiao Wang , Chengjie Wang , Yanwei Fu

Large language models (LLM) trained using the next-token-prediction objective, such as GPT3 and PaLM, have revolutionized natural language processing in recent years by showing impressive zero-shot and few-shot capabilities across a wide…

Computation and Language · Computer Science 2023-02-01 Hao Liu , Xinyang Geng , Lisa Lee , Igor Mordatch , Sergey Levine , Sharan Narang , Pieter Abbeel

Deep neural networks (DNNs) are known to perform well when deployed to test distributions that shares high similarity with the training distribution. Feeding DNNs with new data sequentially that were unseen in the training distribution has…

Machine Learning · Computer Science 2021-07-30 Eugene Lee , Cheng-Han Huang , Chen-Yi Lee

Large language models (LLMs) possess a remarkable ability to perform in-context learning (ICL), which enables them to handle multiple downstream tasks simultaneously without requiring task-specific fine-tuning. Recent studies have shown…

Computation and Language · Computer Science 2026-03-04 Wenchong He , Liqian Peng , Zhe Jiang , Alex Go

Few-shot class-incremental learning is to recognize the new classes given few samples and not forget the old classes. It is a challenging task since representation optimization and prototype reorganization can only be achieved under little…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Kai Zhu , Yang Cao , Wei Zhai , Jie Cheng , Zheng-Jun Zha