English
Related papers

Related papers: Robust Few-shot Learning Without Using any Adversa…

200 papers

Few-shot point cloud semantic segmentation aims to train a model to quickly adapt to new unseen classes with only a handful of support set samples. However, the noise-free assumption in the support set can be easily violated in many…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Yating Xu , Na Zhao , Gim Hee Lee

Few-shot learning aims to recognize novel queries with limited support samples by learning from base knowledge. Recent progress in this setting assumes that the base knowledge and novel query samples are distributed in the same domains,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Yifan Zhao , Tong Zhang , Jia Li , Yonghong Tian

Transductive inference is an effective means of tackling the data deficiency problem in few-shot learning settings. A popular transductive inference technique for few-shot metric-based approaches, is to update the prototype of each class…

Machine Learning · Computer Science 2020-06-25 Seong Min Kye , Hae Beom Lee , Hoirin Kim , Sung Ju Hwang

Few-shot learning, especially few-shot image classification, has received increasing attention and witnessed significant advances in recent years. Some recent studies implicitly show that many generic techniques or ``tricks'', such as data…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Wenbin Li , Ziyi , Wang , Xuesong Yang , Chuanqi Dong , Pinzhuo Tian , Tiexin Qin , Jing Huo , Yinghuan Shi , Lei Wang , Yang Gao , Jiebo Luo

Deep models are highly susceptible to adversarial attacks. Such attacks are carefully crafted imperceptible noises that can fool the network and can cause severe consequences when deployed. To encounter them, the model requires training…

Machine Learning · Computer Science 2022-04-11 Gaurav Kumar Nayak , Ruchit Rawal , Anirban Chakraborty

Few-shot learning aims to build classifiers for new classes from a small number of labeled examples and is commonly facilitated by access to examples from a distinct set of 'base classes'. The difference in data distribution between the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-26 Zitian Chen , Subhransu Maji , Erik Learned-Miller

In this paper, we delve into the essential components of adversarial training which is a pioneering defense technique against adversarial attacks. We indicate that some factors such as the loss function, learning rate scheduler, and data…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Hong Liu

As deep learning applications, especially programs of computer vision, are increasingly deployed in our lives, we have to think more urgently about the security of these applications.One effective way to improve the security of deep…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Xiao Tan , Jingbo Gao , Ruolin Li

Large language models have shown their ability to become effective few-shot learners with prompting, revolutionizing the paradigm of learning with data scarcity. However, this approach largely depends on the quality of prompt…

Computation and Language · Computer Science 2024-10-04 Xiaoming Liu , Chen Liu , Zhaohan Zhang , Chengzhengxu Li , Longtian Wang , Yu Lan , Chao Shen

Learning to generate a task-aware base learner proves a promising direction to deal with few-shot learning (FSL) problem. Existing methods mainly focus on generating an embedding model utilized with a fixed metric (eg, cosine distance) for…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Lei Zhang , Fei Zhou , Wei Wei , Yanning Zhang

Few-shot and continual learning face two well-known challenges in GANs: overfitting and catastrophic forgetting. Learning new tasks results in catastrophic forgetting in deep learning models. In the case of a few-shot setting, the model…

Machine Learning · Computer Science 2024-10-22 Munsif Ali , Leonardo Rossi , Massimo Bertozzi

Automated surgical skill assessment (SSA) is a central task in surgical computer vision. Developing robust SSA models is challenging due to the scarcity of skill annotations, which are time-consuming to produce and require expert consensus.…

Few-shot classifiers excel under limited training samples, making them useful in applications with sparsely user-provided labels. Their unique relative prediction setup offers opportunities for novel attacks, such as targeting support sets…

Cryptography and Security · Computer Science 2021-06-29 Yi Xiang Marcus Tan , Penny Chong , Jiamei Sun , Ngai-Man Cheung , Yuval Elovici , Alexander Binder

Few-shot dense retrieval (DR) aims to effectively generalize to novel search scenarios by learning a few samples. Despite its importance, there is little study on specialized datasets and standardized evaluation protocols. As a result,…

Computation and Language · Computer Science 2023-04-13 Si Sun , Yida Lu , Shi Yu , Xiangyang Li , Zhonghua Li , Zhao Cao , Zhiyuan Liu , Deiming Ye , Jie Bao

Since 2012, Deep learning has revolutionized Artificial Intelligence and has achieved state-of-the-art outcomes in different domains, ranging from Image Classification to Speech Generation. Though it has many potentials, our current…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Shruti Jadon , Aryan Jadon

Recent work has uncovered the interesting (and somewhat surprising) finding that training models to be invariant to adversarial perturbations requires substantially larger datasets than those required for standard classification. This…

Machine Learning · Computer Science 2019-12-06 Jonathan Uesato , Jean-Baptiste Alayrac , Po-Sen Huang , Robert Stanforth , Alhussein Fawzi , Pushmeet Kohli

We demonstrate, theoretically and empirically, that adversarial robustness can significantly benefit from semisupervised learning. Theoretically, we revisit the simple Gaussian model of Schmidt et al. that shows a sample complexity gap…

Machine Learning · Statistics 2022-01-14 Yair Carmon , Aditi Raghunathan , Ludwig Schmidt , Percy Liang , John C. Duchi

Few-Shot Learning (FSL) algorithms are commonly trained through Meta-Learning (ML), which exposes models to batches of tasks sampled from a meta-dataset to mimic tasks seen during evaluation. However, the standard training procedures…

Machine Learning · Computer Science 2024-10-28 Mateusz Ochal , Massimiliano Patacchiola , Amos Storkey , Jose Vazquez , Sen Wang

Few-shot classification aims to carry out classification given only few labeled examples for the categories of interest. Though several approaches have been proposed, most existing few-shot learning (FSL) models assume that base and novel…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Yuan-Chia Cheng , Ci-Siang Lin , Fu-En Yang , Yu-Chiang Frank Wang

Adversarial pruning compresses models while preserving robustness. Current methods require access to adversarial examples during pruning. This significantly hampers training efficiency. Moreover, as new adversarial attacks and training…

Machine Learning · Computer Science 2022-10-11 Tong Jian , Zifeng Wang , Yanzhi Wang , Jennifer Dy , Stratis Ioannidis