English
Related papers

Related papers: ProtAugment: Unsupervised diverse short-texts para…

200 papers

Few-shot action recognition aims to recognize action classes with few training samples. Most existing methods adopt a meta-learning approach with episodic training. In each episode, the few samples in a meta-training task are split into…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Xiatian Zhu , Antoine Toisoul , Juan-Manuel Perez-Rua , Li Zhang , Brais Martinez , Tao Xiang

We lack a systematic understanding of the effects of fine-tuning (via methods such as instruction-tuning or reinforcement learning from human feedback), particularly on tasks outside the narrow fine-tuning distribution. In a simplified…

Computation and Language · Computer Science 2024-04-16 Suhas Kotha , Jacob Mitchell Springer , Aditi Raghunathan

Due to the broad range of social media platforms, the requirements of abusive language detection systems are varied and ever-changing. Already a large set of annotated corpora with different properties and label sets were created, such as…

Computation and Language · Computer Science 2024-05-07 Viktor Hangya , Alexander Fraser

Cross-domain few-shot classification induces a much more challenging problem than its in-domain counterpart due to the existence of domain shifts between the training and test tasks. In this paper, we develop a novel Adaptive Parametric…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Marzi Heidari , Abdullah Alchihabi , Qing En , Yuhong Guo

Few-shot learning has emerged as a powerful paradigm for training models with limited labeled data, addressing challenges in scenarios where large-scale annotation is impractical. While extensive research has been conducted in the image…

Few-shot detection is a major task in pattern recognition which seeks to localize objects using models trained with few labeled data. One of the mainstream few-shot methods is transfer learning which consists in pretraining a detection…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Jie Mei , Mingyuan Jiu , Hichem Sahbi , Xiaoheng Jiang , Mingliang Xu

Detecting social bias in text is challenging due to nuance, subjectivity, and difficulty in obtaining good quality labeled datasets at scale, especially given the evolving nature of social biases and society. To address these challenges, we…

Computation and Language · Computer Science 2022-04-19 Shrimai Prabhumoye , Rafal Kocielnik , Mohammad Shoeybi , Anima Anandkumar , Bryan Catanzaro

The versatility to learn from a handful of samples is the hallmark of human intelligence. Few-shot learning is an endeavour to transcend this capability down to machines. Inspired by the promise and power of probabilistic deep learning, we…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Anuj Singh , Hadi Jamali-Rad

Large-scale pre-trained language models have contributed significantly to natural language processing by demonstrating remarkable abilities as few-shot learners. However, their effectiveness depends mainly on scaling the model parameters…

Computation and Language · Computer Science 2023-01-26 Ningyu Zhang , Luoqiu Li , Xiang Chen , Shumin Deng , Zhen Bi , Chuanqi Tan , Fei Huang , Huajun Chen

Given the rise of conflicts on social media, effective classification models to detect harmful behaviours are essential. Following the garbage-in-garbage-out maxim, machine learning performance depends heavily on training data quality.…

Computation and Language · Computer Science 2025-07-01 Oliver Warke , Joemon M. Jose , Faegheh Hasibi , Jan Breitsohl

In computer vision, fine-tuning is the de-facto approach to leverage pre-trained vision models to perform downstream tasks. However, deploying it in practice is quite challenging, due to adopting parameter inefficient global update and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Xing Nie , Bolin Ni , Jianlong Chang , Gaomeng Meng , Chunlei Huo , Zhaoxiang Zhang , Shiming Xiang , Qi Tian , Chunhong Pan

Few-shot learning aims to adapt knowledge learned from previous tasks to novel tasks with only a limited amount of labeled data. Research literature on few-shot learning exhibits great diversity, while different algorithms often excel at…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Chi Zhang , Henghui Ding , Guosheng Lin , Ruibo Li , Changhu Wang , Chunhua Shen

Text guided diffusion models are used by millions of users, but can be easily exploited to produce harmful content. Concept unlearning methods aim at reducing the models' likelihood of generating harmful content. Traditionally, this has…

Artificial Intelligence · Computer Science 2026-02-10 Mansi , Avinash Kori , Francesca Toni , Soteris Demetriou

What matters for contrastive learning? We argue that contrastive learning heavily relies on informative features, or "hard" (positive or negative) features. Early works include more informative features by applying complex data…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Jiangmeng Li , Wenwen Qiang , Changwen Zheng , Bing Su , Hui Xiong

Paraphrase generation is a longstanding NLP task that has diverse applications for downstream NLP tasks. However, the effectiveness of existing efforts predominantly relies on large amounts of golden labeled data. Though unsupervised…

Computation and Language · Computer Science 2021-09-28 Kaize Ding , Dingcheng Li , Alexander Hanbo Li , Xing Fan , Chenlei Guo , Yang Liu , Huan Liu

Recent breakthroughs in diffusion models have exhibited exceptional image-generation capabilities. However, studies show that some outputs are merely replications of training data. Such replications present potential legal challenges for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Yuxin Wen , Yuchen Liu , Chen Chen , Lingjuan Lyu

The task of Few-shot learning (FSL) aims to transfer the knowledge learned from base categories with sufficient labelled data to novel categories with scarce known information. It is currently an important research question and has great…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Chengming Xu , Chen Liu , Xinwei Sun , Siqian Yang , Yabiao Wang , Chengjie Wang , Yanwei Fu

Prompt tuning, in which a base pretrained model is adapted to each task via conditioning on learned prompt vectors, has emerged as a promising approach for efficiently adapting large language models to multiple downstream tasks. However,…

Computation and Language · Computer Science 2023-03-07 Zhen Wang , Rameswar Panda , Leonid Karlinsky , Rogerio Feris , Huan Sun , Yoon Kim

Many meta-learning approaches for few-shot learning rely on simple base learners such as nearest-neighbor classifiers. However, even in the few-shot regime, discriminatively trained linear predictors can offer better generalization. We…

Computer Vision and Pattern Recognition · Computer Science 2019-04-24 Kwonjoon Lee , Subhransu Maji , Avinash Ravichandran , Stefano Soatto

Few-shot learning aims to train models that can be generalized to novel classes with only a few samples. Recently, a line of works are proposed to enhance few-shot learning with accessible semantic information from class names. However,…

Machine Learning · Computer Science 2023-07-11 Zihao Jiang , Yunkai Dang , Dong Pang , Huishuai Zhang , Weiran Huang