中文
相关论文

相关论文: Few-shot Text Classification with Dual Contrastive…

200 篇论文

Few-shot learning benchmarks are critical for evaluating modern NLP techniques. It is possible, however, that benchmarks favor methods which easily make use of unlabeled text, because researchers can use unlabeled text from the test set to…

计算与语言 · 计算机科学 2024-10-03 Kush Dubey

State-of-the-art natural language understanding classification models follow two-stages: pre-training a large language model on an auxiliary task, and then fine-tuning the model on a task-specific labeled dataset using cross-entropy loss.…

计算与语言 · 计算机科学 2021-04-06 Beliz Gunel , Jingfei Du , Alexis Conneau , Ves Stoyanov

Many tasks related to Computational Social Science and Web Content Analysis involve classifying pieces of text based on the claims they contain. State-of-the-art approaches usually involve fine-tuning models on large annotated datasets,…

计算与语言 · 计算机科学 2024-05-10 Sandrine Chausson , Björn Ross

Few-shot Learning aims to learn and distinguish new categories with a very limited number of available images, presenting a significant challenge in the realm of deep learning. Recent researchers have sought to leverage the additional…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Chunpeng Zhou , Haishuai Wang , Xilu Yuan , Zhi Yu , Jiajun Bu

Transformer-based language models have achieved remarkable success in few-shot in-context learning and drawn a lot of research interest. However, these models' performance greatly depends on the choice of the example prompts and also has…

计算与语言 · 计算机科学 2023-06-21 Genta Indra Winata , Liang-Kang Huang , Soumya Vadlamannati , Yash Chandarana

Few-shot classification consists of learning a predictive model that is able to effectively adapt to a new class, given only a few annotated samples. To solve this challenging problem, meta-learning has become a popular paradigm that…

计算机视觉与模式识别 · 计算机科学 2019-09-02 Nikita Dvornik , Cordelia Schmid , Julien Mairal

Unsupervised learning is argued to be the dark matter of human intelligence. To build in this direction, this paper focuses on unsupervised learning from an abundance of unlabeled data followed by few-shot fine-tuning on a downstream…

计算机视觉与模式识别 · 计算机科学 2022-02-17 Ojas Kishore Shirekar , Hadi Jamali-Rad

The prompt has become an effective linguistic tool for utilizing pre-trained language models. However, in few-shot scenarios, subtle changes in the prompt design always make the result widely different, and the prompt learning methods also…

计算与语言 · 计算机科学 2024-03-13 Jinta Weng , Yifan Deng , d Donghao Li , Hao You , Yue Hu , Heyan Huang

Pre-trained vision-language models learn massive data to model unified representations of images and natural languages, which can be widely applied to downstream machine learning tasks. In addition to zero-shot inference, in order to better…

计算机视觉与模式识别 · 计算机科学 2024-06-28 Qian-Wei Wang , Yuqiu Xie , Letian Zhang , Zimo Liu , Shu-Tao Xia

Few-shot Named Entity Recognition (NER) aims to extract named entities using only a limited number of labeled examples. Existing contrastive learning methods often suffer from insufficient distinguishability in context vector representation…

计算与语言 · 计算机科学 2024-05-09 Haojie Zhang , Yimeng Zhuang

Fine-grained classification involves dealing with datasets with larger number of classes with subtle differences between them. Guiding the model to focus on differentiating dimensions between these commonly confusable classes is key to…

计算与语言 · 计算机科学 2021-09-14 Varsha Suresh , Desmond C. Ong

Metric-based meta-learning techniques have successfully been applied to few-shot classification problems. In this paper, we propose to leverage cross-modal information to enhance metric-based few-shot learning methods. Visual and semantic…

机器学习 · 计算机科学 2020-02-19 Chen Xing , Negar Rostamzadeh , Boris N. Oreshkin , Pedro O. Pinheiro

Few-shot learning is an established topic in natural images for years, but few work is attended to histology images, which is of high clinical value since well-labeled datasets and rare abnormal samples are expensive to collect. Here, we…

图像与视频处理 · 电气工程与系统科学 2022-02-21 Jiawei Yang , Hanbo Chen , Jiangpeng Yan , Xiaoyu Chen , Jianhua Yao

Few-shot learning (FSL) is an emergent paradigm of learning that attempts to learn to reason with low sample complexity to mimic the way humans learn, generalise and extrapolate from only a few seen examples. While FSL attempts to mimic…

机器学习 · 计算机科学 2023-12-08 Jaron Mar , Jiamou Liu

Existing approaches towards anomaly detection~(AD) often rely on a substantial amount of anomaly-free data to train representation and density models. However, large anomaly-free datasets may not always be available before the inference…

计算机视觉与模式识别 · 计算机科学 2024-03-01 Jingyi Liao , Xun Xu , Manh Cuong Nguyen , Adam Goodge , Chuan Sheng Foo

Distribution estimation has been demonstrated as one of the most effective approaches in dealing with few-shot image classification, as the low-level patterns and underlying representations can be easily transferred across different tasks…

计算与语言 · 计算机科学 2023-03-30 Han Liu , Feng Zhang , Xiaotong Zhang , Siyang Zhao , Fenglong Ma , Xiao-Ming Wu , Hongyang Chen , Hong Yu , Xianchao Zhang

As unlabeled data carry rich task-relevant information, they are proven useful for few-shot learning of language model. The question is how to effectively make use of such data. In this work, we revisit the self-training technique for…

计算与语言 · 计算机科学 2021-10-05 Yiming Chen , Yan Zhang , Chen Zhang , Grandee Lee , Ran Cheng , Haizhou Li

Zero-shot text classification remains a difficult task in domains with evolving knowledge and ambiguous category boundaries, such as ticketing systems. Large language models (LLMs) often struggle to generalize in these scenarios due to…

机器学习 · 计算机科学 2025-08-05 Amrit Rajeev , Udayaadithya Avadhanam , Harshula Tulapurkar , SaiBarath Sundar

Few-shot node classification is tasked to provide accurate predictions for nodes from novel classes with only few representative labeled nodes. This problem has drawn tremendous attention for its projection to prevailing real-world…

机器学习 · 计算机科学 2022-12-13 Zhen Tan , Song Wang , Kaize Ding , Jundong Li , Huan Liu

Training data for text classification is often limited in practice, especially for applications with many output classes or involving many related classification problems. This means classifiers must generalize from limited evidence, but…

计算与语言 · 计算机科学 2020-05-19 Abhijit Mahabal , Jason Baldridge , Burcu Karagol Ayan , Vincent Perot , Dan Roth