English
Related papers

Related papers: Universal Natural Language Processing with Limited…

200 papers

Continual learning strives to ensure stability in solving previously seen tasks while demonstrating plasticity in a novel domain. Recent advances in continual learning are mostly confined to a supervised learning setting, especially in NLP…

Machine Learning · Computer Science 2024-06-03 Stella Ho , Ming Liu , Shang Gao , Longxiang Gao

Recent work has shown that NLP tasks such as Relation Extraction (RE) can be recasted as Textual Entailment tasks using verbalizations, with strong performance in zero-shot and few-shot settings thanks to pre-trained entailment models. The…

Computation and Language · Computer Science 2022-05-04 Oscar Sainz , Itziar Gonzalez-Dios , Oier Lopez de Lacalle , Bonan Min , Eneko Agirre

Meta-learning has become a practical approach towards few-shot image classification, where "a strategy to learn a classifier" is meta-learned on labeled base classes and can be applied to tasks with novel classes. We remove the requirement…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Han-Jia Ye , Lu Han , De-Chuan Zhan

While the NLP community has produced numerous summarization benchmarks, none provide the rich annotations required to simultaneously address many important problems related to control and reliability. We introduce a Wikipedia-derived…

Computation and Language · Computer Science 2023-12-05 Kundan Krishna , Prakhar Gupta , Sanjana Ramprasad , Byron C. Wallace , Jeffrey P. Bigham , Zachary C. Lipton

Generalist models have achieved remarkable success in both language and vision-language tasks, showcasing the potential of unified modeling. However, effectively integrating fine-grained perception tasks like detection and segmentation into…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Hao Tang , Chenwei Xie , Haiyang Wang , Xiaoyi Bao , Tingyu Weng , Pandeng Li , Yun Zheng , Liwei Wang

Text classification is usually studied by labeling natural language texts with relevant categories from a predefined set. In the real world, new classes might keep challenging the existing system with limited labeled data. The system should…

Computation and Language · Computer Science 2021-04-27 Congying Xia , Wenpeng Yin , Yihao Feng , Philip Yu

Pre-trained vision-language models learn massive data to model unified representations of images and natural languages, which can be widely applied to downstream machine learning tasks. In addition to zero-shot inference, in order to better…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Qian-Wei Wang , Yuqiu Xie , Letian Zhang , Zimo Liu , Shu-Tao Xia

We consider the task of few-shot intent detection, which involves training a deep learning model to classify utterances based on their underlying intents using only a small amount of labeled data. The current approach to address this…

Computation and Language · Computer Science 2024-09-17 Haode Zhang , Haowen Liang , Liming Zhan , Albert Y. S. Lam , Xiao-Ming Wu

Few-shot learning aims to learn a new concept when only a few training examples are available, which has been extensively explored in recent years. However, most of the current works heavily rely on a large-scale labeled auxiliary set to…

Computer Vision and Pattern Recognition · Computer Science 2020-09-18 Tiexin Qin , Wenbin Li , Yinghuan Shi , Yang Gao

Learning from limited exemplars (few-shot learning) is a fundamental, unsolved problem that has been laboriously explored in the machine learning community. However, current few-shot learners are mostly supervised and rely heavily on a…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Zilong Ji , Xiaolong Zou , Tiejun Huang , Si Wu

Deep neural network models have recently achieved state-of-the-art performance gains in a variety of natural language processing (NLP) tasks (Young, Hazarika, Poria, & Cambria, 2017). However, these gains rely on the availability of large…

Computation and Language · Computer Science 2018-11-15 Maximilian Hofer , Andrey Kormilitzin , Paul Goldberg , Alejo Nevado-Holgado

Intent Detection is one of the core tasks of dialog systems. Few-shot Intent Detection is challenging due to limited number of annotated utterances for novel classes. Generalized Few-shot intent detection is more realistic but challenging…

Computation and Language · Computer Science 2023-12-27 Ayush Kumar , Vijit Malik , Jithendra Vepa

Recent foundational language models have shown state-of-the-art performance in many NLP tasks in zero- and few-shot settings. An advantage of these models over more standard approaches based on fine-tuning is the ability to understand…

Computation and Language · Computer Science 2024-04-16 Aleksandra Edwards , Jose Camacho-Collados

Proprietary and closed APIs are becoming increasingly common to process natural language, and are impacting the practical applications of natural language processing, including few-shot classification. Few-shot classification involves…

Computation and Language · Computer Science 2023-10-24 Pierre Colombo , Victor Pellegrain , Malik Boudiaf , Victor Storchan , Myriam Tami , Ismail Ben Ayed , Celine Hudelot , Pablo Piantanida

Objective: Few-shot learning (FSL) methods require small numbers of labeled instances for training. As many medical topics have limited annotated textual data in practical settings, FSL-based natural language processing (NLP) methods hold…

Computation and Language · Computer Science 2022-05-02 Yao Ge , Yuting Guo , Yuan-Chi Yang , Mohammed Ali Al-Garadi , Abeed Sarker

Building models that can be rapidly adapted to novel tasks using only a handful of annotated examples is an open challenge for multimodal machine learning research. We introduce Flamingo, a family of Visual Language Models (VLM) with this…

Recent studies leverage large language models with multi-tasking capabilities, using natural language prompts to guide the model's behavior and surpassing performance of task-specific models. Motivated by this, we ask: can we build a single…

Computation and Language · Computer Science 2024-04-04 Siddhant Arora , Hayato Futami , Jee-weon Jung , Yifan Peng , Roshan Sharma , Yosuke Kashiwagi , Emiru Tsunoo , Karen Livescu , Shinji Watanabe

While pre-trained language models have obtained state-of-the-art performance for several natural language understanding tasks, they are quite opaque in terms of their decision-making process. While some recent works focus on rationalizing…

Computation and Language · Computer Science 2021-09-20 Meghana Moorthy Bhat , Alessandro Sordoni , Subhabrata Mukherjee

Few-shot learning (FSL) via customization of a deep learning network with limited data has emerged as a promising technique to achieve personalized user experiences on edge devices. However, existing FSL methods primarily assume independent…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Xinyun Zhang , Lanqing Hong

In this paper, we look at the problem of few-shot classification that aims to learn a classifier for previously unseen classes and domains from few labeled samples. Recent methods use adaptation networks for aligning their features to new…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Wei-Hong Li , Xialei Liu , Hakan Bilen