English
Related papers

Related papers: Induction Networks for Few-Shot Text Classificatio…

200 papers

We consider the few-shot classification task with an unbalanced dataset, in which some classes have sufficient training samples while other classes only have limited training samples. Recent works have proposed to solve this task by…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Vivek Roy , Yan Xu , Yu-Xiong Wang , Kris Kitani , Ruslan Salakhutdinov , Martial Hebert

There are classification tasks that take as inputs groups of images rather than single images. In order to address such situations, we introduce a nested multi-instance deep network. The approach is generic in that it is applicable to…

Machine Learning · Statistics 2018-08-31 Alexander Stec , Diego Klabjan , Jean Utke

Few-shot class-incremental learning is to recognize the new classes given few samples and not forget the old classes. It is a challenging task since representation optimization and prototype reorganization can only be achieved under little…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Kai Zhu , Yang Cao , Wei Zhai , Jie Cheng , Zheng-Jun Zha

Language models exhibit an emergent ability to learn a new task from a small number of input-output demonstrations. However, recent work shows that in-context learners largely rely on their pre-trained knowledge, such as the sentiment of…

Computation and Language · Computer Science 2023-07-20 Michal Štefánik , Marek Kadlčík

A family of recent successful approaches to few-shot learning relies on learning an embedding space in which predictions are made by computing similarities between examples. This corresponds to combining information between support and…

Machine Learning · Computer Science 2018-12-04 Hugo Prol , Vincent Dumoulin , Luis Herranz

We address the challenge of building task-agnostic classifiers using only text descriptions, demonstrating a unified approach to image classification, 3D point cloud classification, and action recognition from scenes. Unlike approaches that…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Ohad Amosy , Tomer Volk , Eilam Shapira , Eyal Ben-David , Roi Reichart , Gal Chechik

We propose a method for learning embeddings for few-shot learning that is suitable for use with any number of ways and any number of shots (shot-free). Rather than fixing the class prototypes to be the Euclidean average of sample…

Machine Learning · Computer Science 2020-04-23 Avinash Ravichandran , Rahul Bhotika , Stefano Soatto

Few-shot learning aims to generalize to novel classes with only a few samples with class labels. Research in few-shot learning has borrowed techniques from transfer learning, metric learning, meta-learning, and Bayesian methods. These…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Jaya Krishna Mandivarapu , Eric bunch , Glenn fung

Transductive inference is widely used in few-shot learning, as it leverages the statistics of the unlabeled query set of a few-shot task, typically yielding substantially better performances than its inductive counterpart. The current…

Machine Learning · Computer Science 2022-04-26 Olivier Veilleux , Malik Boudiaf , Pablo Piantanida , Ismail Ben Ayed

Dialogue intent classification aims to identify the underlying purpose or intent of a user's input in a conversation. Current intent classification systems encounter considerable challenges, primarily due to the vast number of possible…

Computation and Language · Computer Science 2024-12-23 Gyutae Park , Ingeol Baek , ByeongJeong Kim , Joongbo Shin , Hwanhee Lee

The use of a few examples for each class to train a predictive model that can be generalized to novel classes is a crucial and valuable research direction in artificial intelligence. This work addresses this problem by proposing a few-shot…

Machine Learning · Computer Science 2020-09-10 Bin Xiao , Chien-Liang Liu , Wen-Hoar Hsaio

Meta-learning for few-shot learning entails acquiring a prior over previous tasks and experiences, such that new tasks be learned from small amounts of data. However, a critical challenge in few-shot learning is task ambiguity: even when a…

Machine Learning · Computer Science 2019-10-18 Chelsea Finn , Kelvin Xu , Sergey Levine

Training deep neural networks from few examples is a highly challenging and key problem for many computer vision tasks. In this context, we are targeting knowledge transfer from a set with abundant data to other sets with few available…

Computer Vision and Pattern Recognition · Computer Science 2019-03-13 Yann Lifchitz , Yannis Avrithis , Sylvaine Picard , Andrei Bursuc

Prompting methods recently achieve impressive success in few-shot learning. These methods modify input samples with prompt sentence pieces, and decode label tokens to map samples to corresponding labels. However, such a paradigm is very…

Computation and Language · Computer Science 2022-04-05 Yutai Hou , Cheng Chen , Xianzhen Luo , Bohan Li , Wanxiang Che

Best-performing speech models are trained on large amounts of data in the language they are meant to work for. However, most languages have sparse data, making training models challenging. This shortage of data is even more prevalent in…

Computation and Language · Computer Science 2024-10-08 David-Gabriel Ion , Răzvan-Alexandru Smădu , Dumitru-Clementin Cercel , Florin Pop , Mihaela-Claudia Cercel

Although providing exceptional results for many computer vision tasks, state-of-the-art deep learning algorithms catastrophically struggle in low data scenarios. However, if data in additional modalities exist (e.g. text) this can…

Computer Vision and Pattern Recognition · Computer Science 2020-11-19 Frederik Pahde , Mihai Puscas , Tassilo Klein , Moin Nabi

Character-based neural models have recently proven very useful for many NLP tasks. However, there is a gap of sophistication between methods for learning representations of sentences and words. While most character models for learning…

Computation and Language · Computer Science 2018-10-31 Yingwei Xin , Ethan Hart , Vibhuti Mahajan , Jean-David Ruvini

We aim to bridge the gap between typical human and machine-learning environments by extending the standard framework of few-shot learning to an online, continual setting. In this setting, episodes do not have separate training and testing…

Machine Learning · Computer Science 2021-04-26 Mengye Ren , Michael L. Iuzzolino , Michael C. Mozer , Richard S. Zemel

Link prediction for knowledge graphs aims to predict missing connections between entities. Prevailing methods are limited to a transductive setting and hard to process unseen entities. The recent proposed subgraph-based models provided…

Machine Learning · Computer Science 2021-08-03 Shuangjia Zheng , Sijie Mai , Ya Sun , Haifeng Hu , Yuedong Yang

Meta-learning has received a tremendous recent attention as a possible approach for mimicking human intelligence, i.e., acquiring new knowledge and skills with little or even no demonstration. Most of the existing meta-learning methods are…

Machine Learning · Computer Science 2019-05-24 Fan Zhou , Chengtai Cao , Kunpeng Zhang , Goce Trajcevski , Ting Zhong , Ji Geng