English
Related papers

Related papers: Exploiting the Potential of Seq2Seq Models as Robu…

200 papers

Large-scale multimodal representation learning successfully optimizes for zero-shot transfer at test time. Yet the standard pretraining paradigm (contrastive learning on large amounts of image-text data) does not explicitly encourage…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Karsten Roth , Zeynep Akata , Dima Damen , Ivana Balažević , Olivier J. Hénaff

Few-shot classification which aims to recognize unseen classes using very limited samples has attracted more and more attention. Usually, it is formulated as a metric learning problem. The core issue of few-shot classification is how to…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Xixi Wang , Xiao Wang , Bo Jiang , Bin Luo

Few-shot semantic segmentation aims to segment novel-class objects in a given query image with only a few labeled support images. Most advanced solutions exploit a metric learning framework that performs segmentation through matching each…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Jiacheng Chen , Bin-Bin Gao , Zongqing Lu , Jing-Hao Xue , Chengjie Wang , Qingmin Liao

The prompt has become an effective linguistic tool for utilizing pre-trained language models. However, in few-shot scenarios, subtle changes in the prompt design always make the result widely different, and the prompt learning methods also…

Computation and Language · Computer Science 2024-03-13 Jinta Weng , Yifan Deng , d Donghao Li , Hao You , Yue Hu , Heyan Huang

Deep learning-based methods in computational microscopy have been shown to be powerful but in general face some challenges due to limited generalization to new types of samples and requirements for large and diverse training data. Here, we…

Image and Video Processing · Electrical Eng. & Systems 2022-06-13 Luzhe Huang , Xilin Yang , Tairan Liu , Aydogan Ozcan

Few-shot recognition involves training an image classifier to distinguish novel concepts at test time using few examples (shot). Existing approaches generally assume that the shot number at test time is known in advance. This is not…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Davis Wertheimer , Luming Tang , Bharath Hariharan

Few-shot learning is devoted to training a model on few samples. Most of these approaches learn a model based on a pixel-level or global-level feature representation. However, using global features may lose local information, and using…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Haoxing Chen , Huaxiong Li , Yaohui Li , Chunlin Chen

To perform few-shot learning, language models extract signals from a few input-label pairs, aggregate these into a learned prediction rule, and apply this rule to new inputs. How is this implemented in the forward pass of modern transformer…

Machine Learning · Computer Science 2025-10-10 Xinyan Hu , Kayo Yin , Michael I. Jordan , Jacob Steinhardt , Lijie Chen

In recent literature, few-shot classification has predominantly been defined by the N-way k-shot meta-learning problem. Models designed for this purpose are usually trained to excel on standard benchmarks following a restricted setup,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Constance Ferragu , Philomene Chagniot , Vincent Coyette

Through a simple multiple choice language prompt a VQA model can operate as a zero-shot image classifier, producing a classification label. Compared to typical image encoders, VQA models offer an advantage: VQA-produced image embeddings can…

Machine Learning · Computer Science 2024-07-24 Dipika Khullar , Emmett Goodman , Negin Sokhandan

In this paper we explore few-shot imitation learning for control problems, which involves learning to imitate a target policy by accessing a limited set of offline rollouts. This setting has been relatively under-explored despite its…

Machine Learning · Computer Science 2023-06-26 Massimiliano Patacchiola , Mingfei Sun , Katja Hofmann , Richard E. Turner

Few-Shot Learning is the challenge of training a model with only a small amount of data. Many solutions to this problem use meta-learning algorithms, i.e. algorithms that learn to learn. By sampling few-shot tasks from a larger dataset, we…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Etienne Bennequin

Few-shot object detection has been extensively investigated by incorporating meta-learning into region-based detection frameworks. Despite its success, the said paradigm is constrained by several factors, such as (i) low-quality region…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Gongjie Zhang , Zhipeng Luo , Kaiwen Cui , Shijian Lu

Few-shot and one-shot learning have been the subject of active and intensive research in recent years, with mounting evidence pointing to successful implementation and exploitation of few-shot learning algorithms in practice. Classical…

Machine Learning · Computer Science 2023-12-07 Ivan Y. Tyukin , Alexander N. Gorban , Muhammad H. Alkhudaydi , Qinghua Zhou

Sign language recognition from sequences of monocular images or 2D poses is a challenging field, not only due to the difficulty to infer 3D information from 2D data, but also due to the temporal relationship between the sequences of…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Silvan Ferreira , Esdras Costa , Márcio Dahia , Jampierre Rocha

Few-shot Continual Relation Extraction is a crucial challenge for enabling AI systems to identify and adapt to evolving relationships in dynamic real-world domains. Traditional memory-based approaches often overfit to limited samples,…

Computation and Language · Computer Science 2025-03-03 Nguyen Xuan Thanh , Anh Duc Le , Quyen Tran , Thanh-Thien Le , Linh Ngo Van , Thien Huu Nguyen

Multimodal few-shot learning is challenging due to the large domain gap between vision and language modalities. Existing methods are trying to communicate visual concepts as prompts to frozen language models, but rely on hand-engineered…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Ivona Najdenkoska , Xiantong Zhen , Marcel Worring

Encoder-decoder recurrent neural network models (RNN Seq2Seq) have achieved great success in ubiquitous areas of computation and applications. It was shown to be successful in modeling data with both temporal and spatial dependencies for…

Machine Learning · Computer Science 2020-02-03 Kun Su , Eli Shlizerman

Current state-of-the-art machine translation systems are based on encoder-decoder architectures, that first encode the input sequence, and then generate an output sequence based on the input encoding. Both are interfaced with an attention…

Computation and Language · Computer Science 2018-11-02 Maha Elbayad , Laurent Besacier , Jakob Verbeek

Current few-shot learning models capture visual object relations in the so-called meta-learning setting under a fixed-resolution input. However, such models have a limited generalization ability under the scale and location mismatch between…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Hongguang Zhang , Philip H. S. Torr , Piotr Koniusz