English
Related papers

Related papers: Embedding Hallucination for Few-Shot Language Fine…

200 papers

Few-Shot Learning (FSL) aims to improve a model's generalization capability in low data regimes. Recent FSL works have made steady progress via metric learning, meta learning, representation learning, etc. However, FSL remains challenging…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Meng Ye , Xiao Lin , Giedrius Burachas , Ajay Divakaran , Yi Yao

Recent work proposes a family of contextual embeddings that significantly improves the accuracy of sequence labelers over non-contextual embeddings. However, there is no definite conclusion on whether we can build better sequence labelers…

Computation and Language · Computer Science 2021-06-03 Xinyu Wang , Yong Jiang , Nguyen Bach , Tao Wang , Zhongqiang Huang , Fei Huang , Kewei Tu

Annotated images and ground truth for the diagnosis of rare and novel diseases are scarce. This is expected to prevail, considering the small number of affected patient population and limited clinical expertise to annotate images. Further,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Karthik Desingu , Mirunalini P. , Aravindan Chandrabose

This work focuses on building a task planner for Embodied Instruction Following (EIF) using Large Language Models (LLMs). Previous works typically train a planner to imitate expert trajectories, treating this as a supervised task. While…

Artificial Intelligence · Computer Science 2024-12-30 Yuxiao Yang , Shenao Zhang , Zhihan Liu , Huaxiu Yao , Zhaoran Wang

Graph few-shot learning, which aims to classify nodes from novel classes with only a few labeled examples, is a widely studied problem in graph learning. However, existing methods often face two key limitations. First, the predominant graph…

Artificial Intelligence · Computer Science 2026-05-26 Renchu Guan , Yajun Wang , Chunli Guo , Bowen Cao , Fausto Giunchiglia , Wei Pang , Yonghao Liu , Xiaoyue Feng

Large Language Models (LLMs) often generate hallucinations, producing outputs that are contextually inaccurate or factually incorrect. We introduce HICD, a novel method designed to induce hallucinations for contrastive decoding to mitigate…

Computation and Language · Computer Science 2025-05-26 Xinyan Jiang , Hang Ye , Yongxin Zhu , Xiaoying Zheng , Zikang Chen , Jun Gong

Few-shot learning amounts to learning representations and acquiring knowledge such that novel tasks may be solved with both supervision and data being limited. Improved performance is possible by transductive inference, where the entire…

Machine Learning · Computer Science 2023-03-29 Michalis Lazarou , Tania Stathaki , Yannis Avrithis

Vision-language models (VLMs) such as CLIP are trained via contrastive learning between text and image pairs, resulting in aligned image and text embeddings that are useful for many downstream tasks. A notable drawback of CLIP, however, is…

Machine Learning · Computer Science 2025-07-08 Dylan Sam , Devin Willmott , Joao D. Semedo , J. Zico Kolter

Few-shot learning has been studied to adapt models to tasks with very few samples. It holds profound significance, particularly in clinical tasks, due to the high annotation cost of medical images. Several works have explored few-shot…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Kaipeng Zheng , Weiran Huang , Lichao Sun

Few-shot learning (FSL) is the task of learning to recognize previously unseen categories of images from a small number of training examples. This is a challenging task, as the available examples may not be enough to unambiguously determine…

Computer Vision and Pattern Recognition · Computer Science 2021-05-24 Kun Yan , Zied Bouraoui , Ping Wang , Shoaib Jameel , Steven Schockaert

With hundreds of thousands of language models available on Huggingface today, efficiently evaluating and utilizing these models across various downstream, tasks has become increasingly critical. Many existing methods repeatedly learn…

Computation and Language · Computer Science 2024-10-18 Richard Zhuang , Tianhao Wu , Zhaojin Wen , Andrew Li , Jiantao Jiao , Kannan Ramchandran

In the context of few-shot classification, the goal is to train a classifier using a limited number of samples while maintaining satisfactory performance. However, traditional metric-based methods exhibit certain limitations in achieving…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Fatemeh Askari , Amirreza Fateh , Mohammad Reza Mohammadi

We present MedHal, a novel large-scale dataset specifically designed to evaluate if models can detect hallucinations in medical texts. Current hallucination detection methods face significant limitations when applied to specialized domains…

Computation and Language · Computer Science 2025-10-08 Gaya Mehenni , Fabrice Lamarche , Odette Rios-Ibacache , John Kildea , Amal Zouaq

Hate speech detection is a challenging natural language processing task that requires capturing linguistic and contextual nuances. Pre-trained language models (PLMs) offer rich semantic representations of text that can improve this task.…

Computation and Language · Computer Science 2023-10-10 Mohammad Aflah Khan , Neemesh Yadav , Mohit Jain , Sanyam Goyal

Autoencoders are commonly trained using element-wise loss. However, element-wise loss disregards high-level structures in the image which can lead to embeddings that disregard them as well. A recent improvement to autoencoders that helps…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Gustav Grund Pihlgren , Fredrik Sandin , Marcus Liwicki

The objective of this paper is few-shot object detection (FSOD) -- the task of expanding an object detector for a new category given only a few instances for training. We introduce a simple pseudo-labelling method to source high-quality…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Prannay Kaul , Weidi Xie , Andrew Zisserman

Few-shot classification addresses the challenge of classifying examples given only limited labeled data. A powerful approach is to go beyond data augmentation, towards data synthesis. However, most of data augmentation/synthesis methods for…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Michalis Lazarou , Yannis Avrithis , Tania Stathaki

In this paper, we extend previous self-supervised approaches for language identification by experimenting with Conformer based architecture in a multilingual pre-training paradigm. We find that pre-trained speech models optimally encode…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Travis M. Bartley , Fei Jia , Krishna C. Puvvada , Samuel Kriman , Boris Ginsburg

We develop a transductive meta-learning method that uses unlabelled instances to improve few-shot image classification performance. Our approach combines a regularized Mahalanobis-distance-based soft k-means clustering procedure with a…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Peyman Bateni , Jarred Barber , Jan-Willem van de Meent , Frank Wood

Few-shot learning (FSL) has attracted increasing attention in recent years but remains challenging, due to the intrinsic difficulty in learning to generalize from a few examples. This paper proposes an adaptive margin principle to improve…

Computer Vision and Pattern Recognition · Computer Science 2020-05-29 Aoxue Li , Weiran Huang , Xu Lan , Jiashi Feng , Zhenguo Li , Liwei Wang