English
Related papers

Related papers: Few-Shot Optimization for Sensor Data Using Large …

200 papers

Large language models (LLMs) have been widely adopted due to their remarkable performance across various applications, driving the accelerated development of a large number of diverse models. However, these individual LLMs show limitations…

Computation and Language · Computer Science 2025-06-13 Kaushal Kumar Maurya , KV Aditya Srivatsa , Ekaterina Kochmar

The task of few-shot image classification and segmentation (FS-CS) requires the classification and segmentation of target objects in a query image, given only a few examples of the target classes. We introduce a method that utilises large…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Tian Meng , Yang Tao , Wuliang Yin

We introduce Transductive Infomation Maximization (TIM) for few-shot learning. Our method maximizes the mutual information between the query features and their label predictions for a given few-shot task, in conjunction with a supervision…

Machine Learning · Computer Science 2020-10-26 Malik Boudiaf , Ziko Imtiaz Masud , Jérôme Rony , José Dolz , Pablo Piantanida , Ismail Ben Ayed

Early Rumor Detection (EARD) aims to identify the earliest point at which a claim can be accurately classified based on a sequence of social media posts. This is especially challenging in data-scarce settings. While Large Language Models…

Computation and Language · Computer Science 2026-01-30 Fengzhu Zeng , Qian Shao , Ling Cheng , Wei Gao , Shih-Fen Cheng , Jing Ma , Cheng Niu

Large-scale vision-language models (VLMs), trained on extensive datasets of image-text pairs, exhibit strong multimodal understanding capabilities by implicitly learning associations between textual descriptions and image regions. This…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Mir Rayat Imtiaz Hossain , Mennatullah Siam , Leonid Sigal , James J. Little

Tabular data high-stakes critical decision-making in domains such as finance, healthcare, and scientific discovery. Yet, learning effectively from tabular data in few-shot settings, where labeled examples are scarce, remains a fundamental…

Machine Learning · Computer Science 2026-01-19 Zhihan Yang , Jiaqi Wei , Xiang Zhang , Haoyu Dong , Yiwen Wang , Xiaoke Guo , Pengkun Zhang , Yiwei Xu , Chenyu You

Remote Sensing Vision-Language Models (RSVLMs) have shown remarkable potential thanks to large-scale pretraining, achieving strong zero-shot performance on various tasks. However, their ability to generalize in low-data regimes, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Karim El Khoury , Maxime Zanella , Christophe De Vleeschouwer , Benoit Macq

Due to the limited availability of data, existing few-shot learning methods trained from scratch fail to achieve satisfactory performance. In contrast, large-scale pre-trained models such as CLIP demonstrate remarkable few-shot and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Kun Song , Huimin Ma , Bochao Zou , Huishuai Zhang , Weiran Huang

Transductive few-shot learning has triggered an abundant literature focusing on vision-only models, but is still at a nascent stage within the recent context of foundational vision-language models (VLMs). Only a few recent methods addressed…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Ghassen Baklouti , Maxime Zanella , Ismail Ben Ayed

Accurate prediction helps to achieve supply-demand balance in energy systems, supporting decision-making and scheduling. Traditional models, lacking AI-assisted automation, rely on experts, incur high costs, and struggle with sparse data…

Machine Learning · Computer Science 2024-12-25 Zihang Qiu , Chaojie Li , Zhongyang Wang , Renyou Xie , Borui Zhang , Huadong Mo , Guo Chen , Zhaoyang Dong

Electronic health records (EHRs) contain valuable patient data for health-related prediction tasks, such as disease prediction. Traditional approaches rely on supervised learning methods that require large labeled datasets, which can be…

Computation and Language · Computer Science 2024-03-26 Hejie Cui , Zhuocheng Shen , Jieyu Zhang , Hui Shao , Lianhui Qin , Joyce C. Ho , Carl Yang

The emergence of Small Language Models (SLMs) as privacy-preserving alternatives for sensitive applications raises a fundamental question about their inherent understanding capabilities compared to Large Language Models (LLMs). This paper…

Computation and Language · Computer Science 2025-07-15 Hong Jia , Shiya Fu , Feng Xia , Vassilis Kostakos , Ting Dang

Understanding user queries is fundamental in many applications, such as home assistants, booking systems, or recommendations. Accordingly, it is crucial to develop accurate Spoken Language Understanding (SLU) approaches to ensure the…

Computation and Language · Computer Science 2025-06-04 Pierre Lepagnol , Sahar Ghannay , Thomas Gerald , Christophe Servan , Sophie Rosset

Large pre-trained language models (LMs) have demonstrated remarkable ability as few-shot learners. However, their success hinges largely on scaling model parameters to a degree that makes it challenging to train and serve. In this paper, we…

Computation and Language · Computer Science 2021-05-03 Sinong Wang , Han Fang , Madian Khabsa , Hanzi Mao , Hao Ma

Vision-Language Models (VLMs) have demonstrated impressive capabilities in zero-shot action recognition by learning to associate video embeddings with class embeddings. However, a significant challenge arises when relying solely on action…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Yehna Kim , Young-Eun Kim , Seong-Whan Lee

Prior work on language models (LMs) shows that training on a large number of diverse tasks improves few-shot learning (FSL) performance on new tasks. We take this to the extreme, automatically extracting 413,299 tasks from internet tables -…

Computation and Language · Computer Science 2022-08-09 Jun Shern Chan , Michael Pieler , Jonathan Jao , Jérémy Scheurer , Ethan Perez

Few-shot learning has attracted intensive research attention in recent years. Many methods have been proposed to generalize a model learned from provided base classes to novel classes, but no previous work studies how to select base…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Linjun Zhou , Peng Cui , Xu Jia , Shiqiang Yang , Qi Tian

Few-shot prompting elicits the remarkable abilities of large language models by equipping them with a few demonstration examples in the input. However, the traditional method of providing large language models with all demonstration…

Computation and Language · Computer Science 2023-12-27 Yu Ji , Wen Wu , Yi Hu , Hong Zheng , Liang He

In the context of few-shot classification, the goal is to train a classifier using a limited number of samples while maintaining satisfactory performance. However, traditional metric-based methods exhibit certain limitations in achieving…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Fatemeh Askari , Amirreza Fateh , Mohammad Reza Mohammadi

Large language models (LLMs) can capture rich representations of concepts that are useful for real-world tasks. However, language alone is limited. While existing LLMs excel at text-based inferences, health applications require that models…

Computation and Language · Computer Science 2023-05-26 Xin Liu , Daniel McDuff , Geza Kovacs , Isaac Galatzer-Levy , Jacob Sunshine , Jiening Zhan , Ming-Zher Poh , Shun Liao , Paolo Di Achille , Shwetak Patel