English
Related papers

Related papers: Few-Shot Upsampling for Protest Size Detection

200 papers

Scene text recognition (STR) task has a common practice: All state-of-the-art STR models are trained on large synthetic data. In contrast to this practice, training STR models only on fewer real labels (STR with fewer labels) is important…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Jeonghun Baek , Yusuke Matsui , Kiyoharu Aizawa

Most previous methods for text data augmentation are limited to simple tasks and weak baselines. We explore data augmentation on hard tasks (i.e., few-shot natural language understanding) and strong baselines (i.e., pretrained models with…

Computation and Language · Computer Science 2022-03-16 Jing Zhou , Yanan Zheng , Jie Tang , Jian Li , Zhilin Yang

Few-shot relation extraction aims to recognize novel relations with few labeled sentences in each relation. Previous metric-based few-shot relation extraction algorithms identify relationships by comparing the prototypes generated by the…

Computation and Language · Computer Science 2023-05-12 Zhongju Yuan , Zhenkun Wang , Genghui Li

Acquiring ground truth labels for unlabelled data can be a costly procedure, since it often requires manual labour that is error-prone. Consequently, the available amount of labelled data is increasingly reduced due to the limitations of…

Machine Learning · Computer Science 2019-12-24 Athanasios Davvetas , Iraklis A. Klampanos

Few-shot learning amounts to learning representations and acquiring knowledge such that novel tasks may be solved with both supervision and data being limited. Improved performance is possible by transductive inference, where the entire…

Machine Learning · Computer Science 2023-03-29 Michalis Lazarou , Tania Stathaki , Yannis Avrithis

While a broad range of techniques have been proposed to tackle distribution shift, the simple baseline of training on an $\textit{undersampled}$ balanced dataset often achieves close to state-of-the-art-accuracy across several popular…

Machine Learning · Computer Science 2023-06-21 Niladri S. Chatterji , Saminul Haque , Tatsunori Hashimoto

The presence of noisy labels in a training dataset can significantly impact the performance of machine learning models. To tackle this issue, researchers have explored methods for Learning with Noisy Labels to identify clean samples and…

Machine Learning · Computer Science 2023-10-30 Sumyeong Ahn , Sihyeon Kim , Jongwoo Ko , Se-Young Yun

Despite being robust to small amounts of label noise, convolutional neural networks trained with stochastic gradient methods have been shown to easily fit random labels. When there are a mixture of correct and mislabelled targets, networks…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Eric Arazo , Diego Ortego , Paul Albert , Noel E. O'Connor , Kevin McGuinness

As new research on Large Language Models (LLMs) continues, it is difficult to keep up with new research and models. To help researchers synthesize the new research many have written survey papers, but even those have become numerous. In…

Computation and Language · Computer Science 2024-02-19 Jun Zhuang , Casey Kennington

Recent advances in few-shot question answering (QA) mostly rely on the power of pre-trained large language models (LLMs) and fine-tuning in specific settings. Although the pre-training stage has already equipped LLMs with powerful reasoning…

Computation and Language · Computer Science 2024-05-29 Xiusi Chen , Jyun-Yu Jiang , Wei-Cheng Chang , Cho-Jui Hsieh , Hsiang-Fu Yu , Wei Wang

Selecting an effective training signal for machine learning tasks is difficult: expert annotations are expensive, and crowd-sourced annotations may not be reliable. Recent work has demonstrated that learning from a distribution over labels…

Computation and Language · Computer Science 2025-04-23 Dustin Wright , Isabelle Augenstein

We describe a bootstrapping algorithm to learn from partially labeled data, and the results of an empirical study for using it to improve performance of sentiment classification using up to 15 million unlabeled Amazon product reviews. Our…

Machine Learning · Computer Science 2012-09-28 Yoav Haimovitch , Koby Crammer , Shie Mannor

While image-text foundation models have succeeded across diverse downstream tasks, they still face challenges in the presence of spurious correlations between the input and label. To address this issue, we propose a simple three-step…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Beier Zhu , Jiequan Cui , Hanwang Zhang , Chi Zhang

Large-scale pretrained language models have led to dramatic improvements in text generation. Impressive performance can be achieved by finetuning only on a small number of instances (few-shot setting). Nonetheless, almost all previous work…

Computation and Language · Computer Science 2021-07-08 Ernie Chang , Xiaoyu Shen , Hui-Syuan Yeh , Vera Demberg

We introduce a new and improved characterization of the label complexity of disagreement-based active learning, in which the leading quantity is the version space compression set size. This quantity is defined as the size of the smallest…

Machine Learning · Computer Science 2014-04-08 Yair Wiener , Steve Hanneke , Ran El-Yaniv

Enabling robots to learn novel visuomotor skills in a data-efficient manner remains an unsolved problem with myriad challenges. A popular paradigm for tackling this problem is through leveraging large unlabeled datasets that have many…

Robotics · Computer Science 2023-05-16 Maximilian Du , Suraj Nair , Dorsa Sadigh , Chelsea Finn

While Large Language Models (LLMs) exhibit remarkable capabilities in zero-shot and few-shot scenarios, they often require computationally prohibitive sizes. Conversely, smaller Masked Language Models (MLMs) like BERT and RoBERTa achieve…

Computation and Language · Computer Science 2024-10-18 Ahmed Elshabrawy , Yongxin Huang , Iryna Gurevych , Alham Fikri Aji

Few-shot semantic segmentation aims to learn to segment unseen class objects with the guidance of only a few support images. Most previous methods rely on the pixel-level label of support images. In this paper, we focus on a more…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Haohan Wang , Liang Liu , Wuhao Zhang , Jiangning Zhang , Zhenye Gan , Yabiao Wang , Chengjie Wang , Haoqian Wang

Music source separation (MSS) faces challenges due to the limited availability of correctly-labeled individual instrument tracks. With the push to acquire larger datasets to improve MSS performance, the inevitability of encountering…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-25 Junghyun Koo , Yunkee Chae , Chang-Bin Jeon , Kyogu Lee

Despite the availability of large datasets for tasks like image classification and image-text alignment, labeled data for more complex recognition tasks, such as detection and segmentation, is less abundant. In particular, for instance…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 François Porcher , Camille Couprie , Marc Szafraniec , Jakob Verbeek