English
Related papers

Related papers: LightNER: A Lightweight Tuning Paradigm for Low-re…

200 papers

The use of LLMs for natural language processing has become a popular trend in the past two years, driven by their formidable capacity for context comprehension and learning, which has inspired a wave of research from academics and industry…

Computation and Language · Computer Science 2024-04-09 Faren Yan , Peng Yu , Xin Chen

Speech emotion recognition (SER) models typically rely on costly human-labeled data for training, making scaling methods to large speech datasets and nuanced emotion taxonomies difficult. We present LanSER, a method that enables the use of…

Computation and Language · Computer Science 2023-09-11 Taesik Gong , Josh Belanich , Krishna Somandepalli , Arsha Nagrani , Brian Eoff , Brendan Jou

Generalizing to novel classes unseen during training is a key challenge of few-shot classification. Recent metric-based methods try to address this by local representations. However, they are unable to take full advantage of them due to (i)…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Shi Tang , Guiming Luo , Xinchen Ye , Zhiyi Xia

Pre-trained language models (PLMs) have exhibited remarkable few-shot learning capabilities when provided a few examples in a natural language prompt as demonstrations of test instances, i.e., in-context learning. However, the performance…

Computation and Language · Computer Science 2022-12-06 Feng Nie , Meixi Chen , Zhirui Zhang , Xu Cheng

Named entity recognition in real-world applications suffers from the diversity of entity types, the emergence of new entity types, and the lack of high-quality annotations. To address the above problems, this paper proposes an in-context…

Computation and Language · Computer Science 2023-05-29 Jiawei Chen , Yaojie Lu , Hongyu Lin , Jie Lou , Wei Jia , Dai Dai , Hua Wu , Boxi Cao , Xianpei Han , Le Sun

Named Entity Recognition (NER) in Few-Shot setting is imperative for entity tagging in low resource domains. Existing approaches only learn class-specific semantic features and intermediate representations from source domains. This affects…

Computation and Language · Computer Science 2022-03-29 Sarkar Snigdha Sarathi Das , Arzoo Katiyar , Rebecca J. Passonneau , Rui Zhang

Prompt tuning has emerged as an effective rehearsal-free technique for class-incremental learning (CIL) that learns a tiny set of task-specific parameters (or prompts) to instruct a pre-trained transformer to learn on a sequence of tasks.…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Thomas De Min , Massimiliano Mancini , Stéphane Lathuilière , Subhankar Roy , Elisa Ricci

Pre-trained language models (PLM) have achieved remarkable advancement in table-to-text generation tasks. However, the lack of labeled domain-specific knowledge and the topology gap between tabular data and text make it difficult for PLMs…

Computation and Language · Computer Science 2023-08-21 Zhixin Guo , Minyxuan Yan , Jiexing Qi , Jianping Zhou , Ziwei He , Zhouhan Lin , Guanjie Zheng , Xinbing Wang

Pretrained language models (PLMs) have shown remarkable few-shot learning capabilities when provided with properly formatted examples. However, selecting the "best" examples remains an open challenge. We propose a complexity-based prompt…

Computation and Language · Computer Science 2024-08-01 Rishabh Adiga , Lakshminarayanan Subramanian , Varun Chandrasekaran

We study the problem of learning a named entity recognition (NER) tagger using noisy labels from multiple weak supervision sources. Though cheap to obtain, the labels from weak supervision sources are often incomplete, inaccurate, and…

Computation and Language · Computer Science 2021-06-01 Yinghao Li , Pranav Shetty , Lucas Liu , Chao Zhang , Le Song

For many natural language processing (NLP) tasks the amount of annotated data is limited. This urges a need to apply semi-supervised learning techniques, such as transfer learning or meta-learning. In this work we tackle Named Entity…

Computation and Language · Computer Science 2018-12-18 Alexander Fritzler , Varvara Logacheva , Maksim Kretov

This paper studies weakly supervised domain adaptation(WSDA) problem, where we only have access to the source domain with noisy labels, from which we need to transfer useful information to the unlabeled target domain. Although there have…

Machine Learning · Computer Science 2022-01-26 Renchunzi Xie , Hongxin Wei , Lei Feng , Bo An

When combined with In-Context Learning, a technique that enables models to adapt to new tasks by incorporating task-specific examples or demonstrations directly within the input prompt, autoregressive language models have achieved good…

Computation and Language · Computer Science 2024-10-18 Enzo Shiraishi , Raphael Y. de Camargo , Henrique L. P. Silva , Ronaldo C. Prati

We present a simple few-shot named entity recognition (NER) system based on nearest neighbor learning and structured inference. Our system uses a supervised NER model trained on the source domain, as a feature extractor. Across several test…

Computation and Language · Computer Science 2020-10-07 Yi Yang , Arzoo Katiyar

Deep Learning shows very good performance when trained on large labeled data sets. The problem of training a deep net on a few or one sample per class requires a different learning approach which can generalize to unseen classes using only…

Machine Learning · Computer Science 2018-08-23 Jinchao Liu , Stuart J. Gibson , Margarita Osadchy

LLMs are typically trained in high-resource languages, and tasks in lower-resourced languages tend to underperform the higher-resource language counterparts for in-context learning. Despite the large body of work on prompting settings, it…

Computation and Language · Computer Science 2025-06-25 Christopher Toukmaji , Jeffrey Flanigan

A visually rich document (VRD) utilizes visual features along with linguistic cues to disseminate information. Training a custom extractor that identifies named entities from a document requires a large number of instances of the target…

Computation and Language · Computer Science 2024-04-02 Ritesh Sarkhel , Xiaoqi Ren , Lauro Beltrao Costa , Guolong Su , Vincent Perot , Yanan Xie , Emmanouil Koukoumidis , Arnab Nandi

Zero-resource named entity recognition (NER) severely suffers from data scarcity in a specific domain or language. Most studies on zero-resource NER transfer knowledge from various data by fine-tuning on different auxiliary tasks. However,…

Computation and Language · Computer Science 2021-07-23 Ying Zhang , Fandong Meng , Yufeng Chen , Jinan Xu , Jie Zhou

Model fine-tuning and adaptation have become a common approach for model specialization for downstream tasks or domains. Fine-tuning the entire model or a subset of the parameters using light-weight adaptation has shown considerable success…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-25 Fadi Biadsy , Youzheng Chen , Xia Zhang , Oleg Rybakov , Andrew Rosenberg , Pedro J. Moreno

We study the problem of building entity tagging systems by using a few rules as weak supervision. Previous methods mostly focus on disambiguation entity types based on contexts and expert-provided rules, while assuming entity spans are…

Computation and Language · Computer Science 2021-07-07 Jiacheng Li , Haibo Ding , Jingbo Shang , Julian McAuley , Zhe Feng