中文
相关论文

相关论文: Evaluation Metrics for Text Data Augmentation in N…

200 篇论文

Large models, encompassing large language and diffusion models, have shown exceptional promise in approximating human-level intelligence, garnering significant interest from both academic and industrial spheres. However, the training of…

机器学习 · 计算机科学 2024-03-05 Yue Zhou , Chenlu Guo , Xu Wang , Yi Chang , Yuan Wu

This paper surveys evaluation techniques to enhance the trustworthiness and understanding of Large Language Models (LLMs). As reliance on LLMs grows, ensuring their reliability, fairness, and transparency is crucial. We explore algorithmic…

计算与语言 · 计算机科学 2024-06-05 Nik Bear Brown

Text data augmentation is an effective strategy for overcoming the challenge of limited sample sizes in many natural language processing (NLP) tasks. This challenge is especially prominent in the few-shot learning scenario, where the data…

Machine learning (ML) has significantly advanced text classification by enabling automated understanding and categorization of complex, unstructured textual data. However, accurately capturing nuanced linguistic patterns and contextual…

计算与语言 · 计算机科学 2025-06-30 Peiheng Gao , Chen Yang , Ning Sun , Ričardas Zitikis

In this paper, we investigate data augmentation for text generation, which we call GenAug. Text generation and language modeling are important tasks within natural language processing, and are especially challenging for low-data regimes. We…

计算与语言 · 计算机科学 2020-10-13 Steven Y. Feng , Varun Gangal , Dongyeop Kang , Teruko Mitamura , Eduard Hovy

This paper explores the use of text data augmentation techniques to enhance conflict and duplicate detection in software engineering tasks through sentence pair classification. The study adapts generic augmentation techniques such as…

软件工程 · 计算机科学 2023-05-17 Garima Malik , Mucahit Cevik , Ayşe Başar

Emotion recognition in text, the task of identifying emotions such as joy or anger, is a challenging problem in NLP with many applications. One of the challenges is the shortage of available datasets that have been annotated with emotions.…

计算与语言 · 计算机科学 2023-10-31 Anna Koufakou , Diego Grisales , Ragy Costa de jesus , Oscar Fox

In the rapidly evolving domain of Natural Language Generation (NLG) evaluation, introducing Large Language Models (LLMs) has opened new avenues for assessing generated content quality, e.g., coherence, creativity, and context relevance.…

计算与语言 · 计算机科学 2024-06-13 Zhen Li , Xiaohan Xu , Tao Shen , Can Xu , Jia-Chen Gu , Yuxuan Lai , Chongyang Tao , Shuai Ma

The paper surveys evaluation methods of natural language generation (NLG) systems that have been developed in the last few years. We group NLG evaluation methods into three categories: (1) human-centric evaluation metrics, (2) automatic…

计算与语言 · 计算机科学 2021-05-19 Asli Celikyilmaz , Elizabeth Clark , Jianfeng Gao

Progress on many Natural Language Processing (NLP) tasks, such as text classification, is driven by objective, reproducible and scalable evaluation via publicly available benchmarks. However, these are not always representative of…

计算与语言 · 计算机科学 2022-11-11 Viktor Schlegel , Erick Mendez-Guzman , Riza Batista-Navarro

Data augmentation is an effective way to improve the performance of many neural text generation models. However, current data augmentation methods need to define or choose proper data mapping functions that map the original samples into the…

计算与语言 · 计算机科学 2021-05-31 Wei Bi , Huayang Li , Jiacheng Huang

In this work we investigate the impact of applying textual data augmentation tasks to low resource machine translation. There has been recent interest in investigating approaches for training systems for languages with limited resources and…

计算与语言 · 计算机科学 2023-06-14 Catherine Gitau , VUkosi Marivate

Natural Language Processing (NLP) relies heavily on training data. Transformers, as they have gotten bigger, have required massive amounts of training data. To satisfy this requirement, text augmentation should be looked at as a way to…

计算与语言 · 计算机科学 2022-11-17 Matthew Ciolino , David Noever , Josh Kalin

Instruction tuning plays a critical role in aligning large language models (LLMs) with human preference. Despite the vast amount of open instruction datasets, naively training a LLM on all existing instructions may not be optimal and…

计算机视觉与模式识别 · 计算机科学 2024-12-31 Yulei Qin , Yuncheng Yang , Pengcheng Guo , Gang Li , Hang Shao , Yuchen Shi , Zihan Xu , Yun Gu , Ke Li , Xing Sun

Despite significant advancements in multi-label text classification, the ability of existing models to generalize to novel and seldom-encountered complex concepts, which are compositions of elementary ones, remains underexplored. This…

计算与语言 · 计算机科学 2023-12-21 Yuyang Chai , Zhuang Li , Jiahui Liu , Lei Chen , Fei Li , Donghong Ji , Chong Teng

Text style transfer (TST) is the task of transforming a text to reflect a particular style while preserving its original content. Evaluating TST outputs is a multidimensional challenge, requiring the assessment of style transfer accuracy,…

计算与语言 · 计算机科学 2025-04-24 Sourabrata Mukherjee , Atul Kr. Ojha , John P. McCrae , Ondrej Dusek

With the capabilities of understanding and executing natural language instructions, Large language models (LLMs) can potentially act as a powerful tool for textual data augmentation. However, the quality of augmented data depends heavily on…

计算与语言 · 计算机科学 2024-04-30 Yichuan Li , Kaize Ding , Jianling Wang , Kyumin Lee

Despite recent advancements in Machine Learning, many tasks still involve working in low-data regimes which can make solving natural language problems difficult. Recently, a number of text augmentation techniques have emerged in the field…

计算与语言 · 计算机科学 2023-02-27 Congcong Wang , Gonzalo Fiz Pontiveros , Steven Derby , Tri Kurniawan Wijaya

In recent years, language models (LMs) have made remarkable progress in advancing the field of natural language processing (NLP). However, the impact of data augmentation (DA) techniques on the fine-tuning (FT) performance of these LMs has…

计算与语言 · 计算机科学 2023-06-14 Zhengxiang Shi , Aldo Lipani

Data augmentation techniques have been used to alleviate the problem of scarce labeled data in various NER tasks (flat, nested, and discontinuous NER tasks). Existing augmentation techniques either manipulate the words in the original text…

计算与语言 · 计算机科学 2023-05-29 Xuming Hu , Yong Jiang , Aiwei Liu , Zhongqiang Huang , Pengjun Xie , Fei Huang , Lijie Wen , Philip S. Yu