中文
相关论文

相关论文: When Does Data Augmentation Help? Evaluating LLM a…

200 篇论文

Creating effective and reliable task-oriented dialog systems (ToDSs) is challenging, not only because of the complex structure of these systems, but also due to the scarcity of training data, especially when several modules need to be…

计算与语言 · 计算机科学 2024-06-11 Christos Vlachos , Themos Stafylakis , Ion Androutsopoulos

Although LLMs have attained significant success in high-resource languages, their capacity in low-resource linguistic environments like Kannada and Arabic is not yet fully understood. This work benchmarking the performance of multilingual…

计算与语言 · 计算机科学 2025-07-29 Maitha Alshehhi , Ahmed Sharshar , Mohsen Guizani

Generative Large Language Models (LLMs) have achieved remarkable advancements in various NLP tasks. However, these advances have not been reflected in the translation task, especially those with moderate model sizes (i.e., 7B or 13B…

计算与语言 · 计算机科学 2024-02-07 Haoran Xu , Young Jin Kim , Amr Sharaf , Hany Hassan Awadalla

As an effective strategy, data augmentation (DA) alleviates data scarcity scenarios where deep learning techniques may fail. It is widely applied in computer vision then introduced to natural language processing and achieves improvements in…

计算与语言 · 计算机科学 2022-06-28 Bohan Li , Yutai Hou , Wanxiang Che

Data augmentation is an important component in the robustness evaluation of models in natural language processing (NLP) and in enhancing the diversity of the data they are trained on. In this paper, we present NL-Augmenter, a new…

计算与语言 · 计算机科学 2022-10-14 Kaustubh D. Dhole , Varun Gangal , Sebastian Gehrmann , Aadesh Gupta , Zhenhao Li , Saad Mahamood , Abinaya Mahendiran , Simon Mille , Ashish Shrivastava , Samson Tan , Tongshuang Wu , Jascha Sohl-Dickstein , Jinho D. Choi , Eduard Hovy , Ondrej Dusek , Sebastian Ruder , Sajant Anand , Nagender Aneja , Rabin Banjade , Lisa Barthe , Hanna Behnke , Ian Berlot-Attwell , Connor Boyle , Caroline Brun , Marco Antonio Sobrevilla Cabezudo , Samuel Cahyawijaya , Emile Chapuis , Wanxiang Che , Mukund Choudhary , Christian Clauss , Pierre Colombo , Filip Cornell , Gautier Dagan , Mayukh Das , Tanay Dixit , Thomas Dopierre , Paul-Alexis Dray , Suchitra Dubey , Tatiana Ekeinhor , Marco Di Giovanni , Tanya Goyal , Rishabh Gupta , Rishabh Gupta , Louanes Hamla , Sang Han , Fabrice Harel-Canada , Antoine Honore , Ishan Jindal , Przemyslaw K. Joniak , Denis Kleyko , Venelin Kovatchev , Kalpesh Krishna , Ashutosh Kumar , Stefan Langer , Seungjae Ryan Lee , Corey James Levinson , Hualou Liang , Kaizhao Liang , Zhexiong Liu , Andrey Lukyanenko , Vukosi Marivate , Gerard de Melo , Simon Meoni , Maxime Meyer , Afnan Mir , Nafise Sadat Moosavi , Niklas Muennighoff , Timothy Sum Hon Mun , Kenton Murray , Marcin Namysl , Maria Obedkova , Priti Oli , Nivranshu Pasricha , Jan Pfister , Richard Plant , Vinay Prabhu , Vasile Pais , Libo Qin , Shahab Raji , Pawan Kumar Rajpoot , Vikas Raunak , Roy Rinberg , Nicolas Roberts , Juan Diego Rodriguez , Claude Roux , Vasconcellos P. H. S. , Ananya B. Sai , Robin M. Schmidt , Thomas Scialom , Tshephisho Sefara , Saqib N. Shamsi , Xudong Shen , Haoyue Shi , Yiwen Shi , Anna Shvets , Nick Siegel , Damien Sileo , Jamie Simon , Chandan Singh , Roman Sitelew , Priyank Soni , Taylor Sorensen , William Soto , Aman Srivastava , KV Aditya Srivatsa , Tony Sun , Mukund Varma T , A Tabassum , Fiona Anting Tan , Ryan Teehan , Mo Tiwari , Marie Tolkiehn , Athena Wang , Zijian Wang , Gloria Wang , Zijie J. Wang , Fuxuan Wei , Bryan Wilie , Genta Indra Winata , Xinyi Wu , Witold Wydmański , Tianbao Xie , Usama Yaseen , Michael A. Yee , Jing Zhang , Yue Zhang

Recent strategies for low-resource machine translation rely on LLMs to generate synthetic data from higher-resource languages. We find that this method fails for Romansh, because LLMs tend to confuse its 6 distinct language varieties. Our…

计算与语言 · 计算机科学 2026-03-27 Jannis Vamvas , Ignacio Pérez Prat , Angela Heldstab , Dominic P. Fischer , Sina Ahmadi , Rico Sennrich

Hausa texts are often characterized by writing anomalies, such as incorrect character substitutions and spacing errors, which sometimes hinder natural language processing (NLP) applications. This paper presents an approach to automatically…

计算与语言 · 计算机科学 2026-05-05 Ahmad Mustapha Wali , Sergiu Nisioi

A multitude of industries depend on accurate and reasonable tabular data augmentation for their business processes. Contemporary methodologies in generating tabular data revolve around utilizing Generative Adversarial Networks (GAN) or…

机器学习 · 计算机科学 2025-02-25 Shuo Yang , Chenchen Yuan , Yao Rong , Felix Steinbauer , Gjergji Kasneci

Named Entity Recognition (NER) is a machine learning task that traditionally relies on supervised learning and annotated data. Acquiring such data is often a challenge, particularly in specialized fields like medical, legal, and financial…

Large language models (LLMs) exhibit substantial performance disparities across languages, particularly between high- and low-resource settings. We propose a framework for improving performance in underrepresented languages while preserving…

计算与语言 · 计算机科学 2026-02-05 Daniil Gurgurov , Tanja Baeumel , Josef van Genabith , Simon Ostermann

Language Models (LMs) memorize a vast amount of factual knowledge, exhibiting strong performance across diverse tasks and domains. However, it has been observed that the performance diminishes when dealing with less-popular or low-frequency…

计算与语言 · 计算机科学 2024-12-03 Heydar Soudani , Evangelos Kanoulas , Faegheh Hasibi

Large Language Models (LLMs) like GPT-4o can help automate text classification tasks at low cost and scale. However, there are major concerns about the validity and reliability of LLM outputs. By contrast, human coding is generally more…

计算与语言 · 计算机科学 2025-01-17 Conrad Borchers , Danielle R. Thomas , Jionghao Lin , Ralph Abboud , Kenneth R. Koedinger

Data augmentation has been widely used in low-resource NER tasks to tackle the problem of data sparsity. However, previous data augmentation methods have the disadvantages of disrupted syntactic structures, token-label mismatch, and…

计算与语言 · 计算机科学 2023-07-18 Sihan Song , Furao Shen , Jian Zhao

In the past five years, research has shifted from traditional Machine Learning (ML) and Deep Learning (DL) approaches to leveraging Large Language Models (LLMs) , including multimodality, for data augmentation to enhance generalization, and…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Ranjan Sapkota , Shaina Raza , Maged Shoman , Achyut Paudel , Manoj Karkee

\textbf{Objective:} We aimed to develop an advanced multi-task large language model (LLM) framework to extract multiple types of information about dietary supplements (DS) from clinical records. \textbf{Methods:} We used four core DS…

计算与语言 · 计算机科学 2025-03-04 Zaifu Zhan , Shuang Zhou , Mingchen Li , Rui Zhang

Synthetic data augmentation via large language models (LLMs) allows researchers to leverage additional training data, thus enhancing the performance of downstream tasks, especially when real-world data is scarce. However, the generated data…

机器学习 · 计算机科学 2025-03-25 Hsun-Yu Kuo , Yin-Hsiang Liao , Yu-Chieh Chao , Wei-Yun Ma , Pu-Jen Cheng

A continued issue for those working with computational tools and endangered and under-resourced languages is the lower accuracy of results for languages with smaller amounts of data. We attempt to ameliorate this issue by using data…

计算与语言 · 计算机科学 2025-04-10 Alessio Tosolini , Claire Bowern

With the ascent of large language models (LLM), natural language processing has witnessed enhancements, such as LLM-based data augmentation. Nonetheless, prior research harbors two primary concerns: firstly, a lack of contemplation…

计算与语言 · 计算机科学 2024-07-02 Zhenhua Wang , Guang Xu , Ming Ren

In Biomedical Natural Language Processing (BioNLP) tasks, such as Relation Extraction, Named Entity Recognition, and Text Classification, the scarcity of high-quality data remains a significant challenge. This limitation poisons large…

计算与语言 · 计算机科学 2025-04-01 Zhengyi Zhao , Shubo Zhang , Bin Liang , Binyang Li , Kam-Fai Wong