English
Related papers

Related papers: Fast Cross-domain Data Augmentation through Neural…

200 papers

Transfer learning techniques are particularly useful in NLP tasks where a sizable amount of high-quality annotated data is difficult to obtain. Current approaches directly adapt a pre-trained language model (LM) on in-domain text before…

Despite pre-trained language models such as BERT have achieved appealing performance in a wide range of natural language processing tasks, they are computationally expensive to be deployed in real-time applications. A typical method is to…

Computation and Language · Computer Science 2021-06-22 Lingyun Feng , Minghui Qiu , Yaliang Li , Hai-Tao Zheng , Ying Shen

Neural machine translation (NMT) has recently gained widespread attention because of its high translation accuracy. However, it shows poor performance in the translation of long sentences, which is a major issue in low-resource languages.…

Computation and Language · Computer Science 2021-04-20 Seiichiro Kondo , Kengo Hotate , Masahiro Kaneko , Mamoru Komachi

In this work, we take the named entity recognition task in the English language as a case study and explore style transfer as a data augmentation method to increase the size and diversity of training data in low-resource scenarios. We…

Computation and Language · Computer Science 2022-10-17 Shuguang Chen , Leonardo Neves , Thamar Solorio

Simple yet effective data augmentation techniques have been proposed for sentence-level and sentence-pair natural language processing tasks. Inspired by these efforts, we design and compare data augmentation for named entity recognition,…

Computation and Language · Computer Science 2020-10-23 Xiang Dai , Heike Adel

Sentence embedding tasks are important in natural language processing (NLP), but improving their performance while keeping them reliable is still hard. This paper presents a framework that combines pseudo-label generation and model ensemble…

Computation and Language · Computer Science 2025-01-28 Ziwei Liu , Qi Zhang , Lifu Gao

Data augmentation methods for neural machine translation are particularly useful when limited amount of training data is available, which is often the case when dealing with low-resource languages. We introduce a novel augmentation method,…

Computation and Language · Computer Science 2023-11-07 Attila Nagy , Dorina Lakatos , Botond Barta , Judit Ács

The construction of open-domain dialogue systems requires high-quality dialogue datasets. The dialogue data admits a wide variety of responses for a given dialogue history, especially responses with different semantics. However, collecting…

Computation and Language · Computer Science 2022-11-01 Jiao Ou , Jinchao Zhang , Yang Feng , Jie Zhou

Data augmentation is an important component in the robustness evaluation of models in natural language processing (NLP) and in enhancing the diversity of the data they are trained on. In this paper, we present NL-Augmenter, a new…

Computation and Language · Computer Science 2022-10-14 Kaustubh D. Dhole , Varun Gangal , Sebastian Gehrmann , Aadesh Gupta , Zhenhao Li , Saad Mahamood , Abinaya Mahendiran , Simon Mille , Ashish Shrivastava , Samson Tan , Tongshuang Wu , Jascha Sohl-Dickstein , Jinho D. Choi , Eduard Hovy , Ondrej Dusek , Sebastian Ruder , Sajant Anand , Nagender Aneja , Rabin Banjade , Lisa Barthe , Hanna Behnke , Ian Berlot-Attwell , Connor Boyle , Caroline Brun , Marco Antonio Sobrevilla Cabezudo , Samuel Cahyawijaya , Emile Chapuis , Wanxiang Che , Mukund Choudhary , Christian Clauss , Pierre Colombo , Filip Cornell , Gautier Dagan , Mayukh Das , Tanay Dixit , Thomas Dopierre , Paul-Alexis Dray , Suchitra Dubey , Tatiana Ekeinhor , Marco Di Giovanni , Tanya Goyal , Rishabh Gupta , Rishabh Gupta , Louanes Hamla , Sang Han , Fabrice Harel-Canada , Antoine Honore , Ishan Jindal , Przemyslaw K. Joniak , Denis Kleyko , Venelin Kovatchev , Kalpesh Krishna , Ashutosh Kumar , Stefan Langer , Seungjae Ryan Lee , Corey James Levinson , Hualou Liang , Kaizhao Liang , Zhexiong Liu , Andrey Lukyanenko , Vukosi Marivate , Gerard de Melo , Simon Meoni , Maxime Meyer , Afnan Mir , Nafise Sadat Moosavi , Niklas Muennighoff , Timothy Sum Hon Mun , Kenton Murray , Marcin Namysl , Maria Obedkova , Priti Oli , Nivranshu Pasricha , Jan Pfister , Richard Plant , Vinay Prabhu , Vasile Pais , Libo Qin , Shahab Raji , Pawan Kumar Rajpoot , Vikas Raunak , Roy Rinberg , Nicolas Roberts , Juan Diego Rodriguez , Claude Roux , Vasconcellos P. H. S. , Ananya B. Sai , Robin M. Schmidt , Thomas Scialom , Tshephisho Sefara , Saqib N. Shamsi , Xudong Shen , Haoyue Shi , Yiwen Shi , Anna Shvets , Nick Siegel , Damien Sileo , Jamie Simon , Chandan Singh , Roman Sitelew , Priyank Soni , Taylor Sorensen , William Soto , Aman Srivastava , KV Aditya Srivatsa , Tony Sun , Mukund Varma T , A Tabassum , Fiona Anting Tan , Ryan Teehan , Mo Tiwari , Marie Tolkiehn , Athena Wang , Zijian Wang , Gloria Wang , Zijie J. Wang , Fuxuan Wei , Bryan Wilie , Genta Indra Winata , Xinyi Wu , Witold Wydmański , Tianbao Xie , Usama Yaseen , Michael A. Yee , Jing Zhang , Yue Zhang

Data augmentation is an effective performance enhancement in neural machine translation (NMT) by generating additional bilingual data. In this paper, we propose a novel data augmentation enhancement strategy for neural machine translation.…

Computation and Language · Computer Science 2020-04-30 Sufeng Duan , Hai Zhao , Dongdong Zhang , Rui Wang

Keyphrase generation is the task of summarizing the contents of any given article into a few salient phrases (or keyphrases). Existing works for the task mostly rely on large-scale annotated datasets, which are not easy to acquire. Very few…

Computation and Language · Computer Science 2023-05-30 Krishna Garg , Jishnu Ray Chowdhury , Cornelia Caragea

Recently, semantic parsing has attracted much attention in the community. Although many neural modeling efforts have greatly improved the performance, it still suffers from the data scarcity issue. In this paper, we propose a novel semantic…

Computation and Language · Computer Science 2020-06-24 Zechang Li , Yuxuan Lai , Yansong Feng , Dongyan Zhao

Data augmentation is an effective approach to tackle over-fitting. Many previous works have proposed different data augmentations strategies for NLP, such as noise injection, word replacement, back-translation etc. Though effective, they…

Computation and Language · Computer Science 2022-07-13 Le Zhang , Zichao Yang , Diyi Yang

Textual data augmentation (DA) is a prolific field of study where novel techniques to create artificial data are regularly proposed, and that has demonstrated great efficiency on small data settings, at least for text classification tasks.…

Computation and Language · Computer Science 2024-09-18 Frédéric Piedboeuf , Philippe Langlais

Semantic parsing datasets are expensive to collect. Moreover, even the questions pertinent to a given domain, which are the input of a semantic parsing system, might not be readily available, especially in cross-domain semantic parsing.…

Computation and Language · Computer Science 2021-12-07 Wei Yang , Peng Xu , Yanshuai Cao

While counterfactual data augmentation offers a promising step towards robust generalization in natural language processing, producing a set of counterfactuals that offer valuable inductive bias for models remains a challenge. Most existing…

Computation and Language · Computer Science 2022-10-25 Phillip Howard , Gadi Singer , Vasudev Lal , Yejin Choi , Swabha Swayamdipta

For pixel-level crowd understanding, it is time-consuming and laborious in data collection and annotation. Some domain adaptation algorithms try to liberate it by training models with synthetic data, and the results in some recent works…

Computer Vision and Pattern Recognition · Computer Science 2020-02-21 Tao Han , Junyu Gao , Yuan Yuan , Qi Wang

Data augmentation has been widely used to improve deep neural networks in many research fields, such as computer vision. However, less work has been done in the context of text, partially due to its discrete nature and the complexity of…

Computation and Language · Computer Science 2021-01-12 Ping Yu , Ruiyi Zhang , Yang Zhao , Yizhe Zhang , Chunyuan Li , Changyou Chen

Sentiment analysis has been emerging recently as one of the major natural language processing (NLP) tasks in many applications. Especially, as social media channels (e.g. social networks or forums) have become significant sources for brands…

Computation and Language · Computer Science 2019-12-23 Khuong Vo , Tri Nguyen , Dang Pham , Mao Nguyen , Minh Truong , Trung Mai , Tho Quan

Tweets are specific text data when compared to general text. Although sentiment analysis over tweets has become very popular in the last decade for English, it is still difficult to find huge annotated corpora for non-English languages. The…

Computation and Language · Computer Science 2020-10-08 Valentin Barriere , Alexandra Balahur