English
Related papers

Related papers: RPN: A Word Vector Level Data Augmentation Algorit…

200 papers

Despite recent monumental advances in the field, many Natural Language Processing (NLP) models still struggle to perform adequately on noisy domains. We propose a novel probabilistic embedding-level method to improve the robustness of NLP…

Computation and Language · Computer Science 2021-04-20 Kira A. Selby , Yinong Wang , Ruizhe Wang , Peyman Passban , Ahmad Rashid , Mehdi Rezagholizadeh , Pascal Poupart

A recurrent issue in deep learning is the scarcity of data, in particular precisely annotated data. Few publicly available databases are correctly annotated and generating correct labels is very time consuming. The present article…

Sound · Computer Science 2019-06-25 Celine Jacques , Axel Roebel

Data scarcity is a problem that occurs in languages and tasks where we do not have large amounts of labeled data but want to use state-of-the-art models. Such models are often deep learning models that require a significant amount of data…

Computation and Language · Computer Science 2023-02-23 Domagoj Pluščec , Jan Šnajder

Recurrent Neural Networks (RNN) have obtained excellent result in many natural language processing (NLP) tasks. However, understanding and interpreting the source of this success remains a challenge. In this paper, we propose Recurrent…

Computation and Language · Computer Science 2016-04-25 Ke Tran , Arianna Bisazza , Christof Monz

The word error rate (WER) of an automatic speech recognition (ASR) system increases when a mismatch occurs between the training and the testing conditions due to the noise, etc. In this case, the acoustic information can be less reliable.…

Computation and Language · Computer Science 2020-11-03 Dominique Fohr , Irina Illina

Text-based Person Retrieval (TPR) aims to retrieve person images that match the description given a text query. The performance improvement of the TPR model relies on high-quality data for supervised training. However, it is difficult to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Zheng Li , Lijia Si , Caili Guo , Yang Yang , Qiushi Cao

Adversarial training has been shown effective at endowing the learned representations with stronger generalization ability. However, it typically requires expensive computation to determine the direction of the injected perturbations. In…

Computation and Language · Computer Science 2020-10-26 Dinghan Shen , Mingzhi Zheng , Yelong Shen , Yanru Qu , Weizhu Chen

Natural Language Processing (NLP) is widely used in fields like machine translation and sentiment analysis. However, traditional NLP models struggle with accuracy and efficiency. This paper introduces Deep Convolutional Neural Networks…

Computation and Language · Computer Science 2024-12-23 Chang Weng , Scott Rood , Mehdi Ali Ramezani , Amir Aslani , Reza Zarrab , Wang Zwuo , Sanjeev Salimans , Tim Satheesh

Instruction-fine-tuned large language models (LLMs) under 14B parameters continue to underperform on natural language understanding (NLU) tasks, often trailing smaller models like BERT-base on benchmarks such as GLUE and SuperGLUE.…

Computation and Language · Computer Science 2025-09-29 Bokai Hu , Sai Ashish Somayajula , Xin Pan , Pengtao Xie

Unsupervised word embeddings have become a popular approach of word representation in NLP tasks. However there are limitations to the semantics represented by unsupervised embeddings, and inadequate fine-tuning of embeddings can lead to…

Computation and Language · Computer Science 2019-06-10 Xiao Zhang , Ji Wu , Dejing Dou

The scarcity and class imbalance of training data are known issues in current rumor detection tasks. We propose a straight-forward and general-purpose data augmentation technique which is beneficial to early rumor detection relying on event…

Computation and Language · Computer Science 2019-07-17 Sooji Han , Jie Gao , Fabio Ciravegna

Data augmentation is a key tool for improving the performance of deep networks, particularly when there is limited labeled data. In some fields, such as computer vision, augmentation methods have been extensively studied; however, for…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-17 Zuzhao Ye , Gregory Ciccarelli , Brian Kulis

Math Word Problem (MWP) solving presents a challenging task in Natural Language Processing (NLP). This study aims to provide MWP solvers with a more diverse training set, ultimately improving their ability to solve various math problems. We…

Computation and Language · Computer Science 2024-05-02 Gulsum Yigit , Mehmet Fatih Amasyali

This work investigates the ways in which deep learning methods can benefit from random projection (RP), a classic linear dimensionality reduction method. We focus on two areas where, as we have found, employing RP techniques can improve…

Machine Learning · Computer Science 2018-12-27 Piotr Iwo Wójcik

The user review data have been demonstrated to be effective in solving different recommendation problems. Previous review-based recommendation methods usually employ sophisticated compositional models, such as Recurrent Neural Networks…

Information Retrieval · Computer Science 2021-01-26 Yong Liu , Susen Yang , Yinan Zhang , Chunyan Miao , Zaiqing Nie , Juyong Zhang

Recent work has shown that data augmentation has the potential to significantly improve the generalization of deep learning models. Recently, automated augmentation strategies have led to state-of-the-art results in image classification and…

Computer Vision and Pattern Recognition · Computer Science 2019-11-15 Ekin D. Cubuk , Barret Zoph , Jonathon Shlens , Quoc V. Le

Handwritten text and scene text suffer from various shapes and distorted patterns. Thus training a robust recognition model requires a large amount of data to cover diversity as much as possible. In contrast to data collection and…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Canjie Luo , Yuanzhi Zhu , Lianwen Jin , Yongpan Wang

Vision-language Navigation (VLN) tasks require an agent to navigate step-by-step while perceiving the visual observations and comprehending a natural language instruction. Large data bias, which is caused by the disparity ratio between the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Chong Liu , Fengda Zhu , Xiaojun Chang , Xiaodan Liang , Zongyuan Ge , Yi-Dong Shen

This paper investigates the effectiveness of token-level text augmentation and the role of probabilistic linguistic knowledge within a linguistically-motivated evaluation context. Two text augmentation programs, REDA and REDA$_{NG}$, were…

Computation and Language · Computer Science 2023-07-04 Zhengxiang Wang

Recurrent neural networks (RNNs) are powerful models of sequential data. They have been successfully used in domains such as text and speech. However, RNNs are susceptible to overfitting; regularization is important. In this paper we…

Machine Learning · Statistics 2018-07-16 Adji B. Dieng , Rajesh Ranganath , Jaan Altosaar , David M. Blei