English
Related papers

Related papers: Data Augmentation for Hypernymy Detection

200 papers

Data augmentation is an inexpensive way to increase training data diversity and is commonly achieved via transformations of existing data. For tasks such as classification, there is a good case for learning representations of the data that…

Sound · Computer Science 2021-04-20 Turab Iqbal , Karim Helwani , Arvindh Krishnaswamy , Wenwu Wang

Deep neural networks (DNNs) often rely on massive labelled data for training, which is inaccessible in many applications. Data augmentation (DA) tackles data scarcity by creating new labelled data from available ones. Different DA methods…

Neural and Evolutionary Computing · Computer Science 2022-05-31 Binyan Hu , Yu Sun , A. K. Qin

Despite large successes of recent language models on diverse tasks, they suffer from severe performance degeneration in low-resource settings with limited training data available. Many existing works tackle this problem by generating…

Computation and Language · Computer Science 2024-02-22 Minju Seo , Jinheon Baek , James Thorne , Sung Ju Hwang

Dataset augmentation, the practice of applying a wide array of domain-specific transformations to synthetically expand a training set, is a standard tool in supervised learning. While effective in tasks such as visual recognition, the set…

Machine Learning · Statistics 2017-02-21 Terrance DeVries , Graham W. Taylor

Data augmentation is a popular technique which helps improve generalization capabilities of deep neural networks. It plays a pivotal role in remote-sensing scenarios in which the amount of high-quality ground truth data is limited, and…

Computer Vision and Pattern Recognition · Computer Science 2019-03-14 Jakub Nalepa , Michal Myller , Michal Kawulok

In the rapidly evolving field of large language models (LLMs), data augmentation (DA) has emerged as a pivotal technique for enhancing model performance by diversifying training examples without the need for additional data collection. This…

Computation and Language · Computer Science 2024-07-03 Bosheng Ding , Chengwei Qin , Ruochen Zhao , Tianze Luo , Xinze Li , Guizhen Chen , Wenhan Xia , Junjie Hu , Anh Tuan Luu , Shafiq Joty

Scarcity of training data is one of the prominent problems for deep networks which require large amounts data. Data augmentation is a widely used method to increase the number of training samples and their variations. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Hilmi Kumdakcı , Cihan Öngün , Alptekin Temizel

Training generative adversarial networks (GANs) with limited real image data generally results in deteriorated performance and collapsed models. To conquer this challenge, we are inspired by the latest observation, that one can discover…

Machine Learning · Computer Science 2021-10-26 Tianlong Chen , Yu Cheng , Zhe Gan , Jingjing Liu , Zhangyang Wang

Neural models often exploit superficial features to achieve good performance, rather than deriving more general features. Overcoming this tendency is a central challenge in areas such as representation learning and ML fairness. Recent work…

Computation and Language · Computer Science 2020-10-12 Rohan Jha , Charles Lovering , Ellie Pavlick

Large crowdsourced datasets are widely used for training and evaluating neural models on natural language inference (NLI). Despite these efforts, neural models have a hard time capturing logical inferences, including those licensed by…

Computation and Language · Computer Science 2019-04-30 Hitomi Yanaka , Koji Mineshima , Daisuke Bekki , Kentaro Inui , Satoshi Sekine , Lasha Abzianidze , Johan Bos

Hypernym and synonym matching are one of the mainstream Natural Language Processing (NLP) tasks. In this paper, we present systems that attempt to solve this problem. We designed these systems to participate in the FinSim-3, a shared task…

Computation and Language · Computer Science 2021-07-30 Ankush Chopra , Sohom Ghosh

Data augmentation is a widely used technique in many machine learning tasks, such as image classification, to virtually enlarge the training dataset size and avoid overfitting. Traditional data augmentation techniques for image…

Machine Learning · Computer Science 2018-04-12 Hiroshi Inoue

We consider the problem of the extraction of semantic attributes, supervised only with classification labels. For example, when learning to classify images of birds into species, we would like to observe the emergence of features that…

Machine Learning · Computer Science 2021-06-14 Ameen Ali , Tomer Galanti , Evgeniy Zheltonozhskiy , Chaim Baskin , Lior Wolf

Deep neural networks have achieved state-of-the-art results in various vision and/or language tasks. Despite the use of large training datasets, most models are trained by iterating over single input-output pairs, discarding the remaining…

Computation and Language · Computer Science 2021-04-27 Rita Parada Ramos , Patrícia Pereira , Helena Moniz , Joao Paulo Carvalho , Bruno Martins

Data sparsity is a main problem hindering the development of code-switching (CS) NLP systems. In this paper, we investigate data augmentation techniques for synthesizing dialectal Arabic-English CS text. We perform lexical replacements…

Computation and Language · Computer Science 2023-04-05 Injy Hamed , Nizar Habash , Slim Abdennadher , Ngoc Thang Vu

The difficulty in obtaining labeled data relevant to a given task is among the most common and well-known practical obstacles to applying deep learning techniques to new or even slightly modified domains. The data volumes required by the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Jonathan Howe , Kyle Pula , Aaron A. Reite

Deep learning (DL) models have gained prominence in domains such as computer vision and natural language processing but remain underutilized for regression tasks involving tabular data. In these cases, traditional machine learning (ML)…

Machine Learning · Computer Science 2025-01-08 Assaf Shmuel , Oren Glickman , Teddy Lazebnik

We propose a novel data augmentation for labeled sentences called contextual augmentation. We assume an invariance that sentences are natural even if the words in the sentences are replaced with other words with paradigmatic relations. We…

Computation and Language · Computer Science 2018-05-17 Sosuke Kobayashi

Data augmentation has been widely used to improve deep neural networks in many research fields, such as computer vision. However, less work has been done in the context of text, partially due to its discrete nature and the complexity of…

Computation and Language · Computer Science 2021-01-12 Ping Yu , Ruiyi Zhang , Yang Zhao , Yizhe Zhang , Chunyuan Li , Changyou Chen

Hypernymy plays a fundamental role in many AI tasks like taxonomy learning, ontology learning, etc. This has motivated the development of many automatic identification methods for extracting this relation, most of which rely on word…

Computation and Language · Computer Science 2024-09-02 Maulik Parmar , Apurva Narayan