中文
相关论文

相关论文: Data Augmentation Approaches in Natural Language P…

200 篇论文

As an essential branch of recommender systems, sequential recommendation (SR) has received much attention due to its well-consistency with real-world situations. However, the widespread data sparsity issue limits the SR model's performance.…

信息检索 · 计算机科学 2024-09-23 Yizhou Dang , Enneng Yang , Yuting Liu , Guibing Guo , Linying Jiang , Jianzhe Zhao , Xingwei Wang

Data Augmentation (DA) is a technique to increase the quantity and diversity of the training data, and by that alleviate overfitting and improve generalisation. However, standard DA produces synthetic data for augmentation with limited…

计算机视觉与模式识别 · 计算机科学 2023-07-24 Lorenzo Tronchin , Minh H. Vu , Paolo Soda , Tommy Löfstedt

In recent years, pretrained neural language models (PNLMs) have taken the field of natural language processing by storm, achieving new benchmarks and state-of-the-art performances. These models often rely heavily on annotated data, which…

计算与语言 · 计算机科学 2023-02-06 Hoang Van

Large models, encompassing large language and diffusion models, have shown exceptional promise in approximating human-level intelligence, garnering significant interest from both academic and industrial spheres. However, the training of…

机器学习 · 计算机科学 2024-03-05 Yue Zhou , Chenlu Guo , Xu Wang , Yi Chang , Yuan Wu

Data augmentation (DA) is an essential technique for training state-of-the-art deep learning systems. In this paper, we empirically show data augmentation might introduce noisy augmented examples and consequently hurt the performance on…

计算机视觉与模式识别 · 计算机科学 2020-11-25 Chengyue Gong , Dilin Wang , Meng Li , Vikas Chandra , Qiang Liu

Data-Augmentation (DA) is known to improve performance across tasks and datasets. We propose a method to theoretically analyze the effect of DA and study questions such as: how many augmented samples are needed to correctly estimate the…

机器学习 · 计算机科学 2022-02-18 Randall Balestriero , Ishan Misra , Yann LeCun

Deep neural networks have emerged as very successful tools for image restoration and reconstruction tasks. These networks are often trained end-to-end to directly reconstruct an image from a noisy or corrupted measurement of that image. To…

图像与视频处理 · 电气工程与系统科学 2021-06-30 Zalan Fabian , Reinhard Heckel , Mahdi Soltanolkotabi

Data augmentation (DA) is commonly used during model training, as it significantly improves test error and model robustness. DA artificially expands the training set by applying random noise, rotations, crops, or even adversarial…

机器学习 · 计算机科学 2019-05-09 Shashank Rajput , Zhili Feng , Zachary Charles , Po-Ling Loh , Dimitris Papailiopoulos

Dementia is a growing problem as our society ages, and detection methods are often invasive and expensive. Recent deep-learning techniques can offer a faster diagnosis and have shown promising results. However, they require large amounts of…

计算与语言 · 计算机科学 2022-07-19 Anna Hlédiková , Dominika Woszczyk , Alican Akman , Soteris Demetriou , Björn Schuller

Data augmentation has recently seen increased interest in NLP due to more work in low-resource domains, new tasks, and the popularity of large-scale neural networks that require large amounts of training data. Despite this recent upsurge,…

计算与语言 · 计算机科学 2021-12-03 Steven Y. Feng , Varun Gangal , Jason Wei , Sarath Chandar , Soroush Vosoughi , Teruko Mitamura , Eduard Hovy

Data augmentation has been widely used to improve deep neural networks in many research fields, such as computer vision. However, less work has been done in the context of text, partially due to its discrete nature and the complexity of…

计算与语言 · 计算机科学 2021-01-12 Ping Yu , Ruiyi Zhang , Yang Zhao , Yizhe Zhang , Chunyuan Li , Changyou Chen

While data augmentation (DA) is generally applied to input data, several studies have reported that applying DA to hidden layers in neural networks, i.e., feature augmentation, can improve performance. However, in previous studies, the…

机器学习 · 计算机科学 2024-08-27 Tomoumi Takase , Ryo Karakida

Data augmentation has been widely applied as an effective methodology to improve generalization in particular when training deep neural networks. Recently, researchers proposed a few intensive data augmentation techniques, which indeed…

机器学习 · 计算机科学 2019-11-22 Zhuoxun He , Lingxi Xie , Xin Chen , Ya Zhang , Yanfeng Wang , Qi Tian

In this paper, we explore and compare multiple solutions to the problem of data augmentation in image classification. Previous work has demonstrated the effectiveness of data augmentation through simple techniques, such as cropping,…

计算机视觉与模式识别 · 计算机科学 2017-12-14 Luis Perez , Jason Wang

In the Machine Learning research community, there is a consensus regarding the relationship between model complexity and the required amount of data and computation power. In real world applications, these computational requirements are not…

机器学习 · 计算机科学 2022-08-03 Joao Fonseca , Fernando Bacao

Deep learning (DL) algorithms have shown significant performance in various computer vision tasks. However, having limited labelled data lead to a network overfitting problem, where network performance is bad on unseen data as compared to…

计算机视觉与模式识别 · 计算机科学 2023-03-14 Teerath Kumar , Alessandra Mileo , Rob Brennan , Malika Bendechache

Existing automatic data augmentation (DA) methods either ignore updating DA's parameters according to the target model's state during training or adopt update strategies that are not effective enough. In this work, we design a novel data…

计算机视觉与模式识别 · 计算机科学 2023-05-11 Xiaogang Xu , Hengshuang Zhao

Business Process Modeling projects often require formal process models as a central component. High costs associated with the creation of such formal process models motivated many different fields of research aimed at automated generation…

计算与语言 · 计算机科学 2024-04-12 Julian Neuberger , Leonie Doll , Benedict Engelmann , Lars Ackermann , Stefan Jablonski

Data Augmentation (DA) has become an essential tool to improve robustness and generalization of modern machine learning. However, when deciding on DA strategies it is critical to choose parameters carefully, and this can be a daunting task…

机器学习 · 计算机科学 2026-03-04 Madi Matymov , Ba-Hien Tran , Michael Kampffmeyer , Markus Heinonen , Maurizio Filippone

Data augmentation is often used to enlarge datasets with synthetic samples generated in accordance with the underlying data distribution. To enable a wider range of augmentations, we explore negative data augmentation strategies (NDA)that…

计算机视觉与模式识别 · 计算机科学 2021-02-11 Abhishek Sinha , Kumar Ayush , Jiaming Song , Burak Uzkent , Hongxia Jin , Stefano Ermon