中文
相关论文

相关论文: Reducing and Exploiting Data Augmentation Noise th…

200 篇论文

Data augmentation is a technique to generate new training data based on existing data. We evaluate the simple and cost-effective method of concatenating the original data examples to build new training instances. Continued training with…

计算与语言 · 计算机科学 2023-06-12 Tsz Kin Lam , Shigehiko Schamoni , Stefan Riezler

Deep neural networks (DNNs) have been used to create models for many complex analysis problems like image recognition and medical diagnosis. DNNs are a popular tool within machine learning due to their ability to model complex patterns and…

机器学习 · 计算机科学 2024-05-14 Parth Patil , Ben Boardley , Jack Gardner , Emily Loiselle , Deerajkumar Parthipan

Text data augmentation is a complex problem due to the discrete nature of sentences. Although rule-based augmentation methods are widely adopted in real-world applications because of their simplicity, they suffer from potential semantic…

计算与语言 · 计算机科学 2024-02-09 Juhwan Choi , Kyohoon Jin , Junho Lee , Sangmin Song , Youngbin Kim

We propose reCSE, a self supervised contrastive learning sentence representation framework based on feature reshaping. This framework is different from the current advanced models that use discrete data augmentation methods, but instead…

计算与语言 · 计算机科学 2024-08-27 Fufangchen Zhao , Jian Gao , Danfeng Yan

Data augmentation has been widely used in low-resource NER tasks to tackle the problem of data sparsity. However, previous data augmentation methods have the disadvantages of disrupted syntactic structures, token-label mismatch, and…

计算与语言 · 计算机科学 2023-07-18 Sihan Song , Furao Shen , Jian Zhao

Data augmentation is an effective technique for improving the performance of machine learning models. However, it has not been explored as extensively in natural language processing (NLP) as it has in computer vision. In this paper, we…

计算与语言 · 计算机科学 2024-01-04 Himmet Toprak Kesgin , Mehmet Fatih Amasyali

Knowledge augmentation has significantly enhanced the performance of Large Language Models (LLMs) in knowledge-intensive tasks. However, existing methods typically operate on the simplistic premise that model performance equates with…

计算与语言 · 计算机科学 2026-02-16 Hao Chen , Ye He , Yuchun Fan , Yukun Yan , Zhenghao Liu , Qingfu Zhu , Maosong Sun , Wanxiang Che

Unsupervised sentence embedding aims to obtain the most appropriate embedding for a sentence to reflect its semantic. Contrastive learning has been attracting developing attention. For a sentence, current models utilize diverse data…

计算与语言 · 计算机科学 2022-03-03 Hao Wang , Yangguang Li , Zhen Huang , Yong Dou , Lingpeng Kong , Jing Shao

Contextual embeddings generated by LLMs exhibit strong positional inductive biases, which can limit their ability to fully capture long-range, order-sensitive dependencies in highly structured source code. Consequently, how to further…

Data augmentation has proven widely effective in computer vision. In Natural Language Processing (NLP) data augmentation remains an area of active research. There is no widely accepted augmentation technique that works well across tasks and…

计算与语言 · 计算机科学 2023-03-07 Isabel Garcia Pietri , Kineret Stanley

This paper presents a system developed for Task 1 of the COLING 2025 Workshop on Detecting AI-Generated Content, focusing on the binary classification of machine-generated versus human-written text. Our approach utilizes an ensemble of…

计算与语言 · 计算机科学 2025-01-22 Md Kamrujjaman Mobin , Md Saiful Islam

A data augmentation module is utilized in contrastive learning to transform the given data example into two views, which is considered essential and irreplaceable. However, the predetermined composition of multiple data augmentations brings…

计算机视觉与模式识别 · 计算机科学 2022-08-23 Junbo Zhang , Kaisheng Ma

Data augmentation using generative models has emerged as a powerful paradigm for enhancing performance in computer vision tasks. However, most existing augmentation approaches primarily focus on optimizing intrinsic data attributes -- such…

计算机视觉与模式识别 · 计算机科学 2025-10-29 Jiyu Guo , Shuo Yang , Yiming Huang , Yancheng Long , Xiaobo Xia , Xiu Su , Bo Zhao , Zeke Xie , Liqiang Nie

Data augmentation methods are commonly integrated into the training of anomaly detection models. Previous approaches have primarily focused on replicating real-world anomalies or enhancing diversity, without considering that the standard of…

人工智能 · 计算机科学 2024-12-30 Jiang Lin , Yaping Yan

Machine learning models for text classification often excel on in-distribution (ID) data but struggle with unseen out-of-distribution (OOD) inputs. Most techniques for improving OOD robustness are not applicable to settings where the model…

机器学习 · 计算机科学 2024-08-06 Kyle O'Brien , Nathan Ng , Isha Puri , Jorge Mendez , Hamid Palangi , Yoon Kim , Marzyeh Ghassemi , Thomas Hartvigsen

Large training datasets almost always contain examples with inaccurate or incorrect labels. Deep Neural Networks (DNNs) tend to overfit training label noise, resulting in poorer model performance in practice. To address this problem, we…

计算机视觉与模式识别 · 计算机科学 2022-03-01 Chen Gong , Kong Bin , Eric J. Seibel , Xin Wang , Youbing Yin , Qi Song

Recent contrastive methods show significant improvement in self-supervised learning in several domains. In particular, contrastive methods are most effective where data augmentation can be easily constructed e.g. in computer vision.…

机器学习 · 计算机科学 2021-12-09 Konstantinos Kallidromitis , Denis Gudovskiy , Kazuki Kozuka , Iku Ohama , Luca Rigazio

Deep learning usually relies on training large-scale data samples to achieve better performance. However, over-fitting based on training data always remains a problem. Scholars have proposed various strategies, such as feature dropping and…

计算机视觉与模式识别 · 计算机科学 2022-11-22 Songhao Jiang , Yan Chu , Tianxing Ma , Tianning Zang

A critical bottleneck in supervised machine learning is the need for large amounts of labeled data which is expensive and time consuming to obtain. However, it has been shown that a small amount of labeled data, while insufficient to…

This paper investigates methods for improving generative data augmentation for deep learning. Generative data augmentation leverages the synthetic samples produced by generative models as an additional dataset for classification with small…

机器学习 · 计算机科学 2023-10-24 Shin'ya Yamaguchi , Daiki Chijiwa , Sekitoshi Kanai , Atsutoshi Kumagai , Hisashi Kashima