中文
相关论文

相关论文: SoftEDA: Rethinking Rule-Based Data Augmentation w…

200 篇论文

Text augmentation techniques are widely used in text classification problems to improve the performance of classifiers, especially in low-resource scenarios. Whilst lots of creative text augmentation methods have been designed, they augment…

计算与语言 · 计算机科学 2021-09-02 Biyang Guo , Sonqiao Han , Hailiang Huang

Data augmentation is an important technique to improve data efficiency and save labeling cost for 3D detection in point clouds. Yet, existing augmentation policies have so far been designed to only utilize labeled data, which limits the…

计算机视觉与模式识别 · 计算机科学 2022-10-25 Zhaoqi Leng , Shuyang Cheng , Benjamin Caine , Weiyue Wang , Xiao Zhang , Jonathon Shlens , Mingxing Tan , Dragomir Anguelov

Incorrect labels in training data occur when human annotators make mistakes or when the data is generated via weak or distant supervision. It has been shown that complex noise-handling techniques - by modeling, cleaning or filtering the…

计算与语言 · 计算机科学 2022-04-21 Dawei Zhu , Michael A. Hedderich , Fangzhou Zhai , David Ifeoluwa Adelani , Dietrich Klakow

Neural language models (LMs) are vulnerable to training data extraction attacks due to data memorization. This paper introduces a novel attack scenario wherein an attacker adversarially fine-tunes pre-trained LMs to amplify the exposure of…

计算与语言 · 计算机科学 2024-09-04 Myung Gyo Oh , Hong Eun Ahn , Leo Hyun Park , Taekyoung Kwon

Data augmentation has recently seen increased interest in NLP due to more work in low-resource domains, new tasks, and the popularity of large-scale neural networks that require large amounts of training data. Despite this recent upsurge,…

计算与语言 · 计算机科学 2021-12-03 Steven Y. Feng , Varun Gangal , Jason Wei , Sarath Chandar , Soroush Vosoughi , Teruko Mitamura , Eduard Hovy

This paper describes a method of domain adaptive training for semantic segmentation using multiple source datasets that are not necessarily relevant to the target dataset. We propose a soft pseudo-label generation method by integrating…

计算机视觉与模式识别 · 计算机科学 2023-08-01 Shigemichi Matsuzaki , Hiroaki Masuzawa , Jun Miura

Long-tailed data is prevalent in real-world classification tasks and heavily relies on supervised information, which makes the annotation process exceptionally labor-intensive and time-consuming. Unfortunately, despite being a common…

机器学习 · 计算机科学 2024-12-04 Meng Wei , Zhongnian Li , Yong Zhou , Xinzheng Xu

Data augmentation has been pivotal in successfully training deep learning models on classification tasks over the past decade. An important subclass of data augmentation techniques - which includes both label smoothing and Mixup - involves…

机器学习 · 计算机科学 2025-02-14 Muthu Chidambaram , Rong Ge

Most reinforcement learning (RL) methods for training large language models (LLMs) require ground-truth labels or task-specific verifiers, limiting scalability when correctness is ambiguous or expensive to obtain. We introduce Reinforcement…

神经与进化计算 · 计算机科学 2026-01-30 Micah Rentschler , Jesse Roberts

In recent years, language models (LMs) have made remarkable progress in advancing the field of natural language processing (NLP). However, the impact of data augmentation (DA) techniques on the fine-tuning (FT) performance of these LMs has…

计算与语言 · 计算机科学 2023-06-14 Zhengxiang Shi , Aldo Lipani

Toxicity classification in textual content remains a significant problem. Data with labels from a single annotator fall short of capturing the diversity of human perspectives. Therefore, there is a growing need to incorporate crowdsourced…

人工智能 · 计算机科学 2024-11-11 Zelei Cheng , Xian Wu , Jiahao Yu , Shuo Han , Xin-Qiang Cai , Xinyu Xing

The growing importance of massive datasets used for deep learning makes robustness to label noise a critical property for classifiers to have. Sources of label noise include automatic labeling, non-expert labeling, and label corruption by…

机器学习 · 计算机科学 2019-01-30 Dan Hendrycks , Mantas Mazeika , Duncan Wilson , Kevin Gimpel

Being able to model correlations between labels is considered crucial in multi-label classification. Rule-based models enable to expose such dependencies, e.g., implications, subsumptions, or exclusions, in an interpretable and…

机器学习 · 计算机科学 2019-08-20 Yannik Klein , Michael Rapp , Eneldo Loza Mencía

Deep learning has achieved remarkable results in many computer vision tasks. Deep neural networks typically rely on large amounts of training data to avoid overfitting. However, labeled data for real-world applications may be limited. By…

计算机视觉与模式识别 · 计算机科学 2023-11-07 Suorong Yang , Weikang Xiao , Mengchen Zhang , Suhan Guo , Jian Zhao , Furao Shen

While previous studies on image segmentation focus on handling severe (or explicit) label noise, real-world datasets also exhibit subtle (or implicit) label imperfections. These arise from inherent challenges, such as ambiguous object…

计算机视觉与模式识别 · 计算机科学 2025-08-25 Yechan Kim , Dongho Yoon , Younkwan Lee , Unse Fatima , Hong Kook Kim , Songjae Lee , Sanga Park , Jeong Ho Park , Seonjong Kang , Moongu Jeon

Data-Augmentation (DA) is known to improve performance across tasks and datasets. We propose a method to theoretically analyze the effect of DA and study questions such as: how many augmented samples are needed to correctly estimate the…

机器学习 · 计算机科学 2022-02-18 Randall Balestriero , Ishan Misra , Yann LeCun

While pre-trained language models (PLMs) are the go-to solution to tackle many natural language processing problems, they are still very limited in their ability to capture and to use common-sense knowledge. In fact, even if information is…

人工智能 · 计算机科学 2021-09-28 Mohammed Saeed , Naser Ahmadi , Preslav Nakov , Paolo Papotti

Creating and collecting labeled data is one of the major bottlenecks in machine learning pipelines and the emergence of automated feature generation techniques such as deep learning, which typically requires a lot of training data, has…

数据库 · 计算机科学 2020-05-14 Sainyam Galhotra , Behzad Golshan , Wang-Chiew Tan

Recent studies on semi-supervised semantic segmentation (SSS) have seen fast progress. Despite their promising performance, current state-of-the-art methods tend to increasingly complex designs at the cost of introducing more network…

计算机视觉与模式识别 · 计算机科学 2022-12-12 Zhen Zhao , Lihe Yang , Sifan Long , Jimin Pi , Luping Zhou , Jingdong Wang

Supervised learning typically focuses on learning transferable representations from training examples annotated by humans. While rich annotations (like soft labels) carry more information than sparse annotations (like hard labels), they are…