中文
相关论文

相关论文: Augmentation-induced Consistency Regularization fo…

200 篇论文

Data augmentation has proven to be effective in training neural networks. Recently, a method called RandAug was proposed, randomly selecting data augmentation techniques from a predefined search space. RandAug has demonstrated significant…

Despite remarkable progress on visual recognition tasks, deep neural-nets still struggle to generalize well when training data is scarce or highly imbalanced, rendering them extremely vulnerable to real-world examples. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2022-06-22 Shiran Zada , Itay Benou , Michal Irani

Image classification has been a popular task due to its feasibility in real-world applications. Training neural networks by feeding them RGB images has demonstrated success over it. Nevertheless, improving the classification accuracy and…

计算机视觉与模式识别 · 计算机科学 2024-01-17 Tianhao Bu , Michalis Lazarou , Tania Stathaki

Deep networks are an integral part of the current machine learning paradigm. Their inherent ability to learn complex functional mappings between data and various target variables, while discovering hidden, task-driven features, makes them a…

计算机视觉与模式识别 · 计算机科学 2019-06-14 Riddhish Bhalodia , Shireen Elhabian , Ladislav Kavan , Ross Whitaker

The ability of deep convolutional neural networks (CNN) to learn discriminative spectro-temporal patterns makes them well suited to environmental sound classification. However, the relative scarcity of labeled data has impeded the…

声音 · 计算机科学 2017-04-05 Justin Salamon , Juan Pablo Bello

In search of robust and generalizable machine learning models, Domain Generalization (DG) has gained significant traction during the past few years. The goal in DG is to produce models which continue to perform well when presented with data…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Aristotelis Ballas , Christos Diou

Consistency regularization is a commonly-used technique for semi-supervised and self-supervised learning. It is an auxiliary objective function that encourages the prediction of the network to be similar in the vicinity of the observed…

机器学习 · 计算机科学 2021-10-05 Erik Englesson , Hossein Azizpour

Despite the prevalence of retrieval-augmented language models (RALMs), the seamless integration of these models with retrieval mechanisms to enhance performance in document-based tasks remains challenging. While some post-retrieval…

计算与语言 · 计算机科学 2024-06-05 Chuankai Xu , Dongming Zhao , Bo Wang , Hanwen Xing

Deep reinforcement learning (RL) agents often fail to generalize to unseen scenarios, even when they are trained on many instances of semantically similar environments. Data augmentation has recently been shown to improve the sample…

机器学习 · 计算机科学 2021-02-23 Roberta Raileanu , Max Goldstein , Denis Yarats , Ilya Kostrikov , Rob Fergus

Deep networks have achieved impressive results on a range of well-curated benchmark datasets. Surprisingly, their performance remains sensitive to perturbations that have little effect on human performance. In this work, we propose a novel…

计算机视觉与模式识别 · 计算机科学 2024-10-22 Jonas Ngnawe , Marianne Abemgnigni Njifon , Jonathan Heek , Yann Dauphin

Although existing Quantization-Aware Training (QAT) methods intensively depend on knowledge distillation to guarantee performance, QAT still suffers from severe performance drop. The experiments have shown that vanilla quantization is…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Junbiao Pang , Tianyang Cai , Baochang Zhang , Jiaqi Wu

Data augmentation is one of the most popular techniques for improving the robustness of neural networks. In addition to directly training the model with original samples and augmented samples, a torrent of methods regularizing the distance…

机器学习 · 计算机科学 2020-11-30 Haohan Wang , Zeyi Huang , Xindi Wu , Eric P. Xing

Unpaired image-to-image (I2I) translation has received considerable attention in pattern recognition and computer vision because of recent advancements in generative adversarial networks (GANs). However, due to the lack of explicit…

计算机视觉与模式识别 · 计算机科学 2020-10-13 Takehiko Ohkawa , Naoto Inoue , Hirokatsu Kataoka , Nakamasa Inoue

Data assisted reconstruction algorithms, incorporating trained neural networks, are a novel paradigm for solving inverse problems. One approach is to first apply a classical reconstruction method and then apply a neural network to improve…

数值分析 · 数学 2020-03-26 Yoeri E. Boink , Markus Haltmeier , Sean Holman , Johannes Schwab

We introduce DiffAug, a simple and efficient diffusion-based augmentation technique to train image classifiers for the crucial yet challenging goal of improved classifier robustness. Applying DiffAug to a given example consists of one…

计算机视觉与模式识别 · 计算机科学 2024-05-30 Chandramouli Sastry , Sri Harsha Dumpala , Sageev Oore

Graph Neural Networks (GNNs) often suffer from weak-generalization due to sparsely labeled data despite their promising results on various graph-based tasks. Data augmentation is a prevalent remedy to improve the generalization ability of…

机器学习 · 计算机科学 2022-03-29 Hyeonjin Park , Seunghun Lee , Sihyeon Kim , Jinyoung Park , Jisu Jeong , Kyung-Min Kim , Jung-Woo Ha , Hyunwoo J. Kim

The performance of generative adversarial networks (GANs) heavily deteriorates given a limited amount of training data. This is mainly because the discriminator is memorizing the exact training set. To combat it, we propose Differentiable…

计算机视觉与模式识别 · 计算机科学 2020-12-08 Shengyu Zhao , Zhijian Liu , Ji Lin , Jun-Yan Zhu , Song Han

Deep learning has made significant advancements in supervised learning. However, models trained in this setting often face challenges due to domain shift between training and test sets, resulting in a significant drop in performance during…

计算机视觉与模式识别 · 计算机科学 2024-02-08 Lei Qi , Hongpeng Yang , Yinghuan Shi , Xin Geng

Deep learning techniques are often criticized to heavily depend on a large quantity of labeled data. This problem is even more challenging in medical image analysis where the annotator expertise is often scarce. We propose a novel…

计算机视觉与模式识别 · 计算机科学 2019-07-30 Florian Dubost , Gerda Bortsova , Hieab Adams , M. Arfan Ikram , Wiro Niessen , Meike Vernooij , Marleen de Bruijne

Though data augmentation has become a standard component of deep neural network training, the underlying mechanism behind the effectiveness of these techniques remains poorly understood. In practice, augmentation policies are often chosen…

机器学习 · 计算机科学 2020-06-08 Raphael Gontijo-Lopes , Sylvia J. Smullin , Ekin D. Cubuk , Ethan Dyer