中文
相关论文

相关论文: Learning Data Augmentation with Online Bilevel Opt…

200 篇论文

Image data augmentation constitutes a critical methodology in modern computer vision tasks, since it can facilitate towards enhancing the diversity and quality of training datasets; thereby, improving the performance and robustness of…

Neural networks are prone to overfitting and memorizing data patterns. To avoid over-fitting and enhance their generalization and performance, various methods have been suggested in the literature, including dropout, regularization, label…

计算机视觉与模式识别 · 计算机科学 2023-02-08 Humza Naveed , Saeed Anwar , Munawar Hayat , Kashif Javed , Ajmal Mian

Contrary to most machine learning models, modern deep artificial neural networks typically include multiple components that contribute to regularization. Despite the fact that some (explicit) regularization techniques, such as weight decay…

计算机视觉与模式识别 · 计算机科学 2020-11-13 Alex Hernández-García , Peter König

Data augmentation is an essential part of the training process applied to deep learning models. The motivation is that a robust training process for deep learning models depends on large annotated datasets, which are expensive to be…

计算机视觉与模式识别 · 计算机科学 2017-10-31 Toan Tran , Trung Pham , Gustavo Carneiro , Lyle Palmer , Ian Reid

Meta-learning algorithms aim to learn two components: a model that predicts targets for a task, and a base learner that quickly updates that model when given examples from a new task. This additional level of learning can be powerful, but…

机器学习 · 计算机科学 2020-11-05 Janarthanan Rajendran , Alex Irpan , Eric Jang

In this paper we investigate the benefit of augmenting data with synthetically created samples when training a machine learning classifier. Two approaches for creating additional training samples are data warping, which generates additional…

计算机视觉与模式识别 · 计算机科学 2016-11-29 Sebastien C. Wong , Adam Gatt , Victor Stamatescu , Mark D. McDonnell

Imitation learning is an effective approach for training game-playing agents and, consequently, for efficient game production. However, generalization - the ability to perform well in related but unseen scenarios - is an essential…

机器学习 · 计算机科学 2024-04-09 Derek Yadgaroff , Alessandro Sestini , Konrad Tollmar , Ayca Ozcelikkale , Linus Gisslén

We design and analyze a novel accelerated gradient-based algorithm for a class of bilevel optimization problems. These problems have various applications arising from machine learning and image processing, where optimal solutions of the two…

最优化与控制 · 数学 2023-11-20 Sepideh Samadi , Daniel Burbano , Farzad Yousefian

Leaping into the rapidly developing world of deep learning is an exciting and sometimes confusing adventure. All of the advice and tutorials available can be hard to organize and work through, especially when training specific models on…

计算机视觉与模式识别 · 计算机科学 2018-09-05 Ishtar Nyawira , Kristi Bushman

The hyperparameter optimization of neural network can be expressed as a bilevel optimization problem. The bilevel optimization is used to automatically update the hyperparameter, and the gradient of the hyperparameter is the approximate…

机器学习 · 计算机科学 2022-12-14 Shuo Yang , Yang Jiao , Shaoyu Dou , Mana Zheng , Chen Zhu

Object-level data association is central to robotic applications such as tracking-by-detection and object-level simultaneous localization and mapping. While current learned visual data association methods outperform hand-crafted algorithms,…

计算机视觉与模式识别 · 计算机科学 2024-10-30 Yorai Shaoul , Katherine Liu , Kyel Ok , Nicholas Roy

Modern neural networks are over-parameterized and thus rely on strong regularization such as data augmentation and weight decay to reduce overfitting and improve generalization. The dominant form of data augmentation applies invariant…

计算机视觉与模式识别 · 计算机科学 2024-01-25 Yang Liu , Shen Yan , Laura Leal-Taixé , James Hays , Deva Ramanan

Data augmentation methods are indispensable heuristics to boost the performance of deep neural networks, especially in image recognition tasks. Recently, several studies have shown that augmentation strategies found by search algorithms…

计算机视觉与模式识别 · 计算机科学 2019-11-19 Ryuichiro Hataya , Jan Zdenek , Kazuki Yoshizoe , Hideki Nakayama

Though data augmentation has become a standard component of deep neural network training, the underlying mechanism behind the effectiveness of these techniques remains poorly understood. In practice, augmentation policies are often chosen…

机器学习 · 计算机科学 2020-06-08 Raphael Gontijo-Lopes , Sylvia J. Smullin , Ekin D. Cubuk , Ethan Dyer

Data augmentations are useful in closing the sim-to-real domain gap when training on synthetic data. This is because they widen the training data distribution, thus encouraging the model to generalize better to other domains. Many image…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Bram Vanherle , Nick Michiels , Frank Van Reeth

Variational regularization techniques are dominant in the field of mathematical imaging. A drawback of these techniques is that they are dependent on a number of parameters which have to be set by the user. A by now common strategy to…

最优化与控制 · 数学 2020-12-10 Matthias J. Ehrhardt , Lindon Roberts

Data augmentation is a widely used technique in classification to increase data used in training. It improves generalization and reduces amount of annotated human activity data needed for training which reduces labour and time needed with…

机器学习 · 计算机科学 2021-09-07 Sandeep Ramachandra , Alexander Hoelzemann , Kristof Van Laerhoven

Objective: The use of deep learning for electroencephalography (EEG) classification tasks has been rapidly growing in the last years, yet its application has been limited by the relatively small size of EEG datasets. Data augmentation,…

机器学习 · 计算机科学 2022-11-16 Cédric Rommel , Joseph Paillard , Thomas Moreau , Alexandre Gramfort

Simple yet effective data augmentation techniques have been proposed for sentence-level and sentence-pair natural language processing tasks. Inspired by these efforts, we design and compare data augmentation for named entity recognition,…

计算与语言 · 计算机科学 2020-10-23 Xiang Dai , Heike Adel

Domain adaptation for semantic image segmentation is very necessary since manually labeling large datasets with pixel-level labels is expensive and time consuming. Existing domain adaptation techniques either work on limited datasets, or…

计算机视觉与模式识别 · 计算机科学 2019-04-25 Yunsheng Li , Lu Yuan , Nuno Vasconcelos