中文
相关论文

相关论文: Learning Data Augmentation with Online Bilevel Opt…

200 篇论文

Bilevel learning has gained prominence in machine learning, inverse problems, and imaging applications, including hyperparameter optimization, learning data-adaptive regularizers, and optimizing forward operators. The large-scale nature of…

最优化与控制 · 数学 2025-05-20 Mohammad Sadegh Salehi , Subhadip Mukherjee , Lindon Roberts , Matthias J. Ehrhardt

Data augmentation is a commonly used technique for increasing both the size and the diversity of labeled training sets by leveraging input transformations that preserve output labels. In computer vision domain, image augmentations have…

计算机视觉与模式识别 · 计算机科学 2020-02-27 Alexander Buslaev , Alex Parinov , Eugene Khvedchenya , Vladimir I. Iglovikov , Alexandr A. Kalinin

At the heart of the success of deep learning is the quality of the data. Through data augmentation, one can train models with better generalization capabilities and thus achieve greater results in their field of interest. In this work, we…

计算机视觉与模式识别 · 计算机科学 2021-10-28 George Chogovadze , Rémi Pautrat , Marc Pollefeys

Hyperparameter optimization can be formulated as a bilevel optimization problem, where the optimal parameters on the training set depend on the hyperparameters. We aim to adapt regularization hyperparameters for neural networks by fitting…

机器学习 · 计算机科学 2019-03-08 Matthew MacKay , Paul Vicol , Jon Lorraine , David Duvenaud , Roger Grosse

Data augmentation (DA) is fundamental against overfitting in large convolutional neural networks, especially with a limited training dataset. In images, DA is usually based on heuristic transformations, like geometric or color…

计算机视觉与模式识别 · 计算机科学 2019-09-24 Saypraseuth Mounsaveng , David Vazquez , Ismail Ben Ayed , Marco Pedersoli

The generation of artificial data based on existing observations, known as data augmentation, is a technique used in machine learning to improve model accuracy, generalisation, and to control overfitting. Augmentor is a software package,…

计算机视觉与模式识别 · 计算机科学 2017-08-18 Marcus D. Bloice , Christof Stocker , Andreas Holzinger

Data augmentation is one of the most prevalent tools in deep learning, underpinning many recent advances, including those from classification, generative models, and representation learning. The standard approach to data augmentation…

计算机视觉与模式识别 · 计算机科学 2025-06-12 Brandon Trabucco , Kyle Doherty , Max Gurinas , Ruslan Salakhutdinov

Bilevel learning refers to machine learning problems that can be formulated as bilevel optimization models, where decisions are organized in a hierarchical structure. This paradigm has recently gained considerable attention in machine…

最优化与控制 · 数学 2026-05-05 Riccardo Grazzi , Massimiliano Pontil , Saverio Salzo , Alain Zemkoho

In this paper, we introduce a new functional point of view on bilevel optimization problems for machine learning, where the inner objective is minimized over a function space. These types of problems are most often solved by using methods…

机器学习 · 统计学 2024-12-10 Ieva Petrulionyte , Julien Mairal , Michael Arbel

Aiming to produce sufficient and diverse training samples, data augmentation has been demonstrated for its effectiveness in training deep models. Regarding that the criterion of the best augmentation is challenging to define, we in this…

计算机视觉与模式识别 · 计算机科学 2019-10-23 Yinghuan Shi , Tiexin Qin , Yong Liu , Jiwen Lu , Yang Gao , Dinggang Shen

Data augmentation (DA) encodes invariance and provides implicit regularization critical to a model's performance in image classification tasks. However, while DA improves average accuracy, recent studies have shown that its impact can be…

计算机视觉与模式识别 · 计算机科学 2024-01-04 Polina Kirichenko , Mark Ibrahim , Randall Balestriero , Diane Bouchacourt , Ramakrishna Vedantam , Hamed Firooz , Andrew Gordon Wilson

Data augmentation plays a pivotal role in enhancing and diversifying training data. Nonetheless, consistently improving model performance in varied learning scenarios, especially those with inherent data biases, remains challenging. To…

机器学习 · 计算机科学 2024-06-04 Xiaoling Zhou , Wei Ye , Zhemg Lee , Rui Xie , Shikun Zhang

Deep learning has become a popular tool for medical image analysis, but the limited availability of training data remains a major challenge, particularly in the medical field where data acquisition can be costly and subject to privacy…

图像与视频处理 · 电气工程与系统科学 2024-06-11 Aghiles Kebaili , Jérôme Lapuyade-Lahorgue , Su Ruan

Evolutionary reinforcement learning (ERL) algorithms recently raise attention in tackling complex reinforcement learning (RL) problems due to high parallelism, while they are prone to insufficient exploration or model collapse without…

神经与进化计算 · 计算机科学 2023-08-03 Junyi Wang , Yuanyang Zhu , Zhi Wang , Yan Zheng , Jianye Hao , Chunlin Chen

(Stochastic) bilevel optimization is a frequently encountered problem in machine learning with a wide range of applications such as meta-learning, hyper-parameter optimization, and reinforcement learning. Most of the existing studies on…

机器学习 · 计算机科学 2023-03-16 Meng Ding , Mingxi Lei , Yunwen Lei , Di Wang , Jinhui Xu

Supervised deep learning relies on the assumption that enough training data is available, which presents a problem for its application to several fields, like medical imaging. On the example of a binary image classification task (breast…

计算机视觉与模式识别 · 计算机科学 2019-02-22 Lukas Jendele , Ondrej Skopek , Anton S. Becker , Ender Konukoglu

Data augmentation is a series of techniques that generate high-quality artificial data by manipulating existing data samples. By leveraging data augmentation techniques, AI models can achieve significantly improved applicability in tasks…

Data augmentation has been widely used to improve generalizability of machine learning models. However, comparatively little work studies data augmentation for graphs. This is largely due to the complex, non-Euclidean structure of graphs,…

机器学习 · 计算机科学 2020-12-03 Tong Zhao , Yozen Liu , Leonardo Neves , Oliver Woodford , Meng Jiang , Neil Shah

Solving image classification tasks given small training datasets remains an open challenge for modern computer vision. Aggressive data augmentation and generative models are among the most straightforward approaches to overcoming the lack…

计算机视觉与模式识别 · 计算机科学 2023-09-06 Lorenzo Brigato , Stavroula Mougiakakou

In practice, data augmentation is assigned a predefined budget in terms of newly created samples per epoch. When using several types of data augmentation, the budget is usually uniformly distributed over the set of augmentations but one can…

机器学习 · 统计学 2022-02-08 Arnaud Deleruyelle , John Klein , Cristian Versari