English
Related papers

Related papers: Learning Data Augmentation with Online Bilevel Opt…

200 papers

Deep neural networks have emerged as very successful tools for image restoration and reconstruction tasks. These networks are often trained end-to-end to directly reconstruct an image from a noisy or corrupted measurement of that image. To…

Image and Video Processing · Electrical Eng. & Systems 2021-06-30 Zalan Fabian , Reinhard Heckel , Mahdi Soltanolkotabi

Sequential recommender systems have recently achieved significant performance improvements with the exploitation of deep learning (DL) based methods. However, although various DL-based methods have been introduced, most of them only focus…

Information Retrieval · Computer Science 2022-03-29 Joo-yeong Song , Bongwon Suh

Hyperparameter optimization has remained a central topic within the machine learning community due to its ability to produce state-of-the-art results. With the recent interest growing in the usage of CNNs for time series prediction, we…

Machine Learning · Computer Science 2021-01-20 Taniya Seth , Pranab K. Muhuri

The abundance of models of complex networks and the current insufficient validation standards make it difficult to judge which models are strongly supported by data and which are not. We focus here on likelihood maximization methods for…

Physics and Society · Physics 2014-03-26 Matus Medo

Data and knowledge representation are fundamental concepts in machine learning. The quality of the representation impacts the performance of the learning model directly. Feature learning transforms or enhances raw data to structures that…

Artificial Intelligence · Computer Science 2021-04-26 Filipe Alves Neto Verri , Renato Tinós , Liang Zhao

In this paper, we present augmentation inside the network, a method that simulates data augmentation techniques for computer vision problems on intermediate features of a convolutional neural network. We perform these transformations,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Maciej Sypetkowski , Jakub Jasiulewicz , Zbigniew Wojna

Classification algorithms have recently found applications in computational physics for the selection of numerical methods or models adapted to the environment and the state of the physical system. For such classification tasks, labeled…

Machine Learning · Statistics 2023-02-02 Thomas Daniel , Fabien Casenave , Nissrine Akkari , David Ryckelynck

Data augmentation has proven widely effective in computer vision. In Natural Language Processing (NLP) data augmentation remains an area of active research. There is no widely accepted augmentation technique that works well across tasks and…

Computation and Language · Computer Science 2023-03-07 Isabel Garcia Pietri , Kineret Stanley

Data augmentation is an essential technique for improving generalization ability of deep learning models. Recently, AutoAugment has been proposed as an algorithm to automatically search for augmentation policies from a dataset and has…

Machine Learning · Computer Science 2020-01-09 Sungbin Lim , Ildoo Kim , Taesup Kim , Chiheon Kim , Sungwoong Kim

We propose a federated learning method with weighted nodes in which the weights can be modified to optimize the model's performance on a separate validation set. The problem is formulated as a bilevel optimization where the inner problem is…

Machine Learning · Computer Science 2022-10-11 Yankun Huang , Qihang Lin , Nick Street , Stephen Baek

Data augmentation is a cornerstone of the machine learning pipeline, yet its theoretical underpinnings remain unclear. Is it merely a way to artificially augment the data set size? Or is it about encouraging the model to satisfy certain…

Machine Learning · Computer Science 2022-09-22 Ruoqi Shen , Sébastien Bubeck , Suriya Gunasekar

Speech enhancement using neural networks is recently receiving large attention in research and being integrated in commercial devices and applications. In this work, we investigate data augmentation techniques for supervised deep…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-25 Sebastian Braun , Ivan Tashev

We study the feature-based newsvendor problem, in which a decision-maker has access to historical data consisting of demand observations and exogenous features. In this setting, we investigate feature selection, aiming to derive sparse,…

Machine Learning · Computer Science 2022-09-13 Breno Serrano , Stefan Minner , Maximilian Schiffer , Thibaut Vidal

We present PointAugment, a new auto-augmentation framework that automatically optimizes and augments point cloud samples to enrich the data diversity when we train a classification network. Different from existing auto-augmentation methods…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Ruihui Li , Xianzhi Li , Pheng-Ann Heng , Chi-Wing Fu

In this paper, we formulate the hyperparameter tuning problem in machine learning as a bilevel program. The bilevel program is solved using a micro genetic algorithm that is enhanced with a linear program. While the genetic algorithm…

Machine Learning · Computer Science 2024-07-02 Ankur Sinha , Paritosh Pankaj

Data augmentation (DA) has been widely utilized to improve generalization in training deep neural networks. Recently, human-designed data augmentation has been gradually replaced by automatically learned augmentation policy. Through finding…

Computer Vision and Pattern Recognition · Computer Science 2019-12-25 Xinyu Zhang , Qiang Wang , Jian Zhang , Zhao Zhong

Deep learning performs remarkably well on many time series analysis tasks recently. The superior performance of deep neural networks relies heavily on a large number of training data to avoid overfitting. However, the labeled data of many…

Machine Learning · Computer Science 2022-04-04 Qingsong Wen , Liang Sun , Fan Yang , Xiaomin Song , Jingkun Gao , Xue Wang , Huan Xu

While data augmentation (DA) is generally applied to input data, several studies have reported that applying DA to hidden layers in neural networks, i.e., feature augmentation, can improve performance. However, in previous studies, the…

Machine Learning · Computer Science 2024-08-27 Tomoumi Takase , Ryo Karakida

Deep learning models have a large number of free parameters that must be estimated by efficient training of the models on a large number of training data samples to increase their generalization performance. In real-world applications, the…

Computer Vision and Pattern Recognition · Computer Science 2018-02-15 Hojjat Salehinejad , Shahrokh Valaee , Timothy Dowdell , Joseph Barfett

In the field of computer vision, data augmentation is widely used to enrich the feature complexity of training datasets with deep learning techniques. However, regarding the generalization capabilities of models, the difference in…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Jianqiang Xiao , Weiwen Guo , Junfeng Liu , Mengze Li