English
Related papers

Related papers: Data augmentation and feature selection for automa…

200 papers

Besides serving as prediction models, classification trees are useful for finding important predictor variables and identifying interesting subgroups in the data. These functions can be compromised by weak split selection algorithms that…

Applications · Statistics 2010-11-03 Wei-Yin Loh

The paper aims to investigate relevant computational issues of deep neural network architectures with an eye to the interaction between the optimization algorithm and the classification performance. In particular, we aim to analyze the…

Optimization and Control · Mathematics 2024-05-06 Corrado Coppola , Lorenzo Papa , Marco Boresta , Irene Amerini , Laura Palagi

The popularity of data augmentation techniques in machine learning has increased in recent years, as they enable the creation of new samples from existing datasets. Rotational augmentation, in particular, has shown great promise by…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Unai Muñoz-Aseguinolaza , Basilio Sierra , Naiara Aginako

Data augmentation is a key element in training high-dimensional models. In this approach, one synthesizes new observations by applying pre-specified transformations to the original training data; e.g.~new images are formed by rotating old…

Computer Vision and Pattern Recognition · Computer Science 2016-07-01 Søren Hauberg , Oren Freifeld , Anders Boesen Lindbo Larsen , John W. Fisher , Lars Kai Hansen

Many real-world machine learning applications are characterized by a huge number of features, leading to computational and memory issues, as well as the risk of overfitting. Ideally, only relevant and non-redundant features should be…

Machine Learning · Computer Science 2023-06-21 Paolo Bonetti , Alberto Maria Metelli , Marcello Restelli

Dimensionality reduction is a topic of recent interest. In this paper, we present the classification constrained dimensionality reduction (CCDR) algorithm to account for label information. The algorithm can account for multiple classes as…

Machine Learning · Statistics 2009-09-29 Raviv Raich , Jose A. Costa , Steven B. Damelin , Alfred O. Hero

It is no secret amongst deep learning researchers that finding the optimal data augmentation strategy during training can mean the difference between state-of-the-art performance and a run-of-the-mill result. To that end, the community has…

Machine Learning · Computer Science 2023-07-17 Xiaomeng Dong , Michael Potter , Gaurav Kumar , Yun-Chan Tsai , V. Ratna Saripalli , Theodore Trafalis

Many machine learning applications such as in vision, biology and social networking deal with data in high dimensions. Feature selection is typically employed to select a subset of features which im- proves generalization accuracy as well…

Machine Learning · Computer Science 2016-06-15 Yamuna Prasad , Dinesh Khandelwal , K. K. Biswas

Algorithms for binary classification based on adaptive tree partitioning are formulated and analyzed for both their risk performance and their friendliness to numerical implementation. The algorithms can be viewed as generating a set…

Statistics Theory · Mathematics 2014-11-05 Peter Binev , Albert Cohen , Wolfgang Dahmen , Ronald DeVore

Stacking, a potent ensemble learning method, leverages a meta-model to harness the strengths of multiple base models, thereby enhancing prediction accuracy. Traditional stacking techniques typically utilize established learning models, such…

Machine Learning · Computer Science 2024-10-31 Wei Wu , Liang Tang , Zhongjie Zhao , Chung-Piaw Teo

Deep neural networks have been exhibiting splendid accuracies in many of visual pattern classification problems. Many of the state-of-the-art methods employ a technique known as data augmentation at the training stage. This paper addresses…

Computer Vision and Pattern Recognition · Computer Science 2015-05-14 Ikuro Sato , Hiroki Nishimura , Kensuke Yokoi

Feature selection plays a crucial role in improving predictive accuracy by identifying relevant features while filtering out irrelevant ones. This study investigates the importance of effective feature selection in enhancing the performance…

Machine Learning · Computer Science 2024-03-12 Younes Ghazagh Jahed , Seyyed Ali Sadat Tavana

Data augmentation is a ubiquitous technique for increasing the size of labeled training sets by leveraging task-specific data transformations that preserve class labels. While it is often easy for domain experts to specify individual…

Machine Learning · Statistics 2018-12-10 Alexander J. Ratner , Henry R. Ehrenberg , Zeshan Hussain , Jared Dunnmon , Christopher Ré

Neural networks have become popular in many fields of science since they serve as promising, reliable and powerful tools. In this work, we study the effect of data augmentation on the predictive power of neural network models for nuclear…

Machine Learning · Computer Science 2022-09-29 Hüseyin Bahtiyar , Derya Soydaner , Esra Yüksel

Deep learning (DL) algorithms have shown significant performance in various computer vision tasks. However, having limited labelled data lead to a network overfitting problem, where network performance is bad on unseen data as compared to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Teerath Kumar , Alessandra Mileo , Rob Brennan , Malika Bendechache

Deep neural networks have emerged as very successful tools for image restoration and reconstruction tasks. These networks are often trained end-to-end to directly reconstruct an image from a noisy or corrupted measurement of that image. To…

Image and Video Processing · Electrical Eng. & Systems 2021-06-30 Zalan Fabian , Reinhard Heckel , Mahdi Soltanolkotabi

Dynamic data selection aims to accelerate training with lossless performance. However, reducing training data inherently limits data diversity, potentially hindering generalization. While data augmentation is widely used to enhance…

Machine Learning · Computer Science 2025-05-13 Suorong Yang , Peng Ye , Furao Shen , Dongzhan Zhou

Data augmentation is a cornerstone of the machine learning pipeline, yet its theoretical underpinnings remain unclear. Is it merely a way to artificially augment the data set size? Or is it about encouraging the model to satisfy certain…

Machine Learning · Computer Science 2022-09-22 Ruoqi Shen , Sébastien Bubeck , Suriya Gunasekar

Data augmentation policies drastically improve the performance of image recognition tasks, especially when the policies are optimized for the target data and tasks. In this paper, we propose to optimize image recognition models and data…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Ryuichiro Hataya , Jan Zdenek , Kazuki Yoshizoe , Hideki Nakayama

Determining the most appropriate features for machine learning predictive models is challenging regarding performance and feature acquisition costs. In particular, global feature choice is limited given that some features will only benefit…

Machine Learning · Computer Science 2026-03-17 Gabriel Bernardino , Anders Jonsson , Patrick Clarysse , Nicolas Duchateau