English
Related papers

Related papers: DHA: End-to-End Joint Optimization of Data Augment…

200 papers

Deep Learning models have experienced exponential growth in complexity and resource demands in recent years. Accelerating these models for efficient execution on resource-constrained devices has become more crucial than ever. Two notable…

Machine Learning · Computer Science 2024-08-09 Inas Bachiri , Hadjer Benmeziane , Smail Niar , Riyadh Baghdadi , Hamza Ouarnoughi , Abdelkrime Aries

Automated data augmentation, which aims at engineering augmentation policy automatically, recently draw a growing research interest. Many previous auto-augmentation methods utilized a Density Matching strategy by evaluating policies in…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Jianwei Zhang , Dong Li , Lituan Wang , Lei Zhang

Designing complex architectures has been an essential cogwheel in the revolution deep learning has brought about in the past decade. When solving difficult problems in a datadriven manner, a well-tried approach is to take an architecture…

Machine Learning · Computer Science 2021-10-14 Attila Nagy , Ábel Boros

Automated machine learning (AutoML) has seen a resurgence in interest with the boom of deep learning over the past decade. In particular, Neural Architecture Search (NAS) has seen significant attention throughout the AutoML research…

Neural and Evolutionary Computing · Computer Science 2020-09-23 Min Shi , David A. Wilson , Xingquan Zhu , Yu Huang , Yuan Zhuang , Jianxun Liu , Yufei Tang

Deep Learning (DL) has advanced various fields by extracting complex patterns from large datasets. However, the computational demands of DL models pose environmental and resource challenges. Deep shift neural networks (DSNNs) offer a…

Machine Learning · Computer Science 2024-04-05 Leona Hennig , Tanja Tornede , Marius Lindauer

Deep learning (DL) models have gained prominence in domains such as computer vision and natural language processing but remain underutilized for regression tasks involving tabular data. In these cases, traditional machine learning (ML)…

Machine Learning · Computer Science 2025-01-08 Assaf Shmuel , Oren Glickman , Teddy Lazebnik

Data augmentation (DA) is widely employed to improve the generalization performance of deep models. However, most existing DA methods employ augmentation operations with fixed or random magnitudes throughout the training process. While this…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Suorong Yang , Peijia Li , Xin Xiong , Furao Shen , Jian Zhao

Neural Architecture Search (NAS) is a collection of methods to craft the way neural networks are built. Current NAS methods are far from ab initio and automatic, as they use manual backbone architectures or micro building blocks (cells),…

Machine Learning · Computer Science 2020-10-20 Anubhav Garg , Amit Kumar Saha , Debo Dutta

Developing high-performing predictive models for large tabular data sets is a challenging task. The state-of-the-art methods are based on expert-developed model ensembles from different supervised learning methods. Recently, automated…

Machine Learning · Computer Science 2021-10-27 Romain Egele , Prasanna Balaprakash , Venkatram Vishwanath , Isabelle Guyon , Zhengying Liu

Data augmentation is arguably the most important regularization technique commonly used to improve generalization performance of machine learning models. It primarily involves the application of appropriate data transformation operations to…

Machine Learning · Computer Science 2025-03-07 Alhassan Mumuni , Fuseini Mumuni

Automatic machine learning (\AML) is a family of techniques to automate the process of training predictive models, aiming to both improve performance and make machine learning more accessible. While many recent works have focused on aspects…

Machine Learning · Computer Science 2020-03-24 Nadiia Chepurko , Ryan Marcus , Emanuel Zgraggen , Raul Castro Fernandez , Tim Kraska , David Karger

While existing work on neural architecture search (NAS) tunes hyperparameters in a separate post-processing step, we demonstrate that architectural choices and other hyperparameter settings interact in a way that can render this separation…

Machine Learning · Computer Science 2018-07-19 Arber Zela , Aaron Klein , Stefan Falkner , Frank Hutter

As we advance in the fast-growing era of Machine Learning, various new and more complex neural architectures are arising to tackle problem more efficiently. On the one hand their efficient usage requires advanced knowledge and expertise,…

Machine Learning · Computer Science 2023-10-30 Léo Pouy , Fouad Khenfri , Patrick Leserf , Chokri Mraidha , Cherif Larouci

As a result of the ever increasing complexity of configuring and fine-tuning machine learning models, the field of automated machine learning (AutoML) has emerged over the past decade. However, software implementations like Auto-WEKA and…

Machine Learning · Computer Science 2022-11-09 Dimitrios Iliadis , Marcel Wever , Bernard De Baets , Willem Waegeman

Automated Machine Learning (AutoML) is an important industrial solution for automatic discovery and deployment of the machine learning models. However, designing an integrated AutoML system faces four great challenges of configurability,…

Data augmentation (DA) has been widely utilized to improve generalization in training deep neural networks. Recently, human-designed data augmentation has been gradually replaced by automatically learned augmentation policy. Through finding…

Computer Vision and Pattern Recognition · Computer Science 2019-12-25 Xinyu Zhang , Qiang Wang , Jian Zhang , Zhao Zhong

In class-incremental learning, a model learns continuously from a sequential data stream in which new classes occur. Existing methods often rely on static architectures that are manually crafted. These methods can be prone to capacity…

Machine Learning · Computer Science 2019-09-17 Shenyang Huang , Vincent François-Lavet , Guillaume Rabusseau

This paper proposes Deep Hyperalignment (DHA) as a regularized, deep extension, scalable Hyperalignment (HA) method, which is well-suited for applying functional alignment to fMRI datasets with nonlinearity, high-dimensionality (broad ROI),…

Neurons and Cognition · Quantitative Biology 2017-10-12 Muhammad Yousefnezhad , Daoqiang Zhang

Designing suitable deep model architectures, for AI-driven on-device apps and features, at par with rapidly evolving mobile hardware and increasingly complex target scenarios is a difficult task. Though Neural Architecture Search…

Machine Learning · Computer Science 2022-03-30 Mayukh Das , Brijraj Singh , Harsh Kanti Chheda , Pawan Sharma , Pradeep NS

Deep learning methods have been successful in solving tasks in machine learning and have made breakthroughs in many sectors owing to their ability to automatically extract features from unstructured data. However, their performance relies…

Machine Learning · Computer Science 2022-03-18 Viet-Khoa Vo-Ho , Kashu Yamazaki , Hieu Hoang , Minh-Triet Tran , Ngan Le