English
Related papers

Related papers: BenchENAS: A Benchmarking Platform for Evolutionar…

200 papers

Automatic methods for generating state-of-the-art neural network architectures without human experts have generated significant attention recently. This is because of the potential to remove human experts from the design loop which can…

Machine Learning · Computer Science 2019-11-22 George Adam , Jonathan Lorraine

Neural Architecture Search (NAS) was first proposed to achieve state-of-the-art performance through the discovery of new architecture patterns, without human intervention. An over-reliance on expert knowledge in the search space design has…

Machine Learning · Computer Science 2021-01-05 Binxin Ru , Pedro Esperanca , Fabio Carlucci

Differentiable Architecture Search (DARTS) has received massive attention in recent years, mainly because it significantly reduces the computational cost through weight sharing and continuous relaxation. However, more recent works find that…

Machine Learning · Computer Science 2021-11-29 Miao Zhang , Jilin Hu , Steven Su , Shirui Pan , Xiaojun Chang , Bin Yang , Gholamreza Haffari

Recently, neural architecture search (NAS) has been applied to automate the design of neural networks in real-world applications. A large number of algorithms have been developed to improve the search cost or the performance of the final…

Machine Learning · Computer Science 2022-06-20 Yao Shu , Yizhou Chen , Zhongxiang Dai , Bryan Kian Hsiang Low

Neural architecture search (NAS) has been proposed to automatically tune deep neural networks, but existing search algorithms, e.g., NASNet, PNAS, usually suffer from expensive computational cost. Network morphism, which keeps the…

Machine Learning · Computer Science 2019-03-27 Haifeng Jin , Qingquan Song , Xia Hu

Deep Neural Networks (DNNs) have made significant improvements to reach the desired accuracy to be employed in a wide variety of Machine Learning (ML) applications. Recently the Google Brain's team demonstrated the ability of Capsule…

Machine Learning · Computer Science 2021-01-26 Alberto Marchisio , Andrea Massa , Vojtech Mrazek , Beatrice Bussolino , Maurizio Martina , Muhammad Shafique

Neural Architecture Search (NAS) has recently become a topic of great interest. However, there is a potentially impactful issue within NAS that remains largely unrecognized: noise. Due to stochastic factors in neural network initialization,…

Neural and Evolutionary Computing · Computer Science 2022-05-03 Arkadiy Dushatskiy , Tanja Alderliesten , Peter A. N. Bosman

Neural Architecture Search (NAS) has been widely studied for designing discriminative deep learning models such as image classification, object detection, and semantic segmentation. As a large number of priors have been obtained through the…

Computer Vision and Pattern Recognition · Computer Science 2019-06-07 Jie An , Haoyi Xiong , Jinwen Ma , Jiebo Luo , Jun Huan

Making models algorithmically fairer in tabular data has been long studied, with techniques typically oriented towards fixes which usually take a neural model with an undesirable outcome and make changes to how the data are ingested, what…

Machine Learning · Computer Science 2023-10-19 Richeek Das , Samuel Dooley

Recently, much attention has been spent on neural architecture search (NAS), aiming to outperform those manually-designed neural architectures on high-level vision recognition tasks. Inspired by the success, here we attempt to leverage NAS…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Haokui Zhang , Ying Li , Hao Chen , Chengrong Gong , Zongwen Bai , Chunhua Shen

Data-driven methods have made great progress in fault diagnosis, especially deep learning method. Deep learning is suitable for processing big data, and has a strong feature extraction ability to realize end-to-end fault diagnosis systems.…

Machine Learning · Computer Science 2020-02-20 Xudong Li , Yang Hu , Jianhua Zheng , Mingtao Li

Neural Architecture Search (NAS) is a powerful tool to automatically design deep neural networks for many tasks, including image classification. Due to the significant computational burden of the search phase, most NAS methods have focused…

We develop a Neural Architecture Search (NAS) framework for CycleGAN that carries out unpaired image-to-image translation task. Extending previous NAS techniques for Generative Adversarial Networks (GANs) to CycleGAN is not straightforward…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Taegun An , Changhee Joo

In the past decade, advances in deep learning have resulted in breakthroughs in a variety of areas, including computer vision, natural language understanding, speech recognition, and reinforcement learning. Specialized, high-performing…

Machine Learning · Computer Science 2023-01-26 Colin White , Mahmoud Safari , Rhea Sukthanker , Binxin Ru , Thomas Elsken , Arber Zela , Debadeepta Dey , Frank Hutter

The robustness of deep neural networks is usually lacking under adversarial examples, common corruptions, and distribution shifts, which becomes an important research problem in the development of deep learning. Although new deep learning…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Chang Liu , Yinpeng Dong , Wenzhao Xiang , Xiao Yang , Hang Su , Jun Zhu , Yuefeng Chen , Yuan He , Hui Xue , Shibao Zheng

Neural Architecture Search (NAS), aiming at automatically designing neural architectures by machines, has been considered a key step toward automatic machine learning. One notable NAS branch is the weight-sharing NAS, which significantly…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Guangrun Wang , Changlin Li , Liuchun Yuan , Jiefeng Peng , Xiaoyu Xian , Xiaodan Liang , Xiaojun Chang , Liang Lin

Neural architecture search (NAS) aims to automate architecture design processes and improve the performance of deep neural networks. Platform-aware NAS methods consider both performance and complexity and can find well-performing…

Neural and Evolutionary Computing · Computer Science 2022-07-22 Yuhei Noda , Shota Saito , Shinichi Shirakawa

The early pioneering Neural Architecture Search (NAS) works were multi-trial methods applicable to any general search space. The subsequent works took advantage of the early findings and developed weight-sharing methods that assume a…

Neural and Evolutionary Computing · Computer Science 2022-02-18 Hyunghun Cho , Jungwook Shin , Wonjong Rhee

Multi-task neural architecture search (NAS) enables transferring architectural knowledge among different tasks. However, ranking disorder between the source task and the target task degrades the architecture performance on the downstream…

Neural and Evolutionary Computing · Computer Science 2026-02-03 TingJie Zhang , HaiLin Liu

The ability to train Deep Neural Networks (DNNs) with constraints is instrumental in improving the fairness of modern machine-learning models. Many algorithms have been analysed in recent years, and yet there is no standard, widely accepted…

Machine Learning · Computer Science 2026-02-19 Andrii Kliachkin , Jana Lepšová , Gilles Bareilles , Jakub Mareček