English
Related papers

Related papers: NSGANetV2: Evolutionary Multi-Objective Surrogate-…

200 papers

Neural Architecture Search (NAS), i.e., the automation of neural network design, has gained much popularity in recent years with increasingly complex search algorithms being proposed. Yet, solid comparisons with simple baselines are often…

Neural and Evolutionary Computing · Computer Science 2020-07-28 T. Den Ottelander , A. Dushatskiy , M. Virgolin , P. A. N. Bosman

We propose to incorporate neural architecture search (NAS) into general-purpose multi-task learning (GP-MTL). Existing NAS methods typically define different search spaces according to different tasks. In order to adapt to different task…

Machine Learning · Computer Science 2020-04-01 Yuan Gao , Haoping Bai , Zequn Jie , Jiayi Ma , Kui Jia , Wei Liu

Designing convolutional neural networks (CNN) for mobile devices is challenging because mobile models need to be small and fast, yet still accurate. Although significant efforts have been dedicated to design and improve mobile CNNs on all…

Computer Vision and Pattern Recognition · Computer Science 2019-05-30 Mingxing Tan , Bo Chen , Ruoming Pang , Vijay Vasudevan , Mark Sandler , Andrew Howard , Quoc V. Le

Recent works have highlighted the strength of the Transformer architecture on sequence tasks while, at the same time, neural architecture search (NAS) has begun to outperform human-designed models. Our goal is to apply NAS to search for a…

Machine Learning · Computer Science 2019-05-21 David R. So , Chen Liang , Quoc V. Le

Neural Architecture Search (NAS) has shown promising performance in the automatic design of vision transformers (ViT) exceeding 1G FLOPs. However, designing lightweight and low-latency ViT models for diverse mobile devices remains a big…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Chen Tang , Li Lyna Zhang , Huiqiang Jiang , Jiahang Xu , Ting Cao , Quanlu Zhang , Yuqing Yang , Zhi Wang , Mao Yang

As urban environments grow, the modelling of transportation systems becomes increasingly complex. This paper advances the field of travel demand modelling by introducing advanced Graph Neural Network (GNN) architectures as surrogate models,…

Machine Learning · Computer Science 2025-03-21 Nikita Makarov , Santhanakrishnan Narayanan , Constantinos Antoniou

Accurate classification of medical images is essential for modern diagnostics. Deep learning advancements led clinicians to increasingly use sophisticated models to make faster and more accurate decisions, sometimes replacing human…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Lunchen Xie , Eugenio Lomurno , Matteo Gambella , Danilo Ardagna , Manuel Roveri , Matteo Matteucci , Qingjiang Shi

Fabricating neural models for a wide range of mobile devices demands for a specific design of networks due to highly constrained resources. Both evolution algorithms (EA) and reinforced learning methods (RL) have been dedicated to solve…

Neural and Evolutionary Computing · Computer Science 2019-01-17 Xiangxiang Chu , Bo Zhang , Ruijun Xu , Hailong Ma

This paper proposes a novel cell-based neural architecture search algorithm (NAS), which completely alleviates the expensive costs of data labeling inherited from supervised learning. Our algorithm capitalizes on the effectiveness of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Nam Nguyen , J. Morris Chang

Neural Architecture Search has achieved state-of-the-art performance in a variety of tasks, out-performing human-designed networks. However, many assumptions, that require human definition, related with the problems being solved or the…

Machine Learning · Computer Science 2020-08-03 Vasco Lopes , Luís A. Alexandre

Machine learning and artificial neural networks (ANNs) have increasingly become integral to data analysis research in astrophysics due to the growing demand for fast calculations resulting from the abundance of observational data.…

General Relativity and Quantum Cosmology · Physics 2023-09-11 Ioannis Liodis , Evaggelos Smirniotis , Nikolaos Stergioulas

Neural Architecture Search (NAS) automates the design of high-performing neural networks but typically targets a single predefined task, thereby restricting its real-world applicability. To address this, Meta Neural Architecture Search…

Machine Learning · Computer Science 2025-08-14 Zijun Sun , Yanning Shen

The emergence of neural architecture search (NAS) has greatly advanced the research on network design. Recent proposals such as gradient-based methods or one-shot approaches significantly boost the efficiency of NAS. In this paper, we…

Machine Learning · Computer Science 2019-12-09 Yizhou Zhou , Xiaoyan Sun , Chong Luo , Zheng-Jun Zha , Wenjun Zeng

Neural Architecture Search (NAS) is an exciting new field which promises to be as much as a game-changer as Convolutional Neural Networks were in 2012. Despite many great works leading to substantial improvements on a variety of tasks,…

Machine Learning · Computer Science 2020-02-17 Antoine Yang , Pedro M. Esperança , Fabio M. Carlucci

Neural network-based semantic segmentation has achieved remarkable results when large amounts of annotated data are available, that is, in the supervised case. However, such data is expensive to collect and so methods have been developed to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-25 Xueqing Deng , Yi Zhu , Yuxin Tian , Shawn Newsam

Customizing Convolution Neural Networks (CNN) for production use has been a challenging task for DL practitioners. This paper intends to expedite the model customization with a model hub that contains the optimized models tiered by their…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Linnan Wang , Chenhan Yu , Satish Salian , Slawomir Kierat , Szymon Migacz , Alex Fit Florea

Neural Architecture Search (NAS) automates and prospers the design of neural networks. Estimator-based NAS has been proposed recently to model the relationship between architectures and their performance to enable scalable and flexible…

Artificial Intelligence · Computer Science 2020-09-29 Hsin-Pai Cheng , Tunhou Zhang , Yixing Zhang , Shiyu Li , Feng Liang , Feng Yan , Meng Li , Vikas Chandra , Hai Li , Yiran Chen

Deep learning has become in recent years a cornerstone tool fueling key innovations in the industry, such as autonomous driving. To attain good performances, the neural network architecture used for a given application must be chosen with…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Anthony Cazasnoves , Pierre-Antoine Ganaye , Kévin Sanchis , Tugdual Ceillier

The renaissance of neural architecture search (NAS) has seen classical methods such as genetic algorithms (GA) and genetic programming (GP) being exploited for convolutional neural network (CNN) architectures. While recent work have…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Clifford Broni-Bediako , Yuki Murata , Luiz Henrique Mormille , Masayasu Atsumi

While early research in neural architecture search (NAS) required extreme computational resources, the recent releases of tabular and surrogate benchmarks have greatly increased the speed and reproducibility of NAS research. However, two of…

Machine Learning · Computer Science 2021-11-08 Shen Yan , Colin White , Yash Savani , Frank Hutter