English
Related papers

Related papers: NSGANetV2: Evolutionary Multi-Objective Surrogate-…

200 papers

Neural Architecture Search (NAS) has been widely adopted to design accurate and efficient image classification models. However, applying NAS to a new computer vision task still requires a huge amount of effort. This is because 1) previous…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Bichen Wu , Chaojian Li , Hang Zhang , Xiaoliang Dai , Peizhao Zhang , Matthew Yu , Jialiang Wang , Yingyan Celine Lin , Peter Vajda

Many hardware-aware neural architecture search (NAS) methods have been developed to optimize the topology of neural networks (NN) with the joint objectives of higher accuracy and lower latency. Recently, both accuracy and latency predictors…

Machine Learning · Computer Science 2023-06-06 Yash Akhauri , Mohamed S. Abdelfattah

Neural Architecture Search (NAS) is quickly becoming the go-to approach to optimize the structure of Deep Learning (DL) models for complex tasks such as Image Classification or Object Detection. However, many other relevant applications of…

Efficient deployment of neural networks (NN) requires the co-optimization of accuracy and latency. For example, hardware-aware neural architecture search has been used to automatically find NN architectures that satisfy a latency constraint…

Machine Learning · Computer Science 2024-03-06 Yash Akhauri , Mohamed S. Abdelfattah

The rise of deep neural networks offers new opportunities in optimizing recommender systems. However, optimizing recommender systems using deep neural networks requires delicate architecture fabrication. We propose NASRec, a paradigm that…

Information Retrieval · Computer Science 2024-01-17 Tunhou Zhang , Dehua Cheng , Yuchen He , Zhengxing Chen , Xiaoliang Dai , Liang Xiong , Feng Yan , Hai Li , Yiran Chen , Wei Wen

Modern convolutional networks such as ResNet and NASNet have achieved state-of-the-art results in many computer vision applications. These architectures consist of stages, which are sets of layers that operate on representations in the same…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Artur Jordao , Fernando Akio , Maiko Lie , William Robson Schwartz

Recent years have witnessed the popularity of Graph Neural Networks (GNN) in various scenarios. To obtain optimal data-specific GNN architectures, researchers turn to neural architecture search (NAS) methods, which have made impressive…

Machine Learning · Computer Science 2020-09-08 Huan Zhao , Lanning Wei , Quanming Yao

Spiking Neural Networks (SNNs) have gained huge attention as a potential energy-efficient alternative to conventional Artificial Neural Networks (ANNs) due to their inherent high-sparsity activation. However, most prior SNN methods use…

Neural and Evolutionary Computing · Computer Science 2022-07-22 Youngeun Kim , Yuhang Li , Hyoungseob Park , Yeshwanth Venkatesha , Priyadarshini Panda

Recently proposed neural architecture search (NAS) algorithms adopt neural predictors to accelerate the architecture search. The capability of neural predictors to accurately predict the performance metrics of neural architecture is…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Chen Wei , Yiping Tang , Chuang Niu , Haihong Hu , Yue Wang , Jimin Liang

Neural Architecture Search (NAS) has shown great potentials in finding better neural network designs. Sample-based NAS is the most reliable approach which aims at exploring the search space and evaluating the most promising architectures.…

Machine Learning · Computer Science 2020-11-26 Han Shi , Renjie Pi , Hang Xu , Zhenguo Li , James T. Kwok , Tong Zhang

One-Shot Neural architecture search (NAS) attracts broad attention recently due to its capacity to reduce the computational hours through weight sharing. However, extensive experiments on several recent works show that there is no positive…

Machine Learning · Computer Science 2019-07-23 Miao Zhang , Huiqi Li , Shirui Pan , Taoping Liu , Steven Su

Differentiable Neural Architecture Search (DNAS) has demonstrated great success in designing state-of-the-art, efficient neural networks. However, DARTS-based DNAS's search space is small when compared to other search methods', since all…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Alvin Wan , Xiaoliang Dai , Peizhao Zhang , Zijian He , Yuandong Tian , Saining Xie , Bichen Wu , Matthew Yu , Tao Xu , Kan Chen , Peter Vajda , Joseph E. Gonzalez

Recently, Neural Architecture Search has achieved great success in large-scale image classification. In contrast, there have been limited works focusing on architecture search for object detection, mainly because the costly ImageNet…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Junran Peng , Ming Sun , Zhaoxiang Zhang , Tieniu Tan , Junjie Yan

Neural architecture search (NAS) has shown great promise in designing state-of-the-art (SOTA) models that are both accurate and efficient. Recently, two-stage NAS, e.g. BigNAS, decouples the model training and searching process and achieves…

Computer Vision and Pattern Recognition · Computer Science 2021-04-15 Dilin Wang , Meng Li , Chengyue Gong , Vikas Chandra

Neural network architectures found by sophistic search algorithms achieve strikingly good test performance, surpassing most human-crafted network models by significant margins. Although computationally efficient, their design is often very…

Machine Learning · Computer Science 2021-04-23 Kevin Alexander Laube , Andreas Zell

Chemical plant design and optimisation have proven challenging due to the complexity of these real-world systems. The resulting complexity translates into high computational costs for these systems' mathematical formulations and simulation…

Neural and Evolutionary Computing · Computer Science 2022-04-28 Liezl Stander , Matthew Woolway , Terence L. Van Zyl

Recent advances in adversarial attacks show the vulnerability of deep neural networks searched by Neural Architecture Search (NAS). Although NAS methods can find network architectures with the state-of-the-art performance, the adversarial…

Machine Learning · Computer Science 2020-11-20 Zhixiong Yue , Baijiong Lin , Xiaonan Huang , Yu Zhang

Network architecture search (NAS) achieves state-of-the-art results in various tasks such as classification and semantic segmentation. Recently, a reinforcement learning-based approach has been proposed for Generative Adversarial Networks…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Sivan Doveh , Raja Giryes

Neural architecture search (NAS) automatically finds the best task-specific neural network topology, outperforming many manual architecture designs. However, it can be prohibitively expensive as the search requires training thousands of…

Machine Learning · Computer Science 2020-12-21 Chris Zhang , Mengye Ren , Raquel Urtasun

Deep neural networks have been found vulnerable to adversarial attacks, thus raising potentially concerns in security-sensitive contexts. To address this problem, recent research has investigated the adversarial robustness of deep neural…

Machine Learning · Computer Science 2022-07-13 Jia Liu , Ran Cheng , Yaochu Jin