English
Related papers

Related papers: MAE-DET: Revisiting Maximum Entropy Principle in Z…

200 papers

Deep learning has revolutionized computer vision, but it achieved its tremendous success using deep network architectures which are mostly hand-crafted and therefore likely suboptimal. Neural Architecture Search (NAS) aims to bridge this…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Ondřej Týbl , Lukáš Neumann

Neural architecture search (NAS) is gaining more and more attention in recent years due to its flexibility and remarkable capability to reduce the burden of neural network design. To achieve better performance, however, the searching…

Machine Learning · Computer Science 2022-05-23 Yijun Bian , Qingquan Song , Mengnan Du , Jun Yao , Huanhuan Chen , Xia Hu

The goals of this research were to search for Convolutional Neural Network (CNN) architectures, suitable for an on-device processor with limited computing resources, performing at substantially lower Network Architecture Search (NAS) costs.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Chakkrit Termritthikun , Yeshi Jamtsho , Jirarat Ieamsaard , Paisarn Muneesawang , Ivan Lee

Neural architecture search (NAS) has shown great promise in designing state-of-the-art (SOTA) models that are both accurate and efficient. Recently, two-stage NAS, e.g. BigNAS, decouples the model training and searching process and achieves…

Computer Vision and Pattern Recognition · Computer Science 2021-04-15 Dilin Wang , Meng Li , Chengyue Gong , Vikas Chandra

Modern applications such as autonomous vehicles, intelligent surveillance, and smart city systems increasingly require object detection on resource-constrained edge devices. Yet, there is still limited understanding of how different object…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Daghash K. Alqahtani , Muhammad Aamir Cheema , Maria A. Rodriguez , Adel N. Toosi

One-shot neural architecture search (NAS) methods significantly reduce the search cost by considering the whole search space as one network, which only needs to be trained once. However, current methods select each operation independently…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Xiu Su , Tao Huang , Yanxi Li , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Chang Xu

Training a supernet matters for one-shot neural architecture search (NAS) methods since it serves as a basic performance estimator for different architectures (paths). Current methods mainly hold the assumption that a supernet should give a…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Shan You , Tao Huang , Mingmin Yang , Fei Wang , Chen Qian , Changshui Zhang

Optimizing resource utilization in target platforms is key to achieving high performance during DNN inference. While optimizations have been proposed for inference latency, memory footprint, and energy consumption, prior hardware-aware…

Machine Learning · Computer Science 2022-03-24 Ahmet Caner Yüzügüler , Nikolaos Dimitriadis , Pascal Frossard

Neural Architecture Search (NAS) has been widely adopted to design accurate and efficient image classification models. However, applying NAS to a new computer vision task still requires a huge amount of effort. This is because 1) previous…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Bichen Wu , Chaojian Li , Hang Zhang , Xiaoliang Dai , Peizhao Zhang , Matthew Yu , Jialiang Wang , Yingyan Celine Lin , Peter Vajda

Neural Architecture Search (NAS) is emerging as a new research direction which has the potential to replace the hand-crafted neural architectures designed for specific tasks. Previous evolution based architecture search requires high…

Neural and Evolutionary Computing · Computer Science 2020-12-24 Nilotpal Sinha , Kuan-Wen Chen

Novelty search (NS) refers to a class of exploration algorithms that seek to uncover diverse system behaviors through simulations or experiments. Such diversity is central to many AI-driven discovery and design tasks, including material and…

Machine Learning · Statistics 2025-07-31 Wei-Ting Tang , Ankush Chakrabarty , Joel A. Paulson

Neural architecture search (NAS) has recently reshaped our understanding on various vision tasks. Similar to the success of NAS in high-level vision tasks, it is possible to find a memory and computationally efficient solution via NAS with…

Image and Video Processing · Electrical Eng. & Systems 2021-04-07 Qian Ning , Weisheng Dong , Xin Li , Jinjian Wu , Leida Li , Guangming Shi

The allocation of computation resources in the backbone is a crucial issue in object detection. However, classification allocation pattern is usually adopted directly to object detector, which is proved to be sub-optimal. In order to…

Computer Vision and Pattern Recognition · Computer Science 2019-12-25 Feng Liang , Chen Lin , Ronghao Guo , Ming Sun , Wei Wu , Junjie Yan , Wanli Ouyang

Improving the efficiency of Neural Architecture Search (NAS) is a challenging but significant task that has received much attention. Previous works mainly adopted the Differentiable Architecture Search (DARTS) and improved its search…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Chongjun Tu , Peng Ye , Weihao Lin , Hancheng Ye , Chong Yu , Tao Chen , Baopu Li , Wanli Ouyang

Neural Architecture Search (NAS) has emerged as one of the effective methods to design the optimal neural network architecture automatically. Although neural architectures have achieved human-level performances in several tasks, few of them…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Caiyang Yu , Xianggen Liu , Yifan Wang , Yun Liu , Wentao Feng , Deng Xiong , Chenwei Tang , Jiancheng Lv

Network Architecture Search (NAS) methods have recently gathered much attention. They design networks with better performance and use a much shorter search time compared to traditional manual tuning. Despite their efficiency in model…

Machine Learning · Computer Science 2021-09-13 Yiren Zhao , Xitong Gao , Ilia Shumailov , Nicolo Fusi , Robert Mullins

Neural Architecture Search (NAS) automates and prospers the design of neural networks. Estimator-based NAS has been proposed recently to model the relationship between architectures and their performance to enable scalable and flexible…

Artificial Intelligence · Computer Science 2020-09-29 Hsin-Pai Cheng , Tunhou Zhang , Yixing Zhang , Shiyu Li , Feng Liang , Feng Yan , Meng Li , Vikas Chandra , Hai Li , Yiran Chen

Can we automatically design a Convolutional Network (ConvNet) with the highest image classification accuracy under the latency constraint of a mobile device? Neural Architecture Search (NAS) for ConvNet design is a challenging problem due…

Machine Learning · Computer Science 2019-05-13 Dimitrios Stamoulis , Ruizhou Ding , Di Wang , Dimitrios Lymberopoulos , Bodhi Priyantha , Jie Liu , Diana Marculescu

Neural structure search (NAS), as the mainstream approach to automate deep neural architecture design, has achieved much success in recent years. However, the performance estimation component adhering to NAS is often prohibitively costly,…

Machine Learning · Computer Science 2022-04-27 Zixuan Liang , Yanan Sun

Neural architecture search (NAS) has dramatically advanced the development of neural network design. We revisit the search space design in most previous NAS methods and find the number and widths of blocks are set manually. However, block…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Jiemin Fang , Yuzhu Sun , Qian Zhang , Yuan Li , Wenyu Liu , Xinggang Wang