中文
相关论文

相关论文: GPNAS: A Neural Network Architecture Search Framew…

200 篇论文

While neural architecture search (NAS) has enabled automated machine learning (AutoML) for well-researched areas, its application to tasks beyond computer vision is still under-explored. As less-studied domains are precisely those where we…

机器学习 · 计算机科学 2022-10-11 Junhong Shen , Mikhail Khodak , Ameet Talwalkar

Hardware-Aware Neural Architecture Search (HW-NAS) is an efficient approach to automatically co-optimizing neural network performance and hardware energy efficiency, making it particularly useful for the development of Deep Neural Network…

机器学习 · 计算机科学 2025-08-04 Yinhui Ma , Tomomasa Yamasaki , Zhehui Wang , Tao Luo , Bo Wang

This work targets designing a principled and unified training-free framework for Neural Architecture Search (NAS), with high performance, low cost, and in-depth interpretation. NAS has been explosively studied to automate the discovery of…

机器学习 · 计算机科学 2023-01-02 Wuyang Chen , Xinyu Gong , Junru Wu , Yunchao Wei , Humphrey Shi , Zhicheng Yan , Yi Yang , Zhangyang Wang

To search an optimal sub-network within a general deep neural network (DNN), existing neural architecture search (NAS) methods typically rely on handcrafting a search space beforehand. Such requirements make it challenging to extend them…

机器学习 · 计算机科学 2023-10-09 Tianyi Chen , Luming Liang , Tianyu Ding , Ilya Zharkov

Developing neural models that accurately understand objects in 3D point clouds is essential for the success of robotics and autonomous driving. However, arguably due to the higher-dimensional nature of the data (as compared to images),…

计算机视觉与模式识别 · 计算机科学 2022-10-12 Chenxi Liu , Zhaoqi Leng , Pei Sun , Shuyang Cheng , Charles R. Qi , Yin Zhou , Mingxing Tan , Dragomir Anguelov

Neural Architecture Search (NAS) has recently gained increased attention, as a class of approaches that automatically searches in an input space of network architectures. A crucial part of the NAS pipeline is the encoding of the…

机器学习 · 计算机科学 2021-08-18 Michail Chatzianastasis , George Dasoulas , Georgios Siolas , Michalis Vazirgiannis

Neural architecture search (NAS) aims to automatically design deep neural networks of satisfactory performance. Wherein, architecture performance predictor is critical to efficiently value an intermediate neural architecture. But for the…

计算机视觉与模式识别 · 计算机科学 2020-10-16 Yehui Tang , Yunhe Wang , Yixing Xu , Hanting Chen , Chunjing Xu , Boxin Shi , Chao Xu , Qi Tian , Chang Xu

Deep learning methods have become very successful at solving many complex tasks such as image classification and segmentation, speech recognition and machine translation. Nevertheless, manually designing a neural network for a specific…

计算机视觉与模式识别 · 计算机科学 2020-11-10 Maria Baldeon Calisto , Susana Lai-Yuen

Monumental advances in deep learning have led to unprecedented achievements across various domains. While the performance of deep neural networks is indubitable, the architectural design and interpretability of such models are nontrivial.…

机器学习 · 计算机科学 2023-07-06 Zachariah Carmichael , Tim Moon , Sam Ade Jacobs

Neural Architecture Search (NAS) often trains and evaluates a large number of architectures. Recent predictor-based NAS approaches attempt to alleviate such heavy computation costs with two key steps: sampling some architecture-performance…

机器学习 · 计算机科学 2021-11-04 Junru Wu , Xiyang Dai , Dongdong Chen , Yinpeng Chen , Mengchen Liu , Ye Yu , Zhangyang Wang , Zicheng Liu , Mei Chen , Lu Yuan

Neural Architecture Search (NAS) can automatically design well-performed architectures of Deep Neural Networks (DNNs) for the tasks at hand. However, one bottleneck of NAS is the prohibitively computational cost largely due to the expensive…

机器学习 · 计算机科学 2021-07-29 Yuqiao Liu , Yehui Tang , Yanan Sun

Differentiable Neural Architecture Search is one of the most popular Neural Architecture Search (NAS) methods for its search efficiency and simplicity, accomplished by jointly optimizing the model weight and architecture parameters in a…

机器学习 · 计算机科学 2021-08-11 Ruochen Wang , Minhao Cheng , Xiangning Chen , Xiaocheng Tang , Cho-Jui Hsieh

Neural Architecture Search (NAS) aims to automatically find effective architectures within a predefined search space. However, the search space is often extremely large. As a result, directly searching in such a large search space is…

计算机视觉与模式识别 · 计算机科学 2024-06-07 Yaofo Chen , Yong Guo , Daihai Liao , Fanbing Lv , Hengjie Song , James Tin-Yau Kwok , Mingkui Tan

Benefiting from the search efficiency, differentiable neural architecture search (NAS) has evolved as the most dominant alternative to automatically design competitive deep neural networks (DNNs). We note that DNNs must be executed under…

机器学习 · 计算机科学 2022-09-01 Xiangzhong Luo , Di Liu , Hao Kong , Shuo Huai , Hui Chen , Weichen Liu

It is of great significance to estimate the performance of a given model architecture without training in the application of Neural Architecture Search (NAS) as it may take a lot of time to evaluate the performance of an architecture. In…

机器学习 · 计算机科学 2023-01-24 Kunlong Chen , Liu Yang , Yitian Chen , Kunjin Chen , Yidan Xu , Lujun Li

This paper studies the neural architecture search (NAS) problem for developing efficient generator networks. Compared with deep models for visual recognition tasks, generative adversarial network (GAN) are usually designed to conduct…

计算机视觉与模式识别 · 计算机科学 2021-04-20 Jiahao Wang , Han Shu , Weihao Xia , Yujiu Yang , Yunhe Wang

Neural Architectures Search (NAS) becomes more and more popular over these years. However, NAS-generated models tends to suffer greater vulnerability to various malicious attacks. Lots of robust NAS methods leverage adversarial training to…

机器学习 · 计算机科学 2023-04-11 Xunyu Zhu , Jian Li , Yong Liu , Weiping Wang

Neural architecture search (NAS) has shown promising results discovering models that are both accurate and fast. For NAS, training a one-shot model has become a popular strategy to rank the relative quality of different architectures (child…

计算机视觉与模式识别 · 计算机科学 2020-07-20 Jiahui Yu , Pengchong Jin , Hanxiao Liu , Gabriel Bender , Pieter-Jan Kindermans , Mingxing Tan , Thomas Huang , Xiaodan Song , Ruoming Pang , Quoc Le

Aiming at two molecular graph datasets and one protein association subgraph dataset in OGB graph classification task, we design a graph neural network framework for graph classification task by introducing PAS(Pooling Architecture Search).…

机器学习 · 计算机科学 2022-07-14 Xu Wang , Huan Zhao , Lanning Wei , Quanming Yao

Search space design is very critical to neural architecture search (NAS) algorithms. We propose a fine-grained search space comprised of atomic blocks, a minimal search unit that is much smaller than the ones used in recent NAS algorithms.…

计算机视觉与模式识别 · 计算机科学 2020-02-25 Jieru Mei , Yingwei Li , Xiaochen Lian , Xiaojie Jin , Linjie Yang , Alan Yuille , Jianchao Yang