中文
相关论文

相关论文: Delta-NAS: Difference of Architecture Encoding for…

200 篇论文

Practical use of neural networks often involves requirements on latency, energy and memory among others. A popular approach to find networks under such requirements is through constrained Neural Architecture Search (NAS). However, previous…

机器学习 · 计算机科学 2022-04-28 Niv Nayman , Yonathan Aflalo , Asaf Noy , Rong Jin , Lihi Zelnik-Manor

Neural Architecture Search (NAS) was first proposed to achieve state-of-the-art performance through the discovery of new architecture patterns, without human intervention. An over-reliance on expert knowledge in the search space design has…

机器学习 · 计算机科学 2021-01-05 Binxin Ru , Pedro Esperanca , Fabio Carlucci

While neural architecture search (NAS) has enabled automated machine learning (AutoML) for well-researched areas, its application to tasks beyond computer vision is still under-explored. As less-studied domains are precisely those where we…

机器学习 · 计算机科学 2022-10-11 Junhong Shen , Mikhail Khodak , Ameet Talwalkar

Neural architecture search (NAS) has become increasingly popular in the deep learning community recently, mainly because it can provide an opportunity to allow interested users without rich expertise to benefit from the success of deep…

机器学习 · 计算机科学 2022-10-25 Shiqing Liu , Haoyu Zhang , Yaochu Jin

Recently, Neural Architecture Search (NAS) methods are introduced and show impressive performance on many benchmarks. Among those NAS studies, Neural Architecture Transformer (NAT) aims to improve the given neural architecture to have…

机器学习 · 计算机科学 2021-10-20 Do-Guk Kim , Heung-Chang Lee

Neural architecture search (NAS) is a promising method for automatically design neural architectures. NAS adopts a search strategy to explore the predefined search space to find outstanding performance architecture with the minimum…

机器学习 · 计算机科学 2020-09-11 Chen Wei , Chuang Niu , Yiping Tang , Yue Wang , Haihong Hu , Jimin Liang

Recently proposed neural architecture search (NAS) algorithms adopt neural predictors to accelerate the architecture search. The capability of neural predictors to accurately predict the performance metrics of neural architecture is…

计算机视觉与模式识别 · 计算机科学 2020-11-03 Chen Wei , Yiping Tang , Chuang Niu , Haihong Hu , Yue Wang , Jimin Liang

Recent advances in Neural Architecture Search (NAS) such as one-shot NAS offer the ability to extract specialized hardware-aware sub-network configurations from a task-specific super-network. While considerable effort has been employed…

Neural Architecture Search (NAS), aiming at automatically designing network architectures by machines, is hoped and expected to bring about a new revolution in machine learning. Despite these high expectation, the effectiveness and…

计算机视觉与模式识别 · 计算机科学 2020-03-09 Changlin Li , Jiefeng Peng , Liuchun Yuan , Guangrun Wang , Xiaodan Liang , Liang Lin , Xiaojun Chang

Recently, predictor-based algorithms emerged as a promising approach for neural architecture search (NAS). For NAS, we typically have to calculate the validation accuracy of a large number of Deep Neural Networks (DNNs), what is…

Neural architecture search (NAS) recently attracts much research attention because of its ability to identify better architectures than handcrafted ones. However, many NAS methods, which optimize the search process in a discrete search…

机器学习 · 计算机科学 2019-11-22 Quanming Yao , Ju Xu , Wei-Wei Tu , Zhanxing Zhu

The searching procedure of neural architecture search (NAS) is notoriously time consuming and cost prohibitive.To make the search space continuous, most existing gradient-based NAS methods relax the categorical choice of a particular…

计算机视觉与模式识别 · 计算机科学 2019-12-11 Shoufa Chen , Yunpeng Chen , Shuicheng Yan , Jiashi Feng

Neural Architecture Search has shown potential to automate the design of neural networks. Deep Reinforcement Learning based agents can learn complex architectural patterns, as well as explore a vast and compositional search space. On the…

机器学习 · 计算机科学 2020-02-18 Krzysztof Maziarz , Mingxing Tan , Andrey Khorlin , Marin Georgiev , Andrea Gesmundo

Efficient search is a core issue in Neural Architecture Search (NAS). It is difficult for conventional NAS algorithms to directly search the architectures on large-scale tasks like ImageNet. In general, the cost of GPU hours for NAS grows…

计算机视觉与模式识别 · 计算机科学 2020-03-30 Xiyang Dai , Dongdong Chen , Mengchen Liu , Yinpeng Chen , Lu Yuan

Neural architecture search (NAS) has shown promise towards automating neural network design for a given task, but it is computationally demanding due to training costs associated with evaluating a large number of architectures to find the…

计算机视觉与模式识别 · 计算机科学 2025-02-07 Shahid Siddiqui , Christos Kyrkou , Theocharis Theocharides

Neural Architecture Search (NAS), i.e., the automation of neural network design, has gained much popularity in recent years with increasingly complex search algorithms being proposed. Yet, solid comparisons with simple baselines are often…

神经与进化计算 · 计算机科学 2020-07-28 T. Den Ottelander , A. Dushatskiy , M. Virgolin , P. A. N. Bosman

Neural Architectures Search (NAS) becomes more and more popular over these years. However, NAS-generated models tends to suffer greater vulnerability to various malicious attacks. Lots of robust NAS methods leverage adversarial training to…

机器学习 · 计算机科学 2023-04-11 Xunyu Zhu , Jian Li , Yong Liu , Weiping Wang

Convolutional Neural Networks (CNNs) continue to achieve great success in classification tasks as innovative techniques and complex multi-path architecture topologies are introduced. Neural Architecture Search (NAS) aims to automate the…

神经与进化计算 · 计算机科学 2023-12-14 Trevor Londt , Xiaoying Gao , Peter Andreae , Yi Mei

Data-driven, automatic design space exploration of neural accelerator architecture is desirable for specialization and productivity. Previous frameworks focus on sizing the numerical architectural hyper-parameters while neglect searching…

机器学习 · 计算机科学 2021-05-28 Yujun Lin , Mengtian Yang , Song Han

Neural Architecture Search (NAS) aims to automatically excavate the optimal network architecture with superior test performance. Recent neural architecture search (NAS) approaches rely on validation loss or accuracy to find the superior…

计算机视觉与模式识别 · 计算机科学 2023-05-19 Joonhyun Jeong , Joonsang Yu , Geondo Park , Dongyoon Han , YoungJoon Yoo