中文
相关论文

相关论文: Zero-Shot NAS via the Suppression of Local Entropy…

200 篇论文

Performance prediction has been a key part of the neural architecture search (NAS) process, allowing to speed up NAS algorithms by avoiding resource-consuming network training. Although many performance predictors correlate well with ground…

One-Shot Neural architecture search (NAS) attracts broad attention recently due to its capacity to reduce the computational hours through weight sharing. However, extensive experiments on several recent works show that there is no positive…

机器学习 · 计算机科学 2019-07-23 Miao Zhang , Huiqi Li , Shirui Pan , Taoping Liu , Steven Su

Zero-Shot Neural Architecture Search (NAS) approaches propose novel training-free metrics called zero-shot proxies to substantially reduce the search time compared to the traditional training-based NAS. Despite the success on image…

计算机视觉与模式识别 · 计算机科学 2023-09-27 Kartikeya Bhardwaj , Hsin-Pai Cheng , Sweta Priyadarshi , Zhuojin Li

One-shot NAS method has attracted much interest from the research community due to its remarkable training efficiency and capacity to discover high performance models. However, the search spaces of previous one-shot based works usually…

计算机视觉与模式识别 · 计算机科学 2020-05-22 Ronghao Guo , Chen Lin , Chuming Li , Keyu Tian , Ming Sun , Lu Sheng , Junjie Yan

An important step in the task of neural network design, such as hyper-parameter optimization (HPO) or neural architecture search (NAS), is the evaluation of a candidate model's performance. Given fixed computational resources, one can…

机器学习 · 计算机科学 2021-03-09 Shengcao Cao , Xiaofang Wang , Kris Kitani

Neural Architecture Search (NAS) has shown excellent results in designing architectures for computer vision problems. NAS alleviates the need for human-defined settings by automating architecture design and engineering. However, NAS methods…

机器学习 · 计算机科学 2021-10-29 Vasco Lopes , Saeid Alirezazadeh , Luís A. Alexandre

Neural architecture search (NAS) is a hard computationally expensive optimization problem with a discrete, vast, and spiky search space. One of the key research efforts dedicated to this space focuses on accelerating NAS via certain proxy…

机器学习 · 计算机科学 2025-09-09 Bo Lyu , Yu Cui , Tuo Shi , Ke Li

Deep learning has revolutionized computer vision, but it achieved its tremendous success using deep network architectures which are mostly hand-crafted and therefore likely suboptimal. Neural Architecture Search (NAS) aims to bridge this…

计算机视觉与模式识别 · 计算机科学 2025-02-10 Ondřej Týbl , Lukáš Neumann

Deep neural networks have brought significant advancements to speech emotion recognition (SER). However, the architecture design in SER is mainly based on expert knowledge and empirical (trial-and-error) evaluations, which is time-consuming…

声音 · 计算机科学 2022-04-01 Xixin Wu , Shoukang Hu , Zhiyong Wu , Xunying Liu , Helen Meng

We formalize and analyze a fundamental component of differentiable neural architecture search (NAS): local "operation scoring" at each operation choice. We view existing operation scoring functions as inexact proxies for accuracy, and we…

机器学习 · 计算机科学 2023-02-10 Lichuan Xiang , Łukasz Dudziak , Mohamed S. Abdelfattah , Thomas Chau , Nicholas D. Lane , Hongkai Wen

We propose Efficient Neural Architecture Search (ENAS), a fast and inexpensive approach for automatic model design. In ENAS, a controller learns to discover neural network architectures by searching for an optimal subgraph within a large…

机器学习 · 计算机科学 2018-02-13 Hieu Pham , Melody Y. Guan , Barret Zoph , Quoc V. Le , Jeff Dean

One-Shot Neural Architecture Search (NAS) is a promising method to significantly reduce search time without any separate training. It can be treated as a Network Compression problem on the architecture parameters from an over-parameterized…

机器学习 · 计算机科学 2019-06-11 Hongpeng Zhou , Minghao Yang , Jun Wang , Wei Pan

Neural Architecture Search (NAS) is a powerful tool for automating architecture design. One-Shot NAS techniques, such as DARTS, have gained substantial popularity due to their combination of search efficiency with simplicity of…

机器学习 · 计算机科学 2025-05-21 Pavel Rumiantsev , Mark Coates

Neural architecture search (NAS) has made tremendous progress in the automatic design of effective neural network structures but suffers from a heavy computational burden. One-shot NAS significantly alleviates the burden through weight…

计算机视觉与模式识别 · 计算机科学 2023-01-25 Peijie Dong , Xin Niu , Lujun Li , Zhiliang Tian , Xiaodong Wang , Zimian Wei , Hengyue Pan , Dongsheng Li

Recently, Neural Architecture Search (NAS) methods have been introduced and show impressive performance on many benchmarks. Among those NAS studies, Neural Architecture Transformer (NAT) aims to adapt the given neural architecture to…

机器学习 · 计算机科学 2022-05-17 Do-Guk Kim , Heung-Chang Lee

Neural Architecture Search (NAS) has proven effective in discovering new Convolutional Neural Network (CNN) architectures, particularly for scenarios with well-defined accuracy optimization goals. However, previous approaches often involve…

机器学习 · 计算机科学 2024-08-28 Ye Qiao , Haocheng Xu , Yifan Zhang , Sitao Huang

Recent neural architecture search (NAS) frameworks have been successful in finding optimal architectures for given conditions (e.g., performance or latency). However, they search for optimal architectures in terms of their performance on…

机器学习 · 计算机科学 2023-10-23 Hyeonjeong Ha , Minseon Kim , Sung Ju Hwang

This work targets designing a principled and unified training-free framework for Neural Architecture Search (NAS), with high performance, low cost, and in-depth interpretation. NAS has been explosively studied to automate the discovery of…

机器学习 · 计算机科学 2023-01-02 Wuyang Chen , Xinyu Gong , Junru Wu , Yunchao Wei , Humphrey Shi , Zhicheng Yan , Yi Yang , Zhangyang Wang

Neural Architecture Search (NAS), the process of automating architecture engineering, is an appealing next step to advancing end-to-end Automatic Speech Recognition (ASR), replacing expert-designed networks with learned, task-specific…

音频与语音处理 · 电气工程与系统科学 2020-11-12 Huahuan Zheng , Keyu An , Zhijian Ou

Due to the recent advances on Neural Architecture Search (NAS), it gains popularity in designing best networks for specific tasks. Although it shows promising results on many benchmarks and competitions, NAS still suffers from its demanding…

机器学习 · 计算机科学 2019-11-22 Minje Park