中文
相关论文

相关论文: Generalized Global Ranking-Aware Neural Architectu…

200 篇论文

Neural Architecture Search (NAS) continues to serve a key roll in the design and development of neural networks for task specific deployment. Modern NAS techniques struggle to deal with ever increasing search space complexity and compute…

计算机视觉与模式识别 · 计算机科学 2024-11-25 Arjun Sridhar , Yiran Chen

Neural architecture search (NAS) aims to automate architecture engineering in neural networks. This often requires a high computational overhead to evaluate a number of candidate networks from the set of all possible networks in the search…

计算机视觉与模式识别 · 计算机科学 2022-04-28 Yameng Peng , Andy Song , Vic Ciesielski , Haytham M. Fayek , Xiaojun Chang

Neural architecture search (NAS) aims to discover network architectures with desired properties such as high accuracy or low latency. Recently, differentiable NAS (DNAS) has demonstrated promising results while maintaining a search cost…

机器学习 · 计算机科学 2020-08-31 Arash Vahdat , Arun Mallya , Ming-Yu Liu , Jan Kautz

The success of deep learning in recent years has lead to a rising demand for neural network architecture engineering. As a consequence, neural architecture search (NAS), which aims at automatically designing neural network architectures in…

计算机视觉与模式识别 · 计算机科学 2022-02-16 Thomas Elsken , Arber Zela , Jan Hendrik Metzen , Benedikt Staffler , Thomas Brox , Abhinav Valada , Frank Hutter

Neural architecture search (NAS) has witnessed prevailing success in image classification and (very recently) segmentation tasks. In this paper, we present the first preliminary study on introducing the NAS algorithm to generative…

计算机视觉与模式识别 · 计算机科学 2019-08-13 Xinyu Gong , Shiyu Chang , Yifan Jiang , Zhangyang Wang

Despite the empirical success of neural architecture search (NAS) in deep learning applications, the optimality, reproducibility and cost of NAS schemes remain hard to assess. In this paper, we propose Generative Adversarial NAS (GA-NAS)…

机器学习 · 计算机科学 2021-06-24 Seyed Saeed Changiz Rezaei , Fred X. Han , Di Niu , Mohammad Salameh , Keith Mills , Shuo Lian , Wei Lu , Shangling Jui

Neural structure search (NAS), as the mainstream approach to automate deep neural architecture design, has achieved much success in recent years. However, the performance estimation component adhering to NAS is often prohibitively costly,…

机器学习 · 计算机科学 2022-04-27 Zixuan Liang , Yanan Sun

Data-driven, automatic design space exploration of neural accelerator architecture is desirable for specialization and productivity. Previous frameworks focus on sizing the numerical architectural hyper-parameters while neglect searching…

机器学习 · 计算机科学 2021-05-28 Yujun Lin , Mengtian Yang , Song Han

In recent years, neural architecture search (NAS) methods have been proposed for the automatic generation of task-oriented network architecture in image classification. However, the architectures obtained by existing NAS approaches are…

计算机视觉与模式识别 · 计算机科学 2021-03-24 Haichao Zhang , Kuangrong Hao , Lei Gao , Xuesong Tang , Bing Wei

Neural architecture search (NAS) has attracted a lot of attention and has been illustrated to bring tangible benefits in a large number of applications in the past few years. Architecture topology and architecture size have been regarded as…

机器学习 · 计算机科学 2021-01-27 Xuanyi Dong , Lu Liu , Katarzyna Musial , Bogdan Gabrys

Neural Architecture Search (NAS) is an emerging topic in machine learning and computer vision. The fundamental ideology of NAS is using an automatic mechanism to replace manual designs for exploring powerful network architectures. One of…

机器学习 · 计算机科学 2020-09-24 Lanfei Wang , Lingxi Xie , Tianyi Zhang , Jun Guo , Qi Tian

Recent state-of-the-art methods for neural architecture search (NAS) exploit gradient-based optimization by relaxing the problem into continuous optimization over architectures and shared-weights, a noisy process that remains poorly…

机器学习 · 计算机科学 2021-03-19 Liam Li , Mikhail Khodak , Maria-Florina Balcan , Ameet Talwalkar

The term Neural Architecture Search (NAS) refers to the automatic optimization of network architectures for a new, previously unknown task. Since testing an architecture is computationally very expensive, many optimizers need days or even…

机器学习 · 计算机科学 2019-07-22 Martin Wistuba

As deep neural networks achieve unprecedented performance in various tasks, neural architecture search (NAS), a research field for designing neural network architectures with automated processes, is actively underway. More recently,…

机器学习 · 计算机科学 2022-06-07 Youngkee Kim , Soyi Jung , Minseok Choi , Joongheon Kim

Recent developments in neural architecture search (NAS) emphasize the significance of considering robust architectures against malicious data. However, there is a notable absence of benchmark evaluations and theoretical guarantees for…

机器学习 · 计算机科学 2024-03-21 Yongtao Wu , Fanghui Liu , Carl-Johann Simon-Gabriel , Grigorios G Chrysos , Volkan Cevher

We propose Stochastic Neural Architecture Search (SNAS), an economical end-to-end solution to Neural Architecture Search (NAS) that trains neural operation parameters and architecture distribution parameters in same round of…

机器学习 · 计算机科学 2020-04-02 Sirui Xie , Hehui Zheng , Chunxiao Liu , Liang Lin

Neural Architecture Search (NAS) yields state-of-the-art neural networks that outperform their best manually-designed counterparts. However, previous NAS methods search for architectures under one set of training hyper-parameters (i.e., a…

计算机视觉与模式识别 · 计算机科学 2021-04-01 Xiaoliang Dai , Alvin Wan , Peizhao Zhang , Bichen Wu , Zijian He , Zhen Wei , Kan Chen , Yuandong Tian , Matthew Yu , Peter Vajda , Joseph E. Gonzalez

Neural Architectures Search (NAS) becomes more and more popular over these years. However, NAS-generated models tends to suffer greater vulnerability to various malicious attacks. Lots of robust NAS methods leverage adversarial training to…

机器学习 · 计算机科学 2023-04-11 Xunyu Zhu , Jian Li , Yong Liu , Weiping Wang

Time-intensive performance evaluations significantly impede progress in Neural Architecture Search (NAS). To address this, neural predictors leverage surrogate models trained on proxy datasets, allowing for direct performance predictions…

机器学习 · 计算机科学 2025-09-24 Jindi Lv , Yuhao Zhou , Yuxin Tian , Qing Ye , Wentao Feng , Jiancheng Lv

Neural architecture search (NAS) has emerged as a promising avenue for automatically designing task-specific neural networks. Existing NAS approaches require one complete search for each deployment specification of hardware or objective.…

计算机视觉与模式识别 · 计算机科学 2021-03-23 Zhichao Lu , Gautam Sreekumar , Erik Goodman , Wolfgang Banzhaf , Kalyanmoy Deb , Vishnu Naresh Boddeti