中文
相关论文

相关论文: How Powerful are Performance Predictors in Neural …

200 篇论文

Neural Architecture Search (NAS) methods have been successfully applied to image tasks with excellent results. However, NAS methods are often complex and tend to converge to local minima as soon as generated architectures seem to yield good…

神经与进化计算 · 计算机科学 2022-08-16 Vasco Lopes , Miguel Santos , Bruno Degardin , Luís A. Alexandre

Conducting efficient performance estimations of neural architectures is a major challenge in neural architecture search (NAS). To reduce the architecture training costs in NAS, one-shot estimators (OSEs) amortize the architecture training…

计算机视觉与模式识别 · 计算机科学 2021-11-01 Xuefei Ning , Changcheng Tang , Wenshuo Li , Zixuan Zhou , Shuang Liang , Huazhong Yang , Yu Wang

The paper provides a comprehensive overview of Neural Architecture Search (NAS), emphasizing its evolution from manual design to automated, computationally-driven approaches. It covers the inception and growth of NAS, highlighting its…

神经与进化计算 · 计算机科学 2024-04-03 Fanfei Meng , Chen-Ao Wang , Lele Zhang

Recently, zero-shot (or training-free) Neural Architecture Search (NAS) approaches have been proposed to liberate NAS from the expensive training process. The key idea behind zero-shot NAS approaches is to design proxies that can predict…

机器学习 · 计算机科学 2024-06-19 Guihong Li , Duc Hoang , Kartikeya Bhardwaj , Ming Lin , Zhangyang Wang , Radu Marculescu

The dynamic energy sector requires both predictive accuracy and runtime efficiency for short-term forecasting of energy generation under operational constraints, where timely and precise predictions are crucial. The manual configuration of…

机器学习 · 计算机科学 2025-11-04 Georg Velev , Stefan Lessmann

Automating the research for the best neural network model is a task that has gained more and more relevance in the last few years. In this context, Neural Architecture Search (NAS) represents the most effective technique whose results rival…

机器学习 · 计算机科学 2022-10-07 Andrea Falanti , Eugenio Lomurno , Stefano Samele , Danilo Ardagna , Matteo Matteucci

Neural Architecture Search (NAS) has emerged as a favoured method for unearthing effective neural architectures. Recent development of large models has intensified the demand for faster search speeds and more accurate search results.…

机器学习 · 计算机科学 2023-11-14 Wang Qinsi , Ke Jinghan , Liang Zhi , Zhang Sihai

Neural architecture search (NAS) algorithms save tremendous labor from human experts. Recent advancements further reduce the computational overhead to an affordable level. However, it is still cumbersome to deploy the NAS techniques in…

计算机视觉与模式识别 · 计算机科学 2022-06-10 Zhuowei Li , Yibo Gao , Zhenzhou Zha , Zhiqiang HU , Qing Xia , Shaoting Zhang , Dimitris N. Metaxas

Neural Architecture Search (NAS) is a popular tool for automatically generating Neural Network (NN) architectures. In early NAS works, these tools typically optimized NN architectures for a single metric, such as accuracy. However, in the…

神经与进化计算 · 计算机科学 2023-04-05 Emil Njor , Jan Madsen , Xenofon Fafoutis

Neural architecture search (NAS) has shown promising results discovering models that are both accurate and fast. For NAS, training a one-shot model has become a popular strategy to rank the relative quality of different architectures (child…

计算机视觉与模式识别 · 计算机科学 2020-07-20 Jiahui Yu , Pengchong Jin , Hanxiao Liu , Gabriel Bender , Pieter-Jan Kindermans , Mingxing Tan , Thomas Huang , Xiaodan Song , Ruoming Pang , Quoc Le

Most existing neural architecture search (NAS) benchmarks and algorithms prioritize well-studied tasks, e.g. image classification on CIFAR or ImageNet. This makes the performance of NAS approaches in more diverse areas poorly understood. In…

计算机视觉与模式识别 · 计算机科学 2023-01-23 Renbo Tu , Nicholas Roberts , Mikhail Khodak , Junhong Shen , Frederic Sala , Ameet Talwalkar

Neural Architecture Search (NAS), aiming at automatically designing network architectures by machines, is hoped and expected to bring about a new revolution in machine learning. Despite these high expectation, the effectiveness and…

计算机视觉与模式识别 · 计算机科学 2020-03-09 Changlin Li , Jiefeng Peng , Liuchun Yuan , Guangrun Wang , Xiaodan Liang , Liang Lin , Xiaojun Chang

Neural architecture search (NAS) methods rely on a search strategy for deciding which architectures to evaluate next and a performance estimation strategy for assessing their performance (e.g., using full evaluations, multi-fidelity…

神经与进化计算 · 计算机科学 2021-08-10 Noor Awad , Neeratyoy Mallik , Frank Hutter

Existing Neural Architecture Search (NAS) methods either encode neural architectures using discrete encodings that do not scale well, or adopt supervised learning-based methods to jointly learn architecture representations and optimize…

计算机视觉与模式识别 · 计算机科学 2020-10-27 Shen Yan , Yu Zheng , Wei Ao , Xiao Zeng , Mi Zhang

The fundamental problem in Neural Architecture Search (NAS) is to efficiently find high-performing architectures from a given search space. We propose a simple but powerful method which we call FEAR, for ranking architectures in any search…

机器学习 · 计算机科学 2021-06-09 Debadeepta Dey , Shital Shah , Sebastien Bubeck

Architecture plays an important role in deciding the performance of deep neural networks. However, the search for the optimal architecture is often hindered by the vast search space, making it a time-intensive process. Recently, a novel…

机器学习 · 计算机科学 2024-12-02 Yuxuan Li , Yunhui Guo

In computer vision research, the process of automating architecture engineering, Neural Architecture Search (NAS), has gained substantial interest. Due to the high computational costs, most recent approaches to NAS as well as the few…

计算机视觉与模式识别 · 计算机科学 2020-10-21 Jovita Lukasik , David Friede , Heiner Stuckenschmidt , Margret Keuper

The term Neural Architecture Search (NAS) refers to the automatic optimization of network architectures for a new, previously unknown task. Since testing an architecture is computationally very expensive, many optimizers need days or even…

机器学习 · 计算机科学 2019-07-22 Martin Wistuba

For the goal of automated design of high-performance deep convolutional neural networks (CNNs), Neural Architecture Search (NAS) methodology is becoming increasingly important for both academia and industries.Due to the costly stochastic…

机器学习 · 计算机科学 2021-10-12 Shengran Hu , Ran Cheng , Cheng He , Zhichao Lu , Jing Wang , Miao Zhang

Designing neural architectures requires immense manual efforts. This has promoted the development of neural architecture search (NAS) to automate the design. While previous NAS methods achieve promising results but run slowly, zero-cost…

机器学习 · 计算机科学 2023-03-14 Yu Shen , Yang Li , Jian Zheng , Wentao Zhang , Peng Yao , Jixiang Li , Sen Yang , Ji Liu , Bin Cui