中文
相关论文

相关论文: Zero-Shot NAS via the Suppression of Local Entropy…

200 篇论文

Neural architecture search (NAS) enables finding the best-performing architecture from a search space automatically. Most NAS methods exploit an over-parameterized network (i.e., a supernet) containing all possible architectures (i.e.,…

计算机视觉与模式识别 · 计算机科学 2024-12-20 Youngmin Oh , Hyunju Lee , Bumsub Ham

Accuracy predictor is a key component in Neural Architecture Search (NAS) for ranking architectures. Building a high-quality accuracy predictor usually costs enormous computation. To address this issue, instead of using an accuracy…

计算机视觉与模式识别 · 计算机科学 2021-08-24 Ming Lin , Pichao Wang , Zhenhong Sun , Hesen Chen , Xiuyu Sun , Qi Qian , Hao Li , Rong Jin

In prediction-based Neural Architecture Search (NAS), performance indicators derived from graph convolutional networks have shown remarkable success. These indicators, achieved by representing feed-forward structures as component graphs…

机器学习 · 计算机科学 2023-09-25 Minh Le , Nhan Nguyen , Ngoc Hoang Luong

The fundamental problem in Neural Architecture Search (NAS) is to efficiently find high-performing architectures from a given search space. We propose a simple but powerful method which we call FEAR, for ranking architectures in any search…

机器学习 · 计算机科学 2021-06-09 Debadeepta Dey , Shital Shah , Sebastien Bubeck

Neural Architecture Search (NAS) has recently become a topic of great interest. However, there is a potentially impactful issue within NAS that remains largely unrecognized: noise. Due to stochastic factors in neural network initialization,…

神经与进化计算 · 计算机科学 2022-05-03 Arkadiy Dushatskiy , Tanja Alderliesten , Peter A. N. Bosman

In the last decade, zero-cost metrics have gained prominence in neural architecture search (NAS) due to their ability to evaluate architectures without training. These metrics are significantly faster and less computationally expensive than…

机器学习 · 计算机科学 2025-07-08 Ekaterina Gracheva

Automatic methods for generating state-of-the-art neural network architectures without human experts have generated significant attention recently. This is because of the potential to remove human experts from the design loop which can…

机器学习 · 计算机科学 2019-11-22 George Adam , Jonathan Lorraine

Neural Architecture Search (NAS) has been quite successful in constructing state-of-the-art models on a variety of tasks. Unfortunately, the computational cost can make it difficult to scale. In this paper, we make the first attempt to…

机器学习 · 计算机科学 2019-11-18 Albert Shaw , Wei Wei , Weiyang Liu , Le Song , Bo Dai

Neural Architecture Search (NAS) for automatically finding the optimal network architecture has shown some success with competitive performances in various computer vision tasks. However, NAS in general requires a tremendous amount of…

计算机视觉与模式识别 · 计算机科学 2022-12-14 Bokyeung Lee , Kyungdeuk Ko , Jonghwan Hong , Hanseok Ko

Efficient search is a core issue in Neural Architecture Search (NAS). It is difficult for conventional NAS algorithms to directly search the architectures on large-scale tasks like ImageNet. In general, the cost of GPU hours for NAS grows…

计算机视觉与模式识别 · 计算机科学 2020-03-30 Xiyang Dai , Dongdong Chen , Mengchen Liu , Yinpeng Chen , Lu Yuan

Neural architecture search (NAS) aims to automate architecture design processes and improve the performance of deep neural networks. Platform-aware NAS methods consider both performance and complexity and can find well-performing…

神经与进化计算 · 计算机科学 2022-07-22 Yuhei Noda , Shota Saito , Shinichi Shirakawa

Neural architecture search (NAS) aims to automate the search procedure of architecture instead of manual design. Even if recent NAS approaches finish the search within days, lengthy training is still required for a specific architecture…

计算机视觉与模式识别 · 计算机科学 2021-01-26 Xuanyi Dong , Yi Yang

Neural architecture search (NAS) is a challenging problem. Hierarchical search spaces allow for cheap evaluations of neural network sub modules to serve as surrogate for architecture evaluations. Yet, sometimes the hierarchy is too…

神经与进化计算 · 计算机科学 2024-04-26 Simon Neumeyer , Julian Stier , Michael Granitzer

As deep neural networks achieve unprecedented performance in various tasks, neural architecture search (NAS), a research field for designing neural network architectures with automated processes, is actively underway. More recently,…

机器学习 · 计算机科学 2022-06-07 Youngkee Kim , Soyi Jung , Minseok Choi , Joongheon Kim

A promising alternative to the computationally expensive Neural Architecture Search (NAS) involves the development of Zero Cost Proxies (ZCPs), which correlate well with trained performance, but can be computed through a single…

机器学习 · 计算机科学 2025-11-20 Richard Goldman , Varun Komperla , Thomas Ploetz , Harish Haresamudram

Neural architecture search (NAS) is gaining more and more attention in recent years due to its flexibility and remarkable capability to reduce the burden of neural network design. To achieve better performance, however, the searching…

机器学习 · 计算机科学 2022-05-23 Yijun Bian , Qingquan Song , Mengnan Du , Jun Yao , Huanhuan Chen , Xia Hu

Neural Architecture Search (NAS) is a powerful automatic alternative to manual design of a neural network. In the zero-shot version, a fast ranking function is used to compare architectures without training them. The outputs of the ranking…

机器学习 · 计算机科学 2025-02-28 Pavel Rumiantsev , Mark Coates

Underwater object detection using sonar imagery has become a critical and rapidly evolving research domain within marine technology. However, sonar images are characterized by lower resolution and sparser features compared to optical…

计算机视觉与模式识别 · 计算机科学 2025-05-13 XiaoTong Gu , Shengyu Tang , Yiming Cao , Changdong Yu

Neural Architecture Search (NAS) is an open and challenging problem in machine learning. While NAS offers great promise, the prohibitive computational demand of most of the existing NAS methods makes it difficult to directly search the…

In the past few years, neural architecture search (NAS) has become an increasingly important tool within the deep learning community. Despite the many recent successes of NAS, however, most existing approaches operate within highly…

机器学习 · 计算机科学 2022-11-14 Charles Jin , Phitchaya Mangpo Phothilimthana , Sudip Roy