中文
相关论文

相关论文: Noisy Heuristics NAS: A Network Morphism based Neu…

200 篇论文

The use of automatic methods, often referred to as Neural Architecture Search (NAS), in designing neural network architectures has recently drawn considerable attention. In this work, we present an efficient NAS approach, named HM- NAS,…

机器学习 · 计算机科学 2019-09-10 Shen Yan , Biyi Fang , Faen Zhang , Yu Zheng , Xiao Zeng , Hui Xu , Mi Zhang

A popular method for Neural Architecture Search (NAS) is based on growing networks via small local changes to the network's architecture called network morphisms. These methods start with a small seed network and progressively grow the…

机器学习 · 计算机科学 2024-11-12 Neal Lawton , Aram Galstyan , Greg Ver Steeg

In the past few years, neural architecture search (NAS) has become an increasingly important tool within the deep learning community. Despite the many recent successes of NAS, however, most existing approaches operate within highly…

机器学习 · 计算机科学 2022-11-14 Charles Jin , Phitchaya Mangpo Phothilimthana , Sudip Roy

Neural Architectures Search (NAS) becomes more and more popular over these years. However, NAS-generated models tends to suffer greater vulnerability to various malicious attacks. Lots of robust NAS methods leverage adversarial training to…

机器学习 · 计算机科学 2023-04-11 Xunyu Zhu , Jian Li , Yong Liu , Weiping Wang

Weight sharing promises to make neural architecture search (NAS) tractable even on commodity hardware. Existing methods in this space rely on a diverse set of heuristics to design and train the shared-weight backbone network, a.k.a. the…

机器学习 · 计算机科学 2021-10-05 Kaicheng Yu , René Ranftl , Mathieu Salzmann

Neural Architecture Search (NAS) was first proposed to achieve state-of-the-art performance through the discovery of new architecture patterns, without human intervention. An over-reliance on expert knowledge in the search space design has…

机器学习 · 计算机科学 2021-01-05 Binxin Ru , Pedro Esperanca , Fabio Carlucci

Neural Architecture Search (NAS) is a collection of methods to craft the way neural networks are built. Current NAS methods are far from ab initio and automatic, as they use manual backbone architectures or micro building blocks (cells),…

机器学习 · 计算机科学 2020-10-20 Anubhav Garg , Amit Kumar Saha , Debo Dutta

Neural Architecture Search (NAS) algorithms automate the task of finding optimal deep learning architectures given an initial search space of possible operations. Developing these search spaces is usually a manual affair with pre-optimized…

机器学习 · 计算机科学 2021-11-08 Robert Wu , Nayan Saxena , Rohan Jain

Neural architecture search (NAS) has seen a steep rise in interest over the last few years. Many algorithms for NAS consist of searching through a space of architectures by iteratively choosing an architecture, evaluating its performance by…

机器学习 · 计算机科学 2022-04-26 Colin White , Sam Nolen , Yash Savani

In neural architecture search (NAS), the space of neural network architectures is automatically explored to maximize predictive accuracy for a given task. Despite the success of recent approaches, most existing methods cannot be directly…

机器学习 · 统计学 2019-02-15 Francesco Paolo Casale , Jonathan Gordon , Nicolo Fusi

Neural architecture search (NAS) has shown promise towards automating neural network design for a given task, but it is computationally demanding due to training costs associated with evaluating a large number of architectures to find the…

计算机视觉与模式识别 · 计算机科学 2025-02-07 Shahid Siddiqui , Christos Kyrkou , Theocharis Theocharides

The neural architecture search (NAS) algorithm with reinforcement learning can be a powerful and novel framework for the automatic discovering process of neural architectures. However, its application is restricted by noncontinuous and…

机器学习 · 计算机科学 2020-03-27 Chun-Ting Liu

Neural Architecture Search (NAS) has recently become a topic of great interest. However, there is a potentially impactful issue within NAS that remains largely unrecognized: noise. Due to stochastic factors in neural network initialization,…

神经与进化计算 · 计算机科学 2022-05-03 Arkadiy Dushatskiy , Tanja Alderliesten , Peter A. N. Bosman

In this paper, we investigate a new variant of neural architecture search (NAS) paradigm -- searching with random labels (RLNAS). The task sounds counter-intuitive for most existing NAS algorithms since random label provides few information…

计算机视觉与模式识别 · 计算机科学 2021-05-26 Xuanyang Zhang , Pengfei Hou , Xiangyu Zhang , Jian Sun

Neural architecture search (NAS) has been proposed to automatically tune deep neural networks, but existing search algorithms, e.g., NASNet, PNAS, usually suffer from expensive computational cost. Network morphism, which keeps the…

机器学习 · 计算机科学 2019-03-27 Haifeng Jin , Qingquan Song , Xia Hu

Recently, neural architecture search (NAS) methods have attracted much attention and outperformed manually designed architectures on a few high-level vision tasks. In this paper, we propose HiNAS (Hierarchical NAS), an effort towards…

计算机视觉与模式识别 · 计算机科学 2020-02-10 Haokui Zhang , Ying Li , Hao Chen , Chunhua Shen

Networks found with Neural Architecture Search (NAS) achieve state-of-the-art performance in a variety of tasks, out-performing human-designed networks. However, most NAS methods heavily rely on human-defined assumptions that constrain the…

计算机视觉与模式识别 · 计算机科学 2023-01-10 Vasco Lopes , Luís A. Alexandre

Neural Architecture Search (NAS) technologies have emerged in many domains to jointly learn the architectures and weights of the neural network. However, most existing NAS works claim they are task-specific and focus only on optimizing a…

计算机视觉与模式识别 · 计算机科学 2020-12-08 Sen Yang , Wankou Yang , Zhen Cui

We propose a novel strategy for Neural Architecture Search (NAS) based on Bregman iterations. Starting from a sparse neural network our gradient-based one-shot algorithm gradually adds relevant parameters in an inverse scale space manner.…

机器学习 · 计算机科学 2021-06-07 Leon Bungert , Tim Roith , Daniel Tenbrinck , Martin Burger

Neural Architecture Search (NAS) is a popular tool for automatically generating Neural Network (NN) architectures. In early NAS works, these tools typically optimized NN architectures for a single metric, such as accuracy. However, in the…

神经与进化计算 · 计算机科学 2023-04-05 Emil Njor , Jan Madsen , Xenofon Fafoutis
‹ 上一页 1 2 3 10 下一页 ›