中文
相关论文

相关论文: Learn to Explore: Meta NAS via Bayesian Optimizati…

200 篇论文

Neural architecture search (NAS) aims to automate architecture engineering in neural networks. This often requires a high computational overhead to evaluate a number of candidate networks from the set of all possible networks in the search…

计算机视觉与模式识别 · 计算机科学 2022-04-28 Yameng Peng , Andy Song , Vic Ciesielski , Haytham M. Fayek , Xiaojun Chang

Neural architecture search (NAS) has emerged as a promising avenue for automatically designing task-specific neural networks. Existing NAS approaches require one complete search for each deployment specification of hardware or objective.…

计算机视觉与模式识别 · 计算机科学 2021-03-23 Zhichao Lu , Gautam Sreekumar , Erik Goodman , Wolfgang Banzhaf , Kalyanmoy Deb , Vishnu Naresh Boddeti

Neural architecture search automates the design of neural network architectures usually by exploring a large and thus complex architecture search space. To advance the architecture search, we present a graph diffusion-based NAS approach…

机器学习 · 计算机科学 2024-03-25 Rohan Asthana , Joschua Conrad , Youssef Dawoud , Maurits Ortmanns , Vasileios Belagiannis

Neural structure search (NAS), as the mainstream approach to automate deep neural architecture design, has achieved much success in recent years. However, the performance estimation component adhering to NAS is often prohibitively costly,…

机器学习 · 计算机科学 2022-04-27 Zixuan Liang , Yanan Sun

Most existing neural architecture search (NAS) algorithms are dedicated to and evaluated by the downstream tasks, e.g., image classification in computer vision. However, extensive experiments have shown that, prominent neural architectures,…

机器学习 · 计算机科学 2021-11-18 Yuhong Li , Cong Hao , Pan Li , Jinjun Xiong , Deming Chen

We propose Efficient Neural Architecture Search (ENAS), a fast and inexpensive approach for automatic model design. In ENAS, a controller learns to discover neural network architectures by searching for an optimal subgraph within a large…

机器学习 · 计算机科学 2018-02-13 Hieu Pham , Melody Y. Guan , Barret Zoph , Quoc V. Le , Jeff Dean

One of the key steps in Neural Architecture Search (NAS) is to estimate the performance of candidate architectures. Existing methods either directly use the validation performance or learn a predictor to estimate the performance. However,…

计算机视觉与模式识别 · 计算机科学 2021-04-07 Yaofo Chen , Yong Guo , Qi Chen , Minli Li , Wei Zeng , Yaowei Wang , Mingkui Tan

The Neural Architecture Search (NAS) problem is typically formulated as a graph search problem where the goal is to learn the optimal operations over edges in order to maximise a graph-level global objective. Due to the large architecture…

计算机视觉与模式识别 · 计算机科学 2023-01-13 Vasco Lopes , Fabio Maria Carlucci , Pedro M Esperança , Marco Singh , Victor Gabillon , Antoine Yang , Hang Xu , Zewei Chen , Jun Wang

We introduce Universal Neural Architecture Space (UniNAS), a generic search space for neural architecture search (NAS) which unifies convolutional networks, transformers, and their hybrid architectures under a single, flexible framework.…

计算机视觉与模式识别 · 计算机科学 2025-10-08 Ondřej Týbl , Lukáš Neumann

Link prediction is the task of predicting missing connections between entities in the knowledge graph (KG). While various forms of models are proposed for the link prediction task, most of them are designed based on a few known relation…

计算与语言 · 计算机科学 2020-08-19 Xiaoyu Kou , Bingfeng Luo , Huang Hu , Yan Zhang

Recently, neural architecture search (NAS) has been applied to automate the design of neural networks in real-world applications. A large number of algorithms have been developed to improve the search cost or the performance of the final…

机器学习 · 计算机科学 2022-06-20 Yao Shu , Yizhou Chen , Zhongxiang Dai , Bryan Kian Hsiang Low

Binary Convolutional Neural Networks (CNNs) have significantly reduced the number of arithmetic operations and the size of memory storage needed for CNNs, which makes their deployment on mobile and embedded systems more feasible. However,…

计算机视觉与模式识别 · 计算机科学 2020-08-11 Baozhou Zhu , Zaid Al-Ars , Peter Hofstee

Neural Architecture Search has achieved state-of-the-art performance in a variety of tasks, out-performing human-designed networks. However, many assumptions, that require human definition, related with the problems being solved or the…

机器学习 · 计算机科学 2020-08-03 Vasco Lopes , Luís A. Alexandre

Neural Architecture Search (NAS) aims to facilitate the design of deep networks for new tasks. Existing techniques rely on two stages: searching over the architecture space and validating the best architecture. NAS algorithms are currently…

机器学习 · 计算机科学 2019-11-25 Kaicheng Yu , Christian Sciuto , Martin Jaggi , Claudiu Musat , Mathieu Salzmann

Neural architecture search (NAS) has recently been addressed from various directions, including discrete, sampling-based methods and efficient differentiable approaches. While the former are notoriously expensive, the latter suffer from…

机器学习 · 计算机科学 2021-05-13 Jovita Lukasik , David Friede , Arber Zela , Frank Hutter , Margret Keuper

Designing neural architectures for edge devices is subject to constraints of accuracy, inference latency, and computational cost. Traditionally, researchers manually craft deep neural networks to meet the needs of mobile devices. Neural…

机器学习 · 计算机科学 2019-06-27 Hsin-Pai Cheng , Tunhou Zhang , Yukun Yang , Feng Yan , Shiyu Li , Harris Teague , Hai Li , Yiran Chen

The neural architecture search (NAS) algorithm with reinforcement learning can be a powerful and novel framework for the automatic discovering process of neural architectures. However, its application is restricted by noncontinuous and…

机器学习 · 计算机科学 2020-03-27 Chun-Ting Liu

In this paper, we propose Broad Neural Architecture Search (BNAS) where we elaborately design broad scalable architecture dubbed Broad Convolutional Neural Network (BCNN) to solve the above issue. On one hand, the proposed broad scalable…

机器学习 · 统计学 2021-03-17 Zixiang Ding , Yaran Chen , Nannan Li , Dongbin Zhao , Zhiquan Sun , C. L. Philip Chen

Neural architecture search (NAS) has gained significant traction in automating the design of neural networks. To reduce search time, differentiable architecture search (DAS) reframes the traditional paradigm of discrete candidate sampling…

机器学习 · 计算机科学 2025-11-26 Xiaoyun Liu , Divya Saxena , Jiannong Cao , Yuqing Zhao , Penghui Ruan

The traditional Neural Network-development process requires substantial expert knowledge and relies heavily on intuition and trial-and-error. Neural Architecture Search (NAS) frameworks were introduced to robustly search for network…

神经与进化计算 · 计算机科学 2023-06-16 Mohamed Shahawy , Elhadj Benkhelifa