中文
相关论文

相关论文: NASTransfer: Analyzing Architecture Transferabilit…

200 篇论文

Neural architecture search (NAS) aims to discover network architectures with desired properties such as high accuracy or low latency. Recently, differentiable NAS (DNAS) has demonstrated promising results while maintaining a search cost…

机器学习 · 计算机科学 2020-08-31 Arash Vahdat , Arun Mallya , Ming-Yu Liu , Jan Kautz

Neural Architecture Search (NAS) was first proposed to achieve state-of-the-art performance through the discovery of new architecture patterns, without human intervention. An over-reliance on expert knowledge in the search space design has…

机器学习 · 计算机科学 2021-01-05 Binxin Ru , Pedro Esperanca , Fabio Carlucci

Searching for the architecture cells is a dominant paradigm in NAS. However, little attention has been devoted to the analysis of the cell-based search spaces even though it is highly important for the continual development of NAS. In this…

机器学习 · 统计学 2022-03-18 Xingchen Wan , Binxin Ru , Pedro M. Esperança , Zhenguo Li

This paper addresses the efficiency challenge of Neural Architecture Search (NAS) by formulating the task as a ranking problem. Previous methods require numerous training examples to estimate the accurate performance of architectures,…

计算与语言 · 计算机科学 2021-09-20 Chi Hu , Chenglong Wang , Xiangnan Ma , Xia Meng , Yinqiao Li , Tong Xiao , Jingbo Zhu , Changliang Li

Due to increasing privacy concerns, neural network (NN) based secure inference (SI) schemes that simultaneously hide the client inputs and server models attract major research interests. While existing works focused on developing secure…

密码学与安全 · 计算机科学 2020-02-18 Song Bian , Weiwen Jiang , Qing Lu , Yiyu Shi , Takashi Sato

Architectures obtained by Neural Architecture Search (NAS) have achieved highly competitive performance in various computer vision tasks. However, the prohibitive computation demand of forward-backward propagation in deep neural networks…

机器学习 · 计算机科学 2019-08-15 Xiawu Zheng , Rongrong Ji , Lang Tang , Baochang Zhang , Jianzhuang Liu , Qi Tian

Recently, Neural Architecture Search has achieved great success in large-scale image classification. In contrast, there have been limited works focusing on architecture search for object detection, mainly because the costly ImageNet…

计算机视觉与模式识别 · 计算机科学 2019-09-06 Junran Peng , Ming Sun , Zhaoxiang Zhang , Tieniu Tan , Junjie Yan

Differentiable architecture search has gradually become the mainstream research topic in the field of Neural Architecture Search (NAS) for its high efficiency compared with the early NAS methods. Recent differentiable NAS also aims at…

机器学习 · 计算机科学 2023-07-04 Bo Lyu , Shiping Wen

The rise of deep neural networks offers new opportunities in optimizing recommender systems. However, optimizing recommender systems using deep neural networks requires delicate architecture fabrication. We propose NASRec, a paradigm that…

信息检索 · 计算机科学 2024-01-17 Tunhou Zhang , Dehua Cheng , Yuchen He , Zhengxing Chen , Xiaoliang Dai , Liang Xiong , Feng Yan , Hai Li , Yiran Chen , Wei Wen

In this paper, we propose Broad Neural Architecture Search (BNAS) where we elaborately design broad scalable architecture dubbed Broad Convolutional Neural Network (BCNN) to solve the above issue. On one hand, the proposed broad scalable…

机器学习 · 统计学 2021-03-17 Zixiang Ding , Yaran Chen , Nannan Li , Dongbin Zhao , Zhiquan Sun , C. L. Philip Chen

Neural Architecture Search (NAS) methods have been growing in popularity. These techniques have been fundamental to automate and speed up the time consuming and error-prone process of synthesizing novel Deep Learning (DL) architectures. NAS…

机器学习 · 计算机科学 2021-01-26 Hadjer Benmeziane , Kaoutar El Maghraoui , Hamza Ouarnoughi , Smail Niar , Martin Wistuba , Naigang Wang

The ability to rank candidate architectures is the key to the performance of neural architecture search~(NAS). One-shot NAS is proposed to reduce the expense but shows inferior performance against conventional NAS and is not adequately…

机器学习 · 计算机科学 2020-04-01 Renqian Luo , Tao Qin , Enhong Chen

This paper proposes a novel differentiable architecture search method by formulating it into a distribution learning problem. We treat the continuously relaxed architecture mixing weight as random variables, modeled by Dirichlet…

机器学习 · 计算机科学 2021-03-17 Xiangning Chen , Ruochen Wang , Minhao Cheng , Xiaocheng Tang , Cho-Jui Hsieh

Weight-sharing (WS) has recently emerged as a paradigm to accelerate the automated search for efficient neural architectures, a process dubbed Neural Architecture Search (NAS). Although very appealing, this framework is not without…

机器学习 · 计算机科学 2020-05-19 Aloïs Pourchot , Alexis Ducarouge , Olivier Sigaud

Differential Neural Architecture Search (NAS) requires all layer choices to be held in memory simultaneously; this limits the size of both search space and final architecture. In contrast, Probabilistic NAS, such as PARSEC, learns a…

计算机视觉与模式识别 · 计算机科学 2021-04-01 Zhicheng Yan , Xiaoliang Dai , Peizhao Zhang , Yuandong Tian , Bichen Wu , Matt Feiszli

Neural Architecture Search (NAS) enabled the discovery of state-of-the-art architectures in many domains. However, the success of NAS depends on the definition of the search space. Current search spaces are defined as a static sequence of…

Neural Architecture Search (NAS) is a promising and rapidly evolving research area. Training a large number of neural networks requires an exceptional amount of computational power, which makes NAS unreachable for those researchers who have…

Neural Architecture Search (NAS) has significantly improved productivity in the design and deployment of neural networks (NN). As NAS typically evaluates multiple models by training them partially or completely, the improved productivity…

机器学习 · 计算机科学 2022-12-22 Yash Akhauri , J. Pablo Munoz , Nilesh Jain , Ravi Iyer

In the realm of neural architecture design, achieving high performance is largely reliant on the manual expertise of researchers. Despite the emergence of Neural Architecture Search (NAS) as a promising technique for automating this…

机器学习 · 计算机科学 2025-01-07 Yannis Y. He

Typically, deep learning architectures are handcrafted for their respective learning problem. As an alternative, neural architecture search (NAS) has been proposed where the architecture's structure is learned in an additional optimization…

图像与视频处理 · 电气工程与系统科学 2019-07-29 Nils Gessert , Alexander Schlaefer