中文
相关论文

相关论文: Neural Architecture Search using Property Guided S…

200 篇论文

Neural Architecture Search (NAS) has shown great potentials in automatically designing scalable network architectures for dense image predictions. However, existing NAS algorithms usually compromise on restricted search space and search on…

计算机视觉与模式识别 · 计算机科学 2021-03-30 Xiong Zhang , Hongmin Xu , Hong Mo , Jianchao Tan , Cheng Yang , Lei Wang , Wenqi Ren

Binary Neural Networks (BNNs) have gained extensive attention for their superior inferencing efficiency and compression ratio compared to traditional full-precision networks. However, due to the unique characteristics of BNNs, designing a…

计算机视觉与模式识别 · 计算机科学 2024-08-29 Zhihao Lin , Yongtao Wang , Jinhe Zhang , Xiaojie Chu , Haibin Ling

Adequate labeled data and expensive compute resources are the prerequisites for the success of neural architecture search(NAS). It is challenging to apply NAS in meta-learning scenarios with limited compute resources and data. In this…

机器学习 · 计算机科学 2021-10-13 Jingtao Rong , Xinyi Yu , Mingyang Zhang , Linlin Ou

Neural Architecture Search (NAS) has been explosively studied to automate the discovery of top-performer neural networks. Current works require heavy training of supernet or intensive architecture evaluations, thus suffering from heavy…

计算机视觉与模式识别 · 计算机科学 2021-03-17 Wuyang Chen , Xinyu Gong , Zhangyang Wang

Neural Architecture Search (NAS) automates the design of high-performing neural networks but typically targets a single predefined task, thereby restricting its real-world applicability. To address this, Meta Neural Architecture Search…

机器学习 · 计算机科学 2025-08-14 Zijun Sun , Yanning Shen

This paper proposes a novel differentiable architecture search method by formulating it into a distribution learning problem. We treat the continuously relaxed architecture mixing weight as random variables, modeled by Dirichlet…

机器学习 · 计算机科学 2021-03-17 Xiangning Chen , Ruochen Wang , Minhao Cheng , Xiaocheng Tang , Cho-Jui Hsieh

Despite the success of recent Neural Architecture Search (NAS) methods on various tasks which have shown to output networks that largely outperform human-designed networks, conventional NAS methods have mostly tackled the optimization of…

机器学习 · 计算机科学 2021-07-05 Hayeon Lee , Eunyoung Hyung , Sung Ju Hwang

Neural Architecture Search (NAS), a framework which automates the task of designing neural networks, has recently been actively studied in the field of deep learning. However, there are only a few NAS methods suitable for 3D medical image…

图像与视频处理 · 电气工程与系统科学 2019-09-04 Woong Bae , Seungho Lee , Yeha Lee , Beomhee Park , Minki Chung , Kyu-Hwan Jung

Neural Architecture Search (NAS) has been a source of dramatic improvements in neural network design, with recent results meeting or exceeding the performance of hand-tuned architectures. However, our understanding of how to represent the…

计算机视觉与模式识别 · 计算机科学 2019-03-26 Andrew Hundt , Varun Jain , Gregory D. Hager

The search space of neural architecture search (NAS) for convolutional neural network (CNN) is huge. To reduce searching cost, most NAS algorithms use fixed outer network level structure, and search the repeatable cell structure only. Such…

计算机视觉与模式识别 · 计算机科学 2020-08-14 Chunnan Wang , Hongzhi Wang , Guosheng Feng , Fei Geng

Neural architecture search (NAS) finds high performing networks for a given task. Yet the results of NAS are fairly prosaic; they did not e.g. create a shift from convolutional structures to transformers. This is not least because the…

In this work, we present a simple and general search space shrinking method, called Angle-Based search space Shrinking (ABS), for Neural Architecture Search (NAS). Our approach progressively simplifies the original search space by dropping…

神经与进化计算 · 计算机科学 2020-07-17 Yiming Hu , Yuding Liang , Zichao Guo , Ruosi Wan , Xiangyu Zhang , Yichen Wei , Qingyi Gu , Jian Sun

In this paper, we propose a new neural architecture search (NAS) problem of Symmetric Positive Definite (SPD) manifold networks, aiming to automate the design of SPD neural architectures. To address this problem, we first introduce a…

机器学习 · 计算机科学 2021-06-15 Rhea Sanjay Sukthanker , Zhiwu Huang , Suryansh Kumar , Erik Goron Endsjo , Yan Wu , Luc Van Gool

As we advance in the fast-growing era of Machine Learning, various new and more complex neural architectures are arising to tackle problem more efficiently. On the one hand their efficient usage requires advanced knowledge and expertise,…

机器学习 · 计算机科学 2023-10-30 Léo Pouy , Fouad Khenfri , Patrick Leserf , Chokri Mraidha , Cherif Larouci

Neural radiance fields (NeRFs) enable high-quality novel view synthesis, but their high computational complexity limits deployability. While existing neural-based solutions strive for efficiency, they use one-size-fits-all architectures…

计算机视觉与模式识别 · 计算机科学 2023-12-12 Saeejith Nair , Yuhao Chen , Mohammad Javad Shafiee , Alexander Wong

Convolutional neural network (CNN) architectures have traditionally been explored by human experts in a manual search process that is time-consuming and ineffectively explores the massive space of potential solutions. Neural architecture…

神经与进化计算 · 计算机科学 2019-04-02 Gerard Jacques van Wyk , Anna Sergeevna Bosman

Convolutional Neural Networks have been used in a variety of image related applications after their rise in popularity due to ImageNet competition. Convolutional Neural Networks have shown remarkable results in applications including face…

机器学习 · 计算机科学 2023-01-18 Anshumaan Chauhan , Siddhartha Bhattacharyya , S. Vadivel

Neural architecture search (NAS) and network pruning are widely studied efficient AI techniques, but not yet perfect. NAS performs exhaustive candidate architecture search, incurring tremendous search cost. Though (structured) pruning can…

计算机视觉与模式识别 · 计算机科学 2022-06-03 Yanyu Li , Pu Zhao , Geng Yuan , Xue Lin , Yanzhi Wang , Xin Chen

Neural architecture search (NAS) is a promising research direction that has the potential to replace expert-designed networks with learned, task-specific architectures. In this work, in order to help ground the empirical results in this…

机器学习 · 计算机科学 2019-08-01 Liam Li , Ameet Talwalkar

Neural Architecture Search (NAS) has emerged as a favoured method for unearthing effective neural architectures. Recent development of large models has intensified the demand for faster search speeds and more accurate search results.…

机器学习 · 计算机科学 2023-11-14 Wang Qinsi , Ke Jinghan , Liang Zhi , Zhang Sihai