中文
相关论文

相关论文: OptiProxy-NAS: Optimization Proxy based End-to-End…

200 篇论文

The search cost of neural architecture search (NAS) has been largely reduced by weight-sharing methods. These methods optimize a super-network with all possible edges and operations, and determine the optimal sub-network by discretization,…

计算机视觉与模式识别 · 计算机科学 2020-07-08 Yunjie Tian , Chang Liu , Lingxi Xie , Jianbin Jiao , Qixiang Ye

In recent years, neural architecture search (NAS) has received intensive scientific and industrial interest due to its capability of finding a neural architecture with high accuracy for various artificial intelligence tasks such as image…

机器学习 · 计算机科学 2021-01-18 Martin Ferianc , Hongxiang Fan , Miguel Rodrigues

Neural Architecture Search (NAS) aims to facilitate the design of deep networks for new tasks. Existing techniques rely on two stages: searching over the architecture space and validating the best architecture. NAS algorithms are currently…

机器学习 · 计算机科学 2019-11-25 Kaicheng Yu , Christian Sciuto , Martin Jaggi , Claudiu Musat , Mathieu Salzmann

The success of deep learning in recent years has lead to a rising demand for neural network architecture engineering. As a consequence, neural architecture search (NAS), which aims at automatically designing neural network architectures in…

计算机视觉与模式识别 · 计算机科学 2022-02-16 Thomas Elsken , Arber Zela , Jan Hendrik Metzen , Benedikt Staffler , Thomas Brox , Abhinav Valada , Frank Hutter

The ongoing advancements in network architecture design have led to remarkable achievements in deep learning across various challenging computer vision tasks. Meanwhile, the development of neural architecture search (NAS) has provided…

神经与进化计算 · 计算机科学 2023-04-19 Zhichao Lu , Ran Cheng , Yaochu Jin , Kay Chen Tan , Kalyanmoy Deb

Due to increasing privacy concerns, neural network (NN) based secure inference (SI) schemes that simultaneously hide the client inputs and server models attract major research interests. While existing works focused on developing secure…

密码学与安全 · 计算机科学 2020-02-18 Song Bian , Weiwen Jiang , Qing Lu , Yiyu Shi , Takashi Sato

We propose a novel hardware and software co-exploration framework for efficient neural architecture search (NAS). Different from existing hardware-aware NAS which assumes a fixed hardware design and explores the neural architecture search…

机器学习 · 计算机科学 2020-01-14 Weiwen Jiang , Lei Yang , Edwin Sha , Qingfeng Zhuge , Shouzhen Gu , Sakyasingha Dasgupta , Yiyu Shi , Jingtong Hu

Differentiable Architecture Search (DARTS) is a recent neural architecture search (NAS) method based on a differentiable relaxation. Due to its success, numerous variants analyzing and improving parts of the DARTS framework have recently…

机器学习 · 计算机科学 2021-10-19 Kaitlin Maile , Erwan Lecarpentier , Hervé Luga , Dennis G. Wilson

Neural Architecture Search (NAS) is a popular tool for automatically generating Neural Network (NN) architectures. In early NAS works, these tools typically optimized NN architectures for a single metric, such as accuracy. However, in the…

神经与进化计算 · 计算机科学 2023-04-05 Emil Njor , Jan Madsen , Xenofon Fafoutis

Neural architecture search (NAS) searches architectures automatically for given tasks, e.g., image classification and language modeling. Improving the search efficiency and effectiveness have attracted increasing attention in recent years.…

机器学习 · 计算机科学 2020-01-03 Yao Shu , Wei Wang , Shaofeng Cai

Neural architecture search (NAS) has recently reshaped our understanding on various vision tasks. Similar to the success of NAS in high-level vision tasks, it is possible to find a memory and computationally efficient solution via NAS with…

图像与视频处理 · 电气工程与系统科学 2021-04-07 Qian Ning , Weisheng Dong , Xin Li , Jinjian Wu , Leida Li , Guangming Shi

Neural architecture search (NAS) automates the design process of high-performing architectures, but remains bottlenecked by expensive performance evaluation. Most existing studies that achieve faster evaluation are mostly tied to cell-based…

Recent state-of-the-art methods for neural architecture search (NAS) exploit gradient-based optimization by relaxing the problem into continuous optimization over architectures and shared-weights, a noisy process that remains poorly…

机器学习 · 计算机科学 2021-03-19 Liam Li , Mikhail Khodak , Maria-Florina Balcan , Ameet Talwalkar

Neural Architectures Search (NAS) becomes more and more popular over these years. However, NAS-generated models tends to suffer greater vulnerability to various malicious attacks. Lots of robust NAS methods leverage adversarial training to…

机器学习 · 计算机科学 2023-04-11 Xunyu Zhu , Jian Li , Yong Liu , Weiping Wang

Neural Architecture Search (NAS), a framework which automates the task of designing neural networks, has recently been actively studied in the field of deep learning. However, there are only a few NAS methods suitable for 3D medical image…

图像与视频处理 · 电气工程与系统科学 2019-09-04 Woong Bae , Seungho Lee , Yeha Lee , Beomhee Park , Minki Chung , Kyu-Hwan Jung

In recent years, neural architecture search (NAS) methods have been proposed for the automatic generation of task-oriented network architecture in image classification. However, the architectures obtained by existing NAS approaches are…

计算机视觉与模式识别 · 计算机科学 2021-03-24 Haichao Zhang , Kuangrong Hao , Lei Gao , Xuesong Tang , Bing Wei

Neural Architecture Search (NAS) often trains and evaluates a large number of architectures. Recent predictor-based NAS approaches attempt to alleviate such heavy computation costs with two key steps: sampling some architecture-performance…

机器学习 · 计算机科学 2021-11-04 Junru Wu , Xiyang Dai , Dongdong Chen , Yinpeng Chen , Mengchen Liu , Ye Yu , Zhangyang Wang , Zicheng Liu , Mei Chen , Lu Yuan

Recently Neural Architecture Search (NAS) has aroused great interest in both academia and industry, however it remains challenging because of its huge and non-continuous search space. Instead of applying evolutionary algorithm or…

计算机视觉与模式识别 · 计算机科学 2018-11-06 Xinbang Zhang , Zehao Huang , Naiyan Wang

Neural Architecture Search (NAS) is a collection of methods to craft the way neural networks are built. We apply this idea to Federated Learning (FL), wherein predefined neural network models are trained on the client/device data. This…

机器学习 · 计算机科学 2020-10-21 Anubhav Garg , Amit Kumar Saha , Debo Dutta

A fundamental question lies in almost every application of deep neural networks: what is the optimal neural architecture given a specific dataset? Recently, several Neural Architecture Search (NAS) frameworks have been developed that use…

分布式、并行与集群计算 · 计算机科学 2019-02-04 Weiwen Jiang , Xinyi Zhang , Edwin H. -M. Sha , Lei Yang , Qingfeng Zhuge , Yiyu Shi , Jingtong Hu