中文
相关论文

相关论文: FBNetV3: Joint Architecture-Recipe Search using Pr…

200 篇论文

In the recent past, the success of Neural Architecture Search (NAS) has enabled researchers to broadly explore the design space using learning-based methods. Apart from finding better neural network architectures, the idea of automation has…

机器学习 · 计算机科学 2019-11-04 Qing Lu , Weiwen Jiang , Xiaowei Xu , Yiyu Shi , Jingtong Hu

Neural architecture search (NAS) has achieved remarkable results in deep neural network design. Differentiable architecture search converts the search over discrete architectures into a hyperparameter optimization problem which can be…

Neural Architecture Search remains a very challenging meta-learning problem. Several recent techniques based on parameter-sharing idea have focused on reducing the NAS running time by leveraging proxy models, leading to architectures with…

机器学习 · 计算机科学 2022-02-08 Minsu Cho , Mohammadreza Soltani , Chinmay Hegde

The recent progress of deep convolutional neural networks has enabled great success in single image super-resolution (SISR) and many other vision tasks. Their performances are also being increased by deepening the networks and developing…

计算机视觉与模式识别 · 计算机科学 2021-04-20 Joon Young Ahn , Nam Ik Cho

In neural architecture search (NAS), the space of neural network architectures is automatically explored to maximize predictive accuracy for a given task. Despite the success of recent approaches, most existing methods cannot be directly…

机器学习 · 统计学 2019-02-15 Francesco Paolo Casale , Jonathan Gordon , Nicolo Fusi

The ability to rank candidate architectures is the key to the performance of neural architecture search~(NAS). One-shot NAS is proposed to reduce the expense but shows inferior performance against conventional NAS and is not adequately…

机器学习 · 计算机科学 2020-04-01 Renqian Luo , Tao Qin , Enhong Chen

Neural Architecture Search (NAS) has emerged as a favoured method for unearthing effective neural architectures. Recent development of large models has intensified the demand for faster search speeds and more accurate search results.…

机器学习 · 计算机科学 2023-11-14 Wang Qinsi , Ke Jinghan , Liang Zhi , Zhang Sihai

The significant computational cost of multiplications hinders the deployment of deep neural networks (DNNs) on edge devices. While multiplication-free models offer enhanced hardware efficiency, they typically sacrifice accuracy. As a…

机器学习 · 计算机科学 2024-09-10 Yang Xu , Huihong Shi , Zhongfeng Wang

Neural Architecture Search (NAS) aims to automate the discovery of high-performing deep neural network architectures. Traditional objective-based NAS approaches typically optimize a certain performance metric (e.g., prediction accuracy),…

神经与进化计算 · 计算机科学 2024-08-01 An Vo , Ngoc Hoang Luong

Neural architecture search has shown its great potential in various areas recently. However, existing methods rely heavily on a black-box controller to search architectures, which suffers from the serious problem of lacking…

机器学习 · 计算机科学 2020-09-29 Xinyue Zheng , Peng Wang , Qigang Wang , Zhongchao Shi

Neural architecture search (NAS) has been proposed to automatically tune deep neural networks, but existing search algorithms, e.g., NASNet, PNAS, usually suffer from expensive computational cost. Network morphism, which keeps the…

机器学习 · 计算机科学 2019-03-27 Haifeng Jin , Qingquan Song , Xia Hu

Neural radiance fields (NeRFs) enable high-quality novel view synthesis, but their high computational complexity limits deployability. While existing neural-based solutions strive for efficiency, they use one-size-fits-all architectures…

计算机视觉与模式识别 · 计算机科学 2023-12-12 Saeejith Nair , Yuhao Chen , Mohammad Javad Shafiee , Alexander Wong

Neural architecture search (NAS) aims to produce the optimal sparse solution from a high-dimensional space spanned by all candidate connections. Current gradient-based NAS methods commonly ignore the constraint of sparsity in the search…

计算机视觉与模式识别 · 计算机科学 2020-10-14 Yibo Yang , Hongyang Li , Shan You , Fei Wang , Chen Qian , Zhouchen Lin

Neural Architecture Search (NAS) is an exciting new field which promises to be as much as a game-changer as Convolutional Neural Networks were in 2012. Despite many great works leading to substantial improvements on a variety of tasks,…

机器学习 · 计算机科学 2020-02-17 Antoine Yang , Pedro M. Esperança , Fabio M. Carlucci

Neural network (NN) models are increasingly used in scientific simulations, AI, and other high performance computing (HPC) fields to extract knowledge from datasets. Each dataset requires tailored NN model architecture, but designing…

Performing analytical tasks over graph data has become increasingly interesting due to the ubiquity and large availability of relational information. However, unlike images or sentences, there is no notion of sequence in networks. Nodes…

神经与进化计算 · 计算机科学 2020-10-28 Matheus Nunes , Gisele L. Pappa

Deep neural networks achieve remarkable performance in many computer vision tasks. Most state-of-the-art (SOTA) semantic segmentation and object detection approaches reuse neural network architectures designed for image classification as…

计算机视觉与模式识别 · 计算机科学 2020-04-10 Jiemin Fang , Yuzhu Sun , Kangjian Peng , Qian Zhang , Yuan Li , Wenyu Liu , Xinggang Wang

This paper showcases the use of a reinforcement learning-based Neural Architecture Search (NAS) agent to design a small neural network to perform active fire detection on multispectral satellite imagery. Specifically, we aim to design a…

机器学习 · 计算机科学 2024-10-14 Amber Cassimon , Phil Reiter , Siegfried Mercelis , Kevin Mets

In few-shot recognition, a classifier that has been trained on one set of classes is required to rapidly adapt and generalize to a disjoint, novel set of classes. To that end, recent studies have shown the efficacy of fine-tuning with…

计算机视觉与模式识别 · 计算机科学 2023-06-16 Panagiotis Eustratiadis , Łukasz Dudziak , Da Li , Timothy Hospedales

The recent progress in neural architecture search (NAS) has allowed scaling the automated design of neural architectures to real-world domains, such as object detection and semantic segmentation. However, one prerequisite for the…

机器学习 · 计算机科学 2021-06-15 Thomas Elsken , Benedikt Staffler , Jan Hendrik Metzen , Frank Hutter