中文
相关论文

相关论文: A Data-driven Approach to Neural Architecture Sear…

200 篇论文

Neural Architecture Search (NAS) aims to automatically find effective architectures within a predefined search space. However, the search space is often extremely large. As a result, directly searching in such a large search space is…

计算机视觉与模式识别 · 计算机科学 2024-06-07 Yaofo Chen , Yong Guo , Daihai Liao , Fanbing Lv , Hengjie Song , James Tin-Yau Kwok , Mingkui Tan

Neural Architecture Search (NAS) is a popular tool for automatically generating Neural Network (NN) architectures. In early NAS works, these tools typically optimized NN architectures for a single metric, such as accuracy. However, in the…

神经与进化计算 · 计算机科学 2023-04-05 Emil Njor , Jan Madsen , Xenofon Fafoutis

Neural architecture search (NAS) aims to automate architecture engineering in neural networks. This often requires a high computational overhead to evaluate a number of candidate networks from the set of all possible networks in the search…

计算机视觉与模式识别 · 计算机科学 2022-04-28 Yameng Peng , Andy Song , Vic Ciesielski , Haytham M. Fayek , Xiaojun Chang

Recently, there emerged revived interests of designing automatic programs (e.g., using genetic/evolutionary algorithms) to optimize the structure of Convolutional Neural Networks (CNNs) for a specific task. The challenge in designing such…

神经与进化计算 · 计算机科学 2018-06-05 Zhe Li , Xuehan Xiong , Zhou Ren , Ning Zhang , Xiaoyu Wang , Tianbao Yang

Artificial neural network (NN) architecture design is a nontrivial and time-consuming task that often requires a high level of human expertise. Neural architecture search (NAS) serves to automate the design of NN architectures and has…

神经与进化计算 · 计算机科学 2024-09-10 Reinhard Booysen , Anna Sergeevna Bosman

In this work, we propose a data-driven scheme to initialize the parameters of a deep neural network. This is in contrast to traditional approaches which randomly initialize parameters by sampling from transformed standard distributions.…

神经与进化计算 · 计算机科学 2021-05-24 Debasmit Das , Yash Bhalgat , Fatih Porikli

Neural Architecture Search (NAS) represents a class of methods to generate the optimal neural network architecture and typically iterate over candidate architectures till convergence over some particular metric like validation loss. They…

机器学习 · 计算机科学 2019-10-22 Abhishek Singh , Anubhav Garg , Jinan Zhou , Shiv Ram Dubey , Debo Dutta

This paper proposes a novel cell-based neural architecture search algorithm (NAS), which completely alleviates the expensive costs of data labeling inherited from supervised learning. Our algorithm capitalizes on the effectiveness of…

计算机视觉与模式识别 · 计算机科学 2021-11-09 Nam Nguyen , J. Morris Chang

In the recent past, the success of Neural Architecture Search (NAS) has enabled researchers to broadly explore the design space using learning-based methods. Apart from finding better neural network architectures, the idea of automation has…

机器学习 · 计算机科学 2019-11-04 Qing Lu , Weiwen Jiang , Xiaowei Xu , Yiyu Shi , Jingtong Hu

In this paper, we compare the three most popular algorithms for hyperparameter optimization (Grid Search, Random Search, and Genetic Algorithm) and attempt to use them for neural architecture search (NAS). We use these algorithms for…

机器学习 · 计算机科学 2019-12-13 Petro Liashchynskyi , Pavlo Liashchynskyi

Neural Architecture Search (NAS), a framework which automates the task of designing neural networks, has recently been actively studied in the field of deep learning. However, there are only a few NAS methods suitable for 3D medical image…

图像与视频处理 · 电气工程与系统科学 2019-09-04 Woong Bae , Seungho Lee , Yeha Lee , Beomhee Park , Minki Chung , Kyu-Hwan Jung

Deep learning has proven to be a highly effective problem-solving tool for object detection and image segmentation across various domains such as healthcare and autonomous driving. At the heart of this performance lies neural architecture…

机器学习 · 计算机科学 2021-06-29 Robert Wu , Nayan Saxena , Rohan Jain

Evolutionary computation (EC)-based neural architecture search (NAS) has achieved remarkable performance in the automatic design of neural architectures. However, the high computational cost associated with evaluating searched architectures…

神经与进化计算 · 计算机科学 2025-05-01 Yangyang Li , Guanlong Liu , Ronghua Shang , Licheng Jiao

Cognitive diagnosis plays a vital role in modern intelligent education platforms to reveal students' proficiency in knowledge concepts for subsequent adaptive tasks. However, due to the requirement of high model interpretability, existing…

神经与进化计算 · 计算机科学 2023-07-11 Shangshang Yang , Haiping Ma , Cheng Zhen , Ye Tian , Limiao Zhang , Yaochu Jin , Xingyi Zhang

Present day artificial neural architecture search (NAS) strategies are essentially prediction-error-optimized. That holds true for AI functions in general. From the developmental neuroscience perspective, I present evidence for the central…

神经元与认知 · 定量生物学 2023-10-06 Martin G. Frasch

We propose Stochastic Neural Architecture Search (SNAS), an economical end-to-end solution to Neural Architecture Search (NAS) that trains neural operation parameters and architecture distribution parameters in same round of…

机器学习 · 计算机科学 2020-04-02 Sirui Xie , Hehui Zheng , Chunxiao Liu , Liang Lin

Neural architecture search (NAS) has been an active direction of automatic machine learning (Auto-ML), aiming to explore efficient network structures. The searched architecture is evaluated by training on datasets with fixed data…

机器学习 · 计算机科学 2022-01-31 Xiaoxing Wang , Xiangxiang Chu , Junchi Yan , Xiaokang Yang

Neural architecture search (NAS) is a hot topic in the field of automated machine learning and outperforms humans in designing neural architectures on quite a few machine learning tasks. Motivated by the natural representation form of…

神经与进化计算 · 计算机科学 2021-09-30 Xuan Wu , Linhan Jia , Xiuyi Zhang , Liang Chen , Yanchun Liang , You Zhou , Chunguo Wu

We study the robustness of data-centric methods to find neural network architectures, known as neural architecture search (NAS), against data poisoning. To audit this robustness, we design a poisoning framework that enables the systematic…

机器学习 · 计算机科学 2025-12-11 Zachary Coalson , Huazheng Wang , Qingyun Wu , Sanghyun Hong

In neural architecture search (NAS), the space of neural network architectures is automatically explored to maximize predictive accuracy for a given task. Despite the success of recent approaches, most existing methods cannot be directly…

机器学习 · 统计学 2019-02-15 Francesco Paolo Casale , Jonathan Gordon , Nicolo Fusi