中文
相关论文

相关论文: Transfer NAS: Knowledge Transfer between Search Sp…

200 篇论文

Finding a well-performing architecture is often tedious for both DL practitioners and researchers, leading to tremendous interest in the automation of this task by means of neural architecture search (NAS). Although the community has made…

机器学习 · 计算机科学 2020-11-04 Marius Lindauer , Frank Hutter

We develop a Neural Architecture Search (NAS) framework for CycleGAN that carries out unpaired image-to-image translation task. Extending previous NAS techniques for Generative Adversarial Networks (GANs) to CycleGAN is not straightforward…

计算机视觉与模式识别 · 计算机科学 2023-11-14 Taegun An , Changhee Joo

Deep Learning has enabled remarkable progress over the last years on a variety of tasks, such as image recognition, speech recognition, and machine translation. One crucial aspect for this progress are novel neural architectures. Currently…

机器学习 · 统计学 2019-04-29 Thomas Elsken , Jan Hendrik Metzen , Frank Hutter

Weight sharing is a fundamental concept in neural architecture search (NAS), enabling gradient-based methods to explore cell-based architectural spaces significantly faster than traditional black-box approaches. In parallel,…

机器学习 · 计算机科学 2025-11-11 Rhea Sanjay Sukthanker , Arjun Krishnakumar , Mahmoud Safari , Frank Hutter

Modern convolutional networks such as ResNet and NASNet have achieved state-of-the-art results in many computer vision applications. These architectures consist of stages, which are sets of layers that operate on representations in the same…

计算机视觉与模式识别 · 计算机科学 2020-10-21 Artur Jordao , Fernando Akio , Maiko Lie , William Robson Schwartz

Differential Neural Architecture Search (NAS) methods represent the network architecture as a repetitive proxy directed acyclic graph (DAG) and optimize the network weights and architecture weights alternatively in a differential manner.…

计算机视觉与模式识别 · 计算机科学 2020-12-01 Benteng Ma , Jing Zhang , Yong Xia , Dacheng Tao

Searching for the architecture cells is a dominant paradigm in NAS. However, little attention has been devoted to the analysis of the cell-based search spaces even though it is highly important for the continual development of NAS. In this…

机器学习 · 统计学 2022-03-18 Xingchen Wan , Binxin Ru , Pedro M. Esperança , Zhenguo Li

This work proposes a novel Graph-based neural ArchiTecture Encoding Scheme, a.k.a. GATES, to improve the predictor-based neural architecture search. Specifically, different from existing graph-based schemes, GATES models the operations as…

机器学习 · 计算机科学 2020-09-02 Xuefei Ning , Yin Zheng , Tianchen Zhao , Yu Wang , Huazhong Yang

Neural Architecture Search (NAS) has recently gained increased attention, as a class of approaches that automatically searches in an input space of network architectures. A crucial part of the NAS pipeline is the encoding of the…

机器学习 · 计算机科学 2021-08-18 Michail Chatzianastasis , George Dasoulas , Georgios Siolas , Michalis Vazirgiannis

Neural architecture search has proven to be a powerful approach to designing and refining neural networks, often boosting their performance and efficiency over manually-designed variations, but comes with computational overhead. While there…

Data-driven methods have made great progress in fault diagnosis, especially deep learning method. Deep learning is suitable for processing big data, and has a strong feature extraction ability to realize end-to-end fault diagnosis systems.…

机器学习 · 计算机科学 2020-02-20 Xudong Li , Yang Hu , Jianhua Zheng , Mingtao Li

Neural Architecture Search (NAS) has shown promising capability in learning text representation. However, existing text-based NAS neither performs a learnable fusion of neural operations to optimize the architecture, nor encodes the latent…

计算与语言 · 计算机科学 2023-07-13 Kuan-Chun Chen , Cheng-Te Li , Kuo-Jung Lee

Neural architecture search (NAS), the study of automating the discovery of optimal deep neural network architectures for tasks in domains such as computer vision and natural language processing, has seen rapid growth in the machine learning…

神经与进化计算 · 计算机科学 2022-03-01 Daniel Cummings , Sharath Nittur Sridhar , Anthony Sarah , Maciej Szankin

Neural architecture search (NAS) methods have been proposed to release human experts from tedious architecture engineering. However, most current methods are constrained in small-scale search due to the issue of computational resources.…

计算机视觉与模式识别 · 计算机科学 2019-03-26 Jiemin Fang , Yukang Chen , Xinbang Zhang , Qian Zhang , Chang Huang , Gaofeng Meng , Wenyu Liu , Xinggang Wang

Neural Architecture Search (NAS) aims to automatically find effective architectures within a predefined search space. However, the search space is often extremely large. As a result, directly searching in such a large search space is…

计算机视觉与模式识别 · 计算机科学 2024-06-07 Yaofo Chen , Yong Guo , Daihai Liao , Fanbing Lv , Hengjie Song , James Tin-Yau Kwok , Mingkui Tan

Early neural network architectures were designed by so-called "grad student descent". Since then, the field of Neural Architecture Search (NAS) has developed with the goal of algorithmically designing architectures tailored for a dataset of…

机器学习 · 计算机科学 2019-11-14 Sam Green , Craig M. Vineyard , Ryan Helinski , Çetin Kaya Koç

Deep neural networks have brought significant advancements to speech emotion recognition (SER). However, the architecture design in SER is mainly based on expert knowledge and empirical (trial-and-error) evaluations, which is time-consuming…

声音 · 计算机科学 2022-04-01 Xixin Wu , Shoukang Hu , Zhiyong Wu , Xunying Liu , Helen Meng

Neural Architecture Search (NAS) is a powerful tool for automating effective image processing DNN designing. The ranking has been advocated to design an efficient performance predictor for NAS. The previous contrastive method solves the…

计算机视觉与模式识别 · 计算机科学 2022-07-13 Bicheng Guo , Tao Chen , Shibo He , Haoyu Liu , Lilin Xu , Peng Ye , Jiming Chen

Neural architecture search (NAS) has fostered various fields of machine learning. Despite its prominent dedications, many have criticized the intrinsic limitations of high computational cost. We aim to ameliorate this by proposing a…

机器学习 · 计算机科学 2021-03-16 Kwanghee Choi , Minyoung Choe , Hyelee Lee

The standard paradigm in Neural Architecture Search (NAS) is to search for a fully deterministic architecture with specific operations and connections. In this work, we instead propose to search for the optimal operation distribution, thus…

机器学习 · 计算机科学 2021-11-09 Xingchen Wan , Binxin Ru , Pedro M. Esperança , Fabio M. Carlucci