中文
相关论文

相关论文: Federated Neural Architecture Search with Model-Ag…

200 篇论文

Neural Architecture Search (NAS) has gained significant popularity as an effective tool for designing high performance deep neural networks (DNNs). NAS can be performed via policy gradient, evolutionary algorithms, differentiable…

机器学习 · 计算机科学 2021-04-27 Hanxun Huang , Xingjun Ma , Sarah M. Erfani , James Bailey

Neural Architecture Search (NAS) has emerged as one of the effective methods to design the optimal neural network architecture automatically. Although neural architectures have achieved human-level performances in several tasks, few of them…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Caiyang Yu , Xianggen Liu , Yifan Wang , Yun Liu , Wentao Feng , Deng Xiong , Chenwei Tang , Jiancheng Lv

Most conventional Neural Architecture Search (NAS) approaches are limited in that they only generate architectures without searching for the optimal parameters. While some NAS methods handle this issue by utilizing a supernet trained on a…

机器学习 · 计算机科学 2021-10-29 Wonyong Jeong , Hayeon Lee , Gun Park , Eunyoung Hyung , Jinheon Baek , Sung Ju Hwang

Neural architecture search (NAS) has shown promising results discovering models that are both accurate and fast. For NAS, training a one-shot model has become a popular strategy to rank the relative quality of different architectures (child…

计算机视觉与模式识别 · 计算机科学 2020-07-20 Jiahui Yu , Pengchong Jin , Hanxiao Liu , Gabriel Bender , Pieter-Jan Kindermans , Mingxing Tan , Thomas Huang , Xiaodan Song , Ruoming Pang , Quoc Le

There has been a large literature of neural architecture search, but most existing work made use of heuristic rules that largely constrained the search flexibility. In this paper, we first relax these manually designed constraints and…

计算机视觉与模式识别 · 计算机科学 2020-07-08 Kaifeng Bi , Lingxi Xie , Xin Chen , Longhui Wei , Qi Tian

Neural architecture search (NAS) searches architectures automatically for given tasks, e.g., image classification and language modeling. Improving the search efficiency and effectiveness have attracted increasing attention in recent years.…

机器学习 · 计算机科学 2020-01-03 Yao Shu , Wei Wang , Shaofeng Cai

Neural architecture search (NAS) has emerged as a powerful paradigm that enables researchers to automatically explore vast search spaces and discover efficient neural networks. However, NAS suffers from a critical bottleneck, i.e. the…

神经与进化计算 · 计算机科学 2026-01-05 Yu Xue , Pengcheng Jiang , Chenchen Zhu , MengChu Zhou , Mohamed Wahib , Moncef Gabbouj

Typically, deep learning architectures are handcrafted for their respective learning problem. As an alternative, neural architecture search (NAS) has been proposed where the architecture's structure is learned in an additional optimization…

图像与视频处理 · 电气工程与系统科学 2019-07-29 Nils Gessert , Alexander Schlaefer

In the past years, significant improvements in the field of neural architecture search(NAS) have been made. However, it is still challenging to search for efficient networks due to the gap between the searched constraint and real inference…

机器学习 · 计算机科学 2022-06-16 Mingyang Zhang , Xinyi Yu , Jingtao Rong , Linlin Ou

Recent advancements in artificial intelligence (AI) have positioned deep learning (DL) as a pivotal technology in fields like computer vision, data mining, and natural language processing. A critical factor in DL performance is the…

机器学习 · 计算机科学 2024-06-26 Jiaming Yan

Hardware-Aware Neural Architecture Search (HW-NAS) requires joint optimization of accuracy and latency under device constraints. Traditional supernet-based methods require multiple GPU days per dataset. Large Language Model (LLM)-driven…

机器学习 · 计算机科学 2025-12-08 Hengyi Zhu , Grace Li Zhang , Shaoyi Huang

Neural architecture search (NAS) automates the discovery of neural networks that meet specified criteria, yet its evaluation procedures are often hardcoded, limiting the ability to introduce new metrics. This issue is especially pronounced…

机器学习 · 计算机科学 2026-03-03 Atah Nuh Mih , Jianzhou Wang , Truong Thanh Hung Nguyen , Hung Cao

Different from other deep scalable architecture-based NAS approaches, Broad Neural Architecture Search (BNAS) proposes a broad scalable architecture which consists of convolution and enhancement blocks, dubbed Broad Convolutional Neural…

计算机视觉与模式识别 · 计算机科学 2022-08-02 Zixiang Ding , Yaran Chen , Nannan Li , Dongbin Zhao , C. L. Philip Chen

Recently, deep learning has become a de facto standard in machine learning with convolutional neural networks (CNNs) demonstrating spectacular success on a wide variety of tasks. However, CNNs are typically very demanding computationally at…

计算机视觉与模式识别 · 计算机科学 2019-09-27 Yochai Zur , Chaim Baskin , Evgenii Zheltonozhskii , Brian Chmiel , Itay Evron , Alex M. Bronstein , Avi Mendelson

Neural Architecture Search (NAS) is a powerful tool to automatically design deep neural networks for many tasks, including image classification. Due to the significant computational burden of the search phase, most NAS methods have focused…

Neural architecture search (NAS) has gained significant traction in automating the design of neural networks. To reduce search time, differentiable architecture search (DAS) reframes the traditional paradigm of discrete candidate sampling…

机器学习 · 计算机科学 2025-11-26 Xiaoyun Liu , Divya Saxena , Jiannong Cao , Yuqing Zhao , Penghui Ruan

Deep learning has become in recent years a cornerstone tool fueling key innovations in the industry, such as autonomous driving. To attain good performances, the neural network architecture used for a given application must be chosen with…

计算机视觉与模式识别 · 计算机科学 2021-09-17 Anthony Cazasnoves , Pierre-Antoine Ganaye , Kévin Sanchis , Tugdual Ceillier

Efficient evaluation of a network architecture drawn from a large search space remains a key challenge in Neural Architecture Search (NAS). Vanilla NAS evaluates each architecture by training from scratch, which gives the true performance…

机器学习 · 计算机科学 2024-08-13 Yiyang Zhao , Linnan Wang , Yuandong Tian , Rodrigo Fonseca , Tian Guo

Designing complex architectures has been an essential cogwheel in the revolution deep learning has brought about in the past decade. When solving difficult problems in a datadriven manner, a well-tried approach is to take an architecture…

机器学习 · 计算机科学 2021-10-14 Attila Nagy , Ábel Boros

Neural Architecture Search (NAS) has emerged as a key tool in identifying optimal configurations of deep neural networks tailored to specific tasks. However, training and assessing numerous architectures introduces considerable…

机器学习 · 计算机科学 2024-04-25 Haoming Zhang , Ran Cheng