English
Related papers

Related papers: An Intelligent End-to-End Neural Architecture Sear…

200 papers

To prevent the leakage of private information while enabling automated machine intelligence, there is an emerging trend to integrate federated learning and Neural Architecture Search (NAS). Although promising as it may seem, the coupling of…

Machine Learning · Computer Science 2020-11-09 Chunhui Zhang , Yongyuan Liang , Xiaoming Yuan , Lei Cheng

Graph neural networks (GNNs) have been successfully applied to learning representation on graphs in many relational tasks. Recently, researchers study neural architecture search (NAS) to reduce the dependence of human expertise and explore…

Machine Learning · Computer Science 2021-09-06 Shaofei Cai , Liang Li , Xinzhe Han , Zheng-jun Zha , Qingming Huang

Neural Architecture Search (NAS) aims to optimize deep neural networks' architecture for better accuracy or smaller computational cost and has recently gained more research interests. Despite various successful approaches proposed to solve…

Machine Learning · Computer Science 2020-11-03 Bas van Stein , Hao Wang , Thomas Bäck

When employing an evolutionary algorithm to optimize a neural networks architecture, developers face the added challenge of tuning the evolutionary algorithm's own hyperparameters - population size, mutation rate, cloning rate, and number…

Neural and Evolutionary Computing · Computer Science 2025-03-17 Benjamin David Winter , William J. Teahan

Recently neural architecture search(NAS) has been successfully used in image classification, natural language processing, and automatic speech recognition(ASR) tasks for finding the state-of-the-art(SOTA) architectures than those…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-14 Yukun Liu , Ta Li , Pengyuan Zhang , Yonghong Yan

Differentiable neural architecture search methods became popular in recent years, mainly due to their low search costs and flexibility in designing the search space. However, these methods suffer the difficulty in optimizing network, so…

Computer Vision and Pattern Recognition · Computer Science 2020-03-27 Yuhui Xu , Lingxi Xie , Xiaopeng Zhang , Xin Chen , Bowen Shi , Qi Tian , Hongkai Xiong

The design of handcrafted neural networks requires a lot of time and resources. Recent techniques in Neural Architecture Search (NAS) have proven to be competitive or better than traditional handcrafted design, although they require domain…

Machine Learning · Computer Science 2021-03-17 Cat P. Le , Mohammadreza Soltani , Robert Ravier , Vahid Tarokh

Artificial Intelligence (AI) has driven innovations and created new opportunities across various sectors. However, leveraging domain-specific knowledge often requires automated tools to design and configure models effectively. In the case…

Machine Learning · Computer Science 2024-11-26 Gabriel Cortês , Nuno Lourenço , Penousal Machado

In this work, we propose a novel and scalable solution to address the challenges of developing efficient dense predictions on edge platforms. Our first key insight is that MultiTask Learning (MTL) and hardware-aware Neural Architecture…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Thanh Vu , Yanqi Zhou , Chunfeng Wen , Yueqi Li , Jan-Michael Frahm

This paper proposes a novel differentiable architecture search method by formulating it into a distribution learning problem. We treat the continuously relaxed architecture mixing weight as random variables, modeled by Dirichlet…

Machine Learning · Computer Science 2021-03-17 Xiangning Chen , Ruochen Wang , Minhao Cheng , Xiaocheng Tang , Cho-Jui Hsieh

This work targets designing a principled and unified training-free framework for Neural Architecture Search (NAS), with high performance, low cost, and in-depth interpretation. NAS has been explosively studied to automate the discovery of…

Machine Learning · Computer Science 2023-01-02 Wuyang Chen , Xinyu Gong , Junru Wu , Yunchao Wei , Humphrey Shi , Zhicheng Yan , Yi Yang , Zhangyang Wang

Neural Architecture Search (NAS) yields state-of-the-art neural networks that outperform their best manually-designed counterparts. However, previous NAS methods search for architectures under one set of training hyper-parameters (i.e., a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Xiaoliang Dai , Alvin Wan , Peizhao Zhang , Bichen Wu , Zijian He , Zhen Wei , Kan Chen , Yuandong Tian , Matthew Yu , Peter Vajda , Joseph E. Gonzalez

The influence of deep learning is continuously expanding across different domains, and its new applications are ubiquitous. The question of neural network design thus increases in importance, as traditional empirical approaches are reaching…

Neural and Evolutionary Computing · Computer Science 2021-01-29 Anton Muravev , Jenni Raitoharju , Moncef Gabbouj

Recent advancements in deep learning models for time series forecasting have been significant. These models often leverage fundamental time series properties such as seasonality and non-stationarity, which may suggest an intrinsic link…

Machine Learning · Computer Science 2025-09-09 Fei Wang , Yujie Li , Zezhi Shao , Chengqing Yu , Yisong Fu , Zhulin An , Yongjun Xu , Xueqi Cheng

In the past few years, neural architecture search (NAS) has become an increasingly important tool within the deep learning community. Despite the many recent successes of NAS, however, most existing approaches operate within highly…

Machine Learning · Computer Science 2022-11-14 Charles Jin , Phitchaya Mangpo Phothilimthana , Sudip Roy

Neural network (NN) models are increasingly used in scientific simulations, AI, and other high performance computing (HPC) fields to extract knowledge from datasets. Each dataset requires tailored NN model architecture, but designing…

Machine Learning · Computer Science 2021-08-12 Ariel Keller Rorabaugh , Silvina Caíno-Lores , Michael R. Wyatt , Travis Johnston , Michela Taufer

This paper proposes a neural architecture search (NAS) method for split computing. Split computing is an emerging machine-learning inference technique that addresses the privacy and latency challenges of deploying deep learning in IoT…

Machine Learning · Computer Science 2022-08-31 Shoma Shimizu , Takayuki Nishio , Shota Saito , Yoichi Hirose , Chen Yen-Hsiu , Shinichi Shirakawa

Neural architecture search (NAS) has gained significant traction in automating the design of neural networks. To reduce search time, differentiable architecture search (DAS) reframes the traditional paradigm of discrete candidate sampling…

Machine Learning · Computer Science 2025-11-26 Xiaoyun Liu , Divya Saxena , Jiannong Cao , Yuqing Zhao , Penghui Ruan

The automated machine learning (AutoML) field has become increasingly relevant in recent years. These algorithms can develop models without the need for expert knowledge, facilitating the application of machine learning techniques in the…

Machine Learning · Computer Science 2022-12-14 Andrea Falanti , Eugenio Lomurno , Danilo Ardagna , Matteo Matteucci

Convolutional Neural Networks (CNN) have been regarded as a capable class of models for visual recognition problems. Nevertheless, it is not trivial to develop generic and powerful network architectures, which requires significant efforts…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Zhaofan Qiu , Ting Yao , Yiheng Zhang , Yongdong Zhang , Tao Mei